Sep 18 03:06:13.848525 ip-10-0-138-38 systemd[1]: Starting Kubernetes Kubelet... Sep 18 03:06:17.228626 ip-10-0-138-38 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 03:06:17.228626 ip-10-0-138-38 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 18 03:06:17.228626 ip-10-0-138-38 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 03:06:17.228626 ip-10-0-138-38 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 18 03:06:17.228626 ip-10-0-138-38 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 03:06:17.229889 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.228701 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 18 03:06:17.233480 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233459 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 03:06:17.233480 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233478 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 03:06:17.233480 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233481 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 03:06:17.233572 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233486 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 03:06:17.233572 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233489 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 03:06:17.233572 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233492 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 03:06:17.233572 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233495 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 03:06:17.233572 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233498 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 03:06:17.233572 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233501 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 03:06:17.233572 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233504 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 03:06:17.233572 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233508 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 03:06:17.233572 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233511 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 03:06:17.233572 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233513 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 03:06:17.233572 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233516 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 03:06:17.233572 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233518 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 03:06:17.233572 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233521 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 03:06:17.233572 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233524 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 03:06:17.233572 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233526 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 03:06:17.233572 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233529 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 03:06:17.233572 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233532 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 03:06:17.233572 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233534 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 03:06:17.233572 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233537 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 03:06:17.233572 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233540 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 03:06:17.234052 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233546 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 03:06:17.234052 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233548 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 03:06:17.234052 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233551 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 03:06:17.234052 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233553 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 03:06:17.234052 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233558 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 03:06:17.234052 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233562 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 03:06:17.234052 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233565 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 03:06:17.234052 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233567 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 03:06:17.234052 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233570 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 03:06:17.234052 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233573 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 03:06:17.234052 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233575 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 03:06:17.234052 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233578 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 03:06:17.234052 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233581 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 03:06:17.234052 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233584 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 03:06:17.234052 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233587 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 03:06:17.234052 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233589 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 03:06:17.234052 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233592 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 03:06:17.234052 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233595 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 03:06:17.234052 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233598 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 03:06:17.234531 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233600 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 03:06:17.234531 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233603 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 03:06:17.234531 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233607 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 03:06:17.234531 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233611 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 03:06:17.234531 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233614 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 03:06:17.234531 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233616 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 03:06:17.234531 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233619 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 03:06:17.234531 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233622 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 03:06:17.234531 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233625 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 03:06:17.234531 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233628 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 03:06:17.234531 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233631 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 03:06:17.234531 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233633 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 03:06:17.234531 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233636 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 03:06:17.234531 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233646 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 03:06:17.234531 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233652 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 03:06:17.234531 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233655 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 03:06:17.234531 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233659 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 03:06:17.234531 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233661 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 18 03:06:17.234531 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233664 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 03:06:17.234531 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233667 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 03:06:17.235015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233670 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 03:06:17.235015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233672 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 03:06:17.235015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233675 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 03:06:17.235015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233677 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 03:06:17.235015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233681 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 03:06:17.235015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233684 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 03:06:17.235015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233686 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 03:06:17.235015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233689 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 03:06:17.235015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233692 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 03:06:17.235015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233695 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 03:06:17.235015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233697 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 03:06:17.235015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233700 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 03:06:17.235015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233702 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 03:06:17.235015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233705 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 03:06:17.235015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233708 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 03:06:17.235015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233711 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 03:06:17.235015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233713 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 03:06:17.235015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233716 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 03:06:17.235015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233719 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 03:06:17.235015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233722 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 03:06:17.235523 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233725 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 03:06:17.235523 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233728 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 03:06:17.235523 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233730 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 03:06:17.235523 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233733 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 03:06:17.235523 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233736 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 03:06:17.235523 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233740 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 03:06:17.235523 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233742 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 03:06:17.235523 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233745 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 03:06:17.235523 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233748 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 03:06:17.235523 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233751 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 03:06:17.235523 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233753 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 03:06:17.235523 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233756 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 03:06:17.235523 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233759 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 03:06:17.235523 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233761 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 03:06:17.235523 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233764 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 03:06:17.235523 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233767 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 03:06:17.235523 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.233771 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 03:06:17.235523 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234504 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 03:06:17.235523 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234511 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 03:06:17.236027 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234514 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 03:06:17.236027 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234518 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 03:06:17.236027 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234521 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 03:06:17.236027 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234524 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 03:06:17.236027 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234527 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 03:06:17.236027 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234530 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 03:06:17.236027 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234533 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 03:06:17.236027 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234536 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 03:06:17.236027 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234538 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 03:06:17.236027 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234541 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 03:06:17.236027 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234544 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 03:06:17.236027 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234548 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 03:06:17.236027 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234550 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 03:06:17.236027 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234554 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 03:06:17.236027 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234557 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 03:06:17.236027 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234560 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 03:06:17.236027 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234564 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 03:06:17.236027 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234568 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 03:06:17.236027 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234570 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 03:06:17.236520 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234573 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 03:06:17.236520 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234576 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 03:06:17.236520 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234578 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 03:06:17.236520 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234581 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 18 03:06:17.236520 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234583 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 03:06:17.236520 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234586 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 03:06:17.236520 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234589 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 03:06:17.236520 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234591 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 03:06:17.236520 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234594 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 03:06:17.236520 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234597 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 03:06:17.236520 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234599 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 03:06:17.236520 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234602 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 03:06:17.236520 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234605 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 03:06:17.236520 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234608 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 03:06:17.236520 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234610 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 03:06:17.236520 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234613 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 03:06:17.236520 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234617 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 03:06:17.236520 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234620 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 03:06:17.236520 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234624 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 03:06:17.236520 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234627 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 03:06:17.237015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234630 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 03:06:17.237015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234633 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 03:06:17.237015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234636 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 03:06:17.237015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234639 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 03:06:17.237015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234643 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 03:06:17.237015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234646 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 03:06:17.237015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234648 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 03:06:17.237015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234653 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 03:06:17.237015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234655 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 03:06:17.237015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234658 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 03:06:17.237015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234661 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 03:06:17.237015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234664 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 03:06:17.237015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234667 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 03:06:17.237015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234669 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 03:06:17.237015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234672 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 03:06:17.237015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234675 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 03:06:17.237015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234677 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 03:06:17.237015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234680 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 03:06:17.237015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234683 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 03:06:17.237015 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234685 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 03:06:17.237529 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234688 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 03:06:17.237529 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234691 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 03:06:17.237529 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234693 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 03:06:17.237529 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234696 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 03:06:17.237529 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234699 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 03:06:17.237529 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234702 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 03:06:17.237529 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234704 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 03:06:17.237529 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234707 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 03:06:17.237529 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234710 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 03:06:17.237529 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234712 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 03:06:17.237529 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234715 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 03:06:17.237529 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234718 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 03:06:17.237529 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234721 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 03:06:17.237529 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234724 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 03:06:17.237529 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234727 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 03:06:17.237529 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234729 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 03:06:17.237529 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234732 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 03:06:17.237529 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234735 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 03:06:17.237529 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234738 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 03:06:17.237529 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234741 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 03:06:17.238024 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234744 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 03:06:17.238024 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234747 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 03:06:17.238024 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234750 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 03:06:17.238024 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234752 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 03:06:17.238024 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234755 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 03:06:17.238024 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234758 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 03:06:17.238024 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234760 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 03:06:17.238024 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234763 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 03:06:17.238024 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234765 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 03:06:17.238024 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234768 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 03:06:17.238024 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234772 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 03:06:17.238024 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234776 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 03:06:17.238024 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234779 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 03:06:17.238024 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234782 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 03:06:17.238024 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234785 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 03:06:17.238024 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234787 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 03:06:17.238024 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234790 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 03:06:17.238024 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.234793 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 03:06:17.238024 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235209 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 03:06:17.238513 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235216 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 03:06:17.238513 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235220 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 03:06:17.238513 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235223 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 03:06:17.238513 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235226 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 03:06:17.238513 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235229 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 03:06:17.238513 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235232 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 03:06:17.238513 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235235 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 03:06:17.238513 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235238 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 03:06:17.238513 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235240 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 03:06:17.238513 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235244 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 03:06:17.238513 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235246 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 03:06:17.238513 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235249 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 03:06:17.238513 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235252 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 03:06:17.238513 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235256 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 03:06:17.238513 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235258 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 03:06:17.238513 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235261 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 03:06:17.238513 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235264 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 03:06:17.238513 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235266 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 03:06:17.238513 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235269 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 03:06:17.238513 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235272 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 03:06:17.239005 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235274 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 03:06:17.239005 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235277 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 03:06:17.239005 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235280 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 03:06:17.239005 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235282 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 03:06:17.239005 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235285 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 03:06:17.239005 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235288 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 03:06:17.239005 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235290 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 03:06:17.239005 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235293 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 03:06:17.239005 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235296 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 03:06:17.239005 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235300 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 03:06:17.239005 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235302 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 03:06:17.239005 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235305 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 03:06:17.239005 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235308 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 03:06:17.239005 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235310 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 03:06:17.239005 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235313 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 03:06:17.239005 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235315 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 03:06:17.239005 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235318 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 03:06:17.239005 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235320 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 03:06:17.239005 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235323 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 03:06:17.239005 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235325 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 03:06:17.239506 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235328 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 03:06:17.239506 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235331 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 03:06:17.239506 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235333 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 03:06:17.239506 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235336 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 03:06:17.239506 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235339 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 03:06:17.239506 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235341 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 03:06:17.239506 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235347 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 03:06:17.239506 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235350 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 03:06:17.239506 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235354 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 03:06:17.239506 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235358 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 03:06:17.239506 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235361 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 03:06:17.239506 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235364 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 03:06:17.239506 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235367 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 03:06:17.239506 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235370 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 03:06:17.239506 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235374 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 03:06:17.239506 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235376 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 03:06:17.239506 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235381 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 03:06:17.239506 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235384 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 03:06:17.239506 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235388 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 03:06:17.239973 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235390 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 03:06:17.239973 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235393 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 03:06:17.239973 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235396 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 03:06:17.239973 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235398 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 03:06:17.239973 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235401 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 03:06:17.239973 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235404 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 03:06:17.239973 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235406 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 03:06:17.239973 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235408 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 03:06:17.239973 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235411 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 03:06:17.239973 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235413 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 03:06:17.239973 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235416 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 03:06:17.239973 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235418 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 03:06:17.239973 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235421 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 03:06:17.239973 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235423 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 03:06:17.239973 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235429 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 03:06:17.239973 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235431 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 03:06:17.239973 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235434 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 03:06:17.239973 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235436 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 03:06:17.239973 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235439 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 18 03:06:17.239973 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235442 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 03:06:17.240516 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235445 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 03:06:17.240516 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235448 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 03:06:17.240516 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235451 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 03:06:17.240516 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235453 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 03:06:17.240516 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235456 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 03:06:17.240516 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235458 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 03:06:17.240516 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235460 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 03:06:17.240516 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235463 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 03:06:17.240516 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235465 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 03:06:17.240516 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235468 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 03:06:17.240516 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235470 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 03:06:17.240516 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235473 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 03:06:17.240516 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235475 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 03:06:17.240516 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235478 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 03:06:17.240516 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235480 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 03:06:17.240516 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235483 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 03:06:17.240516 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235485 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 03:06:17.240516 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235488 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 03:06:17.240516 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.235490 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 03:06:17.240516 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235564 2578 flags.go:64] FLAG: --address="0.0.0.0" Sep 18 03:06:17.240997 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235604 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 18 03:06:17.240997 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235612 2578 flags.go:64] FLAG: --anonymous-auth="true" Sep 18 03:06:17.240997 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235617 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 18 03:06:17.240997 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235621 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 18 03:06:17.240997 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235624 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 18 03:06:17.240997 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235629 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 18 03:06:17.240997 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235635 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 18 03:06:17.240997 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235638 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 18 03:06:17.240997 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235642 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 18 03:06:17.240997 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235646 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 18 03:06:17.240997 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235650 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 18 03:06:17.240997 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235653 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 18 03:06:17.240997 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235656 2578 flags.go:64] FLAG: --cgroup-root="" Sep 18 03:06:17.240997 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235660 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 18 03:06:17.240997 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235663 2578 flags.go:64] FLAG: --client-ca-file="" Sep 18 03:06:17.240997 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235666 2578 flags.go:64] FLAG: --cloud-provider="external" Sep 18 03:06:17.240997 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235669 2578 flags.go:64] FLAG: --cluster-dns="[]" Sep 18 03:06:17.240997 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235673 2578 flags.go:64] FLAG: --cluster-domain="" Sep 18 03:06:17.240997 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235676 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 18 03:06:17.240997 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235679 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 18 03:06:17.240997 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235683 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 18 03:06:17.240997 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235686 2578 flags.go:64] FLAG: --container-log-max-files="5" Sep 18 03:06:17.240997 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235690 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 18 03:06:17.240997 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235693 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 18 03:06:17.241656 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235696 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 18 03:06:17.241656 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235700 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 18 03:06:17.241656 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235703 2578 flags.go:64] FLAG: --contention-profiling="false" Sep 18 03:06:17.241656 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235706 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 18 03:06:17.241656 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235709 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 18 03:06:17.241656 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235712 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 18 03:06:17.241656 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235715 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 18 03:06:17.241656 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235720 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 18 03:06:17.241656 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235723 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 18 03:06:17.241656 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235726 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 18 03:06:17.241656 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235729 2578 flags.go:64] FLAG: --enable-load-reader="false" Sep 18 03:06:17.241656 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235732 2578 flags.go:64] FLAG: --enable-server="true" Sep 18 03:06:17.241656 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235734 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 18 03:06:17.241656 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235740 2578 flags.go:64] FLAG: --event-burst="100" Sep 18 03:06:17.241656 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235744 2578 flags.go:64] FLAG: --event-qps="50" Sep 18 03:06:17.241656 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235747 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 18 03:06:17.241656 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235750 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 18 03:06:17.241656 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235755 2578 flags.go:64] FLAG: --eviction-hard="" Sep 18 03:06:17.241656 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235759 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 18 03:06:17.241656 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235762 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 18 03:06:17.241656 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235765 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 18 03:06:17.241656 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235769 2578 flags.go:64] FLAG: --eviction-soft="" Sep 18 03:06:17.241656 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235772 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 18 03:06:17.241656 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235775 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 18 03:06:17.241656 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235779 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 18 03:06:17.242301 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235782 2578 flags.go:64] FLAG: --experimental-mounter-path="" Sep 18 03:06:17.242301 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235785 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 18 03:06:17.242301 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235788 2578 flags.go:64] FLAG: --fail-swap-on="true" Sep 18 03:06:17.242301 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235791 2578 flags.go:64] FLAG: --feature-gates="" Sep 18 03:06:17.242301 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235795 2578 flags.go:64] FLAG: --file-check-frequency="20s" Sep 18 03:06:17.242301 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235798 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 18 03:06:17.242301 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235801 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 18 03:06:17.242301 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235804 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 18 03:06:17.242301 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235808 2578 flags.go:64] FLAG: --healthz-port="10248" Sep 18 03:06:17.242301 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235811 2578 flags.go:64] FLAG: --help="false" Sep 18 03:06:17.242301 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235814 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-138-38.ec2.internal" Sep 18 03:06:17.242301 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235817 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 18 03:06:17.242301 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235820 2578 flags.go:64] FLAG: --http-check-frequency="20s" Sep 18 03:06:17.242301 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235823 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 18 03:06:17.242301 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235827 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 18 03:06:17.242301 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235830 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 18 03:06:17.242301 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235834 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 18 03:06:17.242301 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235837 2578 flags.go:64] FLAG: --image-service-endpoint="" Sep 18 03:06:17.242301 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235840 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 18 03:06:17.242301 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235842 2578 flags.go:64] FLAG: --kube-api-burst="100" Sep 18 03:06:17.242301 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235845 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 18 03:06:17.242301 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235852 2578 flags.go:64] FLAG: --kube-api-qps="50" Sep 18 03:06:17.242301 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235855 2578 flags.go:64] FLAG: --kube-reserved="" Sep 18 03:06:17.242301 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235858 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 18 03:06:17.242897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235863 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 18 03:06:17.242897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235866 2578 flags.go:64] FLAG: --kubelet-cgroups="" Sep 18 03:06:17.242897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235869 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 18 03:06:17.242897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235872 2578 flags.go:64] FLAG: --lock-file="" Sep 18 03:06:17.242897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235875 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 18 03:06:17.242897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235878 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 18 03:06:17.242897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235882 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 18 03:06:17.242897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235888 2578 flags.go:64] FLAG: --log-json-split-stream="false" Sep 18 03:06:17.242897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235891 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 18 03:06:17.242897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235894 2578 flags.go:64] FLAG: --log-text-split-stream="false" Sep 18 03:06:17.242897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235897 2578 flags.go:64] FLAG: --logging-format="text" Sep 18 03:06:17.242897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235900 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 18 03:06:17.242897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235904 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 18 03:06:17.242897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235906 2578 flags.go:64] FLAG: --manifest-url="" Sep 18 03:06:17.242897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235909 2578 flags.go:64] FLAG: --manifest-url-header="" Sep 18 03:06:17.242897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235914 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 18 03:06:17.242897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235917 2578 flags.go:64] FLAG: --max-open-files="1000000" Sep 18 03:06:17.242897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235922 2578 flags.go:64] FLAG: --max-pods="110" Sep 18 03:06:17.242897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235925 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 18 03:06:17.242897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235928 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 18 03:06:17.242897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235931 2578 flags.go:64] FLAG: --memory-manager-policy="None" Sep 18 03:06:17.242897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235934 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 18 03:06:17.242897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235937 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 18 03:06:17.242897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235940 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 18 03:06:17.242897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235943 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 18 03:06:17.243537 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235951 2578 flags.go:64] FLAG: --node-status-max-images="50" Sep 18 03:06:17.243537 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235954 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 18 03:06:17.243537 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235957 2578 flags.go:64] FLAG: --oom-score-adj="-999" Sep 18 03:06:17.243537 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235960 2578 flags.go:64] FLAG: --pod-cidr="" Sep 18 03:06:17.243537 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235966 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 18 03:06:17.243537 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235972 2578 flags.go:64] FLAG: --pod-manifest-path="" Sep 18 03:06:17.243537 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235975 2578 flags.go:64] FLAG: --pod-max-pids="-1" Sep 18 03:06:17.243537 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235978 2578 flags.go:64] FLAG: --pods-per-core="0" Sep 18 03:06:17.243537 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235985 2578 flags.go:64] FLAG: --port="10250" Sep 18 03:06:17.243537 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235988 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 18 03:06:17.243537 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235991 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04b756266dec8cf8c" Sep 18 03:06:17.243537 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235995 2578 flags.go:64] FLAG: --qos-reserved="" Sep 18 03:06:17.243537 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.235997 2578 flags.go:64] FLAG: --read-only-port="10255" Sep 18 03:06:17.243537 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236001 2578 flags.go:64] FLAG: --register-node="true" Sep 18 03:06:17.243537 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236008 2578 flags.go:64] FLAG: --register-with-taints="" Sep 18 03:06:17.243537 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236013 2578 flags.go:64] FLAG: --registry-burst="10" Sep 18 03:06:17.243537 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236016 2578 flags.go:64] FLAG: --registry-qps="5" Sep 18 03:06:17.243537 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236019 2578 flags.go:64] FLAG: --reserved-cpus="" Sep 18 03:06:17.243537 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236022 2578 flags.go:64] FLAG: --reserved-memory="" Sep 18 03:06:17.243537 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236026 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 18 03:06:17.243537 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236029 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 18 03:06:17.243537 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236033 2578 flags.go:64] FLAG: --rotate-certificates="false" Sep 18 03:06:17.243537 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236036 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 18 03:06:17.243537 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236039 2578 flags.go:64] FLAG: --runonce="false" Sep 18 03:06:17.243537 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236042 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 18 03:06:17.244218 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236045 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 18 03:06:17.244218 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236048 2578 flags.go:64] FLAG: --seccomp-default="false" Sep 18 03:06:17.244218 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236051 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 18 03:06:17.244218 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236054 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 18 03:06:17.244218 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236057 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 18 03:06:17.244218 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236060 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 18 03:06:17.244218 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236063 2578 flags.go:64] FLAG: --storage-driver-password="root" Sep 18 03:06:17.244218 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236066 2578 flags.go:64] FLAG: --storage-driver-secure="false" Sep 18 03:06:17.244218 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236069 2578 flags.go:64] FLAG: --storage-driver-table="stats" Sep 18 03:06:17.244218 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236072 2578 flags.go:64] FLAG: --storage-driver-user="root" Sep 18 03:06:17.244218 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236075 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 18 03:06:17.244218 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236080 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 18 03:06:17.244218 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236083 2578 flags.go:64] FLAG: --system-cgroups="" Sep 18 03:06:17.244218 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236086 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 18 03:06:17.244218 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236091 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 18 03:06:17.244218 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236095 2578 flags.go:64] FLAG: --tls-cert-file="" Sep 18 03:06:17.244218 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236098 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 18 03:06:17.244218 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236103 2578 flags.go:64] FLAG: --tls-min-version="" Sep 18 03:06:17.244218 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236106 2578 flags.go:64] FLAG: --tls-private-key-file="" Sep 18 03:06:17.244218 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236109 2578 flags.go:64] FLAG: --topology-manager-policy="none" Sep 18 03:06:17.244218 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236112 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 18 03:06:17.244218 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236115 2578 flags.go:64] FLAG: --topology-manager-scope="container" Sep 18 03:06:17.244218 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236119 2578 flags.go:64] FLAG: --v="2" Sep 18 03:06:17.244218 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236123 2578 flags.go:64] FLAG: --version="false" Sep 18 03:06:17.244218 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236128 2578 flags.go:64] FLAG: --vmodule="" Sep 18 03:06:17.244837 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236131 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 18 03:06:17.244837 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.236135 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 18 03:06:17.244837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236273 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 03:06:17.244837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236277 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 03:06:17.244837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236281 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 03:06:17.244837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236284 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 03:06:17.244837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236288 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 03:06:17.244837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236291 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 03:06:17.244837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236294 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 03:06:17.244837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236297 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 03:06:17.244837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236301 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 03:06:17.244837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236304 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 03:06:17.244837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236306 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 03:06:17.244837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236309 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 03:06:17.244837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236312 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 03:06:17.244837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236314 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 03:06:17.244837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236317 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 03:06:17.244837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236320 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 03:06:17.244837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236324 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 03:06:17.244837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236327 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 03:06:17.245349 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236329 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 03:06:17.245349 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236332 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 03:06:17.245349 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236336 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 03:06:17.245349 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236339 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 03:06:17.245349 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236341 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 03:06:17.245349 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236344 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 03:06:17.245349 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236347 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 03:06:17.245349 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236350 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 03:06:17.245349 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236352 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 03:06:17.245349 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236355 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 03:06:17.245349 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236359 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 03:06:17.245349 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236362 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 03:06:17.245349 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236364 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 03:06:17.245349 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236367 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 03:06:17.245349 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236370 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 03:06:17.245349 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236372 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 03:06:17.245349 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236375 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 03:06:17.245349 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236379 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 03:06:17.245349 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236383 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 03:06:17.245837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236386 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 03:06:17.245837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236388 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 03:06:17.245837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236391 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 03:06:17.245837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236394 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 03:06:17.245837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236397 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 03:06:17.245837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236400 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 03:06:17.245837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236402 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 03:06:17.245837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236405 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 03:06:17.245837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236408 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 03:06:17.245837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236411 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 03:06:17.245837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236413 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 03:06:17.245837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236418 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 03:06:17.245837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236420 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 03:06:17.245837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236423 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 03:06:17.245837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236426 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 03:06:17.245837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236430 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 03:06:17.245837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236433 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 03:06:17.245837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236435 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 03:06:17.245837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236438 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 03:06:17.245837 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236441 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 03:06:17.246334 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236444 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 03:06:17.246334 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236446 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 03:06:17.246334 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236449 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 03:06:17.246334 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236452 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 03:06:17.246334 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236456 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 03:06:17.246334 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236458 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 03:06:17.246334 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236461 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 18 03:06:17.246334 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236464 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 03:06:17.246334 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236466 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 03:06:17.246334 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236470 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 03:06:17.246334 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236473 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 03:06:17.246334 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236477 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 03:06:17.246334 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236480 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 03:06:17.246334 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236483 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 03:06:17.246334 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236486 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 03:06:17.246334 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236488 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 03:06:17.246334 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236491 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 03:06:17.246334 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236493 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 03:06:17.246334 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236496 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 03:06:17.246798 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236498 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 03:06:17.246798 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236501 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 03:06:17.246798 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236504 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 03:06:17.246798 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236507 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 03:06:17.246798 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236511 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 03:06:17.246798 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236513 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 03:06:17.246798 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236516 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 03:06:17.246798 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236519 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 03:06:17.246798 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236523 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 03:06:17.246798 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236526 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 03:06:17.246798 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236530 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 03:06:17.246798 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236534 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 03:06:17.246798 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236537 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 03:06:17.246798 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236540 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 03:06:17.246798 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236543 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 03:06:17.246798 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236546 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 03:06:17.246798 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236549 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 03:06:17.246798 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236552 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 03:06:17.246798 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236556 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 03:06:17.246798 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236559 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 03:06:17.247310 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236562 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 03:06:17.247310 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236564 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 03:06:17.247310 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.236567 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 03:06:17.247310 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.237076 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 03:06:17.247310 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.244520 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 18 03:06:17.247310 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.244537 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 18 03:06:17.247310 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.244560 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 18 03:06:17.247310 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.244566 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 18 03:06:17.247310 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244627 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 03:06:17.247310 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244632 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 03:06:17.247310 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244636 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 03:06:17.247310 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244639 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 03:06:17.247310 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244642 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 03:06:17.247310 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244645 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 03:06:17.247674 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244648 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 03:06:17.247674 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244651 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 03:06:17.247674 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244654 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 03:06:17.247674 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244658 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 03:06:17.247674 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244662 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 03:06:17.247674 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244665 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 03:06:17.247674 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244668 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 03:06:17.247674 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244671 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 03:06:17.247674 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244674 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 03:06:17.247674 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244677 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 03:06:17.247674 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244680 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 03:06:17.247674 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244683 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 03:06:17.247674 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244685 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 03:06:17.247674 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244688 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 03:06:17.247674 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244691 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 03:06:17.247674 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244694 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 03:06:17.247674 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244699 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 03:06:17.247674 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244703 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 03:06:17.247674 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244706 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 03:06:17.248131 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244710 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 03:06:17.248131 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244712 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 03:06:17.248131 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244715 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 03:06:17.248131 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244718 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 03:06:17.248131 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244721 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 03:06:17.248131 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244724 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 03:06:17.248131 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244727 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 03:06:17.248131 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244729 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 03:06:17.248131 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244732 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 03:06:17.248131 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244735 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 03:06:17.248131 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244737 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 03:06:17.248131 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244740 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 03:06:17.248131 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244743 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 03:06:17.248131 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244745 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 03:06:17.248131 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244748 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 03:06:17.248131 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244751 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 03:06:17.248131 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244754 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 03:06:17.248131 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244756 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 03:06:17.248131 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244759 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 03:06:17.248131 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244761 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 03:06:17.248634 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244764 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 03:06:17.248634 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244767 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 03:06:17.248634 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244770 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 03:06:17.248634 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244773 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 03:06:17.248634 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244775 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 03:06:17.248634 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244778 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 03:06:17.248634 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244781 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 03:06:17.248634 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244783 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 03:06:17.248634 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244786 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 03:06:17.248634 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244789 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 03:06:17.248634 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244793 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 03:06:17.248634 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244796 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 03:06:17.248634 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244798 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 03:06:17.248634 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244801 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 03:06:17.248634 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244803 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 03:06:17.248634 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244806 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 03:06:17.248634 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244810 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 03:06:17.248634 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244812 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 03:06:17.248634 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244815 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 03:06:17.248634 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244818 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 03:06:17.249124 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244820 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 03:06:17.249124 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244823 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 03:06:17.249124 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244826 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 03:06:17.249124 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244828 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 03:06:17.249124 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244831 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 03:06:17.249124 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244834 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 03:06:17.249124 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244837 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 03:06:17.249124 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244839 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 03:06:17.249124 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244842 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 03:06:17.249124 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244845 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 03:06:17.249124 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244847 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 03:06:17.249124 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244851 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 03:06:17.249124 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244854 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 03:06:17.249124 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244856 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 03:06:17.249124 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244859 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 03:06:17.249124 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244862 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 03:06:17.249124 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244864 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 03:06:17.249124 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244867 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 03:06:17.249124 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244870 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 03:06:17.249725 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244874 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 03:06:17.249725 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244877 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 03:06:17.249725 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244880 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 03:06:17.249725 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244883 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 18 03:06:17.249725 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244886 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 03:06:17.249725 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244889 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 03:06:17.249725 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244892 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 03:06:17.249725 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244895 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 03:06:17.249725 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244898 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 03:06:17.249725 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244901 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 03:06:17.249725 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244905 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 03:06:17.249725 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244908 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 03:06:17.249725 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244911 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 03:06:17.249725 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244913 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 03:06:17.249725 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.244916 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 03:06:17.250092 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.244921 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 03:06:17.250092 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245033 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 03:06:17.250092 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245037 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 03:06:17.250092 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245042 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 03:06:17.250092 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245046 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 03:06:17.250092 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245049 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 03:06:17.250092 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245052 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 03:06:17.250092 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245054 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 03:06:17.250092 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245057 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 03:06:17.250092 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245060 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 03:06:17.250092 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245063 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 03:06:17.250092 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245065 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 03:06:17.250092 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245068 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 03:06:17.250092 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245071 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 03:06:17.250446 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245073 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 03:06:17.250446 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245076 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 03:06:17.250446 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245078 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 03:06:17.250446 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245081 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 03:06:17.250446 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245083 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 03:06:17.250446 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245086 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 03:06:17.250446 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245089 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 03:06:17.250446 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245092 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 03:06:17.250446 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245095 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 03:06:17.250446 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245097 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 03:06:17.250446 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245100 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 03:06:17.250446 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245103 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 03:06:17.250446 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245107 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 03:06:17.250446 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245110 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 03:06:17.250446 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245113 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 03:06:17.250446 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245116 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 03:06:17.250446 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245118 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 03:06:17.250446 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245121 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 03:06:17.250446 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245123 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 03:06:17.250446 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245126 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 03:06:17.250939 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245128 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 03:06:17.250939 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245131 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 03:06:17.250939 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245134 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 03:06:17.250939 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245136 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 03:06:17.250939 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245139 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 03:06:17.250939 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245142 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 03:06:17.250939 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245144 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 03:06:17.250939 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245147 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 03:06:17.250939 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245149 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 03:06:17.250939 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245152 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 03:06:17.250939 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245154 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 03:06:17.250939 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245157 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 03:06:17.250939 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245160 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 03:06:17.250939 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245162 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 03:06:17.250939 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245165 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 03:06:17.250939 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245167 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 03:06:17.250939 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245170 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 03:06:17.250939 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245173 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 03:06:17.250939 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245176 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 03:06:17.250939 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245193 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 03:06:17.251692 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245196 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 03:06:17.251692 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245200 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 03:06:17.251692 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245203 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 03:06:17.251692 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245206 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 03:06:17.251692 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245209 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 03:06:17.251692 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245212 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 03:06:17.251692 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245215 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 03:06:17.251692 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245218 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 03:06:17.251692 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245220 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 03:06:17.251692 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245223 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 03:06:17.251692 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245226 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 03:06:17.251692 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245228 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 03:06:17.251692 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245231 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 03:06:17.251692 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245234 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 03:06:17.251692 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245236 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 03:06:17.251692 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245239 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 03:06:17.251692 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245242 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 03:06:17.251692 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245244 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 03:06:17.251692 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245247 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 03:06:17.251692 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245250 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 03:06:17.252273 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245253 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 03:06:17.252273 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245255 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 03:06:17.252273 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245259 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 03:06:17.252273 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245263 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 03:06:17.252273 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245266 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 03:06:17.252273 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245269 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 03:06:17.252273 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245272 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 03:06:17.252273 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245274 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 03:06:17.252273 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245277 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 03:06:17.252273 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245280 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 03:06:17.252273 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245283 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 03:06:17.252273 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245285 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 03:06:17.252273 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245288 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 03:06:17.252273 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245291 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 03:06:17.252273 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245294 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 03:06:17.252273 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245297 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 03:06:17.252273 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245300 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 03:06:17.252273 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245302 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 03:06:17.252273 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245305 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 18 03:06:17.252273 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245308 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 03:06:17.253030 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245311 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 03:06:17.253030 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245313 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 03:06:17.253030 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245316 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 03:06:17.253030 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245318 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 03:06:17.253030 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245321 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 03:06:17.253030 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:17.245324 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 03:06:17.253030 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.245329 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 03:06:17.253030 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.245454 2578 server.go:962] "Client rotation is on, will bootstrap in background" Sep 18 03:06:17.253030 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.247809 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 18 03:06:17.253030 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.248636 2578 server.go:1019] "Starting client certificate rotation" Sep 18 03:06:17.253030 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.248739 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 03:06:17.253030 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.248781 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 03:06:17.253030 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.251080 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 03:06:17.254236 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.254207 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 03:06:17.257898 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.257880 2578 log.go:25] "Validated CRI v1 runtime API" Sep 18 03:06:17.260888 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.260868 2578 log.go:25] "Validated CRI v1 image API" Sep 18 03:06:17.261636 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.261622 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 18 03:06:17.264020 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.263996 2578 fs.go:135] Filesystem UUIDs: map[13b4f98c-f7cf-4c65-92dc-2115c1eb8241:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 de79b069-90b7-4c8d-95dc-05d41841410b:/dev/nvme0n1p4] Sep 18 03:06:17.264103 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.264019 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 18 03:06:17.268425 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.268244 2578 manager.go:216] Machine: {Timestamp:2026-09-18 03:06:17.267709453 +0000 UTC m=+1.863662564 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3121796 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d181b7a797b6abc3574541cebf823 SystemUUID:ec2d181b-7a79-7b6a-bc35-74541cebf823 BootID:d295c245-05fd-4c96-ba89-2bba2e0f10c7 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:cb:b2:88:15 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:cb:b2:88:15 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7e:99:0e:ab:f5:42 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 18 03:06:17.268425 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.268361 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 18 03:06:17.268541 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.268450 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 18 03:06:17.270069 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.270035 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 18 03:06:17.270238 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.270072 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-38.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 18 03:06:17.271327 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.271313 2578 topology_manager.go:138] "Creating topology manager with none policy" Sep 18 03:06:17.271375 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.271329 2578 container_manager_linux.go:309] "Creating device plugin manager" Sep 18 03:06:17.271375 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.271337 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 03:06:17.271375 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.271349 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 03:06:17.271453 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.271431 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 18 03:06:17.275937 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.275916 2578 state_mem.go:36] "Initialized new in-memory state store" Sep 18 03:06:17.276082 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.276071 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 18 03:06:17.276131 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.276109 2578 kubelet.go:486] "Attempting to sync node with API server" Sep 18 03:06:17.276131 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.276126 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 18 03:06:17.276244 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.276151 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 18 03:06:17.276244 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.276166 2578 kubelet.go:398] "Adding apiserver pod source" Sep 18 03:06:17.276244 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.276177 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 18 03:06:17.276905 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.276647 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 03:06:17.276905 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.276666 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 03:06:17.286356 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.286329 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 18 03:06:17.288674 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.288657 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 18 03:06:17.288905 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.288806 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 18 03:06:17.291010 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.290980 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 18 03:06:17.291010 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.291002 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 18 03:06:17.291010 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.291009 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 18 03:06:17.291010 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.291016 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 18 03:06:17.291228 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.291027 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 18 03:06:17.291228 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.291043 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 18 03:06:17.291228 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.291065 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 18 03:06:17.291228 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.291090 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 18 03:06:17.291228 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.291100 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 18 03:06:17.291228 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.291106 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 18 03:06:17.291228 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.291116 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 18 03:06:17.291228 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.291121 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 18 03:06:17.291228 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.291151 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 18 03:06:17.291228 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.291157 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 18 03:06:17.295591 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.295566 2578 server.go:1268] "Started kubelet" Sep 18 03:06:17.295724 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.295688 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 18 03:06:17.295850 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.295674 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 18 03:06:17.295924 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.295896 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 18 03:06:17.296681 ip-10-0-138-38 systemd[1]: Started Kubernetes Kubelet. Sep 18 03:06:17.297223 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.297016 2578 server.go:310] "Adding debug handlers to kubelet server" Sep 18 03:06:17.297223 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.297153 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 18 03:06:17.298053 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:17.298033 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-38.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 18 03:06:17.298153 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:17.298128 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 18 03:06:17.298153 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.298141 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-38.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 18 03:06:17.301013 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:17.300994 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 18 03:06:17.301319 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.301303 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 03:06:17.303325 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.303304 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 18 03:06:17.303325 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.303313 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 18 03:06:17.303466 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:17.303434 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-38.ec2.internal\" not found" Sep 18 03:06:17.304017 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.303996 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 18 03:06:17.304017 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.304016 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 18 03:06:17.304194 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.304101 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 18 03:06:17.304194 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.304137 2578 reconstruct.go:97] "Volume reconstruction finished" Sep 18 03:06:17.304194 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.304146 2578 reconciler.go:29] "Reconciler: start to sync state" Sep 18 03:06:17.304654 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.304638 2578 factory.go:153] Registering CRI-O factory Sep 18 03:06:17.304720 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.304659 2578 factory.go:223] Registration of the crio container factory successfully Sep 18 03:06:17.304720 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.304714 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 18 03:06:17.304791 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.304723 2578 factory.go:55] Registering systemd factory Sep 18 03:06:17.304791 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.304729 2578 factory.go:223] Registration of the systemd container factory successfully Sep 18 03:06:17.304791 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.304742 2578 factory.go:103] Registering Raw factory Sep 18 03:06:17.304791 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.304751 2578 manager.go:1196] Started watching for new ooms in manager Sep 18 03:06:17.305704 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.305662 2578 manager.go:349] Starting recovery of all containers Sep 18 03:06:17.326872 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:17.326674 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-38.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 18 03:06:17.327032 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:17.326987 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 18 03:06:17.327507 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.327489 2578 manager.go:354] Recovery completed Sep 18 03:06:17.333197 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.333170 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 03:06:17.335085 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:17.334297 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-38.ec2.internal.18d64b5fecf0d834 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-38.ec2.internal,UID:ip-10-0-138-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-38.ec2.internal,},FirstTimestamp:2026-09-18 03:06:17.295534132 +0000 UTC m=+1.891487244,LastTimestamp:2026-09-18 03:06:17.295534132 +0000 UTC m=+1.891487244,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-38.ec2.internal,}" Sep 18 03:06:17.335225 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.335140 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasSufficientMemory" Sep 18 03:06:17.335225 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.335171 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 03:06:17.335305 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.335242 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasSufficientPID" Sep 18 03:06:17.335884 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.335867 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 18 03:06:17.335884 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.335880 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 03:06:17.336011 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.335881 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 18 03:06:17.336011 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.335906 2578 state_mem.go:36] "Initialized new in-memory state store" Sep 18 03:06:17.336531 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.336515 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasSufficientMemory" Sep 18 03:06:17.336584 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.336542 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 03:06:17.336584 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.336553 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasSufficientPID" Sep 18 03:06:17.338106 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.338092 2578 policy_none.go:49] "None policy: Start" Sep 18 03:06:17.338166 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.338109 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 18 03:06:17.338166 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.338120 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 18 03:06:17.340065 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.340053 2578 policy_none.go:47] "Start" Sep 18 03:06:17.351552 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:17.351468 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-38.ec2.internal.18d64b5fef4d6fcf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-38.ec2.internal,UID:ip-10-0-138-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-38.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-38.ec2.internal,},FirstTimestamp:2026-09-18 03:06:17.335156687 +0000 UTC m=+1.931109798,LastTimestamp:2026-09-18 03:06:17.335156687 +0000 UTC m=+1.931109798,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-38.ec2.internal,}" Sep 18 03:06:17.365095 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:17.365027 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-38.ec2.internal.18d64b5fef4db970 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-38.ec2.internal,UID:ip-10-0-138-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-38.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-38.ec2.internal,},FirstTimestamp:2026-09-18 03:06:17.335175536 +0000 UTC m=+1.931128647,LastTimestamp:2026-09-18 03:06:17.335175536 +0000 UTC m=+1.931128647,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-38.ec2.internal,}" Sep 18 03:06:17.370839 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.370824 2578 manager.go:337] "Starting Device Plugin manager" Sep 18 03:06:17.370910 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:17.370863 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 18 03:06:17.370910 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.370874 2578 server.go:87] "Starting device plugin registration server" Sep 18 03:06:17.371207 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.371176 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 18 03:06:17.371805 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.371219 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 18 03:06:17.372057 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.372016 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 18 03:06:17.372234 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.372107 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 18 03:06:17.372234 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.372115 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 18 03:06:17.372440 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:17.372292 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 18 03:06:17.372440 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:17.372341 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-38.ec2.internal\" not found" Sep 18 03:06:17.374377 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:17.374302 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-38.ec2.internal.18d64b5fef4ee148 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-38.ec2.internal,UID:ip-10-0-138-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-38.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-38.ec2.internal,},FirstTimestamp:2026-09-18 03:06:17.335251272 +0000 UTC m=+1.931204385,LastTimestamp:2026-09-18 03:06:17.335251272 +0000 UTC m=+1.931204385,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-38.ec2.internal,}" Sep 18 03:06:17.395360 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:17.389408 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-38.ec2.internal.18d64b5fef4d6fcf\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-38.ec2.internal.18d64b5fef4d6fcf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-38.ec2.internal,UID:ip-10-0-138-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-38.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-38.ec2.internal,},FirstTimestamp:2026-09-18 03:06:17.335156687 +0000 UTC m=+1.931109798,LastTimestamp:2026-09-18 03:06:17.336529256 +0000 UTC m=+1.932482366,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-38.ec2.internal,}" Sep 18 03:06:17.404475 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:17.404382 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-38.ec2.internal.18d64b5fef4db970\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-38.ec2.internal.18d64b5fef4db970 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-38.ec2.internal,UID:ip-10-0-138-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-38.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-38.ec2.internal,},FirstTimestamp:2026-09-18 03:06:17.335175536 +0000 UTC m=+1.931128647,LastTimestamp:2026-09-18 03:06:17.336546774 +0000 UTC m=+1.932499884,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-38.ec2.internal,}" Sep 18 03:06:17.420697 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:17.420612 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-38.ec2.internal.18d64b5fef4ee148\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-38.ec2.internal.18d64b5fef4ee148 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-38.ec2.internal,UID:ip-10-0-138-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-38.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-38.ec2.internal,},FirstTimestamp:2026-09-18 03:06:17.335251272 +0000 UTC m=+1.931204385,LastTimestamp:2026-09-18 03:06:17.336559385 +0000 UTC m=+1.932512497,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-38.ec2.internal,}" Sep 18 03:06:17.433009 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:17.432925 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-38.ec2.internal.18d64b5ff195492e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-38.ec2.internal,UID:ip-10-0-138-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-138-38.ec2.internal,},FirstTimestamp:2026-09-18 03:06:17.373419822 +0000 UTC m=+1.969372934,LastTimestamp:2026-09-18 03:06:17.373419822 +0000 UTC m=+1.969372934,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-38.ec2.internal,}" Sep 18 03:06:17.449335 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.449299 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 18 03:06:17.450745 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.450723 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 18 03:06:17.450841 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.450783 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 18 03:06:17.450841 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.450808 2578 kubelet.go:2448] "Starting kubelet main sync loop" Sep 18 03:06:17.450929 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:17.450849 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 18 03:06:17.472261 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.472227 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 03:06:17.473204 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.473172 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasSufficientMemory" Sep 18 03:06:17.473324 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.473217 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 03:06:17.473324 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.473227 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasSufficientPID" Sep 18 03:06:17.473324 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.473250 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-38.ec2.internal" Sep 18 03:06:17.477243 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:17.477218 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Sep 18 03:06:17.477351 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:17.477273 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-38.ec2.internal.18d64b5fef4d6fcf\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-38.ec2.internal.18d64b5fef4d6fcf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-38.ec2.internal,UID:ip-10-0-138-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-38.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-38.ec2.internal,},FirstTimestamp:2026-09-18 03:06:17.335156687 +0000 UTC m=+1.931109798,LastTimestamp:2026-09-18 03:06:17.473201296 +0000 UTC m=+2.069154406,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-38.ec2.internal,}" Sep 18 03:06:17.490027 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:17.489957 2578 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-138-38.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-138-38.ec2.internal" Sep 18 03:06:17.490122 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:17.490020 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-38.ec2.internal.18d64b5fef4db970\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-38.ec2.internal.18d64b5fef4db970 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-38.ec2.internal,UID:ip-10-0-138-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-38.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-38.ec2.internal,},FirstTimestamp:2026-09-18 03:06:17.335175536 +0000 UTC m=+1.931128647,LastTimestamp:2026-09-18 03:06:17.473221957 +0000 UTC m=+2.069175069,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-38.ec2.internal,}" Sep 18 03:06:17.494589 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:17.494518 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-38.ec2.internal.18d64b5fef4ee148\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-38.ec2.internal.18d64b5fef4ee148 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-38.ec2.internal,UID:ip-10-0-138-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-38.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-38.ec2.internal,},FirstTimestamp:2026-09-18 03:06:17.335251272 +0000 UTC m=+1.931204385,LastTimestamp:2026-09-18 03:06:17.473231229 +0000 UTC m=+2.069184339,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-38.ec2.internal,}" Sep 18 03:06:17.503361 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.503338 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r5wnk" Sep 18 03:06:17.513834 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.513810 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r5wnk" Sep 18 03:06:17.529634 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:17.529603 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-38.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="400ms" Sep 18 03:06:17.551749 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.551714 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-38.ec2.internal"] Sep 18 03:06:17.551831 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.551811 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 03:06:17.553492 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.553470 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasSufficientMemory" Sep 18 03:06:17.553615 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.553504 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 03:06:17.553615 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.553518 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasSufficientPID" Sep 18 03:06:17.555904 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.555883 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 03:06:17.556028 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.556009 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal" Sep 18 03:06:17.556075 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.556042 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 03:06:17.556790 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.556766 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasSufficientMemory" Sep 18 03:06:17.556899 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.556802 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 03:06:17.556899 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.556779 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasSufficientMemory" Sep 18 03:06:17.556899 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.556820 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasSufficientPID" Sep 18 03:06:17.556899 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.556834 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 03:06:17.556899 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.556858 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasSufficientPID" Sep 18 03:06:17.559125 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.559107 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-38.ec2.internal" Sep 18 03:06:17.559203 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.559141 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 03:06:17.559984 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.559968 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasSufficientMemory" Sep 18 03:06:17.560050 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.559996 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 03:06:17.560050 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.560009 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasSufficientPID" Sep 18 03:06:17.573878 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:17.573852 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-38.ec2.internal\" not found" node="ip-10-0-138-38.ec2.internal" Sep 18 03:06:17.578156 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:17.578139 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-38.ec2.internal\" not found" node="ip-10-0-138-38.ec2.internal" Sep 18 03:06:17.690052 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.690025 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 03:06:17.691367 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.691346 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasSufficientMemory" Sep 18 03:06:17.691447 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.691384 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 03:06:17.691447 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.691399 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeHasSufficientPID" Sep 18 03:06:17.691447 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.691446 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-38.ec2.internal" Sep 18 03:06:17.701980 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.701956 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-38.ec2.internal" Sep 18 03:06:17.702035 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:17.701994 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-38.ec2.internal\": node \"ip-10-0-138-38.ec2.internal\" not found" Sep 18 03:06:17.705695 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.705673 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/057a0ec2fb9c26d68b86efbdbfc5dfe9-config\") pod \"kube-apiserver-proxy-ip-10-0-138-38.ec2.internal\" (UID: \"057a0ec2fb9c26d68b86efbdbfc5dfe9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-38.ec2.internal" Sep 18 03:06:17.705742 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.705702 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1464c738f5162da5f46c52a035e4932a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal\" (UID: \"1464c738f5162da5f46c52a035e4932a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal" Sep 18 03:06:17.705742 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.705719 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1464c738f5162da5f46c52a035e4932a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal\" (UID: \"1464c738f5162da5f46c52a035e4932a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal" Sep 18 03:06:17.719937 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:17.719911 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-38.ec2.internal\" not found" Sep 18 03:06:17.806467 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.806390 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1464c738f5162da5f46c52a035e4932a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal\" (UID: \"1464c738f5162da5f46c52a035e4932a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal" Sep 18 03:06:17.806467 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.806442 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/057a0ec2fb9c26d68b86efbdbfc5dfe9-config\") pod \"kube-apiserver-proxy-ip-10-0-138-38.ec2.internal\" (UID: \"057a0ec2fb9c26d68b86efbdbfc5dfe9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-38.ec2.internal" Sep 18 03:06:17.806467 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.806463 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1464c738f5162da5f46c52a035e4932a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal\" (UID: \"1464c738f5162da5f46c52a035e4932a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal" Sep 18 03:06:17.806604 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.806482 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1464c738f5162da5f46c52a035e4932a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal\" (UID: \"1464c738f5162da5f46c52a035e4932a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal" Sep 18 03:06:17.806604 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.806503 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1464c738f5162da5f46c52a035e4932a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal\" (UID: \"1464c738f5162da5f46c52a035e4932a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal" Sep 18 03:06:17.806604 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.806523 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/057a0ec2fb9c26d68b86efbdbfc5dfe9-config\") pod \"kube-apiserver-proxy-ip-10-0-138-38.ec2.internal\" (UID: \"057a0ec2fb9c26d68b86efbdbfc5dfe9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-38.ec2.internal" Sep 18 03:06:17.820546 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:17.820516 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-38.ec2.internal\" not found" Sep 18 03:06:17.877719 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.877691 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal" Sep 18 03:06:17.882135 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:17.882103 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-38.ec2.internal" Sep 18 03:06:17.920868 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:17.920831 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-38.ec2.internal\" not found" Sep 18 03:06:18.021738 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:18.021692 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-38.ec2.internal\" not found" Sep 18 03:06:18.122274 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:18.122244 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-38.ec2.internal\" not found" Sep 18 03:06:18.161762 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:18.161733 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 03:06:18.222652 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:18.222615 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-38.ec2.internal\" not found" Sep 18 03:06:18.248803 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:18.248772 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 18 03:06:18.249396 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:18.248937 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 03:06:18.323770 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:18.323737 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-38.ec2.internal\" not found" Sep 18 03:06:18.338135 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:18.338108 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 03:06:18.404556 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:18.404484 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-38.ec2.internal" Sep 18 03:06:18.417925 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:18.417900 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 03:06:18.418776 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:18.418759 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal" Sep 18 03:06:18.433177 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:18.433153 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 03:06:18.519813 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:18.519766 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 03:01:17 +0000 UTC" deadline="2028-02-12 13:16:59.007144459 +0000 UTC" Sep 18 03:06:18.519813 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:18.519814 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12298h10m40.487333852s" Sep 18 03:06:18.631316 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:18.631271 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1464c738f5162da5f46c52a035e4932a.slice/crio-0d8b3e4498a5e6c99de76ab8a66ab1cce5d630f8bcc77af493fe55eff11f975c WatchSource:0}: Error finding container 0d8b3e4498a5e6c99de76ab8a66ab1cce5d630f8bcc77af493fe55eff11f975c: Status 404 returned error can't find the container with id 0d8b3e4498a5e6c99de76ab8a66ab1cce5d630f8bcc77af493fe55eff11f975c Sep 18 03:06:18.631913 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:18.631891 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod057a0ec2fb9c26d68b86efbdbfc5dfe9.slice/crio-73d074fdc233a292784fcc5bcf1e47814b8f6f622b878f7f0ee9507278e53c2b WatchSource:0}: Error finding container 73d074fdc233a292784fcc5bcf1e47814b8f6f622b878f7f0ee9507278e53c2b: Status 404 returned error can't find the container with id 73d074fdc233a292784fcc5bcf1e47814b8f6f622b878f7f0ee9507278e53c2b Sep 18 03:06:18.636676 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:18.636658 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 03:06:18.646828 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:18.646803 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 03:06:19.033926 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.033888 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 03:06:19.277981 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.277948 2578 apiserver.go:52] "Watching apiserver" Sep 18 03:06:19.285475 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.285391 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 18 03:06:19.285809 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.285783 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmt9l","openshift-cluster-node-tuning-operator/tuned-5vv6r","openshift-dns/node-resolver-8scdz","openshift-multus/multus-7kb6r","openshift-multus/network-metrics-daemon-zcq59","openshift-network-diagnostics/network-check-target-g4zw8","kube-system/konnectivity-agent-l6ln7","openshift-image-registry/node-ca-pjgpg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal","openshift-multus/multus-additional-cni-plugins-csnc7","openshift-network-operator/iptables-alerter-gm7zt","openshift-ovn-kubernetes/ovnkube-node-mthtg","kube-system/global-pull-secret-syncer-fxdpf","kube-system/kube-apiserver-proxy-ip-10-0-138-38.ec2.internal"] Sep 18 03:06:19.288353 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.288329 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-csnc7" Sep 18 03:06:19.290557 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.290534 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gm7zt" Sep 18 03:06:19.291299 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.291274 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 18 03:06:19.291400 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.291357 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 18 03:06:19.291400 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.291389 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 18 03:06:19.292556 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.292536 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 18 03:06:19.292759 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.292735 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 18 03:06:19.292839 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.292790 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8scdz" Sep 18 03:06:19.292889 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.292847 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 18 03:06:19.293195 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.293159 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 18 03:06:19.293300 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.293232 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m6rgq\"" Sep 18 03:06:19.294087 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.294070 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 18 03:06:19.294232 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.294211 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6r59b\"" Sep 18 03:06:19.296146 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.296122 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.297166 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.296838 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-x6sms\"" Sep 18 03:06:19.299755 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.297325 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 18 03:06:19.299755 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.297735 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 18 03:06:19.299755 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.299059 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 18 03:06:19.299755 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.299112 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:06:19.299755 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:19.299221 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcq59" podUID="d8ba3428-efa3-42f0-acad-0e524f361a50" Sep 18 03:06:19.299755 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.299255 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5wk6g\"" Sep 18 03:06:19.301548 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.301521 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4zw8" Sep 18 03:06:19.301677 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:19.301600 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4zw8" podUID="94f7ec49-0a27-460a-90cc-16cb68d9beb9" Sep 18 03:06:19.304314 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.303900 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 18 03:06:19.304314 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.303944 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.306458 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.306438 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:19.306720 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:19.306693 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxdpf" podUID="03534b6e-babc-44ea-a841-499edea9d492" Sep 18 03:06:19.308124 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.308092 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 18 03:06:19.308393 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.308377 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 18 03:06:19.308457 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.308377 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 18 03:06:19.308545 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.308510 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 18 03:06:19.308595 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.308544 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 18 03:06:19.308828 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.308811 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.309343 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.309325 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-khkk4\"" Sep 18 03:06:19.309635 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.309614 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 18 03:06:19.311177 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.311153 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmt9l" Sep 18 03:06:19.311669 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.311648 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 18 03:06:19.311669 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.311657 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 18 03:06:19.311827 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.311708 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-l8rv9\"" Sep 18 03:06:19.313300 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.313281 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 18 03:06:19.313703 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.313686 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hqd7f\"" Sep 18 03:06:19.313778 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.313701 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l6ln7" Sep 18 03:06:19.314270 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.314223 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 18 03:06:19.314270 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.314263 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 18 03:06:19.314671 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.314633 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg95r\" (UniqueName: \"kubernetes.io/projected/90b7b9fc-a4d0-4f78-b04a-723ab8565584-kube-api-access-qg95r\") pod \"multus-additional-cni-plugins-csnc7\" (UID: \"90b7b9fc-a4d0-4f78-b04a-723ab8565584\") " pod="openshift-multus/multus-additional-cni-plugins-csnc7" Sep 18 03:06:19.314671 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.314665 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-host-kubelet\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.314821 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.314690 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8ba3428-efa3-42f0-acad-0e524f361a50-metrics-certs\") pod \"network-metrics-daemon-zcq59\" (UID: \"d8ba3428-efa3-42f0-acad-0e524f361a50\") " pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:06:19.314821 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.314713 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.314821 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.314761 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/03534b6e-babc-44ea-a841-499edea9d492-kubelet-config\") pod \"global-pull-secret-syncer-fxdpf\" (UID: \"03534b6e-babc-44ea-a841-499edea9d492\") " pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:19.314821 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.314796 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-log-socket\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.315035 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.314820 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-multus-socket-dir-parent\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.315035 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.314846 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb8a24bb-d540-4fb6-9be3-2af0bd8737ec-host-slash\") pod \"iptables-alerter-gm7zt\" (UID: \"fb8a24bb-d540-4fb6-9be3-2af0bd8737ec\") " pod="openshift-network-operator/iptables-alerter-gm7zt" Sep 18 03:06:19.315035 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.314871 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-host-var-lib-cni-multus\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.315035 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.314890 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-host-run-multus-certs\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.315035 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.314905 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-etc-openvswitch\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.315035 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.314926 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2824667-7219-4da9-b4b4-125da30139e8-tmp-dir\") pod \"node-resolver-8scdz\" (UID: \"c2824667-7219-4da9-b4b4-125da30139e8\") " pod="openshift-dns/node-resolver-8scdz" Sep 18 03:06:19.315035 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.314947 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/90b7b9fc-a4d0-4f78-b04a-723ab8565584-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-csnc7\" (UID: \"90b7b9fc-a4d0-4f78-b04a-723ab8565584\") " pod="openshift-multus/multus-additional-cni-plugins-csnc7" Sep 18 03:06:19.315035 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.314998 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-host-var-lib-kubelet\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.315457 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.315043 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-host-run-k8s-cni-cncf-io\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.315457 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.315074 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2f86f967-298e-4b3b-98fe-40efc67fdf9f-env-overrides\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.315457 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.315099 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-host-run-netns\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.315457 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.315124 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/90b7b9fc-a4d0-4f78-b04a-723ab8565584-tuning-conf-dir\") pod \"multus-additional-cni-plugins-csnc7\" (UID: \"90b7b9fc-a4d0-4f78-b04a-723ab8565584\") " pod="openshift-multus/multus-additional-cni-plugins-csnc7" Sep 18 03:06:19.315457 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.315147 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-run-openvswitch\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.315457 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.315202 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90b7b9fc-a4d0-4f78-b04a-723ab8565584-system-cni-dir\") pod \"multus-additional-cni-plugins-csnc7\" (UID: \"90b7b9fc-a4d0-4f78-b04a-723ab8565584\") " pod="openshift-multus/multus-additional-cni-plugins-csnc7" Sep 18 03:06:19.315457 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.315234 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-host-slash\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.315457 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.315262 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-host-run-ovn-kubernetes\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.315457 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.315287 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-host-cni-bin\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.315457 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.315309 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c2824667-7219-4da9-b4b4-125da30139e8-hosts-file\") pod \"node-resolver-8scdz\" (UID: \"c2824667-7219-4da9-b4b4-125da30139e8\") " pod="openshift-dns/node-resolver-8scdz" Sep 18 03:06:19.315457 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.315331 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b489d687-b213-4c1a-afb2-ed7e2f710493-cni-binary-copy\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.315457 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.315376 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b489d687-b213-4c1a-afb2-ed7e2f710493-multus-daemon-config\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.315457 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.315404 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2f86f967-298e-4b3b-98fe-40efc67fdf9f-ovnkube-config\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.315457 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.315428 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f86f967-298e-4b3b-98fe-40efc67fdf9f-ovn-node-metrics-cert\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.315457 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.315452 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8xp5\" (UniqueName: \"kubernetes.io/projected/b489d687-b213-4c1a-afb2-ed7e2f710493-kube-api-access-z8xp5\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.316299 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.315497 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8gnc\" (UniqueName: \"kubernetes.io/projected/d8ba3428-efa3-42f0-acad-0e524f361a50-kube-api-access-z8gnc\") pod \"network-metrics-daemon-zcq59\" (UID: \"d8ba3428-efa3-42f0-acad-0e524f361a50\") " pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:06:19.316299 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.315553 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/90b7b9fc-a4d0-4f78-b04a-723ab8565584-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-csnc7\" (UID: \"90b7b9fc-a4d0-4f78-b04a-723ab8565584\") " pod="openshift-multus/multus-additional-cni-plugins-csnc7" Sep 18 03:06:19.316299 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.315590 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhgdz\" (UniqueName: \"kubernetes.io/projected/94f7ec49-0a27-460a-90cc-16cb68d9beb9-kube-api-access-mhgdz\") pod \"network-check-target-g4zw8\" (UID: \"94f7ec49-0a27-460a-90cc-16cb68d9beb9\") " pod="openshift-network-diagnostics/network-check-target-g4zw8" Sep 18 03:06:19.316299 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.315614 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2q9p\" (UniqueName: \"kubernetes.io/projected/2f86f967-298e-4b3b-98fe-40efc67fdf9f-kube-api-access-n2q9p\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.316299 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.315636 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/03534b6e-babc-44ea-a841-499edea9d492-dbus\") pod \"global-pull-secret-syncer-fxdpf\" (UID: \"03534b6e-babc-44ea-a841-499edea9d492\") " pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:19.316299 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.315674 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/90b7b9fc-a4d0-4f78-b04a-723ab8565584-cnibin\") pod \"multus-additional-cni-plugins-csnc7\" (UID: \"90b7b9fc-a4d0-4f78-b04a-723ab8565584\") " pod="openshift-multus/multus-additional-cni-plugins-csnc7" Sep 18 03:06:19.316299 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.315713 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/90b7b9fc-a4d0-4f78-b04a-723ab8565584-cni-binary-copy\") pod \"multus-additional-cni-plugins-csnc7\" (UID: \"90b7b9fc-a4d0-4f78-b04a-723ab8565584\") " pod="openshift-multus/multus-additional-cni-plugins-csnc7" Sep 18 03:06:19.316299 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.315753 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8jrz\" (UniqueName: \"kubernetes.io/projected/fb8a24bb-d540-4fb6-9be3-2af0bd8737ec-kube-api-access-t8jrz\") pod \"iptables-alerter-gm7zt\" (UID: \"fb8a24bb-d540-4fb6-9be3-2af0bd8737ec\") " pod="openshift-network-operator/iptables-alerter-gm7zt" Sep 18 03:06:19.316299 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.315779 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03534b6e-babc-44ea-a841-499edea9d492-original-pull-secret\") pod \"global-pull-secret-syncer-fxdpf\" (UID: \"03534b6e-babc-44ea-a841-499edea9d492\") " pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:19.316299 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.315802 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fb8a24bb-d540-4fb6-9be3-2af0bd8737ec-iptables-alerter-script\") pod \"iptables-alerter-gm7zt\" (UID: \"fb8a24bb-d540-4fb6-9be3-2af0bd8737ec\") " pod="openshift-network-operator/iptables-alerter-gm7zt" Sep 18 03:06:19.316299 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.315834 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-host-var-lib-cni-bin\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.316299 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.315857 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-systemd-units\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.316299 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.315898 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-node-log\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.316299 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.315928 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-host-cni-netd\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.316299 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.315961 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-run-ovn\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.316299 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.315988 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-hostroot\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.317074 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.316012 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-multus-cni-dir\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.317074 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.316090 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-cnibin\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.317074 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.316116 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-etc-kubernetes\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.317074 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.316139 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-run-systemd\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.317074 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.316158 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 18 03:06:19.317074 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.316165 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgp7b\" (UniqueName: \"kubernetes.io/projected/c2824667-7219-4da9-b4b4-125da30139e8-kube-api-access-zgp7b\") pod \"node-resolver-8scdz\" (UID: \"c2824667-7219-4da9-b4b4-125da30139e8\") " pod="openshift-dns/node-resolver-8scdz" Sep 18 03:06:19.317074 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.316196 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ll7vs\"" Sep 18 03:06:19.317074 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.316218 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-var-lib-openvswitch\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.317074 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.316248 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-multus-conf-dir\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.317074 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.316255 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 18 03:06:19.317074 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.316274 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-host-run-netns\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.317074 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.316298 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2f86f967-298e-4b3b-98fe-40efc67fdf9f-ovnkube-script-lib\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.317074 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.316322 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-system-cni-dir\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.318225 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.318174 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pjgpg" Sep 18 03:06:19.320584 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.320396 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 18 03:06:19.320584 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.320397 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 18 03:06:19.320584 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.320442 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-x9rpq\"" Sep 18 03:06:19.320813 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.320795 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 18 03:06:19.322454 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.322341 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 03:06:19.355171 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.355144 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zq79k" Sep 18 03:06:19.361727 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.361698 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zq79k" Sep 18 03:06:19.405546 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.405500 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 18 03:06:19.417455 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.417420 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/03534b6e-babc-44ea-a841-499edea9d492-kubelet-config\") pod \"global-pull-secret-syncer-fxdpf\" (UID: \"03534b6e-babc-44ea-a841-499edea9d492\") " pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:19.417534 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.417473 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/087e1ae9-2029-4e0f-b7ff-a79e5cab3349-etc-selinux\") pod \"aws-ebs-csi-driver-node-hmt9l\" (UID: \"087e1ae9-2029-4e0f-b7ff-a79e5cab3349\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmt9l" Sep 18 03:06:19.417534 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.417515 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-log-socket\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.417616 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.417543 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-etc-systemd\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.417616 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.417569 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f519c6c1-a46c-46a8-9911-0a795fdcf765-tmp\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.417616 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.417568 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/03534b6e-babc-44ea-a841-499edea9d492-kubelet-config\") pod \"global-pull-secret-syncer-fxdpf\" (UID: \"03534b6e-babc-44ea-a841-499edea9d492\") " pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:19.417616 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.417595 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-multus-socket-dir-parent\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.417897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.417622 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-log-socket\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.417897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.417638 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb8a24bb-d540-4fb6-9be3-2af0bd8737ec-host-slash\") pod \"iptables-alerter-gm7zt\" (UID: \"fb8a24bb-d540-4fb6-9be3-2af0bd8737ec\") " pod="openshift-network-operator/iptables-alerter-gm7zt" Sep 18 03:06:19.417897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.417675 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-host-var-lib-cni-multus\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.417897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.417679 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb8a24bb-d540-4fb6-9be3-2af0bd8737ec-host-slash\") pod \"iptables-alerter-gm7zt\" (UID: \"fb8a24bb-d540-4fb6-9be3-2af0bd8737ec\") " pod="openshift-network-operator/iptables-alerter-gm7zt" Sep 18 03:06:19.417897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.417710 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-multus-socket-dir-parent\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.417897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.417747 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-host-run-multus-certs\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.417897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.417795 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-host-var-lib-cni-multus\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.417897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.417837 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-etc-openvswitch\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.417897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.417879 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-host-run-multus-certs\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.417897 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.417895 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2824667-7219-4da9-b4b4-125da30139e8-tmp-dir\") pod \"node-resolver-8scdz\" (UID: \"c2824667-7219-4da9-b4b4-125da30139e8\") " pod="openshift-dns/node-resolver-8scdz" Sep 18 03:06:19.418292 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.417914 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-etc-openvswitch\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.418292 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.417944 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/087e1ae9-2029-4e0f-b7ff-a79e5cab3349-device-dir\") pod \"aws-ebs-csi-driver-node-hmt9l\" (UID: \"087e1ae9-2029-4e0f-b7ff-a79e5cab3349\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmt9l" Sep 18 03:06:19.418292 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.417988 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/90b7b9fc-a4d0-4f78-b04a-723ab8565584-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-csnc7\" (UID: \"90b7b9fc-a4d0-4f78-b04a-723ab8565584\") " pod="openshift-multus/multus-additional-cni-plugins-csnc7" Sep 18 03:06:19.418292 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418022 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-host-var-lib-kubelet\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.418292 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418100 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlzbw\" (UniqueName: \"kubernetes.io/projected/f519c6c1-a46c-46a8-9911-0a795fdcf765-kube-api-access-hlzbw\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.418292 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418130 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-host-run-k8s-cni-cncf-io\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.418292 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418172 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-host-var-lib-kubelet\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.418292 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418219 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2f86f967-298e-4b3b-98fe-40efc67fdf9f-env-overrides\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.418292 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418229 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-host-run-k8s-cni-cncf-io\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.418292 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418252 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-etc-kubernetes\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.418292 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418264 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2824667-7219-4da9-b4b4-125da30139e8-tmp-dir\") pod \"node-resolver-8scdz\" (UID: \"c2824667-7219-4da9-b4b4-125da30139e8\") " pod="openshift-dns/node-resolver-8scdz" Sep 18 03:06:19.418731 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418303 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-host-run-netns\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.418731 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418270 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-host-run-netns\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.418731 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418356 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/90b7b9fc-a4d0-4f78-b04a-723ab8565584-tuning-conf-dir\") pod \"multus-additional-cni-plugins-csnc7\" (UID: \"90b7b9fc-a4d0-4f78-b04a-723ab8565584\") " pod="openshift-multus/multus-additional-cni-plugins-csnc7" Sep 18 03:06:19.418731 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418381 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-run-openvswitch\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.418731 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418408 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-lib-modules\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.418731 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418431 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2ffb6d5a-a4e0-444c-986e-282a57ed1add-agent-certs\") pod \"konnectivity-agent-l6ln7\" (UID: \"2ffb6d5a-a4e0-444c-986e-282a57ed1add\") " pod="kube-system/konnectivity-agent-l6ln7" Sep 18 03:06:19.418731 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418454 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90b7b9fc-a4d0-4f78-b04a-723ab8565584-system-cni-dir\") pod \"multus-additional-cni-plugins-csnc7\" (UID: \"90b7b9fc-a4d0-4f78-b04a-723ab8565584\") " pod="openshift-multus/multus-additional-cni-plugins-csnc7" Sep 18 03:06:19.418731 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418452 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-run-openvswitch\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.418731 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418490 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90b7b9fc-a4d0-4f78-b04a-723ab8565584-system-cni-dir\") pod \"multus-additional-cni-plugins-csnc7\" (UID: \"90b7b9fc-a4d0-4f78-b04a-723ab8565584\") " pod="openshift-multus/multus-additional-cni-plugins-csnc7" Sep 18 03:06:19.418731 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418503 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-host-slash\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.418731 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418533 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-host-run-ovn-kubernetes\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.418731 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418534 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/90b7b9fc-a4d0-4f78-b04a-723ab8565584-tuning-conf-dir\") pod \"multus-additional-cni-plugins-csnc7\" (UID: \"90b7b9fc-a4d0-4f78-b04a-723ab8565584\") " pod="openshift-multus/multus-additional-cni-plugins-csnc7" Sep 18 03:06:19.418731 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418571 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-host-run-ovn-kubernetes\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.418731 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418577 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/90b7b9fc-a4d0-4f78-b04a-723ab8565584-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-csnc7\" (UID: \"90b7b9fc-a4d0-4f78-b04a-723ab8565584\") " pod="openshift-multus/multus-additional-cni-plugins-csnc7" Sep 18 03:06:19.418731 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418574 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-host-slash\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.418731 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418589 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-host-cni-bin\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.418731 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418646 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-host-cni-bin\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.419512 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418647 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c2824667-7219-4da9-b4b4-125da30139e8-hosts-file\") pod \"node-resolver-8scdz\" (UID: \"c2824667-7219-4da9-b4b4-125da30139e8\") " pod="openshift-dns/node-resolver-8scdz" Sep 18 03:06:19.419512 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418673 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2f86f967-298e-4b3b-98fe-40efc67fdf9f-env-overrides\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.419512 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418679 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-host\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.419512 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418687 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c2824667-7219-4da9-b4b4-125da30139e8-hosts-file\") pod \"node-resolver-8scdz\" (UID: \"c2824667-7219-4da9-b4b4-125da30139e8\") " pod="openshift-dns/node-resolver-8scdz" Sep 18 03:06:19.419512 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418706 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b489d687-b213-4c1a-afb2-ed7e2f710493-cni-binary-copy\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.419512 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418725 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b489d687-b213-4c1a-afb2-ed7e2f710493-multus-daemon-config\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.419512 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418740 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2f86f967-298e-4b3b-98fe-40efc67fdf9f-ovnkube-config\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.419512 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418755 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f86f967-298e-4b3b-98fe-40efc67fdf9f-ovn-node-metrics-cert\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.419512 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418769 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-var-lib-kubelet\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.419512 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418783 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/087e1ae9-2029-4e0f-b7ff-a79e5cab3349-socket-dir\") pod \"aws-ebs-csi-driver-node-hmt9l\" (UID: \"087e1ae9-2029-4e0f-b7ff-a79e5cab3349\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmt9l" Sep 18 03:06:19.419512 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418804 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/087e1ae9-2029-4e0f-b7ff-a79e5cab3349-registration-dir\") pod \"aws-ebs-csi-driver-node-hmt9l\" (UID: \"087e1ae9-2029-4e0f-b7ff-a79e5cab3349\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmt9l" Sep 18 03:06:19.419512 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418843 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/087e1ae9-2029-4e0f-b7ff-a79e5cab3349-sys-fs\") pod \"aws-ebs-csi-driver-node-hmt9l\" (UID: \"087e1ae9-2029-4e0f-b7ff-a79e5cab3349\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmt9l" Sep 18 03:06:19.419512 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418858 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8xp5\" (UniqueName: \"kubernetes.io/projected/b489d687-b213-4c1a-afb2-ed7e2f710493-kube-api-access-z8xp5\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.419512 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418875 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8gnc\" (UniqueName: \"kubernetes.io/projected/d8ba3428-efa3-42f0-acad-0e524f361a50-kube-api-access-z8gnc\") pod \"network-metrics-daemon-zcq59\" (UID: \"d8ba3428-efa3-42f0-acad-0e524f361a50\") " pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:06:19.419512 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418911 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/90b7b9fc-a4d0-4f78-b04a-723ab8565584-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-csnc7\" (UID: \"90b7b9fc-a4d0-4f78-b04a-723ab8565584\") " pod="openshift-multus/multus-additional-cni-plugins-csnc7" Sep 18 03:06:19.419512 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418936 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhgdz\" (UniqueName: \"kubernetes.io/projected/94f7ec49-0a27-460a-90cc-16cb68d9beb9-kube-api-access-mhgdz\") pod \"network-check-target-g4zw8\" (UID: \"94f7ec49-0a27-460a-90cc-16cb68d9beb9\") " pod="openshift-network-diagnostics/network-check-target-g4zw8" Sep 18 03:06:19.419512 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418960 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2q9p\" (UniqueName: \"kubernetes.io/projected/2f86f967-298e-4b3b-98fe-40efc67fdf9f-kube-api-access-n2q9p\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.420145 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.418982 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/03534b6e-babc-44ea-a841-499edea9d492-dbus\") pod \"global-pull-secret-syncer-fxdpf\" (UID: \"03534b6e-babc-44ea-a841-499edea9d492\") " pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:19.420145 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.419001 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-etc-sysconfig\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.420145 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.419032 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-etc-sysctl-d\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.420145 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.419055 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/90b7b9fc-a4d0-4f78-b04a-723ab8565584-cnibin\") pod \"multus-additional-cni-plugins-csnc7\" (UID: \"90b7b9fc-a4d0-4f78-b04a-723ab8565584\") " pod="openshift-multus/multus-additional-cni-plugins-csnc7" Sep 18 03:06:19.420145 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.419077 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/90b7b9fc-a4d0-4f78-b04a-723ab8565584-cni-binary-copy\") pod \"multus-additional-cni-plugins-csnc7\" (UID: \"90b7b9fc-a4d0-4f78-b04a-723ab8565584\") " pod="openshift-multus/multus-additional-cni-plugins-csnc7" Sep 18 03:06:19.420145 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.419100 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-etc-sysctl-conf\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.420145 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.419097 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 18 03:06:19.420145 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.419260 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f519c6c1-a46c-46a8-9911-0a795fdcf765-etc-tuned\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.420145 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.419284 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2f86f967-298e-4b3b-98fe-40efc67fdf9f-ovnkube-config\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.420145 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.419295 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/087e1ae9-2029-4e0f-b7ff-a79e5cab3349-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hmt9l\" (UID: \"087e1ae9-2029-4e0f-b7ff-a79e5cab3349\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmt9l" Sep 18 03:06:19.420145 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.419334 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b489d687-b213-4c1a-afb2-ed7e2f710493-cni-binary-copy\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.420145 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.419346 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/90b7b9fc-a4d0-4f78-b04a-723ab8565584-cnibin\") pod \"multus-additional-cni-plugins-csnc7\" (UID: \"90b7b9fc-a4d0-4f78-b04a-723ab8565584\") " pod="openshift-multus/multus-additional-cni-plugins-csnc7" Sep 18 03:06:19.420145 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.419414 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2ffb6d5a-a4e0-444c-986e-282a57ed1add-konnectivity-ca\") pod \"konnectivity-agent-l6ln7\" (UID: \"2ffb6d5a-a4e0-444c-986e-282a57ed1add\") " pod="kube-system/konnectivity-agent-l6ln7" Sep 18 03:06:19.420145 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.419490 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/03534b6e-babc-44ea-a841-499edea9d492-dbus\") pod \"global-pull-secret-syncer-fxdpf\" (UID: \"03534b6e-babc-44ea-a841-499edea9d492\") " pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:19.420145 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.419498 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8jrz\" (UniqueName: \"kubernetes.io/projected/fb8a24bb-d540-4fb6-9be3-2af0bd8737ec-kube-api-access-t8jrz\") pod \"iptables-alerter-gm7zt\" (UID: \"fb8a24bb-d540-4fb6-9be3-2af0bd8737ec\") " pod="openshift-network-operator/iptables-alerter-gm7zt" Sep 18 03:06:19.420145 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.419492 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/90b7b9fc-a4d0-4f78-b04a-723ab8565584-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-csnc7\" (UID: \"90b7b9fc-a4d0-4f78-b04a-723ab8565584\") " pod="openshift-multus/multus-additional-cni-plugins-csnc7" Sep 18 03:06:19.420145 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.419530 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03534b6e-babc-44ea-a841-499edea9d492-original-pull-secret\") pod \"global-pull-secret-syncer-fxdpf\" (UID: \"03534b6e-babc-44ea-a841-499edea9d492\") " pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:19.420891 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.419594 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/90b7b9fc-a4d0-4f78-b04a-723ab8565584-cni-binary-copy\") pod \"multus-additional-cni-plugins-csnc7\" (UID: \"90b7b9fc-a4d0-4f78-b04a-723ab8565584\") " pod="openshift-multus/multus-additional-cni-plugins-csnc7" Sep 18 03:06:19.420891 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.419650 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fb8a24bb-d540-4fb6-9be3-2af0bd8737ec-iptables-alerter-script\") pod \"iptables-alerter-gm7zt\" (UID: \"fb8a24bb-d540-4fb6-9be3-2af0bd8737ec\") " pod="openshift-network-operator/iptables-alerter-gm7zt" Sep 18 03:06:19.420891 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:19.419705 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 03:06:19.420891 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.419726 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b489d687-b213-4c1a-afb2-ed7e2f710493-multus-daemon-config\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.420891 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.419759 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-host-var-lib-cni-bin\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.420891 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:19.419813 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03534b6e-babc-44ea-a841-499edea9d492-original-pull-secret podName:03534b6e-babc-44ea-a841-499edea9d492 nodeName:}" failed. No retries permitted until 2026-09-18 03:06:19.919796966 +0000 UTC m=+4.515750077 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03534b6e-babc-44ea-a841-499edea9d492-original-pull-secret") pod "global-pull-secret-syncer-fxdpf" (UID: "03534b6e-babc-44ea-a841-499edea9d492") : object "kube-system"/"original-pull-secret" not registered Sep 18 03:06:19.420891 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.419833 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-systemd-units\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.420891 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.419854 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-host-var-lib-cni-bin\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.420891 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.419891 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-node-log\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.420891 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.419912 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-host-cni-netd\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.420891 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.419961 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-host-cni-netd\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.420891 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.419964 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-systemd-units\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.420891 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420028 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-run-ovn\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.420891 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420068 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-hostroot\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.420891 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420035 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-node-log\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.420891 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420094 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-run-ovn\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.420891 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420094 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-multus-cni-dir\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.421501 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420135 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-cnibin\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.421501 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420154 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-multus-cni-dir\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.421501 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420201 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-hostroot\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.421501 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420212 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-etc-kubernetes\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.421501 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420241 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-run-systemd\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.421501 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420249 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-etc-kubernetes\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.421501 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420212 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fb8a24bb-d540-4fb6-9be3-2af0bd8737ec-iptables-alerter-script\") pod \"iptables-alerter-gm7zt\" (UID: \"fb8a24bb-d540-4fb6-9be3-2af0bd8737ec\") " pod="openshift-network-operator/iptables-alerter-gm7zt" Sep 18 03:06:19.421501 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420250 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-cnibin\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.421501 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420269 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgp7b\" (UniqueName: \"kubernetes.io/projected/c2824667-7219-4da9-b4b4-125da30139e8-kube-api-access-zgp7b\") pod \"node-resolver-8scdz\" (UID: \"c2824667-7219-4da9-b4b4-125da30139e8\") " pod="openshift-dns/node-resolver-8scdz" Sep 18 03:06:19.421501 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420306 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-run-systemd\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.421501 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420309 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-var-lib-openvswitch\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.421501 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420334 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-sys\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.421501 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420352 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wswqn\" (UniqueName: \"kubernetes.io/projected/087e1ae9-2029-4e0f-b7ff-a79e5cab3349-kube-api-access-wswqn\") pod \"aws-ebs-csi-driver-node-hmt9l\" (UID: \"087e1ae9-2029-4e0f-b7ff-a79e5cab3349\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmt9l" Sep 18 03:06:19.421501 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420371 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-multus-conf-dir\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.421501 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420395 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-host-run-netns\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.421501 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420419 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2f86f967-298e-4b3b-98fe-40efc67fdf9f-ovnkube-script-lib\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.421501 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420442 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/833a036f-c311-46c4-8ecf-16723e7ac9f8-host\") pod \"node-ca-pjgpg\" (UID: \"833a036f-c311-46c4-8ecf-16723e7ac9f8\") " pod="openshift-image-registry/node-ca-pjgpg" Sep 18 03:06:19.421501 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420449 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-multus-conf-dir\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.422244 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420465 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-etc-modprobe-d\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.422244 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420490 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-system-cni-dir\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.422244 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420431 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-var-lib-openvswitch\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.422244 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420508 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-host-run-netns\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.422244 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420528 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg95r\" (UniqueName: \"kubernetes.io/projected/90b7b9fc-a4d0-4f78-b04a-723ab8565584-kube-api-access-qg95r\") pod \"multus-additional-cni-plugins-csnc7\" (UID: \"90b7b9fc-a4d0-4f78-b04a-723ab8565584\") " pod="openshift-multus/multus-additional-cni-plugins-csnc7" Sep 18 03:06:19.422244 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420561 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b489d687-b213-4c1a-afb2-ed7e2f710493-system-cni-dir\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.422244 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420594 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-host-kubelet\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.422244 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420705 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/833a036f-c311-46c4-8ecf-16723e7ac9f8-serviceca\") pod \"node-ca-pjgpg\" (UID: \"833a036f-c311-46c4-8ecf-16723e7ac9f8\") " pod="openshift-image-registry/node-ca-pjgpg" Sep 18 03:06:19.422244 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420719 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-host-kubelet\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.422244 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420802 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9d4v\" (UniqueName: \"kubernetes.io/projected/833a036f-c311-46c4-8ecf-16723e7ac9f8-kube-api-access-d9d4v\") pod \"node-ca-pjgpg\" (UID: \"833a036f-c311-46c4-8ecf-16723e7ac9f8\") " pod="openshift-image-registry/node-ca-pjgpg" Sep 18 03:06:19.422244 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420849 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-run\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.422244 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420878 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8ba3428-efa3-42f0-acad-0e524f361a50-metrics-certs\") pod \"network-metrics-daemon-zcq59\" (UID: \"d8ba3428-efa3-42f0-acad-0e524f361a50\") " pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:06:19.422244 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420905 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.422244 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420951 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2f86f967-298e-4b3b-98fe-40efc67fdf9f-ovnkube-script-lib\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.422244 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:19.420978 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:06:19.422244 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.420986 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f86f967-298e-4b3b-98fe-40efc67fdf9f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.422244 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:19.421057 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8ba3428-efa3-42f0-acad-0e524f361a50-metrics-certs podName:d8ba3428-efa3-42f0-acad-0e524f361a50 nodeName:}" failed. No retries permitted until 2026-09-18 03:06:19.921039054 +0000 UTC m=+4.516992157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8ba3428-efa3-42f0-acad-0e524f361a50-metrics-certs") pod "network-metrics-daemon-zcq59" (UID: "d8ba3428-efa3-42f0-acad-0e524f361a50") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:06:19.422726 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.422546 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f86f967-298e-4b3b-98fe-40efc67fdf9f-ovn-node-metrics-cert\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.433289 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.433255 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2q9p\" (UniqueName: \"kubernetes.io/projected/2f86f967-298e-4b3b-98fe-40efc67fdf9f-kube-api-access-n2q9p\") pod \"ovnkube-node-mthtg\" (UID: \"2f86f967-298e-4b3b-98fe-40efc67fdf9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.433443 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.433253 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8jrz\" (UniqueName: \"kubernetes.io/projected/fb8a24bb-d540-4fb6-9be3-2af0bd8737ec-kube-api-access-t8jrz\") pod \"iptables-alerter-gm7zt\" (UID: \"fb8a24bb-d540-4fb6-9be3-2af0bd8737ec\") " pod="openshift-network-operator/iptables-alerter-gm7zt" Sep 18 03:06:19.434305 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.434276 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8gnc\" (UniqueName: \"kubernetes.io/projected/d8ba3428-efa3-42f0-acad-0e524f361a50-kube-api-access-z8gnc\") pod \"network-metrics-daemon-zcq59\" (UID: \"d8ba3428-efa3-42f0-acad-0e524f361a50\") " pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:06:19.435510 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:19.435490 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 03:06:19.435626 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:19.435515 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 03:06:19.435626 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:19.435529 2578 projected.go:196] Error preparing data for projected volume kube-api-access-mhgdz for pod openshift-network-diagnostics/network-check-target-g4zw8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:06:19.435626 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:19.435595 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94f7ec49-0a27-460a-90cc-16cb68d9beb9-kube-api-access-mhgdz podName:94f7ec49-0a27-460a-90cc-16cb68d9beb9 nodeName:}" failed. No retries permitted until 2026-09-18 03:06:19.935576795 +0000 UTC m=+4.531529896 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mhgdz" (UniqueName: "kubernetes.io/projected/94f7ec49-0a27-460a-90cc-16cb68d9beb9-kube-api-access-mhgdz") pod "network-check-target-g4zw8" (UID: "94f7ec49-0a27-460a-90cc-16cb68d9beb9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:06:19.441510 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.441482 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgp7b\" (UniqueName: \"kubernetes.io/projected/c2824667-7219-4da9-b4b4-125da30139e8-kube-api-access-zgp7b\") pod \"node-resolver-8scdz\" (UID: \"c2824667-7219-4da9-b4b4-125da30139e8\") " pod="openshift-dns/node-resolver-8scdz" Sep 18 03:06:19.442113 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.442091 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8xp5\" (UniqueName: \"kubernetes.io/projected/b489d687-b213-4c1a-afb2-ed7e2f710493-kube-api-access-z8xp5\") pod \"multus-7kb6r\" (UID: \"b489d687-b213-4c1a-afb2-ed7e2f710493\") " pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.442272 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.442104 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg95r\" (UniqueName: \"kubernetes.io/projected/90b7b9fc-a4d0-4f78-b04a-723ab8565584-kube-api-access-qg95r\") pod \"multus-additional-cni-plugins-csnc7\" (UID: \"90b7b9fc-a4d0-4f78-b04a-723ab8565584\") " pod="openshift-multus/multus-additional-cni-plugins-csnc7" Sep 18 03:06:19.455921 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.455870 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-38.ec2.internal" event={"ID":"057a0ec2fb9c26d68b86efbdbfc5dfe9","Type":"ContainerStarted","Data":"73d074fdc233a292784fcc5bcf1e47814b8f6f622b878f7f0ee9507278e53c2b"} Sep 18 03:06:19.457239 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.457210 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal" event={"ID":"1464c738f5162da5f46c52a035e4932a","Type":"ContainerStarted","Data":"0d8b3e4498a5e6c99de76ab8a66ab1cce5d630f8bcc77af493fe55eff11f975c"} Sep 18 03:06:19.522129 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.522093 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2ffb6d5a-a4e0-444c-986e-282a57ed1add-konnectivity-ca\") pod \"konnectivity-agent-l6ln7\" (UID: \"2ffb6d5a-a4e0-444c-986e-282a57ed1add\") " pod="kube-system/konnectivity-agent-l6ln7" Sep 18 03:06:19.522334 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.522155 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-sys\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.522334 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.522199 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wswqn\" (UniqueName: \"kubernetes.io/projected/087e1ae9-2029-4e0f-b7ff-a79e5cab3349-kube-api-access-wswqn\") pod \"aws-ebs-csi-driver-node-hmt9l\" (UID: \"087e1ae9-2029-4e0f-b7ff-a79e5cab3349\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmt9l" Sep 18 03:06:19.522334 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.522224 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/833a036f-c311-46c4-8ecf-16723e7ac9f8-host\") pod \"node-ca-pjgpg\" (UID: \"833a036f-c311-46c4-8ecf-16723e7ac9f8\") " pod="openshift-image-registry/node-ca-pjgpg" Sep 18 03:06:19.522334 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.522245 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-etc-modprobe-d\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.522334 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.522270 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/833a036f-c311-46c4-8ecf-16723e7ac9f8-serviceca\") pod \"node-ca-pjgpg\" (UID: \"833a036f-c311-46c4-8ecf-16723e7ac9f8\") " pod="openshift-image-registry/node-ca-pjgpg" Sep 18 03:06:19.522334 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.522272 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-sys\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.522334 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.522293 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9d4v\" (UniqueName: \"kubernetes.io/projected/833a036f-c311-46c4-8ecf-16723e7ac9f8-kube-api-access-d9d4v\") pod \"node-ca-pjgpg\" (UID: \"833a036f-c311-46c4-8ecf-16723e7ac9f8\") " pod="openshift-image-registry/node-ca-pjgpg" Sep 18 03:06:19.522334 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.522316 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-run\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.522733 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.522360 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/087e1ae9-2029-4e0f-b7ff-a79e5cab3349-etc-selinux\") pod \"aws-ebs-csi-driver-node-hmt9l\" (UID: \"087e1ae9-2029-4e0f-b7ff-a79e5cab3349\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmt9l" Sep 18 03:06:19.522733 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.522418 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-etc-systemd\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.522733 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.522475 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f519c6c1-a46c-46a8-9911-0a795fdcf765-tmp\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.522733 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.522505 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/087e1ae9-2029-4e0f-b7ff-a79e5cab3349-device-dir\") pod \"aws-ebs-csi-driver-node-hmt9l\" (UID: \"087e1ae9-2029-4e0f-b7ff-a79e5cab3349\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmt9l" Sep 18 03:06:19.522733 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.522534 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlzbw\" (UniqueName: \"kubernetes.io/projected/f519c6c1-a46c-46a8-9911-0a795fdcf765-kube-api-access-hlzbw\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.522733 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.522556 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-etc-kubernetes\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.522733 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.522584 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-lib-modules\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.522733 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.522606 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2ffb6d5a-a4e0-444c-986e-282a57ed1add-agent-certs\") pod \"konnectivity-agent-l6ln7\" (UID: \"2ffb6d5a-a4e0-444c-986e-282a57ed1add\") " pod="kube-system/konnectivity-agent-l6ln7" Sep 18 03:06:19.522733 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.522634 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-host\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.522733 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.522705 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/087e1ae9-2029-4e0f-b7ff-a79e5cab3349-etc-selinux\") pod \"aws-ebs-csi-driver-node-hmt9l\" (UID: \"087e1ae9-2029-4e0f-b7ff-a79e5cab3349\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmt9l" Sep 18 03:06:19.522733 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.522711 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-var-lib-kubelet\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.522733 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.522738 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/087e1ae9-2029-4e0f-b7ff-a79e5cab3349-socket-dir\") pod \"aws-ebs-csi-driver-node-hmt9l\" (UID: \"087e1ae9-2029-4e0f-b7ff-a79e5cab3349\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmt9l" Sep 18 03:06:19.523316 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.522765 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/087e1ae9-2029-4e0f-b7ff-a79e5cab3349-registration-dir\") pod \"aws-ebs-csi-driver-node-hmt9l\" (UID: \"087e1ae9-2029-4e0f-b7ff-a79e5cab3349\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmt9l" Sep 18 03:06:19.523316 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.522788 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/087e1ae9-2029-4e0f-b7ff-a79e5cab3349-sys-fs\") pod \"aws-ebs-csi-driver-node-hmt9l\" (UID: \"087e1ae9-2029-4e0f-b7ff-a79e5cab3349\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmt9l" Sep 18 03:06:19.523316 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.522792 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2ffb6d5a-a4e0-444c-986e-282a57ed1add-konnectivity-ca\") pod \"konnectivity-agent-l6ln7\" (UID: \"2ffb6d5a-a4e0-444c-986e-282a57ed1add\") " pod="kube-system/konnectivity-agent-l6ln7" Sep 18 03:06:19.523316 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.522806 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-etc-modprobe-d\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.523316 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.522831 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-etc-sysconfig\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.523316 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.522853 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-etc-sysctl-d\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.523316 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.522876 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-etc-sysctl-conf\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.523316 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.522904 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f519c6c1-a46c-46a8-9911-0a795fdcf765-etc-tuned\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.523316 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.522928 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/087e1ae9-2029-4e0f-b7ff-a79e5cab3349-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hmt9l\" (UID: \"087e1ae9-2029-4e0f-b7ff-a79e5cab3349\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmt9l" Sep 18 03:06:19.523316 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.522937 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-lib-modules\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.523316 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.523055 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/833a036f-c311-46c4-8ecf-16723e7ac9f8-host\") pod \"node-ca-pjgpg\" (UID: \"833a036f-c311-46c4-8ecf-16723e7ac9f8\") " pod="openshift-image-registry/node-ca-pjgpg" Sep 18 03:06:19.523316 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.523116 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-run\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.523316 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.523170 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/087e1ae9-2029-4e0f-b7ff-a79e5cab3349-device-dir\") pod \"aws-ebs-csi-driver-node-hmt9l\" (UID: \"087e1ae9-2029-4e0f-b7ff-a79e5cab3349\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmt9l" Sep 18 03:06:19.523316 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.523238 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-etc-systemd\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.523316 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.523318 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-etc-sysconfig\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.524061 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.523339 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/833a036f-c311-46c4-8ecf-16723e7ac9f8-serviceca\") pod \"node-ca-pjgpg\" (UID: \"833a036f-c311-46c4-8ecf-16723e7ac9f8\") " pod="openshift-image-registry/node-ca-pjgpg" Sep 18 03:06:19.524061 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.523388 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-host\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.524061 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.523449 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-var-lib-kubelet\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.524061 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.523546 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/087e1ae9-2029-4e0f-b7ff-a79e5cab3349-socket-dir\") pod \"aws-ebs-csi-driver-node-hmt9l\" (UID: \"087e1ae9-2029-4e0f-b7ff-a79e5cab3349\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmt9l" Sep 18 03:06:19.524061 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.523571 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-etc-kubernetes\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.524061 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.523599 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/087e1ae9-2029-4e0f-b7ff-a79e5cab3349-registration-dir\") pod \"aws-ebs-csi-driver-node-hmt9l\" (UID: \"087e1ae9-2029-4e0f-b7ff-a79e5cab3349\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmt9l" Sep 18 03:06:19.524061 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.523648 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/087e1ae9-2029-4e0f-b7ff-a79e5cab3349-sys-fs\") pod \"aws-ebs-csi-driver-node-hmt9l\" (UID: \"087e1ae9-2029-4e0f-b7ff-a79e5cab3349\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmt9l" Sep 18 03:06:19.524061 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.523710 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-etc-sysctl-conf\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.524061 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.523714 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/087e1ae9-2029-4e0f-b7ff-a79e5cab3349-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hmt9l\" (UID: \"087e1ae9-2029-4e0f-b7ff-a79e5cab3349\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmt9l" Sep 18 03:06:19.524061 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.523761 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f519c6c1-a46c-46a8-9911-0a795fdcf765-etc-sysctl-d\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.525852 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.525829 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f519c6c1-a46c-46a8-9911-0a795fdcf765-etc-tuned\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.528624 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.526256 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f519c6c1-a46c-46a8-9911-0a795fdcf765-tmp\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.528624 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.526301 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2ffb6d5a-a4e0-444c-986e-282a57ed1add-agent-certs\") pod \"konnectivity-agent-l6ln7\" (UID: \"2ffb6d5a-a4e0-444c-986e-282a57ed1add\") " pod="kube-system/konnectivity-agent-l6ln7" Sep 18 03:06:19.536438 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.536342 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlzbw\" (UniqueName: \"kubernetes.io/projected/f519c6c1-a46c-46a8-9911-0a795fdcf765-kube-api-access-hlzbw\") pod \"tuned-5vv6r\" (UID: \"f519c6c1-a46c-46a8-9911-0a795fdcf765\") " pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.536438 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.536342 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wswqn\" (UniqueName: \"kubernetes.io/projected/087e1ae9-2029-4e0f-b7ff-a79e5cab3349-kube-api-access-wswqn\") pod \"aws-ebs-csi-driver-node-hmt9l\" (UID: \"087e1ae9-2029-4e0f-b7ff-a79e5cab3349\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmt9l" Sep 18 03:06:19.536438 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.536342 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9d4v\" (UniqueName: \"kubernetes.io/projected/833a036f-c311-46c4-8ecf-16723e7ac9f8-kube-api-access-d9d4v\") pod \"node-ca-pjgpg\" (UID: \"833a036f-c311-46c4-8ecf-16723e7ac9f8\") " pod="openshift-image-registry/node-ca-pjgpg" Sep 18 03:06:19.602754 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.602718 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-csnc7" Sep 18 03:06:19.612560 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.612354 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gm7zt" Sep 18 03:06:19.616796 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:19.616759 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90b7b9fc_a4d0_4f78_b04a_723ab8565584.slice/crio-1f60e153e24ff2843d9f1a32428037748f4f813277f9b5944893a777f70813f5 WatchSource:0}: Error finding container 1f60e153e24ff2843d9f1a32428037748f4f813277f9b5944893a777f70813f5: Status 404 returned error can't find the container with id 1f60e153e24ff2843d9f1a32428037748f4f813277f9b5944893a777f70813f5 Sep 18 03:06:19.622033 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.622003 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8scdz" Sep 18 03:06:19.624300 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:19.624269 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb8a24bb_d540_4fb6_9be3_2af0bd8737ec.slice/crio-dd24cac1a06ece87165bd1159e6b1f3d9d35678fc10d379792807b233fee211b WatchSource:0}: Error finding container dd24cac1a06ece87165bd1159e6b1f3d9d35678fc10d379792807b233fee211b: Status 404 returned error can't find the container with id dd24cac1a06ece87165bd1159e6b1f3d9d35678fc10d379792807b233fee211b Sep 18 03:06:19.629695 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.629667 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7kb6r" Sep 18 03:06:19.634452 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.634423 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:19.634583 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:19.634548 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2824667_7219_4da9_b4b4_125da30139e8.slice/crio-264fb24ff8cce65367147473076c65a0e01164b8485697a898cc857d761907f4 WatchSource:0}: Error finding container 264fb24ff8cce65367147473076c65a0e01164b8485697a898cc857d761907f4: Status 404 returned error can't find the container with id 264fb24ff8cce65367147473076c65a0e01164b8485697a898cc857d761907f4 Sep 18 03:06:19.642615 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.642402 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" Sep 18 03:06:19.648749 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.648488 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmt9l" Sep 18 03:06:19.656980 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.656788 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l6ln7" Sep 18 03:06:19.660344 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:19.660298 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf519c6c1_a46c_46a8_9911_0a795fdcf765.slice/crio-a9f993c56000b844236da23db66d4633e142da9454f5fc911807a13ae8048377 WatchSource:0}: Error finding container a9f993c56000b844236da23db66d4633e142da9454f5fc911807a13ae8048377: Status 404 returned error can't find the container with id a9f993c56000b844236da23db66d4633e142da9454f5fc911807a13ae8048377 Sep 18 03:06:19.662693 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.662512 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pjgpg" Sep 18 03:06:19.670695 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:19.670662 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod087e1ae9_2029_4e0f_b7ff_a79e5cab3349.slice/crio-6ea2520db135eb71d4c727938d3bd9db3df65c57b06410e6669c7ed50aec3daf WatchSource:0}: Error finding container 6ea2520db135eb71d4c727938d3bd9db3df65c57b06410e6669c7ed50aec3daf: Status 404 returned error can't find the container with id 6ea2520db135eb71d4c727938d3bd9db3df65c57b06410e6669c7ed50aec3daf Sep 18 03:06:19.672968 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:19.672936 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ffb6d5a_a4e0_444c_986e_282a57ed1add.slice/crio-a7bdc5ede1f2f9b01c0d003086c752c3ce38c4c2e2c93d46f48f3f19d8dd0fe6 WatchSource:0}: Error finding container a7bdc5ede1f2f9b01c0d003086c752c3ce38c4c2e2c93d46f48f3f19d8dd0fe6: Status 404 returned error can't find the container with id a7bdc5ede1f2f9b01c0d003086c752c3ce38c4c2e2c93d46f48f3f19d8dd0fe6 Sep 18 03:06:19.680902 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:19.680868 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod833a036f_c311_46c4_8ecf_16723e7ac9f8.slice/crio-3bc4fbadb01193494c7332a005d895455b11f70e811d2a3f7f4cb6e4b73e73b9 WatchSource:0}: Error finding container 3bc4fbadb01193494c7332a005d895455b11f70e811d2a3f7f4cb6e4b73e73b9: Status 404 returned error can't find the container with id 3bc4fbadb01193494c7332a005d895455b11f70e811d2a3f7f4cb6e4b73e73b9 Sep 18 03:06:19.925046 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.925008 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03534b6e-babc-44ea-a841-499edea9d492-original-pull-secret\") pod \"global-pull-secret-syncer-fxdpf\" (UID: \"03534b6e-babc-44ea-a841-499edea9d492\") " pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:19.925247 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:19.925068 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8ba3428-efa3-42f0-acad-0e524f361a50-metrics-certs\") pod \"network-metrics-daemon-zcq59\" (UID: \"d8ba3428-efa3-42f0-acad-0e524f361a50\") " pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:06:19.925247 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:19.925196 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:06:19.925351 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:19.925271 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8ba3428-efa3-42f0-acad-0e524f361a50-metrics-certs podName:d8ba3428-efa3-42f0-acad-0e524f361a50 nodeName:}" failed. No retries permitted until 2026-09-18 03:06:20.925250408 +0000 UTC m=+5.521203522 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8ba3428-efa3-42f0-acad-0e524f361a50-metrics-certs") pod "network-metrics-daemon-zcq59" (UID: "d8ba3428-efa3-42f0-acad-0e524f361a50") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:06:19.925351 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:19.925195 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 03:06:19.925473 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:19.925362 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03534b6e-babc-44ea-a841-499edea9d492-original-pull-secret podName:03534b6e-babc-44ea-a841-499edea9d492 nodeName:}" failed. No retries permitted until 2026-09-18 03:06:20.925336988 +0000 UTC m=+5.521290088 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03534b6e-babc-44ea-a841-499edea9d492-original-pull-secret") pod "global-pull-secret-syncer-fxdpf" (UID: "03534b6e-babc-44ea-a841-499edea9d492") : object "kube-system"/"original-pull-secret" not registered Sep 18 03:06:20.026103 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:20.026053 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhgdz\" (UniqueName: \"kubernetes.io/projected/94f7ec49-0a27-460a-90cc-16cb68d9beb9-kube-api-access-mhgdz\") pod \"network-check-target-g4zw8\" (UID: \"94f7ec49-0a27-460a-90cc-16cb68d9beb9\") " pod="openshift-network-diagnostics/network-check-target-g4zw8" Sep 18 03:06:20.026321 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:20.026218 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 03:06:20.026321 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:20.026243 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 03:06:20.026321 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:20.026253 2578 projected.go:196] Error preparing data for projected volume kube-api-access-mhgdz for pod openshift-network-diagnostics/network-check-target-g4zw8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:06:20.026321 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:20.026310 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94f7ec49-0a27-460a-90cc-16cb68d9beb9-kube-api-access-mhgdz podName:94f7ec49-0a27-460a-90cc-16cb68d9beb9 nodeName:}" failed. No retries permitted until 2026-09-18 03:06:21.026295782 +0000 UTC m=+5.622248880 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mhgdz" (UniqueName: "kubernetes.io/projected/94f7ec49-0a27-460a-90cc-16cb68d9beb9-kube-api-access-mhgdz") pod "network-check-target-g4zw8" (UID: "94f7ec49-0a27-460a-90cc-16cb68d9beb9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:06:20.130826 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:20.130798 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 03:06:20.364679 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:20.364625 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 03:01:19 +0000 UTC" deadline="2028-04-30 04:46:39.738208242 +0000 UTC" Sep 18 03:06:20.364679 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:20.364672 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14161h40m19.373538598s" Sep 18 03:06:20.452208 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:20.451942 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:20.452208 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:20.452076 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxdpf" podUID="03534b6e-babc-44ea-a841-499edea9d492" Sep 18 03:06:20.460482 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:20.460378 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" event={"ID":"2f86f967-298e-4b3b-98fe-40efc67fdf9f","Type":"ContainerStarted","Data":"3da883ad8e693e6feb5fb4c7803cb993a0ab995833e332e3d4589783e7194860"} Sep 18 03:06:20.461934 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:20.461873 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7kb6r" event={"ID":"b489d687-b213-4c1a-afb2-ed7e2f710493","Type":"ContainerStarted","Data":"c414f317a15c39433c30afbdf0a0ccd379803ce918673add1d310df930c7de66"} Sep 18 03:06:20.463238 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:20.463165 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pjgpg" event={"ID":"833a036f-c311-46c4-8ecf-16723e7ac9f8","Type":"ContainerStarted","Data":"3bc4fbadb01193494c7332a005d895455b11f70e811d2a3f7f4cb6e4b73e73b9"} Sep 18 03:06:20.464752 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:20.464655 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l6ln7" event={"ID":"2ffb6d5a-a4e0-444c-986e-282a57ed1add","Type":"ContainerStarted","Data":"a7bdc5ede1f2f9b01c0d003086c752c3ce38c4c2e2c93d46f48f3f19d8dd0fe6"} Sep 18 03:06:20.466021 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:20.465958 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8scdz" event={"ID":"c2824667-7219-4da9-b4b4-125da30139e8","Type":"ContainerStarted","Data":"264fb24ff8cce65367147473076c65a0e01164b8485697a898cc857d761907f4"} Sep 18 03:06:20.467387 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:20.467360 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gm7zt" event={"ID":"fb8a24bb-d540-4fb6-9be3-2af0bd8737ec","Type":"ContainerStarted","Data":"dd24cac1a06ece87165bd1159e6b1f3d9d35678fc10d379792807b233fee211b"} Sep 18 03:06:20.468839 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:20.468811 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-csnc7" event={"ID":"90b7b9fc-a4d0-4f78-b04a-723ab8565584","Type":"ContainerStarted","Data":"1f60e153e24ff2843d9f1a32428037748f4f813277f9b5944893a777f70813f5"} Sep 18 03:06:20.470129 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:20.470106 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmt9l" event={"ID":"087e1ae9-2029-4e0f-b7ff-a79e5cab3349","Type":"ContainerStarted","Data":"6ea2520db135eb71d4c727938d3bd9db3df65c57b06410e6669c7ed50aec3daf"} Sep 18 03:06:20.471484 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:20.471461 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" event={"ID":"f519c6c1-a46c-46a8-9911-0a795fdcf765","Type":"ContainerStarted","Data":"a9f993c56000b844236da23db66d4633e142da9454f5fc911807a13ae8048377"} Sep 18 03:06:20.933953 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:20.933910 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03534b6e-babc-44ea-a841-499edea9d492-original-pull-secret\") pod \"global-pull-secret-syncer-fxdpf\" (UID: \"03534b6e-babc-44ea-a841-499edea9d492\") " pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:20.934127 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:20.933979 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8ba3428-efa3-42f0-acad-0e524f361a50-metrics-certs\") pod \"network-metrics-daemon-zcq59\" (UID: \"d8ba3428-efa3-42f0-acad-0e524f361a50\") " pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:06:20.934127 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:20.934094 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:06:20.934127 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:20.934095 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 03:06:20.934283 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:20.934158 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8ba3428-efa3-42f0-acad-0e524f361a50-metrics-certs podName:d8ba3428-efa3-42f0-acad-0e524f361a50 nodeName:}" failed. No retries permitted until 2026-09-18 03:06:22.934139196 +0000 UTC m=+7.530092308 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8ba3428-efa3-42f0-acad-0e524f361a50-metrics-certs") pod "network-metrics-daemon-zcq59" (UID: "d8ba3428-efa3-42f0-acad-0e524f361a50") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:06:20.934283 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:20.934177 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03534b6e-babc-44ea-a841-499edea9d492-original-pull-secret podName:03534b6e-babc-44ea-a841-499edea9d492 nodeName:}" failed. No retries permitted until 2026-09-18 03:06:22.934167465 +0000 UTC m=+7.530120568 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03534b6e-babc-44ea-a841-499edea9d492-original-pull-secret") pod "global-pull-secret-syncer-fxdpf" (UID: "03534b6e-babc-44ea-a841-499edea9d492") : object "kube-system"/"original-pull-secret" not registered Sep 18 03:06:21.034406 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:21.034363 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhgdz\" (UniqueName: \"kubernetes.io/projected/94f7ec49-0a27-460a-90cc-16cb68d9beb9-kube-api-access-mhgdz\") pod \"network-check-target-g4zw8\" (UID: \"94f7ec49-0a27-460a-90cc-16cb68d9beb9\") " pod="openshift-network-diagnostics/network-check-target-g4zw8" Sep 18 03:06:21.034584 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:21.034570 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 03:06:21.034668 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:21.034593 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 03:06:21.034668 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:21.034606 2578 projected.go:196] Error preparing data for projected volume kube-api-access-mhgdz for pod openshift-network-diagnostics/network-check-target-g4zw8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:06:21.034773 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:21.034668 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94f7ec49-0a27-460a-90cc-16cb68d9beb9-kube-api-access-mhgdz podName:94f7ec49-0a27-460a-90cc-16cb68d9beb9 nodeName:}" failed. No retries permitted until 2026-09-18 03:06:23.0346495 +0000 UTC m=+7.630602615 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mhgdz" (UniqueName: "kubernetes.io/projected/94f7ec49-0a27-460a-90cc-16cb68d9beb9-kube-api-access-mhgdz") pod "network-check-target-g4zw8" (UID: "94f7ec49-0a27-460a-90cc-16cb68d9beb9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:06:21.371223 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:21.370928 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 03:01:19 +0000 UTC" deadline="2028-06-01 10:12:46.691458382 +0000 UTC" Sep 18 03:06:21.371223 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:21.371202 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14935h6m25.320264651s" Sep 18 03:06:21.451273 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:21.451127 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:06:21.451429 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:21.451329 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcq59" podUID="d8ba3428-efa3-42f0-acad-0e524f361a50" Sep 18 03:06:21.452085 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:21.451916 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4zw8" Sep 18 03:06:21.452085 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:21.452022 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4zw8" podUID="94f7ec49-0a27-460a-90cc-16cb68d9beb9" Sep 18 03:06:21.520570 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:21.517660 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-38.ec2.internal" event={"ID":"057a0ec2fb9c26d68b86efbdbfc5dfe9","Type":"ContainerStarted","Data":"ae8ebfac33386f8d564a36cb121a3120726374636b1250bf4b0d2d5004795c36"} Sep 18 03:06:21.533742 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:21.533492 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-38.ec2.internal" podStartSLOduration=3.5334679060000003 podStartE2EDuration="3.533467906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:06:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:06:21.533361073 +0000 UTC m=+6.129314194" watchObservedRunningTime="2026-09-18 03:06:21.533467906 +0000 UTC m=+6.129421027" Sep 18 03:06:22.451654 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:22.451617 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:22.452129 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:22.451750 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxdpf" podUID="03534b6e-babc-44ea-a841-499edea9d492" Sep 18 03:06:22.524433 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:22.523757 2578 generic.go:356] "Generic (PLEG): container finished" podID="1464c738f5162da5f46c52a035e4932a" containerID="5fc9563ac63c2cf473957bca4995382cc5e86845ae4b96337641d55cca2dd37f" exitCode=0 Sep 18 03:06:22.524433 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:22.523967 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal" event={"ID":"1464c738f5162da5f46c52a035e4932a","Type":"ContainerDied","Data":"5fc9563ac63c2cf473957bca4995382cc5e86845ae4b96337641d55cca2dd37f"} Sep 18 03:06:22.950086 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:22.950049 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03534b6e-babc-44ea-a841-499edea9d492-original-pull-secret\") pod \"global-pull-secret-syncer-fxdpf\" (UID: \"03534b6e-babc-44ea-a841-499edea9d492\") " pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:22.950282 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:22.950095 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8ba3428-efa3-42f0-acad-0e524f361a50-metrics-certs\") pod \"network-metrics-daemon-zcq59\" (UID: \"d8ba3428-efa3-42f0-acad-0e524f361a50\") " pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:06:22.950282 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:22.950228 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:06:22.950407 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:22.950291 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8ba3428-efa3-42f0-acad-0e524f361a50-metrics-certs podName:d8ba3428-efa3-42f0-acad-0e524f361a50 nodeName:}" failed. No retries permitted until 2026-09-18 03:06:26.950273525 +0000 UTC m=+11.546226643 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8ba3428-efa3-42f0-acad-0e524f361a50-metrics-certs") pod "network-metrics-daemon-zcq59" (UID: "d8ba3428-efa3-42f0-acad-0e524f361a50") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:06:22.950707 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:22.950606 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 03:06:22.950707 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:22.950678 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03534b6e-babc-44ea-a841-499edea9d492-original-pull-secret podName:03534b6e-babc-44ea-a841-499edea9d492 nodeName:}" failed. No retries permitted until 2026-09-18 03:06:26.950660104 +0000 UTC m=+11.546613204 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03534b6e-babc-44ea-a841-499edea9d492-original-pull-secret") pod "global-pull-secret-syncer-fxdpf" (UID: "03534b6e-babc-44ea-a841-499edea9d492") : object "kube-system"/"original-pull-secret" not registered Sep 18 03:06:23.050472 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:23.050435 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhgdz\" (UniqueName: \"kubernetes.io/projected/94f7ec49-0a27-460a-90cc-16cb68d9beb9-kube-api-access-mhgdz\") pod \"network-check-target-g4zw8\" (UID: \"94f7ec49-0a27-460a-90cc-16cb68d9beb9\") " pod="openshift-network-diagnostics/network-check-target-g4zw8" Sep 18 03:06:23.050668 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:23.050625 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 03:06:23.050668 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:23.050649 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 03:06:23.050668 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:23.050663 2578 projected.go:196] Error preparing data for projected volume kube-api-access-mhgdz for pod openshift-network-diagnostics/network-check-target-g4zw8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:06:23.050832 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:23.050722 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94f7ec49-0a27-460a-90cc-16cb68d9beb9-kube-api-access-mhgdz podName:94f7ec49-0a27-460a-90cc-16cb68d9beb9 nodeName:}" failed. No retries permitted until 2026-09-18 03:06:27.050703131 +0000 UTC m=+11.646656233 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mhgdz" (UniqueName: "kubernetes.io/projected/94f7ec49-0a27-460a-90cc-16cb68d9beb9-kube-api-access-mhgdz") pod "network-check-target-g4zw8" (UID: "94f7ec49-0a27-460a-90cc-16cb68d9beb9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:06:23.462469 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:23.462435 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:06:23.462938 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:23.462582 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcq59" podUID="d8ba3428-efa3-42f0-acad-0e524f361a50" Sep 18 03:06:23.463019 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:23.462979 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4zw8" Sep 18 03:06:23.463106 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:23.463071 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4zw8" podUID="94f7ec49-0a27-460a-90cc-16cb68d9beb9" Sep 18 03:06:24.452285 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:24.451715 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:24.452285 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:24.451856 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxdpf" podUID="03534b6e-babc-44ea-a841-499edea9d492" Sep 18 03:06:25.455692 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:25.455613 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:06:25.456137 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:25.455760 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcq59" podUID="d8ba3428-efa3-42f0-acad-0e524f361a50" Sep 18 03:06:25.456137 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:25.455613 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4zw8" Sep 18 03:06:25.456137 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:25.455872 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4zw8" podUID="94f7ec49-0a27-460a-90cc-16cb68d9beb9" Sep 18 03:06:26.451464 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:26.451415 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:26.451660 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:26.451571 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxdpf" podUID="03534b6e-babc-44ea-a841-499edea9d492" Sep 18 03:06:26.982290 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:26.982248 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03534b6e-babc-44ea-a841-499edea9d492-original-pull-secret\") pod \"global-pull-secret-syncer-fxdpf\" (UID: \"03534b6e-babc-44ea-a841-499edea9d492\") " pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:26.982791 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:26.982316 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8ba3428-efa3-42f0-acad-0e524f361a50-metrics-certs\") pod \"network-metrics-daemon-zcq59\" (UID: \"d8ba3428-efa3-42f0-acad-0e524f361a50\") " pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:06:26.982791 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:26.982477 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:06:26.982791 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:26.982504 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 03:06:26.982791 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:26.982551 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8ba3428-efa3-42f0-acad-0e524f361a50-metrics-certs podName:d8ba3428-efa3-42f0-acad-0e524f361a50 nodeName:}" failed. No retries permitted until 2026-09-18 03:06:34.982529954 +0000 UTC m=+19.578483055 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8ba3428-efa3-42f0-acad-0e524f361a50-metrics-certs") pod "network-metrics-daemon-zcq59" (UID: "d8ba3428-efa3-42f0-acad-0e524f361a50") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:06:26.982791 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:26.982570 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03534b6e-babc-44ea-a841-499edea9d492-original-pull-secret podName:03534b6e-babc-44ea-a841-499edea9d492 nodeName:}" failed. No retries permitted until 2026-09-18 03:06:34.982561162 +0000 UTC m=+19.578514263 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03534b6e-babc-44ea-a841-499edea9d492-original-pull-secret") pod "global-pull-secret-syncer-fxdpf" (UID: "03534b6e-babc-44ea-a841-499edea9d492") : object "kube-system"/"original-pull-secret" not registered Sep 18 03:06:27.083582 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:27.083432 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhgdz\" (UniqueName: \"kubernetes.io/projected/94f7ec49-0a27-460a-90cc-16cb68d9beb9-kube-api-access-mhgdz\") pod \"network-check-target-g4zw8\" (UID: \"94f7ec49-0a27-460a-90cc-16cb68d9beb9\") " pod="openshift-network-diagnostics/network-check-target-g4zw8" Sep 18 03:06:27.083757 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:27.083657 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 03:06:27.083757 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:27.083692 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 03:06:27.083757 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:27.083708 2578 projected.go:196] Error preparing data for projected volume kube-api-access-mhgdz for pod openshift-network-diagnostics/network-check-target-g4zw8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:06:27.083932 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:27.083774 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94f7ec49-0a27-460a-90cc-16cb68d9beb9-kube-api-access-mhgdz podName:94f7ec49-0a27-460a-90cc-16cb68d9beb9 nodeName:}" failed. No retries permitted until 2026-09-18 03:06:35.083754937 +0000 UTC m=+19.679708036 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mhgdz" (UniqueName: "kubernetes.io/projected/94f7ec49-0a27-460a-90cc-16cb68d9beb9-kube-api-access-mhgdz") pod "network-check-target-g4zw8" (UID: "94f7ec49-0a27-460a-90cc-16cb68d9beb9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:06:27.452497 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:27.452460 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4zw8" Sep 18 03:06:27.452685 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:27.452579 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4zw8" podUID="94f7ec49-0a27-460a-90cc-16cb68d9beb9" Sep 18 03:06:27.452957 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:27.452933 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:06:27.453081 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:27.453059 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcq59" podUID="d8ba3428-efa3-42f0-acad-0e524f361a50" Sep 18 03:06:28.452287 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:28.452012 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:28.452287 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:28.452171 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxdpf" podUID="03534b6e-babc-44ea-a841-499edea9d492" Sep 18 03:06:29.452320 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:29.451721 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:06:29.452320 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:29.451882 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcq59" podUID="d8ba3428-efa3-42f0-acad-0e524f361a50" Sep 18 03:06:29.452320 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:29.452095 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4zw8" Sep 18 03:06:29.452320 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:29.452217 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4zw8" podUID="94f7ec49-0a27-460a-90cc-16cb68d9beb9" Sep 18 03:06:30.451818 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:30.451776 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:30.451990 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:30.451908 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxdpf" podUID="03534b6e-babc-44ea-a841-499edea9d492" Sep 18 03:06:31.451405 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:31.451363 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4zw8" Sep 18 03:06:31.451898 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:31.451422 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:06:31.451898 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:31.451503 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4zw8" podUID="94f7ec49-0a27-460a-90cc-16cb68d9beb9" Sep 18 03:06:31.451898 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:31.451644 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcq59" podUID="d8ba3428-efa3-42f0-acad-0e524f361a50" Sep 18 03:06:32.451868 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:32.451822 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:32.452334 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:32.451974 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxdpf" podUID="03534b6e-babc-44ea-a841-499edea9d492" Sep 18 03:06:33.451721 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:33.451656 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:06:33.451919 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:33.451656 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4zw8" Sep 18 03:06:33.452304 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:33.451922 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4zw8" podUID="94f7ec49-0a27-460a-90cc-16cb68d9beb9" Sep 18 03:06:33.452304 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:33.451791 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcq59" podUID="d8ba3428-efa3-42f0-acad-0e524f361a50" Sep 18 03:06:34.451499 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:34.451462 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:34.451677 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:34.451585 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxdpf" podUID="03534b6e-babc-44ea-a841-499edea9d492" Sep 18 03:06:35.047724 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:35.047683 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03534b6e-babc-44ea-a841-499edea9d492-original-pull-secret\") pod \"global-pull-secret-syncer-fxdpf\" (UID: \"03534b6e-babc-44ea-a841-499edea9d492\") " pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:35.048154 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:35.047739 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8ba3428-efa3-42f0-acad-0e524f361a50-metrics-certs\") pod \"network-metrics-daemon-zcq59\" (UID: \"d8ba3428-efa3-42f0-acad-0e524f361a50\") " pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:06:35.048154 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:35.047844 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:06:35.048154 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:35.047849 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 03:06:35.048154 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:35.047916 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8ba3428-efa3-42f0-acad-0e524f361a50-metrics-certs podName:d8ba3428-efa3-42f0-acad-0e524f361a50 nodeName:}" failed. No retries permitted until 2026-09-18 03:06:51.047897039 +0000 UTC m=+35.643850139 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8ba3428-efa3-42f0-acad-0e524f361a50-metrics-certs") pod "network-metrics-daemon-zcq59" (UID: "d8ba3428-efa3-42f0-acad-0e524f361a50") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:06:35.048154 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:35.047931 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03534b6e-babc-44ea-a841-499edea9d492-original-pull-secret podName:03534b6e-babc-44ea-a841-499edea9d492 nodeName:}" failed. No retries permitted until 2026-09-18 03:06:51.047924706 +0000 UTC m=+35.643877804 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03534b6e-babc-44ea-a841-499edea9d492-original-pull-secret") pod "global-pull-secret-syncer-fxdpf" (UID: "03534b6e-babc-44ea-a841-499edea9d492") : object "kube-system"/"original-pull-secret" not registered Sep 18 03:06:35.148899 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:35.148855 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhgdz\" (UniqueName: \"kubernetes.io/projected/94f7ec49-0a27-460a-90cc-16cb68d9beb9-kube-api-access-mhgdz\") pod \"network-check-target-g4zw8\" (UID: \"94f7ec49-0a27-460a-90cc-16cb68d9beb9\") " pod="openshift-network-diagnostics/network-check-target-g4zw8" Sep 18 03:06:35.149081 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:35.149026 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 03:06:35.149081 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:35.149049 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 03:06:35.149081 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:35.149058 2578 projected.go:196] Error preparing data for projected volume kube-api-access-mhgdz for pod openshift-network-diagnostics/network-check-target-g4zw8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:06:35.149225 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:35.149127 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94f7ec49-0a27-460a-90cc-16cb68d9beb9-kube-api-access-mhgdz podName:94f7ec49-0a27-460a-90cc-16cb68d9beb9 nodeName:}" failed. No retries permitted until 2026-09-18 03:06:51.149109815 +0000 UTC m=+35.745062937 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mhgdz" (UniqueName: "kubernetes.io/projected/94f7ec49-0a27-460a-90cc-16cb68d9beb9-kube-api-access-mhgdz") pod "network-check-target-g4zw8" (UID: "94f7ec49-0a27-460a-90cc-16cb68d9beb9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:06:35.451426 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:35.451393 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4zw8" Sep 18 03:06:35.451615 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:35.451393 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:06:35.451615 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:35.451518 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4zw8" podUID="94f7ec49-0a27-460a-90cc-16cb68d9beb9" Sep 18 03:06:35.451697 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:35.451611 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcq59" podUID="d8ba3428-efa3-42f0-acad-0e524f361a50" Sep 18 03:06:36.452013 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:36.451978 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:36.452451 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:36.452113 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxdpf" podUID="03534b6e-babc-44ea-a841-499edea9d492" Sep 18 03:06:37.451747 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:37.451710 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:06:37.451903 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:37.451817 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcq59" podUID="d8ba3428-efa3-42f0-acad-0e524f361a50" Sep 18 03:06:37.451903 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:37.451862 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4zw8" Sep 18 03:06:37.451977 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:37.451947 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4zw8" podUID="94f7ec49-0a27-460a-90cc-16cb68d9beb9" Sep 18 03:06:38.451223 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:38.450988 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:38.451799 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:38.451338 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxdpf" podUID="03534b6e-babc-44ea-a841-499edea9d492" Sep 18 03:06:38.563496 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:38.563471 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mthtg_2f86f967-298e-4b3b-98fe-40efc67fdf9f/ovn-acl-logging/0.log" Sep 18 03:06:38.563842 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:38.563817 2578 generic.go:356] "Generic (PLEG): container finished" podID="2f86f967-298e-4b3b-98fe-40efc67fdf9f" containerID="b44983b3aa0bbd0b736a6006b5d2a75ef6557213881af4c4e96d1069c8cbbaf2" exitCode=1 Sep 18 03:06:38.563905 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:38.563886 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" event={"ID":"2f86f967-298e-4b3b-98fe-40efc67fdf9f","Type":"ContainerStarted","Data":"cba68d21c7b5f898f28c2febb457e227c9634f7f80f29832d6a15dc01ca8ab13"} Sep 18 03:06:38.563965 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:38.563951 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" event={"ID":"2f86f967-298e-4b3b-98fe-40efc67fdf9f","Type":"ContainerStarted","Data":"74d2b21a317c941a579cd476628854ff0c9680634e2bca1ef98384525c6b85c0"} Sep 18 03:06:38.564007 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:38.563985 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" event={"ID":"2f86f967-298e-4b3b-98fe-40efc67fdf9f","Type":"ContainerStarted","Data":"7aff9c1659630ed7b393f50953637aeeaf8c7c9a5cf0a265a9133ac2a8ff4c32"} Sep 18 03:06:38.564041 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:38.564023 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" event={"ID":"2f86f967-298e-4b3b-98fe-40efc67fdf9f","Type":"ContainerStarted","Data":"fda4a63cd8d5fff71d2be256847d6e04bd53b51d3e1500a35b022b6d7b6ac8ca"} Sep 18 03:06:38.564084 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:38.564052 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" event={"ID":"2f86f967-298e-4b3b-98fe-40efc67fdf9f","Type":"ContainerDied","Data":"b44983b3aa0bbd0b736a6006b5d2a75ef6557213881af4c4e96d1069c8cbbaf2"} Sep 18 03:06:38.564084 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:38.564082 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" event={"ID":"2f86f967-298e-4b3b-98fe-40efc67fdf9f","Type":"ContainerStarted","Data":"c05c549c71c0a277ba6d8180b2eac21ed6b0f6c298035bb5acece428b11c82b7"} Sep 18 03:06:38.565495 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:38.565466 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7kb6r" event={"ID":"b489d687-b213-4c1a-afb2-ed7e2f710493","Type":"ContainerStarted","Data":"33b763865e75a76a14dce9c14fdc95b25c1387688ed98398b296599a4968e788"} Sep 18 03:06:38.567646 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:38.567624 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal" event={"ID":"1464c738f5162da5f46c52a035e4932a","Type":"ContainerStarted","Data":"ef0cc0aa355a0556fd7ab7482f8bd9dde35ab5f51946b99763362c963ef0e6d0"} Sep 18 03:06:38.569862 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:38.569807 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pjgpg" event={"ID":"833a036f-c311-46c4-8ecf-16723e7ac9f8","Type":"ContainerStarted","Data":"9fef7fca7fa87a8900fc7ea324fba9c587fe6fbd760c460bb870abe82826504c"} Sep 18 03:06:38.574207 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:38.574162 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l6ln7" event={"ID":"2ffb6d5a-a4e0-444c-986e-282a57ed1add","Type":"ContainerStarted","Data":"67ea16efb775dca4e7cc4e555dc158cb518c703988a916eed6d9400af101f2a2"} Sep 18 03:06:38.575604 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:38.575586 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8scdz" event={"ID":"c2824667-7219-4da9-b4b4-125da30139e8","Type":"ContainerStarted","Data":"b800dddb62903aacc4ce09e0f55112e61c95188c74e5e62271f942bc319c98b1"} Sep 18 03:06:38.577206 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:38.577162 2578 generic.go:356] "Generic (PLEG): container finished" podID="90b7b9fc-a4d0-4f78-b04a-723ab8565584" containerID="db61cf5c219b18273ec6e60a63bf405cd08c4b10d8f7b54ba3a8b3e5540740b8" exitCode=0 Sep 18 03:06:38.577280 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:38.577211 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-csnc7" event={"ID":"90b7b9fc-a4d0-4f78-b04a-723ab8565584","Type":"ContainerDied","Data":"db61cf5c219b18273ec6e60a63bf405cd08c4b10d8f7b54ba3a8b3e5540740b8"} Sep 18 03:06:38.578838 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:38.578817 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmt9l" event={"ID":"087e1ae9-2029-4e0f-b7ff-a79e5cab3349","Type":"ContainerStarted","Data":"ee7b570fca82033f7fa49273798a2084dd049979b274a193524a976da1cb187f"} Sep 18 03:06:38.580296 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:38.580275 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" event={"ID":"f519c6c1-a46c-46a8-9911-0a795fdcf765","Type":"ContainerStarted","Data":"f8363b049fc8ee04c7c74c934e9c15ab4371602bc5c381b4aaad5093c0ad0329"} Sep 18 03:06:38.607471 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:38.607431 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7kb6r" podStartSLOduration=3.460466639 podStartE2EDuration="21.607416317s" totalImagesPullingTime="18.146949678s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:06:38.588594473 +0000 UTC m=+23.184547626" watchObservedRunningTime="2026-09-18 03:06:38.607416317 +0000 UTC m=+23.203369438" Sep 18 03:06:38.629115 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:38.629061 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5vv6r" podStartSLOduration=2.544191934 podStartE2EDuration="20.629041955s" totalImagesPullingTime="18.084850021s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:06:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:06:38.609304087 +0000 UTC m=+23.205257206" watchObservedRunningTime="2026-09-18 03:06:38.629041955 +0000 UTC m=+23.224995077" Sep 18 03:06:38.629393 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:38.629356 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-l6ln7" podStartSLOduration=2.619357213 podStartE2EDuration="20.629348567s" totalImagesPullingTime="18.009991354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:06:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:06:38.628664091 +0000 UTC m=+23.224617213" watchObservedRunningTime="2026-09-18 03:06:38.629348567 +0000 UTC m=+23.225301686" Sep 18 03:06:38.669669 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:38.669597 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pjgpg" podStartSLOduration=2.6671972029999997 podStartE2EDuration="20.669575896s" totalImagesPullingTime="18.002378693s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:06:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:06:38.649063643 +0000 UTC m=+23.245016764" watchObservedRunningTime="2026-09-18 03:06:38.669575896 +0000 UTC m=+23.265529017" Sep 18 03:06:38.692974 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:38.692915 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-38.ec2.internal" podStartSLOduration=20.692893105 podStartE2EDuration="20.692893105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:06:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:06:38.669007933 +0000 UTC m=+23.264961054" watchObservedRunningTime="2026-09-18 03:06:38.692893105 +0000 UTC m=+23.288846226" Sep 18 03:06:39.378106 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:39.378080 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 18 03:06:39.383151 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:39.383045 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T03:06:39.378099129Z","UUID":"6d70e045-0925-44e1-b528-913e0e35e65b","Handler":null,"Name":"","Endpoint":""} Sep 18 03:06:39.384905 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:39.384877 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 18 03:06:39.385007 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:39.384912 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 18 03:06:39.451826 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:39.451789 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:06:39.452346 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:39.451789 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4zw8" Sep 18 03:06:39.452346 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:39.451944 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcq59" podUID="d8ba3428-efa3-42f0-acad-0e524f361a50" Sep 18 03:06:39.452346 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:39.452007 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4zw8" podUID="94f7ec49-0a27-460a-90cc-16cb68d9beb9" Sep 18 03:06:39.583706 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:39.583627 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmt9l" event={"ID":"087e1ae9-2029-4e0f-b7ff-a79e5cab3349","Type":"ContainerStarted","Data":"f7297f75736ba48dbe6d81e32d54f9d62b5898d9df2a7ce0d1f480488d4beda1"} Sep 18 03:06:39.584996 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:39.584963 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gm7zt" event={"ID":"fb8a24bb-d540-4fb6-9be3-2af0bd8737ec","Type":"ContainerStarted","Data":"c1aaae47e41f80e5b48445a8c8c53421ef1e7a88f7ade0f57fd88bcf895bd5b2"} Sep 18 03:06:39.603370 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:39.603320 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8scdz" podStartSLOduration=8.700086673 podStartE2EDuration="22.603302205s" totalImagesPullingTime="13.903215532s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:06:38.711671344 +0000 UTC m=+23.307624465" watchObservedRunningTime="2026-09-18 03:06:39.603302205 +0000 UTC m=+24.199255303" Sep 18 03:06:40.451548 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:40.451498 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:40.451714 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:40.451616 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxdpf" podUID="03534b6e-babc-44ea-a841-499edea9d492" Sep 18 03:06:41.039567 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:41.039308 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-l6ln7" Sep 18 03:06:41.040282 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:41.040256 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-l6ln7" Sep 18 03:06:41.060462 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:41.060406 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gm7zt" podStartSLOduration=5.957404252 podStartE2EDuration="24.060387279s" totalImagesPullingTime="18.102983027s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:06:39.605057477 +0000 UTC m=+24.201010597" watchObservedRunningTime="2026-09-18 03:06:41.060387279 +0000 UTC m=+25.656340403" Sep 18 03:06:41.452069 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:41.452039 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4zw8" Sep 18 03:06:41.452278 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:41.452135 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4zw8" podUID="94f7ec49-0a27-460a-90cc-16cb68d9beb9" Sep 18 03:06:41.452278 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:41.452211 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:06:41.452416 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:41.452329 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcq59" podUID="d8ba3428-efa3-42f0-acad-0e524f361a50" Sep 18 03:06:41.591969 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:41.591932 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmt9l" event={"ID":"087e1ae9-2029-4e0f-b7ff-a79e5cab3349","Type":"ContainerStarted","Data":"dff6a3e4dd211038727a617e80d15b2542f3fa0b6992def5ec7fd7ed0b872aed"} Sep 18 03:06:41.597464 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:41.597383 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mthtg_2f86f967-298e-4b3b-98fe-40efc67fdf9f/ovn-acl-logging/0.log" Sep 18 03:06:41.597913 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:41.597859 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" event={"ID":"2f86f967-298e-4b3b-98fe-40efc67fdf9f","Type":"ContainerStarted","Data":"2b156b13586b9d893954730547a76ebbab1154bb61073804ebf36f2d2ff0ea08"} Sep 18 03:06:41.613591 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:41.613555 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmt9l" podStartSLOduration=7.091839142 podStartE2EDuration="23.613540381s" totalImagesPullingTime="16.521701239s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:06:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:06:41.612765473 +0000 UTC m=+26.208718587" watchObservedRunningTime="2026-09-18 03:06:41.613540381 +0000 UTC m=+26.209493502" Sep 18 03:06:42.450969 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:42.450938 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:42.451638 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:42.451054 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxdpf" podUID="03534b6e-babc-44ea-a841-499edea9d492" Sep 18 03:06:43.451792 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:43.451746 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:06:43.452386 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:43.451797 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4zw8" Sep 18 03:06:43.452386 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:43.451877 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcq59" podUID="d8ba3428-efa3-42f0-acad-0e524f361a50" Sep 18 03:06:43.452386 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:43.451963 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4zw8" podUID="94f7ec49-0a27-460a-90cc-16cb68d9beb9" Sep 18 03:06:44.445107 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:44.445078 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-l6ln7" Sep 18 03:06:44.445278 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:44.445263 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 18 03:06:44.445749 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:44.445734 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-l6ln7" Sep 18 03:06:44.451889 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:44.451872 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:44.452221 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:44.451965 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxdpf" podUID="03534b6e-babc-44ea-a841-499edea9d492" Sep 18 03:06:44.607941 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:44.607776 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mthtg_2f86f967-298e-4b3b-98fe-40efc67fdf9f/ovn-acl-logging/0.log" Sep 18 03:06:44.608275 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:44.608252 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" event={"ID":"2f86f967-298e-4b3b-98fe-40efc67fdf9f","Type":"ContainerStarted","Data":"9be98f58bd53039796b8ee952e736007fa250a4c2b0fd5647ad2eeafb6f3de15"} Sep 18 03:06:44.608508 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:44.608486 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:44.608612 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:44.608560 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:44.608692 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:44.608678 2578 scope.go:117] "RemoveContainer" containerID="b44983b3aa0bbd0b736a6006b5d2a75ef6557213881af4c4e96d1069c8cbbaf2" Sep 18 03:06:44.624679 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:44.624655 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:45.451362 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:45.451329 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:06:45.451557 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:45.451329 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4zw8" Sep 18 03:06:45.451557 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:45.451439 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcq59" podUID="d8ba3428-efa3-42f0-acad-0e524f361a50" Sep 18 03:06:45.451557 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:45.451508 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4zw8" podUID="94f7ec49-0a27-460a-90cc-16cb68d9beb9" Sep 18 03:06:45.614142 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:45.614115 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mthtg_2f86f967-298e-4b3b-98fe-40efc67fdf9f/ovn-acl-logging/0.log" Sep 18 03:06:45.614580 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:45.614530 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" event={"ID":"2f86f967-298e-4b3b-98fe-40efc67fdf9f","Type":"ContainerStarted","Data":"78907013bef4f1cb9bea8322bbcee37358c6a60363b6ea62a9d7ffff552603df"} Sep 18 03:06:45.614706 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:45.614682 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:45.616449 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:45.616425 2578 generic.go:356] "Generic (PLEG): container finished" podID="90b7b9fc-a4d0-4f78-b04a-723ab8565584" containerID="eeda7970a52d57ee3f3f90d4a111f7d4863022159ec0e51c8630b411c2d2b33c" exitCode=0 Sep 18 03:06:45.616558 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:45.616460 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-csnc7" event={"ID":"90b7b9fc-a4d0-4f78-b04a-723ab8565584","Type":"ContainerDied","Data":"eeda7970a52d57ee3f3f90d4a111f7d4863022159ec0e51c8630b411c2d2b33c"} Sep 18 03:06:45.630481 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:45.630456 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:06:45.716930 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:45.716791 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" podStartSLOduration=10.596494604 podStartE2EDuration="28.716767509s" totalImagesPullingTime="18.120272905s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:06:45.672071469 +0000 UTC m=+30.268024599" watchObservedRunningTime="2026-09-18 03:06:45.716767509 +0000 UTC m=+30.312720608" Sep 18 03:06:46.451529 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:46.451498 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:46.451662 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:46.451610 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxdpf" podUID="03534b6e-babc-44ea-a841-499edea9d492" Sep 18 03:06:46.642599 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:46.642573 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-g4zw8"] Sep 18 03:06:46.642984 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:46.642678 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4zw8" Sep 18 03:06:46.642984 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:46.642783 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4zw8" podUID="94f7ec49-0a27-460a-90cc-16cb68d9beb9" Sep 18 03:06:46.645169 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:46.645144 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fxdpf"] Sep 18 03:06:46.645295 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:46.645273 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:46.645428 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:46.645376 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxdpf" podUID="03534b6e-babc-44ea-a841-499edea9d492" Sep 18 03:06:46.645795 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:46.645773 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zcq59"] Sep 18 03:06:46.645907 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:46.645865 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:06:46.645954 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:46.645941 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcq59" podUID="d8ba3428-efa3-42f0-acad-0e524f361a50" Sep 18 03:06:47.623230 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:47.623193 2578 generic.go:356] "Generic (PLEG): container finished" podID="90b7b9fc-a4d0-4f78-b04a-723ab8565584" containerID="8bcf71b431aff0b99ff341804077dbb790d8ffcf938027a079df49a677789a05" exitCode=0 Sep 18 03:06:47.623389 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:47.623273 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-csnc7" event={"ID":"90b7b9fc-a4d0-4f78-b04a-723ab8565584","Type":"ContainerDied","Data":"8bcf71b431aff0b99ff341804077dbb790d8ffcf938027a079df49a677789a05"} Sep 18 03:06:48.451406 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:48.451372 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:06:48.451915 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:48.451422 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:48.451915 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:48.451381 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4zw8" Sep 18 03:06:48.451915 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:48.451508 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcq59" podUID="d8ba3428-efa3-42f0-acad-0e524f361a50" Sep 18 03:06:48.451915 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:48.451581 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4zw8" podUID="94f7ec49-0a27-460a-90cc-16cb68d9beb9" Sep 18 03:06:48.451915 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:48.451687 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxdpf" podUID="03534b6e-babc-44ea-a841-499edea9d492" Sep 18 03:06:49.629591 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:49.629556 2578 generic.go:356] "Generic (PLEG): container finished" podID="90b7b9fc-a4d0-4f78-b04a-723ab8565584" containerID="96d738d4c2a7ab7aa3255d160f4d987bb8ae4e6f5a6daded1506b1f378e1cdd3" exitCode=0 Sep 18 03:06:49.630048 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:49.629603 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-csnc7" event={"ID":"90b7b9fc-a4d0-4f78-b04a-723ab8565584","Type":"ContainerDied","Data":"96d738d4c2a7ab7aa3255d160f4d987bb8ae4e6f5a6daded1506b1f378e1cdd3"} Sep 18 03:06:50.451344 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.451317 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:06:50.451478 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.451351 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4zw8" Sep 18 03:06:50.451478 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.451353 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:50.451478 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:50.451424 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcq59" podUID="d8ba3428-efa3-42f0-acad-0e524f361a50" Sep 18 03:06:50.451581 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:50.451504 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4zw8" podUID="94f7ec49-0a27-460a-90cc-16cb68d9beb9" Sep 18 03:06:50.451581 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:50.451575 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxdpf" podUID="03534b6e-babc-44ea-a841-499edea9d492" Sep 18 03:06:50.787833 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.787739 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-38.ec2.internal" event="NodeReady" Sep 18 03:06:50.788444 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.787897 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 18 03:06:50.845619 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.845580 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d846bf499-n47kw"] Sep 18 03:06:50.865603 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.865573 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:06:50.870065 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.870040 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 18 03:06:50.870316 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.870129 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 18 03:06:50.872291 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.872248 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qwc8j\"" Sep 18 03:06:50.872865 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.872843 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 18 03:06:50.873813 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.873784 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d846bf499-n47kw"] Sep 18 03:06:50.877455 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.877437 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 18 03:06:50.886044 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.886022 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vvz5b"] Sep 18 03:06:50.902901 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.902875 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kzq2n"] Sep 18 03:06:50.903101 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.903083 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vvz5b" Sep 18 03:06:50.909242 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.909196 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 18 03:06:50.909338 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.909250 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 18 03:06:50.909416 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.909394 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-h5848\"" Sep 18 03:06:50.909471 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.909447 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 18 03:06:50.925044 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.925019 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kzq2n"] Sep 18 03:06:50.925159 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.925136 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kzq2n" Sep 18 03:06:50.928780 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.928762 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zf6js\"" Sep 18 03:06:50.928880 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.928790 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vvz5b"] Sep 18 03:06:50.928880 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.928823 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 18 03:06:50.929137 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.929117 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 18 03:06:50.959229 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.959201 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-certificates\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:06:50.959353 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.959261 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-tls\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:06:50.959353 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.959334 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nls76\" (UniqueName: \"kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-kube-api-access-nls76\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:06:50.959465 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.959404 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2125c521-5e13-4541-9230-f8f93bd5cdbd-trusted-ca\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:06:50.959465 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.959435 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2125c521-5e13-4541-9230-f8f93bd5cdbd-image-registry-private-configuration\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:06:50.959568 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.959469 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2125c521-5e13-4541-9230-f8f93bd5cdbd-ca-trust-extracted\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:06:50.959568 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.959509 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2125c521-5e13-4541-9230-f8f93bd5cdbd-installation-pull-secrets\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:06:50.959568 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:50.959549 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-bound-sa-token\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:06:51.060967 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.060871 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2125c521-5e13-4541-9230-f8f93bd5cdbd-trusted-ca\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:06:51.061441 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.060923 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/851f3001-1c5d-4201-be57-76d2fb4c4e52-metrics-tls\") pod \"dns-default-kzq2n\" (UID: \"851f3001-1c5d-4201-be57-76d2fb4c4e52\") " pod="openshift-dns/dns-default-kzq2n" Sep 18 03:06:51.061441 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.061353 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2125c521-5e13-4541-9230-f8f93bd5cdbd-image-registry-private-configuration\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:06:51.061666 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.061639 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2125c521-5e13-4541-9230-f8f93bd5cdbd-ca-trust-extracted\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:06:51.061722 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.061708 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2125c521-5e13-4541-9230-f8f93bd5cdbd-installation-pull-secrets\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:06:51.063525 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.062478 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2125c521-5e13-4541-9230-f8f93bd5cdbd-ca-trust-extracted\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:06:51.063525 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.063126 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2125c521-5e13-4541-9230-f8f93bd5cdbd-trusted-ca\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:06:51.063525 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.063222 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-bound-sa-token\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:06:51.063525 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.063323 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-certificates\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:06:51.063525 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.063358 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03534b6e-babc-44ea-a841-499edea9d492-original-pull-secret\") pod \"global-pull-secret-syncer-fxdpf\" (UID: \"03534b6e-babc-44ea-a841-499edea9d492\") " pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:51.063525 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.063402 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-tls\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:06:51.063525 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.063439 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b347ac1a-6339-4018-9726-ec04debd21e1-cert\") pod \"ingress-canary-vvz5b\" (UID: \"b347ac1a-6339-4018-9726-ec04debd21e1\") " pod="openshift-ingress-canary/ingress-canary-vvz5b" Sep 18 03:06:51.063525 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.063461 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x74td\" (UniqueName: \"kubernetes.io/projected/b347ac1a-6339-4018-9726-ec04debd21e1-kube-api-access-x74td\") pod \"ingress-canary-vvz5b\" (UID: \"b347ac1a-6339-4018-9726-ec04debd21e1\") " pod="openshift-ingress-canary/ingress-canary-vvz5b" Sep 18 03:06:51.063525 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.063493 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/851f3001-1c5d-4201-be57-76d2fb4c4e52-config-volume\") pod \"dns-default-kzq2n\" (UID: \"851f3001-1c5d-4201-be57-76d2fb4c4e52\") " pod="openshift-dns/dns-default-kzq2n" Sep 18 03:06:51.063525 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.063524 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/851f3001-1c5d-4201-be57-76d2fb4c4e52-tmp-dir\") pod \"dns-default-kzq2n\" (UID: \"851f3001-1c5d-4201-be57-76d2fb4c4e52\") " pod="openshift-dns/dns-default-kzq2n" Sep 18 03:06:51.064012 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.063554 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8ba3428-efa3-42f0-acad-0e524f361a50-metrics-certs\") pod \"network-metrics-daemon-zcq59\" (UID: \"d8ba3428-efa3-42f0-acad-0e524f361a50\") " pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:06:51.064012 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.063588 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nls76\" (UniqueName: \"kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-kube-api-access-nls76\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:06:51.064012 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.063617 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc2zt\" (UniqueName: \"kubernetes.io/projected/851f3001-1c5d-4201-be57-76d2fb4c4e52-kube-api-access-jc2zt\") pod \"dns-default-kzq2n\" (UID: \"851f3001-1c5d-4201-be57-76d2fb4c4e52\") " pod="openshift-dns/dns-default-kzq2n" Sep 18 03:06:51.064211 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.064172 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-certificates\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:06:51.064329 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:51.064311 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 03:06:51.064416 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:51.064403 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03534b6e-babc-44ea-a841-499edea9d492-original-pull-secret podName:03534b6e-babc-44ea-a841-499edea9d492 nodeName:}" failed. No retries permitted until 2026-09-18 03:07:23.064374312 +0000 UTC m=+67.660327425 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03534b6e-babc-44ea-a841-499edea9d492-original-pull-secret") pod "global-pull-secret-syncer-fxdpf" (UID: "03534b6e-babc-44ea-a841-499edea9d492") : object "kube-system"/"original-pull-secret" not registered Sep 18 03:06:51.065101 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:51.065078 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 03:06:51.065101 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:51.065102 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d846bf499-n47kw: secret "image-registry-tls" not found Sep 18 03:06:51.065273 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:51.065157 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-tls podName:2125c521-5e13-4541-9230-f8f93bd5cdbd nodeName:}" failed. No retries permitted until 2026-09-18 03:06:51.565141061 +0000 UTC m=+36.161094174 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-tls") pod "image-registry-5d846bf499-n47kw" (UID: "2125c521-5e13-4541-9230-f8f93bd5cdbd") : secret "image-registry-tls" not found Sep 18 03:06:51.065340 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:51.065308 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:06:51.065393 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:51.065359 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8ba3428-efa3-42f0-acad-0e524f361a50-metrics-certs podName:d8ba3428-efa3-42f0-acad-0e524f361a50 nodeName:}" failed. No retries permitted until 2026-09-18 03:07:23.065344477 +0000 UTC m=+67.661297575 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8ba3428-efa3-42f0-acad-0e524f361a50-metrics-certs") pod "network-metrics-daemon-zcq59" (UID: "d8ba3428-efa3-42f0-acad-0e524f361a50") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 03:06:51.066989 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.066656 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2125c521-5e13-4541-9230-f8f93bd5cdbd-installation-pull-secrets\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:06:51.067722 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.067702 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2125c521-5e13-4541-9230-f8f93bd5cdbd-image-registry-private-configuration\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:06:51.075340 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.075318 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-bound-sa-token\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:06:51.077293 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.077270 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nls76\" (UniqueName: \"kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-kube-api-access-nls76\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:06:51.164547 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.164514 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b347ac1a-6339-4018-9726-ec04debd21e1-cert\") pod \"ingress-canary-vvz5b\" (UID: \"b347ac1a-6339-4018-9726-ec04debd21e1\") " pod="openshift-ingress-canary/ingress-canary-vvz5b" Sep 18 03:06:51.164547 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.164549 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x74td\" (UniqueName: \"kubernetes.io/projected/b347ac1a-6339-4018-9726-ec04debd21e1-kube-api-access-x74td\") pod \"ingress-canary-vvz5b\" (UID: \"b347ac1a-6339-4018-9726-ec04debd21e1\") " pod="openshift-ingress-canary/ingress-canary-vvz5b" Sep 18 03:06:51.164754 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.164574 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/851f3001-1c5d-4201-be57-76d2fb4c4e52-config-volume\") pod \"dns-default-kzq2n\" (UID: \"851f3001-1c5d-4201-be57-76d2fb4c4e52\") " pod="openshift-dns/dns-default-kzq2n" Sep 18 03:06:51.164754 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.164600 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/851f3001-1c5d-4201-be57-76d2fb4c4e52-tmp-dir\") pod \"dns-default-kzq2n\" (UID: \"851f3001-1c5d-4201-be57-76d2fb4c4e52\") " pod="openshift-dns/dns-default-kzq2n" Sep 18 03:06:51.164754 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.164638 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc2zt\" (UniqueName: \"kubernetes.io/projected/851f3001-1c5d-4201-be57-76d2fb4c4e52-kube-api-access-jc2zt\") pod \"dns-default-kzq2n\" (UID: \"851f3001-1c5d-4201-be57-76d2fb4c4e52\") " pod="openshift-dns/dns-default-kzq2n" Sep 18 03:06:51.164754 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.164666 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/851f3001-1c5d-4201-be57-76d2fb4c4e52-metrics-tls\") pod \"dns-default-kzq2n\" (UID: \"851f3001-1c5d-4201-be57-76d2fb4c4e52\") " pod="openshift-dns/dns-default-kzq2n" Sep 18 03:06:51.164754 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.164711 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhgdz\" (UniqueName: \"kubernetes.io/projected/94f7ec49-0a27-460a-90cc-16cb68d9beb9-kube-api-access-mhgdz\") pod \"network-check-target-g4zw8\" (UID: \"94f7ec49-0a27-460a-90cc-16cb68d9beb9\") " pod="openshift-network-diagnostics/network-check-target-g4zw8" Sep 18 03:06:51.164981 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:51.164815 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 03:06:51.164981 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:51.164824 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 03:06:51.164981 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:51.164835 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 03:06:51.164981 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:51.164938 2578 projected.go:196] Error preparing data for projected volume kube-api-access-mhgdz for pod openshift-network-diagnostics/network-check-target-g4zw8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:06:51.165151 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:51.164925 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/851f3001-1c5d-4201-be57-76d2fb4c4e52-metrics-tls podName:851f3001-1c5d-4201-be57-76d2fb4c4e52 nodeName:}" failed. No retries permitted until 2026-09-18 03:06:51.664902414 +0000 UTC m=+36.260855533 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/851f3001-1c5d-4201-be57-76d2fb4c4e52-metrics-tls") pod "dns-default-kzq2n" (UID: "851f3001-1c5d-4201-be57-76d2fb4c4e52") : secret "dns-default-metrics-tls" not found Sep 18 03:06:51.165151 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:51.165014 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94f7ec49-0a27-460a-90cc-16cb68d9beb9-kube-api-access-mhgdz podName:94f7ec49-0a27-460a-90cc-16cb68d9beb9 nodeName:}" failed. No retries permitted until 2026-09-18 03:07:23.164998048 +0000 UTC m=+67.760951146 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mhgdz" (UniqueName: "kubernetes.io/projected/94f7ec49-0a27-460a-90cc-16cb68d9beb9-kube-api-access-mhgdz") pod "network-check-target-g4zw8" (UID: "94f7ec49-0a27-460a-90cc-16cb68d9beb9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 03:06:51.165151 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.165025 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/851f3001-1c5d-4201-be57-76d2fb4c4e52-tmp-dir\") pod \"dns-default-kzq2n\" (UID: \"851f3001-1c5d-4201-be57-76d2fb4c4e52\") " pod="openshift-dns/dns-default-kzq2n" Sep 18 03:06:51.165278 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.165205 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/851f3001-1c5d-4201-be57-76d2fb4c4e52-config-volume\") pod \"dns-default-kzq2n\" (UID: \"851f3001-1c5d-4201-be57-76d2fb4c4e52\") " pod="openshift-dns/dns-default-kzq2n" Sep 18 03:06:51.166971 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.166950 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b347ac1a-6339-4018-9726-ec04debd21e1-cert\") pod \"ingress-canary-vvz5b\" (UID: \"b347ac1a-6339-4018-9726-ec04debd21e1\") " pod="openshift-ingress-canary/ingress-canary-vvz5b" Sep 18 03:06:51.175799 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.175778 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc2zt\" (UniqueName: \"kubernetes.io/projected/851f3001-1c5d-4201-be57-76d2fb4c4e52-kube-api-access-jc2zt\") pod \"dns-default-kzq2n\" (UID: \"851f3001-1c5d-4201-be57-76d2fb4c4e52\") " pod="openshift-dns/dns-default-kzq2n" Sep 18 03:06:51.176412 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.176395 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x74td\" (UniqueName: \"kubernetes.io/projected/b347ac1a-6339-4018-9726-ec04debd21e1-kube-api-access-x74td\") pod \"ingress-canary-vvz5b\" (UID: \"b347ac1a-6339-4018-9726-ec04debd21e1\") " pod="openshift-ingress-canary/ingress-canary-vvz5b" Sep 18 03:06:51.206687 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.206655 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l6ln7_2ffb6d5a-a4e0-444c-986e-282a57ed1add/konnectivity-agent/0.log" limit=1024 Sep 18 03:06:51.213348 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.213325 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vvz5b" Sep 18 03:06:51.322916 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.322734 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l6ln7_2ffb6d5a-a4e0-444c-986e-282a57ed1add/konnectivity-agent/0.log" limit=1024 Sep 18 03:06:51.542354 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.542323 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vvz5b"] Sep 18 03:06:51.552849 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:06:51.552823 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb347ac1a_6339_4018_9726_ec04debd21e1.slice/crio-40c400ef8beb037109d9d1ac43026840f5800a70ddcacf14de928e49db887a92 WatchSource:0}: Error finding container 40c400ef8beb037109d9d1ac43026840f5800a70ddcacf14de928e49db887a92: Status 404 returned error can't find the container with id 40c400ef8beb037109d9d1ac43026840f5800a70ddcacf14de928e49db887a92 Sep 18 03:06:51.567324 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.567298 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-tls\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:06:51.567453 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:51.567434 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 03:06:51.567492 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:51.567455 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d846bf499-n47kw: secret "image-registry-tls" not found Sep 18 03:06:51.567527 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:51.567503 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-tls podName:2125c521-5e13-4541-9230-f8f93bd5cdbd nodeName:}" failed. No retries permitted until 2026-09-18 03:06:52.567488594 +0000 UTC m=+37.163441691 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-tls") pod "image-registry-5d846bf499-n47kw" (UID: "2125c521-5e13-4541-9230-f8f93bd5cdbd") : secret "image-registry-tls" not found Sep 18 03:06:51.636978 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.636887 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vvz5b" event={"ID":"b347ac1a-6339-4018-9726-ec04debd21e1","Type":"ContainerStarted","Data":"40c400ef8beb037109d9d1ac43026840f5800a70ddcacf14de928e49db887a92"} Sep 18 03:06:51.668338 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:51.668305 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/851f3001-1c5d-4201-be57-76d2fb4c4e52-metrics-tls\") pod \"dns-default-kzq2n\" (UID: \"851f3001-1c5d-4201-be57-76d2fb4c4e52\") " pod="openshift-dns/dns-default-kzq2n" Sep 18 03:06:51.668519 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:51.668472 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 03:06:51.668564 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:51.668535 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/851f3001-1c5d-4201-be57-76d2fb4c4e52-metrics-tls podName:851f3001-1c5d-4201-be57-76d2fb4c4e52 nodeName:}" failed. No retries permitted until 2026-09-18 03:06:52.668516517 +0000 UTC m=+37.264469633 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/851f3001-1c5d-4201-be57-76d2fb4c4e52-metrics-tls") pod "dns-default-kzq2n" (UID: "851f3001-1c5d-4201-be57-76d2fb4c4e52") : secret "dns-default-metrics-tls" not found Sep 18 03:06:52.451222 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:52.451174 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:06:52.451923 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:52.451306 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4zw8" Sep 18 03:06:52.451923 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:52.451341 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:06:52.454546 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:52.454523 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 03:06:52.454667 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:52.454575 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 03:06:52.454810 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:52.454793 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 03:06:52.455491 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:52.455399 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 03:06:52.455491 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:52.455460 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hxvn5\"" Sep 18 03:06:52.455491 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:52.455486 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2hctc\"" Sep 18 03:06:52.576032 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:52.575999 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-tls\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:06:52.576220 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:52.576198 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 03:06:52.576220 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:52.576220 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d846bf499-n47kw: secret "image-registry-tls" not found Sep 18 03:06:52.576340 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:52.576280 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-tls podName:2125c521-5e13-4541-9230-f8f93bd5cdbd nodeName:}" failed. No retries permitted until 2026-09-18 03:06:54.576264015 +0000 UTC m=+39.172217113 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-tls") pod "image-registry-5d846bf499-n47kw" (UID: "2125c521-5e13-4541-9230-f8f93bd5cdbd") : secret "image-registry-tls" not found Sep 18 03:06:52.676512 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:52.676476 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/851f3001-1c5d-4201-be57-76d2fb4c4e52-metrics-tls\") pod \"dns-default-kzq2n\" (UID: \"851f3001-1c5d-4201-be57-76d2fb4c4e52\") " pod="openshift-dns/dns-default-kzq2n" Sep 18 03:06:52.676704 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:52.676681 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 03:06:52.676777 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:52.676767 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/851f3001-1c5d-4201-be57-76d2fb4c4e52-metrics-tls podName:851f3001-1c5d-4201-be57-76d2fb4c4e52 nodeName:}" failed. No retries permitted until 2026-09-18 03:06:54.676745433 +0000 UTC m=+39.272698548 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/851f3001-1c5d-4201-be57-76d2fb4c4e52-metrics-tls") pod "dns-default-kzq2n" (UID: "851f3001-1c5d-4201-be57-76d2fb4c4e52") : secret "dns-default-metrics-tls" not found Sep 18 03:06:54.183363 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:54.183319 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l6ln7_2ffb6d5a-a4e0-444c-986e-282a57ed1add/konnectivity-agent/0.log" limit=1024 Sep 18 03:06:54.274965 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:54.274920 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l6ln7_2ffb6d5a-a4e0-444c-986e-282a57ed1add/konnectivity-agent/0.log" limit=1024 Sep 18 03:06:54.592091 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:54.592056 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-tls\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:06:54.592338 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:54.592222 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 03:06:54.592338 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:54.592241 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d846bf499-n47kw: secret "image-registry-tls" not found Sep 18 03:06:54.592338 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:54.592307 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-tls podName:2125c521-5e13-4541-9230-f8f93bd5cdbd nodeName:}" failed. No retries permitted until 2026-09-18 03:06:58.592289716 +0000 UTC m=+43.188242814 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-tls") pod "image-registry-5d846bf499-n47kw" (UID: "2125c521-5e13-4541-9230-f8f93bd5cdbd") : secret "image-registry-tls" not found Sep 18 03:06:54.693157 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:54.693119 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/851f3001-1c5d-4201-be57-76d2fb4c4e52-metrics-tls\") pod \"dns-default-kzq2n\" (UID: \"851f3001-1c5d-4201-be57-76d2fb4c4e52\") " pod="openshift-dns/dns-default-kzq2n" Sep 18 03:06:54.693363 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:54.693277 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 03:06:54.693363 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:54.693363 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/851f3001-1c5d-4201-be57-76d2fb4c4e52-metrics-tls podName:851f3001-1c5d-4201-be57-76d2fb4c4e52 nodeName:}" failed. No retries permitted until 2026-09-18 03:06:58.693340146 +0000 UTC m=+43.289293249 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/851f3001-1c5d-4201-be57-76d2fb4c4e52-metrics-tls") pod "dns-default-kzq2n" (UID: "851f3001-1c5d-4201-be57-76d2fb4c4e52") : secret "dns-default-metrics-tls" not found Sep 18 03:06:55.220010 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:55.219901 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l6ln7_2ffb6d5a-a4e0-444c-986e-282a57ed1add/konnectivity-agent/0.log" limit=1024 Sep 18 03:06:55.307826 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:55.307779 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l6ln7_2ffb6d5a-a4e0-444c-986e-282a57ed1add/konnectivity-agent/0.log" limit=1024 Sep 18 03:06:55.691089 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:55.691052 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l6ln7_2ffb6d5a-a4e0-444c-986e-282a57ed1add/konnectivity-agent/0.log" limit=1024 Sep 18 03:06:56.065804 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:56.065769 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l6ln7_2ffb6d5a-a4e0-444c-986e-282a57ed1add/konnectivity-agent/0.log" limit=1024 Sep 18 03:06:56.159559 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:56.159519 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l6ln7_2ffb6d5a-a4e0-444c-986e-282a57ed1add/konnectivity-agent/0.log" limit=1024 Sep 18 03:06:56.650440 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:56.650403 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vvz5b" event={"ID":"b347ac1a-6339-4018-9726-ec04debd21e1","Type":"ContainerStarted","Data":"2fdb1bbacc3d29c042b844538085d17b087959a595e145b969eb5fc4f0aae8c1"} Sep 18 03:06:56.653148 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:56.653120 2578 generic.go:356] "Generic (PLEG): container finished" podID="90b7b9fc-a4d0-4f78-b04a-723ab8565584" containerID="299280647f9dbd7960efaf4645424addc64bb8af212f411cbf439b70b0ab75b5" exitCode=0 Sep 18 03:06:56.653306 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:56.653159 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-csnc7" event={"ID":"90b7b9fc-a4d0-4f78-b04a-723ab8565584","Type":"ContainerDied","Data":"299280647f9dbd7960efaf4645424addc64bb8af212f411cbf439b70b0ab75b5"} Sep 18 03:06:56.690039 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:56.689985 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vvz5b" podStartSLOduration=2.623957946 podStartE2EDuration="6.689967372s" totalImagesPullingTime="4.066009426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:06:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:06:56.689640986 +0000 UTC m=+41.285594106" watchObservedRunningTime="2026-09-18 03:06:56.689967372 +0000 UTC m=+41.285920493" Sep 18 03:06:57.017831 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:57.017743 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l6ln7_2ffb6d5a-a4e0-444c-986e-282a57ed1add/konnectivity-agent/0.log" limit=1024 Sep 18 03:06:57.658668 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:57.658629 2578 generic.go:356] "Generic (PLEG): container finished" podID="90b7b9fc-a4d0-4f78-b04a-723ab8565584" containerID="2df399f59a4529bc2969f75cbc7c6aa2791e7a147c3f11b4a16a8d4a52954b26" exitCode=0 Sep 18 03:06:57.659115 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:57.658701 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-csnc7" event={"ID":"90b7b9fc-a4d0-4f78-b04a-723ab8565584","Type":"ContainerDied","Data":"2df399f59a4529bc2969f75cbc7c6aa2791e7a147c3f11b4a16a8d4a52954b26"} Sep 18 03:06:58.627575 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:58.627534 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-tls\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:06:58.627748 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:58.627658 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 03:06:58.627748 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:58.627670 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d846bf499-n47kw: secret "image-registry-tls" not found Sep 18 03:06:58.627748 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:58.627730 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-tls podName:2125c521-5e13-4541-9230-f8f93bd5cdbd nodeName:}" failed. No retries permitted until 2026-09-18 03:07:06.627716848 +0000 UTC m=+51.223669946 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-tls") pod "image-registry-5d846bf499-n47kw" (UID: "2125c521-5e13-4541-9230-f8f93bd5cdbd") : secret "image-registry-tls" not found Sep 18 03:06:58.664663 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:58.664625 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-csnc7" event={"ID":"90b7b9fc-a4d0-4f78-b04a-723ab8565584","Type":"ContainerStarted","Data":"6c518114925d3168babbdc03748e5ee22c349d2f7d7a9f39e7ab3fcdb339c7d9"} Sep 18 03:06:58.728795 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:58.728750 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/851f3001-1c5d-4201-be57-76d2fb4c4e52-metrics-tls\") pod \"dns-default-kzq2n\" (UID: \"851f3001-1c5d-4201-be57-76d2fb4c4e52\") " pod="openshift-dns/dns-default-kzq2n" Sep 18 03:06:58.728975 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:58.728896 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 03:06:58.728975 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:06:58.728954 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/851f3001-1c5d-4201-be57-76d2fb4c4e52-metrics-tls podName:851f3001-1c5d-4201-be57-76d2fb4c4e52 nodeName:}" failed. No retries permitted until 2026-09-18 03:07:06.728937626 +0000 UTC m=+51.324890724 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/851f3001-1c5d-4201-be57-76d2fb4c4e52-metrics-tls") pod "dns-default-kzq2n" (UID: "851f3001-1c5d-4201-be57-76d2fb4c4e52") : secret "dns-default-metrics-tls" not found Sep 18 03:06:58.921333 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:58.921248 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l6ln7_2ffb6d5a-a4e0-444c-986e-282a57ed1add/konnectivity-agent/0.log" limit=1024 Sep 18 03:06:59.070429 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:06:59.070401 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-l6ln7_2ffb6d5a-a4e0-444c-986e-282a57ed1add/konnectivity-agent/0.log" limit=1024 Sep 18 03:07:06.688161 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:07:06.688115 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-tls\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:07:06.688577 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:07:06.688284 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 03:07:06.688577 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:07:06.688299 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d846bf499-n47kw: secret "image-registry-tls" not found Sep 18 03:07:06.688577 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:07:06.688359 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-tls podName:2125c521-5e13-4541-9230-f8f93bd5cdbd nodeName:}" failed. No retries permitted until 2026-09-18 03:07:22.68834268 +0000 UTC m=+67.284295778 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-tls") pod "image-registry-5d846bf499-n47kw" (UID: "2125c521-5e13-4541-9230-f8f93bd5cdbd") : secret "image-registry-tls" not found Sep 18 03:07:06.789481 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:07:06.789442 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/851f3001-1c5d-4201-be57-76d2fb4c4e52-metrics-tls\") pod \"dns-default-kzq2n\" (UID: \"851f3001-1c5d-4201-be57-76d2fb4c4e52\") " pod="openshift-dns/dns-default-kzq2n" Sep 18 03:07:06.789653 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:07:06.789575 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 03:07:06.789653 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:07:06.789637 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/851f3001-1c5d-4201-be57-76d2fb4c4e52-metrics-tls podName:851f3001-1c5d-4201-be57-76d2fb4c4e52 nodeName:}" failed. No retries permitted until 2026-09-18 03:07:22.789621566 +0000 UTC m=+67.385574664 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/851f3001-1c5d-4201-be57-76d2fb4c4e52-metrics-tls") pod "dns-default-kzq2n" (UID: "851f3001-1c5d-4201-be57-76d2fb4c4e52") : secret "dns-default-metrics-tls" not found Sep 18 03:07:17.643938 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:07:17.643904 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mthtg" Sep 18 03:07:17.683711 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:07:17.683652 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-csnc7" podStartSLOduration=28.174162666 podStartE2EDuration="1m0.683635965s" totalImagesPullingTime="32.509473299s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:06:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:06:58.698013733 +0000 UTC m=+43.293966869" watchObservedRunningTime="2026-09-18 03:07:17.683635965 +0000 UTC m=+62.279589086" Sep 18 03:07:22.707060 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:07:22.707013 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-tls\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:07:22.707569 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:07:22.707200 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 03:07:22.707569 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:07:22.707222 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d846bf499-n47kw: secret "image-registry-tls" not found Sep 18 03:07:22.707569 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:07:22.707293 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-tls podName:2125c521-5e13-4541-9230-f8f93bd5cdbd nodeName:}" failed. No retries permitted until 2026-09-18 03:07:54.707273976 +0000 UTC m=+99.303227073 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-tls") pod "image-registry-5d846bf499-n47kw" (UID: "2125c521-5e13-4541-9230-f8f93bd5cdbd") : secret "image-registry-tls" not found Sep 18 03:07:22.808026 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:07:22.807969 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/851f3001-1c5d-4201-be57-76d2fb4c4e52-metrics-tls\") pod \"dns-default-kzq2n\" (UID: \"851f3001-1c5d-4201-be57-76d2fb4c4e52\") " pod="openshift-dns/dns-default-kzq2n" Sep 18 03:07:22.808235 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:07:22.808097 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 03:07:22.808235 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:07:22.808150 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/851f3001-1c5d-4201-be57-76d2fb4c4e52-metrics-tls podName:851f3001-1c5d-4201-be57-76d2fb4c4e52 nodeName:}" failed. No retries permitted until 2026-09-18 03:07:54.80813637 +0000 UTC m=+99.404089467 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/851f3001-1c5d-4201-be57-76d2fb4c4e52-metrics-tls") pod "dns-default-kzq2n" (UID: "851f3001-1c5d-4201-be57-76d2fb4c4e52") : secret "dns-default-metrics-tls" not found Sep 18 03:07:23.111376 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:07:23.111332 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8ba3428-efa3-42f0-acad-0e524f361a50-metrics-certs\") pod \"network-metrics-daemon-zcq59\" (UID: \"d8ba3428-efa3-42f0-acad-0e524f361a50\") " pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:07:23.111550 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:07:23.111417 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03534b6e-babc-44ea-a841-499edea9d492-original-pull-secret\") pod \"global-pull-secret-syncer-fxdpf\" (UID: \"03534b6e-babc-44ea-a841-499edea9d492\") " pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:07:23.115839 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:07:23.115813 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 03:07:23.115948 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:07:23.115887 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 03:07:23.122130 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:07:23.122103 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 18 03:07:23.122234 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:07:23.122173 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8ba3428-efa3-42f0-acad-0e524f361a50-metrics-certs podName:d8ba3428-efa3-42f0-acad-0e524f361a50 nodeName:}" failed. No retries permitted until 2026-09-18 03:08:27.12215358 +0000 UTC m=+131.718106703 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8ba3428-efa3-42f0-acad-0e524f361a50-metrics-certs") pod "network-metrics-daemon-zcq59" (UID: "d8ba3428-efa3-42f0-acad-0e524f361a50") : secret "metrics-daemon-secret" not found Sep 18 03:07:23.125348 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:07:23.125325 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03534b6e-babc-44ea-a841-499edea9d492-original-pull-secret\") pod \"global-pull-secret-syncer-fxdpf\" (UID: \"03534b6e-babc-44ea-a841-499edea9d492\") " pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:07:23.211929 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:07:23.211891 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhgdz\" (UniqueName: \"kubernetes.io/projected/94f7ec49-0a27-460a-90cc-16cb68d9beb9-kube-api-access-mhgdz\") pod \"network-check-target-g4zw8\" (UID: \"94f7ec49-0a27-460a-90cc-16cb68d9beb9\") " pod="openshift-network-diagnostics/network-check-target-g4zw8" Sep 18 03:07:23.214910 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:07:23.214889 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 03:07:23.225614 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:07:23.225577 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 03:07:23.236052 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:07:23.236023 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhgdz\" (UniqueName: \"kubernetes.io/projected/94f7ec49-0a27-460a-90cc-16cb68d9beb9-kube-api-access-mhgdz\") pod \"network-check-target-g4zw8\" (UID: \"94f7ec49-0a27-460a-90cc-16cb68d9beb9\") " pod="openshift-network-diagnostics/network-check-target-g4zw8" Sep 18 03:07:23.364975 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:07:23.364879 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxdpf" Sep 18 03:07:23.376834 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:07:23.376809 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2hctc\"" Sep 18 03:07:23.384054 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:07:23.384028 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4zw8" Sep 18 03:07:23.636374 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:07:23.636284 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fxdpf"] Sep 18 03:07:23.665474 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:07:23.665434 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-g4zw8"] Sep 18 03:07:23.669124 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:07:23.669093 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94f7ec49_0a27_460a_90cc_16cb68d9beb9.slice/crio-c9f3d22fef8e5c30c6bac1e2af7beb4b57784bb38cc0c15aa4b5446095a40824 WatchSource:0}: Error finding container c9f3d22fef8e5c30c6bac1e2af7beb4b57784bb38cc0c15aa4b5446095a40824: Status 404 returned error can't find the container with id c9f3d22fef8e5c30c6bac1e2af7beb4b57784bb38cc0c15aa4b5446095a40824 Sep 18 03:07:23.723113 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:07:23.723066 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fxdpf" event={"ID":"03534b6e-babc-44ea-a841-499edea9d492","Type":"ContainerStarted","Data":"b7c8d7cefabb62f500dbbc6bdede0447af08e1c6dd0b94cf2ddb02cb8aa3b5a0"} Sep 18 03:07:23.724256 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:07:23.724228 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-g4zw8" event={"ID":"94f7ec49-0a27-460a-90cc-16cb68d9beb9","Type":"ContainerStarted","Data":"c9f3d22fef8e5c30c6bac1e2af7beb4b57784bb38cc0c15aa4b5446095a40824"} Sep 18 03:07:28.741325 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:07:28.741161 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fxdpf" event={"ID":"03534b6e-babc-44ea-a841-499edea9d492","Type":"ContainerStarted","Data":"9fd16d28f6c034e6dc4dd98077cd69278336e47a5680995be92a62b55bb2485a"} Sep 18 03:07:28.742768 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:07:28.742742 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-g4zw8" event={"ID":"94f7ec49-0a27-460a-90cc-16cb68d9beb9","Type":"ContainerStarted","Data":"56b9beaf920b7ba2f46a54a45a9f54e0474776aef27281df1980dff5ea85f8f0"} Sep 18 03:07:28.742900 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:07:28.742885 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-g4zw8" Sep 18 03:07:28.760372 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:07:28.760318 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fxdpf" podStartSLOduration=65.841954494 podStartE2EDuration="1m10.760300136s" totalImagesPullingTime="4.918345642s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:06:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:07:28.75912925 +0000 UTC m=+73.355082367" watchObservedRunningTime="2026-09-18 03:07:28.760300136 +0000 UTC m=+73.356253275" Sep 18 03:07:28.779202 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:07:28.776063 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-g4zw8" podStartSLOduration=66.888833034 podStartE2EDuration="1m11.775990685s" totalImagesPullingTime="4.887157651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:07:28.774752417 +0000 UTC m=+73.370705528" watchObservedRunningTime="2026-09-18 03:07:28.775990685 +0000 UTC m=+73.371943806" Sep 18 03:07:54.736439 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:07:54.736393 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-tls\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:07:54.736950 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:07:54.736557 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 03:07:54.736950 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:07:54.736579 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d846bf499-n47kw: secret "image-registry-tls" not found Sep 18 03:07:54.736950 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:07:54.736650 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-tls podName:2125c521-5e13-4541-9230-f8f93bd5cdbd nodeName:}" failed. No retries permitted until 2026-09-18 03:08:58.736632293 +0000 UTC m=+163.332585390 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-tls") pod "image-registry-5d846bf499-n47kw" (UID: "2125c521-5e13-4541-9230-f8f93bd5cdbd") : secret "image-registry-tls" not found Sep 18 03:07:54.837150 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:07:54.837106 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/851f3001-1c5d-4201-be57-76d2fb4c4e52-metrics-tls\") pod \"dns-default-kzq2n\" (UID: \"851f3001-1c5d-4201-be57-76d2fb4c4e52\") " pod="openshift-dns/dns-default-kzq2n" Sep 18 03:07:54.837342 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:07:54.837269 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 03:07:54.837342 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:07:54.837330 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/851f3001-1c5d-4201-be57-76d2fb4c4e52-metrics-tls podName:851f3001-1c5d-4201-be57-76d2fb4c4e52 nodeName:}" failed. No retries permitted until 2026-09-18 03:08:58.837312185 +0000 UTC m=+163.433265291 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/851f3001-1c5d-4201-be57-76d2fb4c4e52-metrics-tls") pod "dns-default-kzq2n" (UID: "851f3001-1c5d-4201-be57-76d2fb4c4e52") : secret "dns-default-metrics-tls" not found Sep 18 03:07:59.748226 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:07:59.748175 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-g4zw8" Sep 18 03:08:05.514237 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.514200 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-2rkw7"] Sep 18 03:08:05.516800 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.516781 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-2rkw7" Sep 18 03:08:05.520000 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.519978 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 18 03:08:05.520882 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.520863 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 18 03:08:05.521015 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.520902 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-qmsw5\"" Sep 18 03:08:05.521264 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.521247 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 18 03:08:05.521707 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.521682 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 18 03:08:05.525477 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.525455 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 18 03:08:05.542470 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.542431 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-2rkw7"] Sep 18 03:08:05.617905 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.617875 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/97141cd8-00c5-4fad-a218-c5536c869671-serving-cert\") pod \"insights-operator-6f9c644dd9-2rkw7\" (UID: \"97141cd8-00c5-4fad-a218-c5536c869671\") " pod="openshift-insights/insights-operator-6f9c644dd9-2rkw7" Sep 18 03:08:05.618081 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.617923 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97141cd8-00c5-4fad-a218-c5536c869671-tmp\") pod \"insights-operator-6f9c644dd9-2rkw7\" (UID: \"97141cd8-00c5-4fad-a218-c5536c869671\") " pod="openshift-insights/insights-operator-6f9c644dd9-2rkw7" Sep 18 03:08:05.618081 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.617946 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97141cd8-00c5-4fad-a218-c5536c869671-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-2rkw7\" (UID: \"97141cd8-00c5-4fad-a218-c5536c869671\") " pod="openshift-insights/insights-operator-6f9c644dd9-2rkw7" Sep 18 03:08:05.618081 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.618014 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/97141cd8-00c5-4fad-a218-c5536c869671-snapshots\") pod \"insights-operator-6f9c644dd9-2rkw7\" (UID: \"97141cd8-00c5-4fad-a218-c5536c869671\") " pod="openshift-insights/insights-operator-6f9c644dd9-2rkw7" Sep 18 03:08:05.618081 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.618063 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97141cd8-00c5-4fad-a218-c5536c869671-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-2rkw7\" (UID: \"97141cd8-00c5-4fad-a218-c5536c869671\") " pod="openshift-insights/insights-operator-6f9c644dd9-2rkw7" Sep 18 03:08:05.618259 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.618084 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czrh6\" (UniqueName: \"kubernetes.io/projected/97141cd8-00c5-4fad-a218-c5536c869671-kube-api-access-czrh6\") pod \"insights-operator-6f9c644dd9-2rkw7\" (UID: \"97141cd8-00c5-4fad-a218-c5536c869671\") " pod="openshift-insights/insights-operator-6f9c644dd9-2rkw7" Sep 18 03:08:05.628424 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.628368 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-xcvnb"] Sep 18 03:08:05.630383 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.630356 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-8zsrm"] Sep 18 03:08:05.630531 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.630496 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xcvnb" Sep 18 03:08:05.632302 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.632282 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-8zsrm" Sep 18 03:08:05.636878 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.636849 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 18 03:08:05.637023 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.636859 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 18 03:08:05.637093 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.637073 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 18 03:08:05.637366 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.637349 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-8rgsh\"" Sep 18 03:08:05.637448 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.637383 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 18 03:08:05.637448 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.637433 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-vh74j\"" Sep 18 03:08:05.637675 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.637651 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 18 03:08:05.641420 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.641395 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 18 03:08:05.641595 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.641563 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 18 03:08:05.650481 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.650452 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-xcvnb"] Sep 18 03:08:05.656267 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.656240 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-8zsrm"] Sep 18 03:08:05.719118 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.719082 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/97141cd8-00c5-4fad-a218-c5536c869671-serving-cert\") pod \"insights-operator-6f9c644dd9-2rkw7\" (UID: \"97141cd8-00c5-4fad-a218-c5536c869671\") " pod="openshift-insights/insights-operator-6f9c644dd9-2rkw7" Sep 18 03:08:05.719345 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.719131 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/af398652-bdcb-47cc-b06b-4fd71d017c19-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-8zsrm\" (UID: \"af398652-bdcb-47cc-b06b-4fd71d017c19\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-8zsrm" Sep 18 03:08:05.719345 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.719151 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79pb6\" (UniqueName: \"kubernetes.io/projected/af398652-bdcb-47cc-b06b-4fd71d017c19-kube-api-access-79pb6\") pod \"cluster-samples-operator-685d7d68b5-8zsrm\" (UID: \"af398652-bdcb-47cc-b06b-4fd71d017c19\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-8zsrm" Sep 18 03:08:05.719345 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.719167 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97141cd8-00c5-4fad-a218-c5536c869671-tmp\") pod \"insights-operator-6f9c644dd9-2rkw7\" (UID: \"97141cd8-00c5-4fad-a218-c5536c869671\") " pod="openshift-insights/insights-operator-6f9c644dd9-2rkw7" Sep 18 03:08:05.719345 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.719201 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97141cd8-00c5-4fad-a218-c5536c869671-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-2rkw7\" (UID: \"97141cd8-00c5-4fad-a218-c5536c869671\") " pod="openshift-insights/insights-operator-6f9c644dd9-2rkw7" Sep 18 03:08:05.719345 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.719298 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75371579-d5c5-47c3-a75e-ec79499e4abb-config\") pod \"service-ca-operator-57cdc4b768-xcvnb\" (UID: \"75371579-d5c5-47c3-a75e-ec79499e4abb\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xcvnb" Sep 18 03:08:05.719345 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.719333 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75371579-d5c5-47c3-a75e-ec79499e4abb-serving-cert\") pod \"service-ca-operator-57cdc4b768-xcvnb\" (UID: \"75371579-d5c5-47c3-a75e-ec79499e4abb\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xcvnb" Sep 18 03:08:05.719644 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.719358 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsrz2\" (UniqueName: \"kubernetes.io/projected/75371579-d5c5-47c3-a75e-ec79499e4abb-kube-api-access-qsrz2\") pod \"service-ca-operator-57cdc4b768-xcvnb\" (UID: \"75371579-d5c5-47c3-a75e-ec79499e4abb\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xcvnb" Sep 18 03:08:05.719644 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.719421 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/97141cd8-00c5-4fad-a218-c5536c869671-snapshots\") pod \"insights-operator-6f9c644dd9-2rkw7\" (UID: \"97141cd8-00c5-4fad-a218-c5536c869671\") " pod="openshift-insights/insights-operator-6f9c644dd9-2rkw7" Sep 18 03:08:05.719644 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.719473 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97141cd8-00c5-4fad-a218-c5536c869671-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-2rkw7\" (UID: \"97141cd8-00c5-4fad-a218-c5536c869671\") " pod="openshift-insights/insights-operator-6f9c644dd9-2rkw7" Sep 18 03:08:05.719644 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.719500 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czrh6\" (UniqueName: \"kubernetes.io/projected/97141cd8-00c5-4fad-a218-c5536c869671-kube-api-access-czrh6\") pod \"insights-operator-6f9c644dd9-2rkw7\" (UID: \"97141cd8-00c5-4fad-a218-c5536c869671\") " pod="openshift-insights/insights-operator-6f9c644dd9-2rkw7" Sep 18 03:08:05.719644 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.719589 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97141cd8-00c5-4fad-a218-c5536c869671-tmp\") pod \"insights-operator-6f9c644dd9-2rkw7\" (UID: \"97141cd8-00c5-4fad-a218-c5536c869671\") " pod="openshift-insights/insights-operator-6f9c644dd9-2rkw7" Sep 18 03:08:05.719844 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.719820 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97141cd8-00c5-4fad-a218-c5536c869671-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-2rkw7\" (UID: \"97141cd8-00c5-4fad-a218-c5536c869671\") " pod="openshift-insights/insights-operator-6f9c644dd9-2rkw7" Sep 18 03:08:05.719992 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.719975 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/97141cd8-00c5-4fad-a218-c5536c869671-snapshots\") pod \"insights-operator-6f9c644dd9-2rkw7\" (UID: \"97141cd8-00c5-4fad-a218-c5536c869671\") " pod="openshift-insights/insights-operator-6f9c644dd9-2rkw7" Sep 18 03:08:05.720565 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.720544 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97141cd8-00c5-4fad-a218-c5536c869671-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-2rkw7\" (UID: \"97141cd8-00c5-4fad-a218-c5536c869671\") " pod="openshift-insights/insights-operator-6f9c644dd9-2rkw7" Sep 18 03:08:05.721815 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.721792 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/97141cd8-00c5-4fad-a218-c5536c869671-serving-cert\") pod \"insights-operator-6f9c644dd9-2rkw7\" (UID: \"97141cd8-00c5-4fad-a218-c5536c869671\") " pod="openshift-insights/insights-operator-6f9c644dd9-2rkw7" Sep 18 03:08:05.728226 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.728202 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czrh6\" (UniqueName: \"kubernetes.io/projected/97141cd8-00c5-4fad-a218-c5536c869671-kube-api-access-czrh6\") pod \"insights-operator-6f9c644dd9-2rkw7\" (UID: \"97141cd8-00c5-4fad-a218-c5536c869671\") " pod="openshift-insights/insights-operator-6f9c644dd9-2rkw7" Sep 18 03:08:05.820074 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.820039 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/af398652-bdcb-47cc-b06b-4fd71d017c19-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-8zsrm\" (UID: \"af398652-bdcb-47cc-b06b-4fd71d017c19\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-8zsrm" Sep 18 03:08:05.820306 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.820080 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79pb6\" (UniqueName: \"kubernetes.io/projected/af398652-bdcb-47cc-b06b-4fd71d017c19-kube-api-access-79pb6\") pod \"cluster-samples-operator-685d7d68b5-8zsrm\" (UID: \"af398652-bdcb-47cc-b06b-4fd71d017c19\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-8zsrm" Sep 18 03:08:05.820306 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.820108 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75371579-d5c5-47c3-a75e-ec79499e4abb-config\") pod \"service-ca-operator-57cdc4b768-xcvnb\" (UID: \"75371579-d5c5-47c3-a75e-ec79499e4abb\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xcvnb" Sep 18 03:08:05.820306 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.820129 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75371579-d5c5-47c3-a75e-ec79499e4abb-serving-cert\") pod \"service-ca-operator-57cdc4b768-xcvnb\" (UID: \"75371579-d5c5-47c3-a75e-ec79499e4abb\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xcvnb" Sep 18 03:08:05.820306 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.820154 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsrz2\" (UniqueName: \"kubernetes.io/projected/75371579-d5c5-47c3-a75e-ec79499e4abb-kube-api-access-qsrz2\") pod \"service-ca-operator-57cdc4b768-xcvnb\" (UID: \"75371579-d5c5-47c3-a75e-ec79499e4abb\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xcvnb" Sep 18 03:08:05.820306 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:05.820228 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 18 03:08:05.820490 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:05.820314 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af398652-bdcb-47cc-b06b-4fd71d017c19-samples-operator-tls podName:af398652-bdcb-47cc-b06b-4fd71d017c19 nodeName:}" failed. No retries permitted until 2026-09-18 03:08:06.320297061 +0000 UTC m=+110.916250171 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/af398652-bdcb-47cc-b06b-4fd71d017c19-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-8zsrm" (UID: "af398652-bdcb-47cc-b06b-4fd71d017c19") : secret "samples-operator-tls" not found Sep 18 03:08:05.820753 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.820732 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75371579-d5c5-47c3-a75e-ec79499e4abb-config\") pod \"service-ca-operator-57cdc4b768-xcvnb\" (UID: \"75371579-d5c5-47c3-a75e-ec79499e4abb\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xcvnb" Sep 18 03:08:05.822425 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.822407 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75371579-d5c5-47c3-a75e-ec79499e4abb-serving-cert\") pod \"service-ca-operator-57cdc4b768-xcvnb\" (UID: \"75371579-d5c5-47c3-a75e-ec79499e4abb\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xcvnb" Sep 18 03:08:05.825446 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.825430 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-2rkw7" Sep 18 03:08:05.829321 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.829299 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsrz2\" (UniqueName: \"kubernetes.io/projected/75371579-d5c5-47c3-a75e-ec79499e4abb-kube-api-access-qsrz2\") pod \"service-ca-operator-57cdc4b768-xcvnb\" (UID: \"75371579-d5c5-47c3-a75e-ec79499e4abb\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xcvnb" Sep 18 03:08:05.829715 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.829690 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79pb6\" (UniqueName: \"kubernetes.io/projected/af398652-bdcb-47cc-b06b-4fd71d017c19-kube-api-access-79pb6\") pod \"cluster-samples-operator-685d7d68b5-8zsrm\" (UID: \"af398652-bdcb-47cc-b06b-4fd71d017c19\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-8zsrm" Sep 18 03:08:05.944025 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:05.943969 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xcvnb" Sep 18 03:08:06.114038 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:06.113981 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-2rkw7"] Sep 18 03:08:06.116467 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:08:06.116446 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97141cd8_00c5_4fad_a218_c5536c869671.slice/crio-dbe745d63fc1e80f8b59ab1e7a43b90f35179c46168f357f84d1eabb7e1c6f2b WatchSource:0}: Error finding container dbe745d63fc1e80f8b59ab1e7a43b90f35179c46168f357f84d1eabb7e1c6f2b: Status 404 returned error can't find the container with id dbe745d63fc1e80f8b59ab1e7a43b90f35179c46168f357f84d1eabb7e1c6f2b Sep 18 03:08:06.216274 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:06.216241 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-xcvnb"] Sep 18 03:08:06.219484 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:08:06.219457 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75371579_d5c5_47c3_a75e_ec79499e4abb.slice/crio-6618bfc24b179c70578e65a8eec1bd691179d5c557f0f37a466227df0aefc589 WatchSource:0}: Error finding container 6618bfc24b179c70578e65a8eec1bd691179d5c557f0f37a466227df0aefc589: Status 404 returned error can't find the container with id 6618bfc24b179c70578e65a8eec1bd691179d5c557f0f37a466227df0aefc589 Sep 18 03:08:06.325290 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:06.325253 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/af398652-bdcb-47cc-b06b-4fd71d017c19-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-8zsrm\" (UID: \"af398652-bdcb-47cc-b06b-4fd71d017c19\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-8zsrm" Sep 18 03:08:06.325481 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:06.325369 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 18 03:08:06.325481 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:06.325428 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af398652-bdcb-47cc-b06b-4fd71d017c19-samples-operator-tls podName:af398652-bdcb-47cc-b06b-4fd71d017c19 nodeName:}" failed. No retries permitted until 2026-09-18 03:08:07.325414004 +0000 UTC m=+111.921367103 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/af398652-bdcb-47cc-b06b-4fd71d017c19-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-8zsrm" (UID: "af398652-bdcb-47cc-b06b-4fd71d017c19") : secret "samples-operator-tls" not found Sep 18 03:08:06.837573 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:06.837530 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xcvnb" event={"ID":"75371579-d5c5-47c3-a75e-ec79499e4abb","Type":"ContainerStarted","Data":"6618bfc24b179c70578e65a8eec1bd691179d5c557f0f37a466227df0aefc589"} Sep 18 03:08:06.839063 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:06.839029 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-2rkw7" event={"ID":"97141cd8-00c5-4fad-a218-c5536c869671","Type":"ContainerStarted","Data":"dbe745d63fc1e80f8b59ab1e7a43b90f35179c46168f357f84d1eabb7e1c6f2b"} Sep 18 03:08:07.334296 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:07.334258 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/af398652-bdcb-47cc-b06b-4fd71d017c19-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-8zsrm\" (UID: \"af398652-bdcb-47cc-b06b-4fd71d017c19\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-8zsrm" Sep 18 03:08:07.334495 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:07.334394 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 18 03:08:07.334495 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:07.334466 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af398652-bdcb-47cc-b06b-4fd71d017c19-samples-operator-tls podName:af398652-bdcb-47cc-b06b-4fd71d017c19 nodeName:}" failed. No retries permitted until 2026-09-18 03:08:09.334450898 +0000 UTC m=+113.930403996 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/af398652-bdcb-47cc-b06b-4fd71d017c19-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-8zsrm" (UID: "af398652-bdcb-47cc-b06b-4fd71d017c19") : secret "samples-operator-tls" not found Sep 18 03:08:08.851800 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:08.851748 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xcvnb" event={"ID":"75371579-d5c5-47c3-a75e-ec79499e4abb","Type":"ContainerStarted","Data":"84f222173bcf7f6fba0cee9007c05b5c053d371623dddf291947ab0109cc85a8"} Sep 18 03:08:08.853511 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:08.853473 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-2rkw7" event={"ID":"97141cd8-00c5-4fad-a218-c5536c869671","Type":"ContainerStarted","Data":"e15e9716ff46669507dc63ecba4dc453c95869f9d7e76fa9f2d0df98892f1a7c"} Sep 18 03:08:08.870990 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:08.870926 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xcvnb" podStartSLOduration=1.402461199 podStartE2EDuration="3.870906443s" totalImagesPullingTime="2.468445244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:08:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:08:08.870605787 +0000 UTC m=+113.466558908" watchObservedRunningTime="2026-09-18 03:08:08.870906443 +0000 UTC m=+113.466859565" Sep 18 03:08:08.890695 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:08.890635 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-6f9c644dd9-2rkw7" podStartSLOduration=1.320673369 podStartE2EDuration="3.89061698s" totalImagesPullingTime="2.569943611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:08:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:08:08.889627625 +0000 UTC m=+113.485580748" watchObservedRunningTime="2026-09-18 03:08:08.89061698 +0000 UTC m=+113.486570101" Sep 18 03:08:09.348932 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:09.348875 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/af398652-bdcb-47cc-b06b-4fd71d017c19-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-8zsrm\" (UID: \"af398652-bdcb-47cc-b06b-4fd71d017c19\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-8zsrm" Sep 18 03:08:09.349124 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:09.349028 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 18 03:08:09.349124 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:09.349101 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af398652-bdcb-47cc-b06b-4fd71d017c19-samples-operator-tls podName:af398652-bdcb-47cc-b06b-4fd71d017c19 nodeName:}" failed. No retries permitted until 2026-09-18 03:08:13.349083794 +0000 UTC m=+117.945036892 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/af398652-bdcb-47cc-b06b-4fd71d017c19-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-8zsrm" (UID: "af398652-bdcb-47cc-b06b-4fd71d017c19") : secret "samples-operator-tls" not found Sep 18 03:08:10.501500 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:10.501467 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rwffz"] Sep 18 03:08:10.503722 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:10.503704 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rwffz" Sep 18 03:08:10.514365 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:10.514338 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 18 03:08:10.516498 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:10.516478 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 18 03:08:10.516598 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:10.516581 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gr8bz\"" Sep 18 03:08:10.539912 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:10.539872 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rwffz"] Sep 18 03:08:10.561117 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:10.561080 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d42a764b-488c-4735-be3a-98a5487fb603-crio-socket\") pod \"insights-runtime-extractor-rwffz\" (UID: \"d42a764b-488c-4735-be3a-98a5487fb603\") " pod="openshift-insights/insights-runtime-extractor-rwffz" Sep 18 03:08:10.561117 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:10.561112 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d42a764b-488c-4735-be3a-98a5487fb603-data-volume\") pod \"insights-runtime-extractor-rwffz\" (UID: \"d42a764b-488c-4735-be3a-98a5487fb603\") " pod="openshift-insights/insights-runtime-extractor-rwffz" Sep 18 03:08:10.561361 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:10.561141 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4bwn\" (UniqueName: \"kubernetes.io/projected/d42a764b-488c-4735-be3a-98a5487fb603-kube-api-access-n4bwn\") pod \"insights-runtime-extractor-rwffz\" (UID: \"d42a764b-488c-4735-be3a-98a5487fb603\") " pod="openshift-insights/insights-runtime-extractor-rwffz" Sep 18 03:08:10.561361 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:10.561248 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d42a764b-488c-4735-be3a-98a5487fb603-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rwffz\" (UID: \"d42a764b-488c-4735-be3a-98a5487fb603\") " pod="openshift-insights/insights-runtime-extractor-rwffz" Sep 18 03:08:10.561361 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:10.561342 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d42a764b-488c-4735-be3a-98a5487fb603-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rwffz\" (UID: \"d42a764b-488c-4735-be3a-98a5487fb603\") " pod="openshift-insights/insights-runtime-extractor-rwffz" Sep 18 03:08:10.661964 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:10.661920 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d42a764b-488c-4735-be3a-98a5487fb603-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rwffz\" (UID: \"d42a764b-488c-4735-be3a-98a5487fb603\") " pod="openshift-insights/insights-runtime-extractor-rwffz" Sep 18 03:08:10.662140 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:10.662033 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d42a764b-488c-4735-be3a-98a5487fb603-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rwffz\" (UID: \"d42a764b-488c-4735-be3a-98a5487fb603\") " pod="openshift-insights/insights-runtime-extractor-rwffz" Sep 18 03:08:10.662140 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:10.662075 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d42a764b-488c-4735-be3a-98a5487fb603-crio-socket\") pod \"insights-runtime-extractor-rwffz\" (UID: \"d42a764b-488c-4735-be3a-98a5487fb603\") " pod="openshift-insights/insights-runtime-extractor-rwffz" Sep 18 03:08:10.662140 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:10.662075 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 03:08:10.662140 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:10.662118 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 03:08:10.662325 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:10.662154 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d42a764b-488c-4735-be3a-98a5487fb603-insights-runtime-extractor-tls podName:d42a764b-488c-4735-be3a-98a5487fb603 nodeName:}" failed. No retries permitted until 2026-09-18 03:08:11.162134653 +0000 UTC m=+115.758087766 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d42a764b-488c-4735-be3a-98a5487fb603-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rwffz" (UID: "d42a764b-488c-4735-be3a-98a5487fb603") : secret "insights-runtime-extractor-tls" not found Sep 18 03:08:10.662325 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:10.662161 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d42a764b-488c-4735-be3a-98a5487fb603-crio-socket\") pod \"insights-runtime-extractor-rwffz\" (UID: \"d42a764b-488c-4735-be3a-98a5487fb603\") " pod="openshift-insights/insights-runtime-extractor-rwffz" Sep 18 03:08:10.662325 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:10.662225 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d42a764b-488c-4735-be3a-98a5487fb603-kube-rbac-proxy-cm podName:d42a764b-488c-4735-be3a-98a5487fb603 nodeName:}" failed. No retries permitted until 2026-09-18 03:08:11.162206546 +0000 UTC m=+115.758159677 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d42a764b-488c-4735-be3a-98a5487fb603-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rwffz" (UID: "d42a764b-488c-4735-be3a-98a5487fb603") : configmap "kube-rbac-proxy" not found Sep 18 03:08:10.662325 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:10.662222 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d42a764b-488c-4735-be3a-98a5487fb603-data-volume\") pod \"insights-runtime-extractor-rwffz\" (UID: \"d42a764b-488c-4735-be3a-98a5487fb603\") " pod="openshift-insights/insights-runtime-extractor-rwffz" Sep 18 03:08:10.662325 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:10.662279 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4bwn\" (UniqueName: \"kubernetes.io/projected/d42a764b-488c-4735-be3a-98a5487fb603-kube-api-access-n4bwn\") pod \"insights-runtime-extractor-rwffz\" (UID: \"d42a764b-488c-4735-be3a-98a5487fb603\") " pod="openshift-insights/insights-runtime-extractor-rwffz" Sep 18 03:08:10.662573 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:10.662552 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d42a764b-488c-4735-be3a-98a5487fb603-data-volume\") pod \"insights-runtime-extractor-rwffz\" (UID: \"d42a764b-488c-4735-be3a-98a5487fb603\") " pod="openshift-insights/insights-runtime-extractor-rwffz" Sep 18 03:08:10.674375 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:10.674346 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4bwn\" (UniqueName: \"kubernetes.io/projected/d42a764b-488c-4735-be3a-98a5487fb603-kube-api-access-n4bwn\") pod \"insights-runtime-extractor-rwffz\" (UID: \"d42a764b-488c-4735-be3a-98a5487fb603\") " pod="openshift-insights/insights-runtime-extractor-rwffz" Sep 18 03:08:11.166877 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:11.166831 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d42a764b-488c-4735-be3a-98a5487fb603-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rwffz\" (UID: \"d42a764b-488c-4735-be3a-98a5487fb603\") " pod="openshift-insights/insights-runtime-extractor-rwffz" Sep 18 03:08:11.167056 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:11.166913 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d42a764b-488c-4735-be3a-98a5487fb603-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rwffz\" (UID: \"d42a764b-488c-4735-be3a-98a5487fb603\") " pod="openshift-insights/insights-runtime-extractor-rwffz" Sep 18 03:08:11.167056 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:11.166952 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 03:08:11.167056 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:11.167027 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d42a764b-488c-4735-be3a-98a5487fb603-kube-rbac-proxy-cm podName:d42a764b-488c-4735-be3a-98a5487fb603 nodeName:}" failed. No retries permitted until 2026-09-18 03:08:12.16701075 +0000 UTC m=+116.762963848 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d42a764b-488c-4735-be3a-98a5487fb603-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rwffz" (UID: "d42a764b-488c-4735-be3a-98a5487fb603") : configmap "kube-rbac-proxy" not found Sep 18 03:08:11.167056 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:11.167027 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 03:08:11.167222 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:11.167073 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d42a764b-488c-4735-be3a-98a5487fb603-insights-runtime-extractor-tls podName:d42a764b-488c-4735-be3a-98a5487fb603 nodeName:}" failed. No retries permitted until 2026-09-18 03:08:12.167060506 +0000 UTC m=+116.763013604 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d42a764b-488c-4735-be3a-98a5487fb603-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rwffz" (UID: "d42a764b-488c-4735-be3a-98a5487fb603") : secret "insights-runtime-extractor-tls" not found Sep 18 03:08:12.175291 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:12.175241 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d42a764b-488c-4735-be3a-98a5487fb603-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rwffz\" (UID: \"d42a764b-488c-4735-be3a-98a5487fb603\") " pod="openshift-insights/insights-runtime-extractor-rwffz" Sep 18 03:08:12.175778 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:12.175373 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 03:08:12.175778 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:12.175397 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d42a764b-488c-4735-be3a-98a5487fb603-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rwffz\" (UID: \"d42a764b-488c-4735-be3a-98a5487fb603\") " pod="openshift-insights/insights-runtime-extractor-rwffz" Sep 18 03:08:12.175778 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:12.175460 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d42a764b-488c-4735-be3a-98a5487fb603-kube-rbac-proxy-cm podName:d42a764b-488c-4735-be3a-98a5487fb603 nodeName:}" failed. No retries permitted until 2026-09-18 03:08:14.175440586 +0000 UTC m=+118.771393684 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d42a764b-488c-4735-be3a-98a5487fb603-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rwffz" (UID: "d42a764b-488c-4735-be3a-98a5487fb603") : configmap "kube-rbac-proxy" not found Sep 18 03:08:12.175778 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:12.175527 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 03:08:12.175778 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:12.175575 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d42a764b-488c-4735-be3a-98a5487fb603-insights-runtime-extractor-tls podName:d42a764b-488c-4735-be3a-98a5487fb603 nodeName:}" failed. No retries permitted until 2026-09-18 03:08:14.175563682 +0000 UTC m=+118.771516779 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d42a764b-488c-4735-be3a-98a5487fb603-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rwffz" (UID: "d42a764b-488c-4735-be3a-98a5487fb603") : secret "insights-runtime-extractor-tls" not found Sep 18 03:08:12.341659 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:12.341625 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8scdz_c2824667-7219-4da9-b4b4-125da30139e8/dns-node-resolver/0.log" Sep 18 03:08:13.140951 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:13.140923 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pjgpg_833a036f-c311-46c4-8ecf-16723e7ac9f8/node-ca/0.log" Sep 18 03:08:13.384477 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:13.384438 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/af398652-bdcb-47cc-b06b-4fd71d017c19-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-8zsrm\" (UID: \"af398652-bdcb-47cc-b06b-4fd71d017c19\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-8zsrm" Sep 18 03:08:13.384869 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:13.384605 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 18 03:08:13.384869 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:13.384679 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af398652-bdcb-47cc-b06b-4fd71d017c19-samples-operator-tls podName:af398652-bdcb-47cc-b06b-4fd71d017c19 nodeName:}" failed. No retries permitted until 2026-09-18 03:08:21.38466155 +0000 UTC m=+125.980614648 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/af398652-bdcb-47cc-b06b-4fd71d017c19-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-8zsrm" (UID: "af398652-bdcb-47cc-b06b-4fd71d017c19") : secret "samples-operator-tls" not found Sep 18 03:08:14.142732 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:14.142697 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vvz5b_b347ac1a-6339-4018-9726-ec04debd21e1/serve-healthcheck-canary/0.log" Sep 18 03:08:14.191959 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:14.191919 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d42a764b-488c-4735-be3a-98a5487fb603-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rwffz\" (UID: \"d42a764b-488c-4735-be3a-98a5487fb603\") " pod="openshift-insights/insights-runtime-extractor-rwffz" Sep 18 03:08:14.192120 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:14.192014 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d42a764b-488c-4735-be3a-98a5487fb603-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rwffz\" (UID: \"d42a764b-488c-4735-be3a-98a5487fb603\") " pod="openshift-insights/insights-runtime-extractor-rwffz" Sep 18 03:08:14.192120 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:14.192078 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 03:08:14.192120 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:14.192110 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 03:08:14.192258 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:14.192147 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d42a764b-488c-4735-be3a-98a5487fb603-insights-runtime-extractor-tls podName:d42a764b-488c-4735-be3a-98a5487fb603 nodeName:}" failed. No retries permitted until 2026-09-18 03:08:18.192130205 +0000 UTC m=+122.788083308 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d42a764b-488c-4735-be3a-98a5487fb603-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rwffz" (UID: "d42a764b-488c-4735-be3a-98a5487fb603") : secret "insights-runtime-extractor-tls" not found Sep 18 03:08:14.192258 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:14.192167 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d42a764b-488c-4735-be3a-98a5487fb603-kube-rbac-proxy-cm podName:d42a764b-488c-4735-be3a-98a5487fb603 nodeName:}" failed. No retries permitted until 2026-09-18 03:08:18.192154046 +0000 UTC m=+122.788107162 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d42a764b-488c-4735-be3a-98a5487fb603-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rwffz" (UID: "d42a764b-488c-4735-be3a-98a5487fb603") : configmap "kube-rbac-proxy" not found Sep 18 03:08:18.227472 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:18.227431 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d42a764b-488c-4735-be3a-98a5487fb603-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rwffz\" (UID: \"d42a764b-488c-4735-be3a-98a5487fb603\") " pod="openshift-insights/insights-runtime-extractor-rwffz" Sep 18 03:08:18.227952 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:18.227508 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d42a764b-488c-4735-be3a-98a5487fb603-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rwffz\" (UID: \"d42a764b-488c-4735-be3a-98a5487fb603\") " pod="openshift-insights/insights-runtime-extractor-rwffz" Sep 18 03:08:18.227952 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:18.227579 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 03:08:18.227952 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:18.227642 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d42a764b-488c-4735-be3a-98a5487fb603-kube-rbac-proxy-cm podName:d42a764b-488c-4735-be3a-98a5487fb603 nodeName:}" failed. No retries permitted until 2026-09-18 03:08:26.227627622 +0000 UTC m=+130.823580720 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d42a764b-488c-4735-be3a-98a5487fb603-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rwffz" (UID: "d42a764b-488c-4735-be3a-98a5487fb603") : configmap "kube-rbac-proxy" not found Sep 18 03:08:18.227952 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:18.227579 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 03:08:18.227952 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:18.227712 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d42a764b-488c-4735-be3a-98a5487fb603-insights-runtime-extractor-tls podName:d42a764b-488c-4735-be3a-98a5487fb603 nodeName:}" failed. No retries permitted until 2026-09-18 03:08:26.227696222 +0000 UTC m=+130.823649321 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d42a764b-488c-4735-be3a-98a5487fb603-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rwffz" (UID: "d42a764b-488c-4735-be3a-98a5487fb603") : secret "insights-runtime-extractor-tls" not found Sep 18 03:08:21.456879 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:21.456841 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/af398652-bdcb-47cc-b06b-4fd71d017c19-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-8zsrm\" (UID: \"af398652-bdcb-47cc-b06b-4fd71d017c19\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-8zsrm" Sep 18 03:08:21.459254 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:21.459231 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/af398652-bdcb-47cc-b06b-4fd71d017c19-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-8zsrm\" (UID: \"af398652-bdcb-47cc-b06b-4fd71d017c19\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-8zsrm" Sep 18 03:08:21.552208 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:21.552150 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-8rgsh\"" Sep 18 03:08:21.560433 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:21.560407 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-8zsrm" Sep 18 03:08:21.837613 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:21.837579 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-8zsrm"] Sep 18 03:08:21.891368 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:21.891333 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-8zsrm" event={"ID":"af398652-bdcb-47cc-b06b-4fd71d017c19","Type":"ContainerStarted","Data":"8690d6c60c16f13f51f22b527440063c055c1776478db8ff72bfa1063be478ff"} Sep 18 03:08:23.904371 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:23.904334 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-8zsrm" event={"ID":"af398652-bdcb-47cc-b06b-4fd71d017c19","Type":"ContainerStarted","Data":"b8eedc56d4051d8f99f69e50fc6f234392fdd7bed7af6e89692cf91d8180785e"} Sep 18 03:08:23.904848 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:23.904414 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-8zsrm" event={"ID":"af398652-bdcb-47cc-b06b-4fd71d017c19","Type":"ContainerStarted","Data":"9cc6d1bd5e768d9a87ba9e32c437261f487a2f1d2a5863778507fb117efb96a2"} Sep 18 03:08:23.923222 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:23.923145 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-8zsrm" podStartSLOduration=17.112035377 podStartE2EDuration="18.923129017s" totalImagesPullingTime="1.81109364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:08:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:08:23.922410331 +0000 UTC m=+128.518363452" watchObservedRunningTime="2026-09-18 03:08:23.923129017 +0000 UTC m=+128.519082134" Sep 18 03:08:26.298359 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:26.298313 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d42a764b-488c-4735-be3a-98a5487fb603-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rwffz\" (UID: \"d42a764b-488c-4735-be3a-98a5487fb603\") " pod="openshift-insights/insights-runtime-extractor-rwffz" Sep 18 03:08:26.298888 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:26.298393 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d42a764b-488c-4735-be3a-98a5487fb603-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rwffz\" (UID: \"d42a764b-488c-4735-be3a-98a5487fb603\") " pod="openshift-insights/insights-runtime-extractor-rwffz" Sep 18 03:08:26.298888 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:26.298523 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 03:08:26.298888 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:26.298596 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d42a764b-488c-4735-be3a-98a5487fb603-insights-runtime-extractor-tls podName:d42a764b-488c-4735-be3a-98a5487fb603 nodeName:}" failed. No retries permitted until 2026-09-18 03:08:42.298576495 +0000 UTC m=+146.894529594 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d42a764b-488c-4735-be3a-98a5487fb603-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rwffz" (UID: "d42a764b-488c-4735-be3a-98a5487fb603") : secret "insights-runtime-extractor-tls" not found Sep 18 03:08:26.298888 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:26.298875 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d42a764b-488c-4735-be3a-98a5487fb603-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rwffz\" (UID: \"d42a764b-488c-4735-be3a-98a5487fb603\") " pod="openshift-insights/insights-runtime-extractor-rwffz" Sep 18 03:08:27.205713 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:27.205667 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8ba3428-efa3-42f0-acad-0e524f361a50-metrics-certs\") pod \"network-metrics-daemon-zcq59\" (UID: \"d8ba3428-efa3-42f0-acad-0e524f361a50\") " pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:08:27.207962 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:27.207936 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8ba3428-efa3-42f0-acad-0e524f361a50-metrics-certs\") pod \"network-metrics-daemon-zcq59\" (UID: \"d8ba3428-efa3-42f0-acad-0e524f361a50\") " pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:08:27.284083 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:27.284046 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hxvn5\"" Sep 18 03:08:27.291753 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:27.291716 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcq59" Sep 18 03:08:27.567740 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:27.567710 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zcq59"] Sep 18 03:08:27.570929 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:08:27.570889 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8ba3428_efa3_42f0_acad_0e524f361a50.slice/crio-07b0c4f05a9c13203862464236904727dd1552598f9d806138cbab6482c57cf5 WatchSource:0}: Error finding container 07b0c4f05a9c13203862464236904727dd1552598f9d806138cbab6482c57cf5: Status 404 returned error can't find the container with id 07b0c4f05a9c13203862464236904727dd1552598f9d806138cbab6482c57cf5 Sep 18 03:08:27.917299 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:27.917207 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zcq59" event={"ID":"d8ba3428-efa3-42f0-acad-0e524f361a50","Type":"ContainerStarted","Data":"07b0c4f05a9c13203862464236904727dd1552598f9d806138cbab6482c57cf5"} Sep 18 03:08:28.925010 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:28.924913 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zcq59" event={"ID":"d8ba3428-efa3-42f0-acad-0e524f361a50","Type":"ContainerStarted","Data":"25d2c5ae8c76e9de1e7538487c9c2b176f50d5fdad92b72a9661ca2d9be78812"} Sep 18 03:08:28.925411 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:28.925018 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zcq59" event={"ID":"d8ba3428-efa3-42f0-acad-0e524f361a50","Type":"ContainerStarted","Data":"578ccab6471f35aa8f504395f88500545a85eab4733299fcea54927b4efda472"} Sep 18 03:08:28.946021 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:28.945965 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zcq59" podStartSLOduration=130.85035259 podStartE2EDuration="2m11.945947983s" totalImagesPullingTime="1.095595393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:08:28.944969693 +0000 UTC m=+133.540922812" watchObservedRunningTime="2026-09-18 03:08:28.945947983 +0000 UTC m=+133.541901103" Sep 18 03:08:39.918624 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:39.918587 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5557bb9479-ttk7f"] Sep 18 03:08:39.921948 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:39.921925 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5557bb9479-ttk7f" Sep 18 03:08:39.926927 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:39.926897 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 18 03:08:39.926927 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:39.926914 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 18 03:08:39.929143 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:39.929120 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 18 03:08:39.930288 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:39.930266 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 18 03:08:39.997205 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:39.996946 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5557bb9479-ttk7f"] Sep 18 03:08:40.003042 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:40.002976 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9eab5339-72dc-45da-bf33-9cd881b677a9-klusterlet-config\") pod \"klusterlet-addon-workmgr-5557bb9479-ttk7f\" (UID: \"9eab5339-72dc-45da-bf33-9cd881b677a9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5557bb9479-ttk7f" Sep 18 03:08:40.003042 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:40.003067 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9eab5339-72dc-45da-bf33-9cd881b677a9-tmp\") pod \"klusterlet-addon-workmgr-5557bb9479-ttk7f\" (UID: \"9eab5339-72dc-45da-bf33-9cd881b677a9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5557bb9479-ttk7f" Sep 18 03:08:40.003719 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:40.003107 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdplm\" (UniqueName: \"kubernetes.io/projected/9eab5339-72dc-45da-bf33-9cd881b677a9-kube-api-access-zdplm\") pod \"klusterlet-addon-workmgr-5557bb9479-ttk7f\" (UID: \"9eab5339-72dc-45da-bf33-9cd881b677a9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5557bb9479-ttk7f" Sep 18 03:08:40.103607 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:40.103553 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9eab5339-72dc-45da-bf33-9cd881b677a9-klusterlet-config\") pod \"klusterlet-addon-workmgr-5557bb9479-ttk7f\" (UID: \"9eab5339-72dc-45da-bf33-9cd881b677a9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5557bb9479-ttk7f" Sep 18 03:08:40.103607 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:40.103611 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9eab5339-72dc-45da-bf33-9cd881b677a9-tmp\") pod \"klusterlet-addon-workmgr-5557bb9479-ttk7f\" (UID: \"9eab5339-72dc-45da-bf33-9cd881b677a9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5557bb9479-ttk7f" Sep 18 03:08:40.103824 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:40.103637 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdplm\" (UniqueName: \"kubernetes.io/projected/9eab5339-72dc-45da-bf33-9cd881b677a9-kube-api-access-zdplm\") pod \"klusterlet-addon-workmgr-5557bb9479-ttk7f\" (UID: \"9eab5339-72dc-45da-bf33-9cd881b677a9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5557bb9479-ttk7f" Sep 18 03:08:40.104119 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:40.104100 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9eab5339-72dc-45da-bf33-9cd881b677a9-tmp\") pod \"klusterlet-addon-workmgr-5557bb9479-ttk7f\" (UID: \"9eab5339-72dc-45da-bf33-9cd881b677a9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5557bb9479-ttk7f" Sep 18 03:08:40.106321 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:40.106296 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9eab5339-72dc-45da-bf33-9cd881b677a9-klusterlet-config\") pod \"klusterlet-addon-workmgr-5557bb9479-ttk7f\" (UID: \"9eab5339-72dc-45da-bf33-9cd881b677a9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5557bb9479-ttk7f" Sep 18 03:08:40.136859 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:40.136821 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdplm\" (UniqueName: \"kubernetes.io/projected/9eab5339-72dc-45da-bf33-9cd881b677a9-kube-api-access-zdplm\") pod \"klusterlet-addon-workmgr-5557bb9479-ttk7f\" (UID: \"9eab5339-72dc-45da-bf33-9cd881b677a9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5557bb9479-ttk7f" Sep 18 03:08:40.231322 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:40.231239 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5557bb9479-ttk7f" Sep 18 03:08:40.379051 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:40.379016 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-sr9fn"] Sep 18 03:08:40.383119 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:40.383102 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-sr9fn" Sep 18 03:08:40.385626 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:40.385603 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-ngwck\"" Sep 18 03:08:40.386704 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:40.386689 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 18 03:08:40.392803 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:40.392773 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-sr9fn"] Sep 18 03:08:40.406959 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:40.406921 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8096db38-7db2-4f2a-a526-74f08e019726-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-sr9fn\" (UID: \"8096db38-7db2-4f2a-a526-74f08e019726\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-sr9fn" Sep 18 03:08:40.508064 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:40.507964 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8096db38-7db2-4f2a-a526-74f08e019726-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-sr9fn\" (UID: \"8096db38-7db2-4f2a-a526-74f08e019726\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-sr9fn" Sep 18 03:08:40.510748 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:40.510720 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8096db38-7db2-4f2a-a526-74f08e019726-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-sr9fn\" (UID: \"8096db38-7db2-4f2a-a526-74f08e019726\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-sr9fn" Sep 18 03:08:40.531692 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:40.531555 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5557bb9479-ttk7f"] Sep 18 03:08:40.534161 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:08:40.534133 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eab5339_72dc_45da_bf33_9cd881b677a9.slice/crio-985a67c85c8d233494561e4717bb2bdc99d97b0149092bed5c41509badba28d8 WatchSource:0}: Error finding container 985a67c85c8d233494561e4717bb2bdc99d97b0149092bed5c41509badba28d8: Status 404 returned error can't find the container with id 985a67c85c8d233494561e4717bb2bdc99d97b0149092bed5c41509badba28d8 Sep 18 03:08:40.692739 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:40.692695 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-sr9fn" Sep 18 03:08:40.967710 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:40.967672 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5557bb9479-ttk7f" event={"ID":"9eab5339-72dc-45da-bf33-9cd881b677a9","Type":"ContainerStarted","Data":"985a67c85c8d233494561e4717bb2bdc99d97b0149092bed5c41509badba28d8"} Sep 18 03:08:40.968162 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:40.968009 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-sr9fn"] Sep 18 03:08:40.970527 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:08:40.970503 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8096db38_7db2_4f2a_a526_74f08e019726.slice/crio-619af71eb40d5cabc9cfc64892aecddb01a19f367f3f75cadd91592cbc2dcf26 WatchSource:0}: Error finding container 619af71eb40d5cabc9cfc64892aecddb01a19f367f3f75cadd91592cbc2dcf26: Status 404 returned error can't find the container with id 619af71eb40d5cabc9cfc64892aecddb01a19f367f3f75cadd91592cbc2dcf26 Sep 18 03:08:41.974629 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:41.974578 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-sr9fn" event={"ID":"8096db38-7db2-4f2a-a526-74f08e019726","Type":"ContainerStarted","Data":"619af71eb40d5cabc9cfc64892aecddb01a19f367f3f75cadd91592cbc2dcf26"} Sep 18 03:08:42.323628 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:42.323582 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d42a764b-488c-4735-be3a-98a5487fb603-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rwffz\" (UID: \"d42a764b-488c-4735-be3a-98a5487fb603\") " pod="openshift-insights/insights-runtime-extractor-rwffz" Sep 18 03:08:42.326760 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:42.326726 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d42a764b-488c-4735-be3a-98a5487fb603-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rwffz\" (UID: \"d42a764b-488c-4735-be3a-98a5487fb603\") " pod="openshift-insights/insights-runtime-extractor-rwffz" Sep 18 03:08:42.615830 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:42.615751 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gr8bz\"" Sep 18 03:08:42.623348 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:42.623294 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rwffz" Sep 18 03:08:43.325931 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:43.325892 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rwffz"] Sep 18 03:08:43.983744 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:43.983707 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-sr9fn" event={"ID":"8096db38-7db2-4f2a-a526-74f08e019726","Type":"ContainerStarted","Data":"bdb53400f219a783fbed12c5d046f2ee69c9e88e2ee8d978062d6c56c3690ad0"} Sep 18 03:08:43.983963 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:43.983939 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-sr9fn" Sep 18 03:08:43.989305 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:43.989281 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-sr9fn" Sep 18 03:08:44.002117 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:44.002055 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-sr9fn" podStartSLOduration=1.918567439 podStartE2EDuration="4.002033111s" totalImagesPullingTime="2.083465672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:08:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:08:44.001204021 +0000 UTC m=+148.597157132" watchObservedRunningTime="2026-09-18 03:08:44.002033111 +0000 UTC m=+148.597986233" Sep 18 03:08:44.256731 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:08:44.256650 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd42a764b_488c_4735_be3a_98a5487fb603.slice/crio-cacdf4885fba6c04819687705a6c217bc452839c3fcad0195bdfbf92087b693e WatchSource:0}: Error finding container cacdf4885fba6c04819687705a6c217bc452839c3fcad0195bdfbf92087b693e: Status 404 returned error can't find the container with id cacdf4885fba6c04819687705a6c217bc452839c3fcad0195bdfbf92087b693e Sep 18 03:08:44.514770 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:44.514688 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-gtf25"] Sep 18 03:08:44.517756 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:44.517740 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gtf25" Sep 18 03:08:44.520339 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:44.520307 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 18 03:08:44.520339 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:44.520319 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 18 03:08:44.520509 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:44.520395 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 18 03:08:44.521596 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:44.521579 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 18 03:08:44.521708 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:44.521620 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 18 03:08:44.521752 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:44.521737 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vkvxs\"" Sep 18 03:08:44.541093 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:44.541071 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-gtf25"] Sep 18 03:08:44.543227 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:44.543204 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e8ad848-cb76-4121-b47b-e44c0c040a57-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-gtf25\" (UID: \"2e8ad848-cb76-4121-b47b-e44c0c040a57\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gtf25" Sep 18 03:08:44.543317 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:44.543287 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txh9b\" (UniqueName: \"kubernetes.io/projected/2e8ad848-cb76-4121-b47b-e44c0c040a57-kube-api-access-txh9b\") pod \"prometheus-operator-7bd5d56d6-gtf25\" (UID: \"2e8ad848-cb76-4121-b47b-e44c0c040a57\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gtf25" Sep 18 03:08:44.543356 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:44.543345 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e8ad848-cb76-4121-b47b-e44c0c040a57-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-gtf25\" (UID: \"2e8ad848-cb76-4121-b47b-e44c0c040a57\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gtf25" Sep 18 03:08:44.543396 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:44.543367 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e8ad848-cb76-4121-b47b-e44c0c040a57-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-gtf25\" (UID: \"2e8ad848-cb76-4121-b47b-e44c0c040a57\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gtf25" Sep 18 03:08:44.643754 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:44.643718 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e8ad848-cb76-4121-b47b-e44c0c040a57-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-gtf25\" (UID: \"2e8ad848-cb76-4121-b47b-e44c0c040a57\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gtf25" Sep 18 03:08:44.643931 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:44.643770 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txh9b\" (UniqueName: \"kubernetes.io/projected/2e8ad848-cb76-4121-b47b-e44c0c040a57-kube-api-access-txh9b\") pod \"prometheus-operator-7bd5d56d6-gtf25\" (UID: \"2e8ad848-cb76-4121-b47b-e44c0c040a57\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gtf25" Sep 18 03:08:44.643931 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:44.643814 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e8ad848-cb76-4121-b47b-e44c0c040a57-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-gtf25\" (UID: \"2e8ad848-cb76-4121-b47b-e44c0c040a57\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gtf25" Sep 18 03:08:44.643931 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:44.643831 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e8ad848-cb76-4121-b47b-e44c0c040a57-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-gtf25\" (UID: \"2e8ad848-cb76-4121-b47b-e44c0c040a57\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gtf25" Sep 18 03:08:44.644540 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:44.644511 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e8ad848-cb76-4121-b47b-e44c0c040a57-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-gtf25\" (UID: \"2e8ad848-cb76-4121-b47b-e44c0c040a57\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gtf25" Sep 18 03:08:44.646311 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:44.646289 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e8ad848-cb76-4121-b47b-e44c0c040a57-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-gtf25\" (UID: \"2e8ad848-cb76-4121-b47b-e44c0c040a57\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gtf25" Sep 18 03:08:44.646395 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:44.646369 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2e8ad848-cb76-4121-b47b-e44c0c040a57-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-gtf25\" (UID: \"2e8ad848-cb76-4121-b47b-e44c0c040a57\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gtf25" Sep 18 03:08:44.655668 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:44.655641 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txh9b\" (UniqueName: \"kubernetes.io/projected/2e8ad848-cb76-4121-b47b-e44c0c040a57-kube-api-access-txh9b\") pod \"prometheus-operator-7bd5d56d6-gtf25\" (UID: \"2e8ad848-cb76-4121-b47b-e44c0c040a57\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gtf25" Sep 18 03:08:44.827121 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:44.827089 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gtf25" Sep 18 03:08:44.993316 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:44.993284 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5557bb9479-ttk7f" event={"ID":"9eab5339-72dc-45da-bf33-9cd881b677a9","Type":"ContainerStarted","Data":"c4c200f5c45aaf8a9c3b509b8b025f7fbbbe4967e209377b34b736fece974893"} Sep 18 03:08:44.993532 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:44.993512 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5557bb9479-ttk7f" Sep 18 03:08:44.994886 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:44.994855 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rwffz" event={"ID":"d42a764b-488c-4735-be3a-98a5487fb603","Type":"ContainerStarted","Data":"9ed9c3f46dce6777a8b375255cb69f962470df5e9ef96d774962475e6d64c956"} Sep 18 03:08:44.994992 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:44.994912 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rwffz" event={"ID":"d42a764b-488c-4735-be3a-98a5487fb603","Type":"ContainerStarted","Data":"cacdf4885fba6c04819687705a6c217bc452839c3fcad0195bdfbf92087b693e"} Sep 18 03:08:44.995453 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:44.995435 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5557bb9479-ttk7f" Sep 18 03:08:45.018503 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:45.018462 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5557bb9479-ttk7f" podStartSLOduration=2.228559947 podStartE2EDuration="6.018447558s" totalImagesPullingTime="3.789887611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:08:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:08:45.017988075 +0000 UTC m=+149.613941195" watchObservedRunningTime="2026-09-18 03:08:45.018447558 +0000 UTC m=+149.614400677" Sep 18 03:08:45.111258 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:45.111177 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-gtf25"] Sep 18 03:08:45.114748 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:08:45.114725 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e8ad848_cb76_4121_b47b_e44c0c040a57.slice/crio-b96b5793edb6749219b3d6018555cde4eb543e5a39a0dcdfd09a46ce03063993 WatchSource:0}: Error finding container b96b5793edb6749219b3d6018555cde4eb543e5a39a0dcdfd09a46ce03063993: Status 404 returned error can't find the container with id b96b5793edb6749219b3d6018555cde4eb543e5a39a0dcdfd09a46ce03063993 Sep 18 03:08:46.002930 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:46.002887 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rwffz" event={"ID":"d42a764b-488c-4735-be3a-98a5487fb603","Type":"ContainerStarted","Data":"398ce068cb2d9cd19484fee96cb3b4e71f53f1b144dd4a1260bc8d82925523b8"} Sep 18 03:08:46.004326 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:46.004294 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gtf25" event={"ID":"2e8ad848-cb76-4121-b47b-e44c0c040a57","Type":"ContainerStarted","Data":"b96b5793edb6749219b3d6018555cde4eb543e5a39a0dcdfd09a46ce03063993"} Sep 18 03:08:47.010152 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:47.010061 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rwffz" event={"ID":"d42a764b-488c-4735-be3a-98a5487fb603","Type":"ContainerStarted","Data":"c01018bb397b058fa553538aa4aa7cadfea994f278cd7be7fef85269a9767905"} Sep 18 03:08:47.011978 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:47.011952 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gtf25" event={"ID":"2e8ad848-cb76-4121-b47b-e44c0c040a57","Type":"ContainerStarted","Data":"153960b4c056f46f4cf67c74b43f3a7539bfe5d2500340d95110f6f4a0501e4d"} Sep 18 03:08:47.012107 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:47.011996 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gtf25" event={"ID":"2e8ad848-cb76-4121-b47b-e44c0c040a57","Type":"ContainerStarted","Data":"f7176978bb434b88cdc51fb15e4fe8bec7b0fb3770d361d9dc7acd80dfc9f761"} Sep 18 03:08:47.035545 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:47.035495 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rwffz" podStartSLOduration=34.835939028 podStartE2EDuration="37.035473561s" totalImagesPullingTime="2.199534533s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:08:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:08:47.034277579 +0000 UTC m=+151.630230699" watchObservedRunningTime="2026-09-18 03:08:47.035473561 +0000 UTC m=+151.631426711" Sep 18 03:08:47.067387 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:47.067332 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gtf25" podStartSLOduration=1.610165212 podStartE2EDuration="3.06731374s" totalImagesPullingTime="1.457148528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:08:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:08:47.065163875 +0000 UTC m=+151.661116996" watchObservedRunningTime="2026-09-18 03:08:47.06731374 +0000 UTC m=+151.663266880" Sep 18 03:08:48.873425 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:48.873388 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-fqs8x"] Sep 18 03:08:48.876806 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:48.876790 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fqs8x" Sep 18 03:08:48.879621 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:48.879585 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"openshift-state-metrics-86c5bc79d6-fqs8x\" is forbidden: User \"system:node:ip-10-0-138-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-138-38.ec2.internal' and this object" podUID="6b7bf314-5d22-410b-a0a8-9b2602dd834e" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fqs8x" Sep 18 03:08:48.879781 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:48.879681 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"openshift-state-metrics-tls\" is forbidden: User \"system:node:ip-10-0-138-38.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-138-38.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" type="*v1.Secret" Sep 18 03:08:48.879850 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:48.879811 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"openshift-state-metrics-dockercfg-hmds5\" is forbidden: User \"system:node:ip-10-0-138-38.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-138-38.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-hmds5\"" type="*v1.Secret" Sep 18 03:08:48.880049 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:48.880028 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"openshift-state-metrics-kube-rbac-proxy-config\" is forbidden: User \"system:node:ip-10-0-138-38.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-138-38.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" type="*v1.Secret" Sep 18 03:08:48.891469 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:48.891448 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nl2mw"] Sep 18 03:08:48.894429 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:48.894413 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nl2mw" Sep 18 03:08:48.896926 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:48.896898 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2mhvk\"" Sep 18 03:08:48.897037 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:48.896955 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 18 03:08:48.897519 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:48.897497 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 18 03:08:48.897619 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:48.897518 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 18 03:08:48.898551 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:48.898529 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-fqs8x"] Sep 18 03:08:48.980399 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:48.980363 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f0f73a2-8b4e-4884-922e-94e17ef5df72-metrics-client-ca\") pod \"node-exporter-nl2mw\" (UID: \"1f0f73a2-8b4e-4884-922e-94e17ef5df72\") " pod="openshift-monitoring/node-exporter-nl2mw" Sep 18 03:08:48.980399 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:48.980399 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b7bf314-5d22-410b-a0a8-9b2602dd834e-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-fqs8x\" (UID: \"6b7bf314-5d22-410b-a0a8-9b2602dd834e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fqs8x" Sep 18 03:08:48.980631 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:48.980467 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zps9\" (UniqueName: \"kubernetes.io/projected/6b7bf314-5d22-410b-a0a8-9b2602dd834e-kube-api-access-9zps9\") pod \"openshift-state-metrics-86c5bc79d6-fqs8x\" (UID: \"6b7bf314-5d22-410b-a0a8-9b2602dd834e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fqs8x" Sep 18 03:08:48.980631 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:48.980485 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1f0f73a2-8b4e-4884-922e-94e17ef5df72-node-exporter-accelerators-collector-config\") pod \"node-exporter-nl2mw\" (UID: \"1f0f73a2-8b4e-4884-922e-94e17ef5df72\") " pod="openshift-monitoring/node-exporter-nl2mw" Sep 18 03:08:48.980631 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:48.980503 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f0f73a2-8b4e-4884-922e-94e17ef5df72-sys\") pod \"node-exporter-nl2mw\" (UID: \"1f0f73a2-8b4e-4884-922e-94e17ef5df72\") " pod="openshift-monitoring/node-exporter-nl2mw" Sep 18 03:08:48.980631 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:48.980575 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1f0f73a2-8b4e-4884-922e-94e17ef5df72-node-exporter-wtmp\") pod \"node-exporter-nl2mw\" (UID: \"1f0f73a2-8b4e-4884-922e-94e17ef5df72\") " pod="openshift-monitoring/node-exporter-nl2mw" Sep 18 03:08:48.980631 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:48.980605 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbwzf\" (UniqueName: \"kubernetes.io/projected/1f0f73a2-8b4e-4884-922e-94e17ef5df72-kube-api-access-dbwzf\") pod \"node-exporter-nl2mw\" (UID: \"1f0f73a2-8b4e-4884-922e-94e17ef5df72\") " pod="openshift-monitoring/node-exporter-nl2mw" Sep 18 03:08:48.980631 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:48.980625 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f0f73a2-8b4e-4884-922e-94e17ef5df72-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nl2mw\" (UID: \"1f0f73a2-8b4e-4884-922e-94e17ef5df72\") " pod="openshift-monitoring/node-exporter-nl2mw" Sep 18 03:08:48.980848 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:48.980651 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b7bf314-5d22-410b-a0a8-9b2602dd834e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-fqs8x\" (UID: \"6b7bf314-5d22-410b-a0a8-9b2602dd834e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fqs8x" Sep 18 03:08:48.980848 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:48.980704 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1f0f73a2-8b4e-4884-922e-94e17ef5df72-node-exporter-textfile\") pod \"node-exporter-nl2mw\" (UID: \"1f0f73a2-8b4e-4884-922e-94e17ef5df72\") " pod="openshift-monitoring/node-exporter-nl2mw" Sep 18 03:08:48.980848 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:48.980729 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1f0f73a2-8b4e-4884-922e-94e17ef5df72-root\") pod \"node-exporter-nl2mw\" (UID: \"1f0f73a2-8b4e-4884-922e-94e17ef5df72\") " pod="openshift-monitoring/node-exporter-nl2mw" Sep 18 03:08:48.980848 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:48.980745 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f0f73a2-8b4e-4884-922e-94e17ef5df72-node-exporter-tls\") pod \"node-exporter-nl2mw\" (UID: \"1f0f73a2-8b4e-4884-922e-94e17ef5df72\") " pod="openshift-monitoring/node-exporter-nl2mw" Sep 18 03:08:48.980848 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:48.980773 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b7bf314-5d22-410b-a0a8-9b2602dd834e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-fqs8x\" (UID: \"6b7bf314-5d22-410b-a0a8-9b2602dd834e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fqs8x" Sep 18 03:08:49.081662 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:49.081627 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b7bf314-5d22-410b-a0a8-9b2602dd834e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-fqs8x\" (UID: \"6b7bf314-5d22-410b-a0a8-9b2602dd834e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fqs8x" Sep 18 03:08:49.081662 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:49.081664 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1f0f73a2-8b4e-4884-922e-94e17ef5df72-node-exporter-textfile\") pod \"node-exporter-nl2mw\" (UID: \"1f0f73a2-8b4e-4884-922e-94e17ef5df72\") " pod="openshift-monitoring/node-exporter-nl2mw" Sep 18 03:08:49.081918 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:49.081684 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1f0f73a2-8b4e-4884-922e-94e17ef5df72-root\") pod \"node-exporter-nl2mw\" (UID: \"1f0f73a2-8b4e-4884-922e-94e17ef5df72\") " pod="openshift-monitoring/node-exporter-nl2mw" Sep 18 03:08:49.081918 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:49.081701 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f0f73a2-8b4e-4884-922e-94e17ef5df72-node-exporter-tls\") pod \"node-exporter-nl2mw\" (UID: \"1f0f73a2-8b4e-4884-922e-94e17ef5df72\") " pod="openshift-monitoring/node-exporter-nl2mw" Sep 18 03:08:49.081918 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:49.081728 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b7bf314-5d22-410b-a0a8-9b2602dd834e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-fqs8x\" (UID: \"6b7bf314-5d22-410b-a0a8-9b2602dd834e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fqs8x" Sep 18 03:08:49.081918 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:49.081751 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f0f73a2-8b4e-4884-922e-94e17ef5df72-metrics-client-ca\") pod \"node-exporter-nl2mw\" (UID: \"1f0f73a2-8b4e-4884-922e-94e17ef5df72\") " pod="openshift-monitoring/node-exporter-nl2mw" Sep 18 03:08:49.081918 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:49.081779 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b7bf314-5d22-410b-a0a8-9b2602dd834e-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-fqs8x\" (UID: \"6b7bf314-5d22-410b-a0a8-9b2602dd834e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fqs8x" Sep 18 03:08:49.081918 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:49.081789 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1f0f73a2-8b4e-4884-922e-94e17ef5df72-root\") pod \"node-exporter-nl2mw\" (UID: \"1f0f73a2-8b4e-4884-922e-94e17ef5df72\") " pod="openshift-monitoring/node-exporter-nl2mw" Sep 18 03:08:49.081918 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:49.081875 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zps9\" (UniqueName: \"kubernetes.io/projected/6b7bf314-5d22-410b-a0a8-9b2602dd834e-kube-api-access-9zps9\") pod \"openshift-state-metrics-86c5bc79d6-fqs8x\" (UID: \"6b7bf314-5d22-410b-a0a8-9b2602dd834e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fqs8x" Sep 18 03:08:49.081918 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:49.081907 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1f0f73a2-8b4e-4884-922e-94e17ef5df72-node-exporter-accelerators-collector-config\") pod \"node-exporter-nl2mw\" (UID: \"1f0f73a2-8b4e-4884-922e-94e17ef5df72\") " pod="openshift-monitoring/node-exporter-nl2mw" Sep 18 03:08:49.082310 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:49.081935 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f0f73a2-8b4e-4884-922e-94e17ef5df72-sys\") pod \"node-exporter-nl2mw\" (UID: \"1f0f73a2-8b4e-4884-922e-94e17ef5df72\") " pod="openshift-monitoring/node-exporter-nl2mw" Sep 18 03:08:49.082310 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:49.081976 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1f0f73a2-8b4e-4884-922e-94e17ef5df72-node-exporter-wtmp\") pod \"node-exporter-nl2mw\" (UID: \"1f0f73a2-8b4e-4884-922e-94e17ef5df72\") " pod="openshift-monitoring/node-exporter-nl2mw" Sep 18 03:08:49.082310 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:49.082004 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbwzf\" (UniqueName: \"kubernetes.io/projected/1f0f73a2-8b4e-4884-922e-94e17ef5df72-kube-api-access-dbwzf\") pod \"node-exporter-nl2mw\" (UID: \"1f0f73a2-8b4e-4884-922e-94e17ef5df72\") " pod="openshift-monitoring/node-exporter-nl2mw" Sep 18 03:08:49.082310 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:49.082029 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f0f73a2-8b4e-4884-922e-94e17ef5df72-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nl2mw\" (UID: \"1f0f73a2-8b4e-4884-922e-94e17ef5df72\") " pod="openshift-monitoring/node-exporter-nl2mw" Sep 18 03:08:49.082310 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:49.082066 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f0f73a2-8b4e-4884-922e-94e17ef5df72-sys\") pod \"node-exporter-nl2mw\" (UID: \"1f0f73a2-8b4e-4884-922e-94e17ef5df72\") " pod="openshift-monitoring/node-exporter-nl2mw" Sep 18 03:08:49.082310 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:49.082166 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1f0f73a2-8b4e-4884-922e-94e17ef5df72-node-exporter-wtmp\") pod \"node-exporter-nl2mw\" (UID: \"1f0f73a2-8b4e-4884-922e-94e17ef5df72\") " pod="openshift-monitoring/node-exporter-nl2mw" Sep 18 03:08:49.082310 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:49.082031 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1f0f73a2-8b4e-4884-922e-94e17ef5df72-node-exporter-textfile\") pod \"node-exporter-nl2mw\" (UID: \"1f0f73a2-8b4e-4884-922e-94e17ef5df72\") " pod="openshift-monitoring/node-exporter-nl2mw" Sep 18 03:08:49.082633 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:49.082446 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f0f73a2-8b4e-4884-922e-94e17ef5df72-metrics-client-ca\") pod \"node-exporter-nl2mw\" (UID: \"1f0f73a2-8b4e-4884-922e-94e17ef5df72\") " pod="openshift-monitoring/node-exporter-nl2mw" Sep 18 03:08:49.082633 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:49.082578 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b7bf314-5d22-410b-a0a8-9b2602dd834e-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-fqs8x\" (UID: \"6b7bf314-5d22-410b-a0a8-9b2602dd834e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fqs8x" Sep 18 03:08:49.082633 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:49.082596 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1f0f73a2-8b4e-4884-922e-94e17ef5df72-node-exporter-accelerators-collector-config\") pod \"node-exporter-nl2mw\" (UID: \"1f0f73a2-8b4e-4884-922e-94e17ef5df72\") " pod="openshift-monitoring/node-exporter-nl2mw" Sep 18 03:08:49.084264 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:49.084234 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f0f73a2-8b4e-4884-922e-94e17ef5df72-node-exporter-tls\") pod \"node-exporter-nl2mw\" (UID: \"1f0f73a2-8b4e-4884-922e-94e17ef5df72\") " pod="openshift-monitoring/node-exporter-nl2mw" Sep 18 03:08:49.084378 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:49.084333 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f0f73a2-8b4e-4884-922e-94e17ef5df72-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nl2mw\" (UID: \"1f0f73a2-8b4e-4884-922e-94e17ef5df72\") " pod="openshift-monitoring/node-exporter-nl2mw" Sep 18 03:08:49.102837 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:49.102815 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbwzf\" (UniqueName: \"kubernetes.io/projected/1f0f73a2-8b4e-4884-922e-94e17ef5df72-kube-api-access-dbwzf\") pod \"node-exporter-nl2mw\" (UID: \"1f0f73a2-8b4e-4884-922e-94e17ef5df72\") " pod="openshift-monitoring/node-exporter-nl2mw" Sep 18 03:08:49.103028 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:49.103011 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zps9\" (UniqueName: \"kubernetes.io/projected/6b7bf314-5d22-410b-a0a8-9b2602dd834e-kube-api-access-9zps9\") pod \"openshift-state-metrics-86c5bc79d6-fqs8x\" (UID: \"6b7bf314-5d22-410b-a0a8-9b2602dd834e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fqs8x" Sep 18 03:08:49.204004 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:49.203906 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nl2mw" Sep 18 03:08:49.215638 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:08:49.215610 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f0f73a2_8b4e_4884_922e_94e17ef5df72.slice/crio-828b9ba742dbb7de270ab9750eb7e1701dd04801472f28bae271fa6f842bb389 WatchSource:0}: Error finding container 828b9ba742dbb7de270ab9750eb7e1701dd04801472f28bae271fa6f842bb389: Status 404 returned error can't find the container with id 828b9ba742dbb7de270ab9750eb7e1701dd04801472f28bae271fa6f842bb389 Sep 18 03:08:50.023705 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:50.022600 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nl2mw" event={"ID":"1f0f73a2-8b4e-4884-922e-94e17ef5df72","Type":"ContainerStarted","Data":"828b9ba742dbb7de270ab9750eb7e1701dd04801472f28bae271fa6f842bb389"} Sep 18 03:08:50.082744 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:50.082704 2578 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: failed to sync secret cache: timed out waiting for the condition Sep 18 03:08:50.082935 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:50.082792 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b7bf314-5d22-410b-a0a8-9b2602dd834e-openshift-state-metrics-tls podName:6b7bf314-5d22-410b-a0a8-9b2602dd834e nodeName:}" failed. No retries permitted until 2026-09-18 03:08:50.582773363 +0000 UTC m=+155.178726460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/6b7bf314-5d22-410b-a0a8-9b2602dd834e-openshift-state-metrics-tls") pod "openshift-state-metrics-86c5bc79d6-fqs8x" (UID: "6b7bf314-5d22-410b-a0a8-9b2602dd834e") : failed to sync secret cache: timed out waiting for the condition Sep 18 03:08:50.082935 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:50.082718 2578 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-kube-rbac-proxy-config: failed to sync secret cache: timed out waiting for the condition Sep 18 03:08:50.082935 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:50.082893 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b7bf314-5d22-410b-a0a8-9b2602dd834e-openshift-state-metrics-kube-rbac-proxy-config podName:6b7bf314-5d22-410b-a0a8-9b2602dd834e nodeName:}" failed. No retries permitted until 2026-09-18 03:08:50.582873487 +0000 UTC m=+155.178826601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-kube-rbac-proxy-config" (UniqueName: "kubernetes.io/secret/6b7bf314-5d22-410b-a0a8-9b2602dd834e-openshift-state-metrics-kube-rbac-proxy-config") pod "openshift-state-metrics-86c5bc79d6-fqs8x" (UID: "6b7bf314-5d22-410b-a0a8-9b2602dd834e") : failed to sync secret cache: timed out waiting for the condition Sep 18 03:08:50.090400 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:50.090334 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 18 03:08:50.142688 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:50.142646 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-hmds5\"" Sep 18 03:08:50.286930 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:50.286906 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 18 03:08:50.594033 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:50.593997 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b7bf314-5d22-410b-a0a8-9b2602dd834e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-fqs8x\" (UID: \"6b7bf314-5d22-410b-a0a8-9b2602dd834e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fqs8x" Sep 18 03:08:50.594227 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:50.594042 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b7bf314-5d22-410b-a0a8-9b2602dd834e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-fqs8x\" (UID: \"6b7bf314-5d22-410b-a0a8-9b2602dd834e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fqs8x" Sep 18 03:08:50.596462 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:50.596429 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b7bf314-5d22-410b-a0a8-9b2602dd834e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-fqs8x\" (UID: \"6b7bf314-5d22-410b-a0a8-9b2602dd834e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fqs8x" Sep 18 03:08:50.596571 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:50.596486 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b7bf314-5d22-410b-a0a8-9b2602dd834e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-fqs8x\" (UID: \"6b7bf314-5d22-410b-a0a8-9b2602dd834e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fqs8x" Sep 18 03:08:50.685326 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:50.685290 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fqs8x" Sep 18 03:08:51.027282 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:51.027174 2578 generic.go:356] "Generic (PLEG): container finished" podID="1f0f73a2-8b4e-4884-922e-94e17ef5df72" containerID="fd5c2b77854ef8e1fe9d0e9e39e9032c6682f9aa06f3fbe107ae136724bf0515" exitCode=0 Sep 18 03:08:51.027282 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:51.027256 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nl2mw" event={"ID":"1f0f73a2-8b4e-4884-922e-94e17ef5df72","Type":"ContainerDied","Data":"fd5c2b77854ef8e1fe9d0e9e39e9032c6682f9aa06f3fbe107ae136724bf0515"} Sep 18 03:08:51.048925 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:51.048899 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-fqs8x"] Sep 18 03:08:51.060273 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:08:51.060244 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b7bf314_5d22_410b_a0a8_9b2602dd834e.slice/crio-e1ee792bb37c630a19929f11ef24246abc25eef6f7432d514ca67aa705d92bad WatchSource:0}: Error finding container e1ee792bb37c630a19929f11ef24246abc25eef6f7432d514ca67aa705d92bad: Status 404 returned error can't find the container with id e1ee792bb37c630a19929f11ef24246abc25eef6f7432d514ca67aa705d92bad Sep 18 03:08:52.032553 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:52.032516 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fqs8x" event={"ID":"6b7bf314-5d22-410b-a0a8-9b2602dd834e","Type":"ContainerStarted","Data":"1951d4bab5db9c88ea2cdadcbb00f65ba86ec8eb0dbd74dd59792cdfc92c51e3"} Sep 18 03:08:52.032923 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:52.032588 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fqs8x" event={"ID":"6b7bf314-5d22-410b-a0a8-9b2602dd834e","Type":"ContainerStarted","Data":"9ad0d0d1eb9db98fc137d970ef42987fb7a95e3a46b5775ed3033aa99b9639ce"} Sep 18 03:08:52.032923 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:52.032613 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fqs8x" event={"ID":"6b7bf314-5d22-410b-a0a8-9b2602dd834e","Type":"ContainerStarted","Data":"e1ee792bb37c630a19929f11ef24246abc25eef6f7432d514ca67aa705d92bad"} Sep 18 03:08:52.034419 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:52.034398 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nl2mw" event={"ID":"1f0f73a2-8b4e-4884-922e-94e17ef5df72","Type":"ContainerStarted","Data":"92711ade49fec3f4ab2b7bfb0074db32e62308126f72615382c0c5073c32cfcb"} Sep 18 03:08:52.034514 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:52.034436 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nl2mw" event={"ID":"1f0f73a2-8b4e-4884-922e-94e17ef5df72","Type":"ContainerStarted","Data":"06eb8a473a416235f247fb3cac2e3b225a389c236ef30e0a77b00a698cdac178"} Sep 18 03:08:53.040896 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:53.040862 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fqs8x" event={"ID":"6b7bf314-5d22-410b-a0a8-9b2602dd834e","Type":"ContainerStarted","Data":"4877b29b88dec7fc4c6ecd1e76b352a2fb35b2cad0495c712ed254b7f4de616b"} Sep 18 03:08:53.063224 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:53.063156 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-fqs8x" podStartSLOduration=4.197756966 podStartE2EDuration="5.063136732s" totalImagesPullingTime="865.379766ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:08:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:08:53.062060991 +0000 UTC m=+157.658014111" watchObservedRunningTime="2026-09-18 03:08:53.063136732 +0000 UTC m=+157.659089853" Sep 18 03:08:53.063393 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:53.063289 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nl2mw" podStartSLOduration=3.967794093 podStartE2EDuration="5.063281557s" totalImagesPullingTime="1.032177979s" totalInitContainerRuntime="63.309485ms" isStatefulPod=true podCreationTimestamp="2026-09-18 03:08:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:08:52.066759421 +0000 UTC m=+156.662712552" watchObservedRunningTime="2026-09-18 03:08:53.063281557 +0000 UTC m=+157.659234863" Sep 18 03:08:53.621153 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:53.621119 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-h2p9v"] Sep 18 03:08:53.627759 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:53.627733 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-h2p9v" Sep 18 03:08:53.630659 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:53.630632 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 18 03:08:53.631070 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:53.631046 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-42s9m\"" Sep 18 03:08:53.637974 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:53.637941 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-h2p9v"] Sep 18 03:08:53.721114 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:53.721080 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/91811aa9-183f-4397-8bae-45a6a5555963-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-h2p9v\" (UID: \"91811aa9-183f-4397-8bae-45a6a5555963\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-h2p9v" Sep 18 03:08:53.721298 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:53.721137 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhd4t\" (UniqueName: \"kubernetes.io/projected/91811aa9-183f-4397-8bae-45a6a5555963-kube-api-access-hhd4t\") pod \"monitoring-plugin-5984459ff8-h2p9v\" (UID: \"91811aa9-183f-4397-8bae-45a6a5555963\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-h2p9v" Sep 18 03:08:53.822329 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:53.822292 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhd4t\" (UniqueName: \"kubernetes.io/projected/91811aa9-183f-4397-8bae-45a6a5555963-kube-api-access-hhd4t\") pod \"monitoring-plugin-5984459ff8-h2p9v\" (UID: \"91811aa9-183f-4397-8bae-45a6a5555963\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-h2p9v" Sep 18 03:08:53.822504 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:53.822397 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/91811aa9-183f-4397-8bae-45a6a5555963-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-h2p9v\" (UID: \"91811aa9-183f-4397-8bae-45a6a5555963\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-h2p9v" Sep 18 03:08:53.824890 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:53.824859 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/91811aa9-183f-4397-8bae-45a6a5555963-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-h2p9v\" (UID: \"91811aa9-183f-4397-8bae-45a6a5555963\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-h2p9v" Sep 18 03:08:53.833319 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:53.833291 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhd4t\" (UniqueName: \"kubernetes.io/projected/91811aa9-183f-4397-8bae-45a6a5555963-kube-api-access-hhd4t\") pod \"monitoring-plugin-5984459ff8-h2p9v\" (UID: \"91811aa9-183f-4397-8bae-45a6a5555963\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-h2p9v" Sep 18 03:08:53.875964 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:53.875883 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5d846bf499-n47kw" podUID="2125c521-5e13-4541-9230-f8f93bd5cdbd" Sep 18 03:08:53.936224 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:53.936164 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-h2p9v" Sep 18 03:08:53.936404 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:08:53.936331 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kzq2n" podUID="851f3001-1c5d-4201-be57-76d2fb4c4e52" Sep 18 03:08:54.044853 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:54.044819 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:08:54.215949 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:54.215919 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-h2p9v"] Sep 18 03:08:54.218356 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:08:54.218330 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91811aa9_183f_4397_8bae_45a6a5555963.slice/crio-640c1af7c65a4875822fb46e734e2f14daa5947dbab7da23cfe0f5d9ee84679b WatchSource:0}: Error finding container 640c1af7c65a4875822fb46e734e2f14daa5947dbab7da23cfe0f5d9ee84679b: Status 404 returned error can't find the container with id 640c1af7c65a4875822fb46e734e2f14daa5947dbab7da23cfe0f5d9ee84679b Sep 18 03:08:55.049719 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.049661 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-h2p9v" event={"ID":"91811aa9-183f-4397-8bae-45a6a5555963","Type":"ContainerStarted","Data":"640c1af7c65a4875822fb46e734e2f14daa5947dbab7da23cfe0f5d9ee84679b"} Sep 18 03:08:55.722767 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.722688 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 03:08:55.727236 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.727202 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.734555 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.733972 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 18 03:08:55.734555 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.734383 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-px7hk\"" Sep 18 03:08:55.734765 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.734693 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 18 03:08:55.734816 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.734785 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 18 03:08:55.735059 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.735036 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 18 03:08:55.735150 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.735100 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 18 03:08:55.735759 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.735550 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 18 03:08:55.735759 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.735621 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 18 03:08:55.735759 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.735717 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 18 03:08:55.735926 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.735826 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 18 03:08:55.735926 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.735897 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 18 03:08:55.735926 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.735903 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8gdluqf4hu0mt\"" Sep 18 03:08:55.736074 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.735987 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 18 03:08:55.736074 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.736031 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 18 03:08:55.737535 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.737512 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 18 03:08:55.739767 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.739745 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 18 03:08:55.740072 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.740052 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 18 03:08:55.749605 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.749581 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 03:08:55.840494 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.840462 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.840494 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.840498 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.840714 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.840519 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.840714 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.840538 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.840714 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.840631 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.840714 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.840665 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cd0606f1-90a2-4e1d-adda-4de9923aabd8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.840714 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.840685 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.840714 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.840707 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftqdr\" (UniqueName: \"kubernetes.io/projected/cd0606f1-90a2-4e1d-adda-4de9923aabd8-kube-api-access-ftqdr\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.841012 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.840775 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-web-config\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.841012 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.840817 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-config\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.841012 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.840874 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cd0606f1-90a2-4e1d-adda-4de9923aabd8-config-out\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.841012 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.840906 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.841012 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.840937 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.841012 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.840976 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.841012 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.841009 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.841326 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.841032 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.841326 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.841061 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cd0606f1-90a2-4e1d-adda-4de9923aabd8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.841326 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.841084 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.841326 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.841111 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.841326 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.841163 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.942156 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.942104 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-config\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.942156 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.942160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cd0606f1-90a2-4e1d-adda-4de9923aabd8-config-out\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.942432 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.942178 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.942432 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.942212 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.942432 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.942234 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.942432 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.942264 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.942432 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.942312 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.942432 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.942353 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cd0606f1-90a2-4e1d-adda-4de9923aabd8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.942432 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.942387 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.942432 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.942417 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.942831 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.942450 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.942831 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.942478 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.942831 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.942504 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.942831 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.942530 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.942831 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.942558 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.943081 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.943030 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.945381 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.945350 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.945510 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.945394 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cd0606f1-90a2-4e1d-adda-4de9923aabd8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.945510 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.945425 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.945510 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.945448 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftqdr\" (UniqueName: \"kubernetes.io/projected/cd0606f1-90a2-4e1d-adda-4de9923aabd8-kube-api-access-ftqdr\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.945510 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.945495 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-web-config\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.945726 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.945548 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.945726 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.945693 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.945879 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.945859 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cd0606f1-90a2-4e1d-adda-4de9923aabd8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.946240 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.946217 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.946450 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.946429 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.946531 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.946450 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.946600 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.946548 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.946991 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.946970 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cd0606f1-90a2-4e1d-adda-4de9923aabd8-config-out\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.947509 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.947280 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-config\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.947509 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.947286 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.947670 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.947503 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.947670 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.947568 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.947670 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.947648 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.948150 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.948104 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-web-config\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.949222 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.949197 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cd0606f1-90a2-4e1d-adda-4de9923aabd8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.950049 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.950006 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.950591 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.950549 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.951954 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.951929 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:55.959535 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:55.959516 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftqdr\" (UniqueName: \"kubernetes.io/projected/cd0606f1-90a2-4e1d-adda-4de9923aabd8-kube-api-access-ftqdr\") pod \"prometheus-k8s-0\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:56.039721 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:56.039623 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:08:56.057805 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:56.057762 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-h2p9v" event={"ID":"91811aa9-183f-4397-8bae-45a6a5555963","Type":"ContainerStarted","Data":"9f3762bf4844394ec5caf504ac85f0a05345d41ecb07baf63f8a4cbd72d3cd1c"} Sep 18 03:08:56.058219 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:56.057936 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-h2p9v" Sep 18 03:08:56.063098 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:56.063072 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-h2p9v" Sep 18 03:08:56.084004 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:56.083933 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-h2p9v" podStartSLOduration=1.846880909 podStartE2EDuration="3.083910577s" totalImagesPullingTime="1.237029668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:08:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:08:56.081554877 +0000 UTC m=+160.677507998" watchObservedRunningTime="2026-09-18 03:08:56.083910577 +0000 UTC m=+160.679863697" Sep 18 03:08:56.344005 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:56.343972 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 03:08:56.347806 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:08:56.347770 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd0606f1_90a2_4e1d_adda_4de9923aabd8.slice/crio-06b9e40e6e4f2b686ad3affe57e3e7cb225ce0149bbb39165a018336307c02b7 WatchSource:0}: Error finding container 06b9e40e6e4f2b686ad3affe57e3e7cb225ce0149bbb39165a018336307c02b7: Status 404 returned error can't find the container with id 06b9e40e6e4f2b686ad3affe57e3e7cb225ce0149bbb39165a018336307c02b7 Sep 18 03:08:57.068200 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:57.068148 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd0606f1-90a2-4e1d-adda-4de9923aabd8","Type":"ContainerStarted","Data":"06b9e40e6e4f2b686ad3affe57e3e7cb225ce0149bbb39165a018336307c02b7"} Sep 18 03:08:58.073124 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:58.073089 2578 generic.go:356] "Generic (PLEG): container finished" podID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerID="f026c23235538a8d1b7b52130d69cfddb694328831361e46b003d2c49f845e0c" exitCode=0 Sep 18 03:08:58.073546 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:58.073201 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd0606f1-90a2-4e1d-adda-4de9923aabd8","Type":"ContainerDied","Data":"f026c23235538a8d1b7b52130d69cfddb694328831361e46b003d2c49f845e0c"} Sep 18 03:08:58.771497 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:58.771407 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-tls\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:08:58.774144 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:58.774107 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-tls\") pod \"image-registry-5d846bf499-n47kw\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:08:58.848351 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:58.848315 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qwc8j\"" Sep 18 03:08:58.855659 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:58.855632 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:08:58.873045 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:58.872996 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/851f3001-1c5d-4201-be57-76d2fb4c4e52-metrics-tls\") pod \"dns-default-kzq2n\" (UID: \"851f3001-1c5d-4201-be57-76d2fb4c4e52\") " pod="openshift-dns/dns-default-kzq2n" Sep 18 03:08:58.875831 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:58.875806 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/851f3001-1c5d-4201-be57-76d2fb4c4e52-metrics-tls\") pod \"dns-default-kzq2n\" (UID: \"851f3001-1c5d-4201-be57-76d2fb4c4e52\") " pod="openshift-dns/dns-default-kzq2n" Sep 18 03:08:59.149985 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:08:59.149950 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d846bf499-n47kw"] Sep 18 03:08:59.156140 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:08:59.156103 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2125c521_5e13_4541_9230_f8f93bd5cdbd.slice/crio-609a24191d46e472cccea0a2be46a55d105cb758801863d8346f7ace8033d635 WatchSource:0}: Error finding container 609a24191d46e472cccea0a2be46a55d105cb758801863d8346f7ace8033d635: Status 404 returned error can't find the container with id 609a24191d46e472cccea0a2be46a55d105cb758801863d8346f7ace8033d635 Sep 18 03:09:00.083952 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:00.083911 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d846bf499-n47kw" event={"ID":"2125c521-5e13-4541-9230-f8f93bd5cdbd","Type":"ContainerStarted","Data":"e0ef14ba22f63fc82460450a522abfcc723876de5a8e88a6556a0d6d7e317812"} Sep 18 03:09:00.084162 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:00.083972 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d846bf499-n47kw" event={"ID":"2125c521-5e13-4541-9230-f8f93bd5cdbd","Type":"ContainerStarted","Data":"609a24191d46e472cccea0a2be46a55d105cb758801863d8346f7ace8033d635"} Sep 18 03:09:00.084162 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:00.084064 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:09:00.109265 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:00.109175 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d846bf499-n47kw" podStartSLOduration=162.109155294 podStartE2EDuration="2m42.109155294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:06:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:09:00.108083802 +0000 UTC m=+164.704036927" watchObservedRunningTime="2026-09-18 03:09:00.109155294 +0000 UTC m=+164.705108415" Sep 18 03:09:02.094750 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:02.094708 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd0606f1-90a2-4e1d-adda-4de9923aabd8","Type":"ContainerStarted","Data":"0c88bf188a2d769d8abe0395455e78ddd6677948411a8fcf6dd93053f6ecc2d8"} Sep 18 03:09:02.095177 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:02.094789 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd0606f1-90a2-4e1d-adda-4de9923aabd8","Type":"ContainerStarted","Data":"e115d206282a672236fac8dd7c73ca38441a3718bc6363ffabffa60d763bc775"} Sep 18 03:09:03.176355 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:03.176328 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d846bf499-n47kw"] Sep 18 03:09:04.111383 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:04.111345 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd0606f1-90a2-4e1d-adda-4de9923aabd8","Type":"ContainerStarted","Data":"28dfd08d72f7690b7f02da14951a83dffba8457b59f63f91bb54f819f1edda04"} Sep 18 03:09:04.111559 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:04.111412 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd0606f1-90a2-4e1d-adda-4de9923aabd8","Type":"ContainerStarted","Data":"a4f728a93f88f99157b415e2054e9c83b208e1453e31dbdc3cec10b2dbbedb5e"} Sep 18 03:09:04.111559 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:04.111439 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd0606f1-90a2-4e1d-adda-4de9923aabd8","Type":"ContainerStarted","Data":"f5e71e78e0d9129ca48926bd37f90b16c58466e70f13927f474bcdadb7e2ed6f"} Sep 18 03:09:04.111559 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:04.111463 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd0606f1-90a2-4e1d-adda-4de9923aabd8","Type":"ContainerStarted","Data":"6342831fc876398676ffe68537840c38c5528cea1925f30f732cab65bd7dac8f"} Sep 18 03:09:04.152931 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:04.152839 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.383705965 podStartE2EDuration="9.152813768s" totalImagesPullingTime="5.747048015s" totalInitContainerRuntime="22.059788ms" isStatefulPod=false podCreationTimestamp="2026-09-18 03:08:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:09:04.151055136 +0000 UTC m=+168.747008258" watchObservedRunningTime="2026-09-18 03:09:04.152813768 +0000 UTC m=+168.748766880" Sep 18 03:09:04.452035 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:04.451945 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kzq2n" Sep 18 03:09:04.455257 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:04.455219 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zf6js\"" Sep 18 03:09:04.462767 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:04.462736 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kzq2n" Sep 18 03:09:04.760461 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:04.760384 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kzq2n"] Sep 18 03:09:04.764282 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:09:04.764250 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod851f3001_1c5d_4201_be57_76d2fb4c4e52.slice/crio-2465b53be6dd33364eae0068f0c773045ae44fb07c86a2d9cff0b70f81f4b459 WatchSource:0}: Error finding container 2465b53be6dd33364eae0068f0c773045ae44fb07c86a2d9cff0b70f81f4b459: Status 404 returned error can't find the container with id 2465b53be6dd33364eae0068f0c773045ae44fb07c86a2d9cff0b70f81f4b459 Sep 18 03:09:05.116965 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:05.116924 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kzq2n" event={"ID":"851f3001-1c5d-4201-be57-76d2fb4c4e52","Type":"ContainerStarted","Data":"2465b53be6dd33364eae0068f0c773045ae44fb07c86a2d9cff0b70f81f4b459"} Sep 18 03:09:06.039895 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:06.039855 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:09:07.129318 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:07.129275 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kzq2n" event={"ID":"851f3001-1c5d-4201-be57-76d2fb4c4e52","Type":"ContainerStarted","Data":"40a93b4151a154abefd148ea5f6700ff793613edfd4a13eea470035c14b8b567"} Sep 18 03:09:07.129726 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:07.129335 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kzq2n" event={"ID":"851f3001-1c5d-4201-be57-76d2fb4c4e52","Type":"ContainerStarted","Data":"16319bc98ff43e400ef1487df3b5d67e686d46e67009c7b83df1f7f3c6d157a1"} Sep 18 03:09:07.129726 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:07.129359 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kzq2n" Sep 18 03:09:07.152085 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:07.151523 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kzq2n" podStartSLOduration=135.237616646 podStartE2EDuration="2m17.15149907s" totalImagesPullingTime="1.913882424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:06:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:09:07.150145669 +0000 UTC m=+171.746098789" watchObservedRunningTime="2026-09-18 03:09:07.15149907 +0000 UTC m=+171.747452192" Sep 18 03:09:15.160062 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:15.160021 2578 generic.go:356] "Generic (PLEG): container finished" podID="75371579-d5c5-47c3-a75e-ec79499e4abb" containerID="84f222173bcf7f6fba0cee9007c05b5c053d371623dddf291947ab0109cc85a8" exitCode=0 Sep 18 03:09:15.160496 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:15.160090 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xcvnb" event={"ID":"75371579-d5c5-47c3-a75e-ec79499e4abb","Type":"ContainerDied","Data":"84f222173bcf7f6fba0cee9007c05b5c053d371623dddf291947ab0109cc85a8"} Sep 18 03:09:15.160496 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:15.160443 2578 scope.go:117] "RemoveContainer" containerID="84f222173bcf7f6fba0cee9007c05b5c053d371623dddf291947ab0109cc85a8" Sep 18 03:09:16.165593 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:16.165557 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-xcvnb" event={"ID":"75371579-d5c5-47c3-a75e-ec79499e4abb","Type":"ContainerStarted","Data":"c1805aa7a68fe864a61793429ccc2f6a2269304335a8f848cffb9ca5e1cddd12"} Sep 18 03:09:17.135763 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:17.135733 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kzq2n" Sep 18 03:09:23.185483 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:23.185448 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:09:28.203426 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:28.203364 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5d846bf499-n47kw" podUID="2125c521-5e13-4541-9230-f8f93bd5cdbd" containerName="registry" containerID="cri-o://e0ef14ba22f63fc82460450a522abfcc723876de5a8e88a6556a0d6d7e317812" gracePeriod=30 Sep 18 03:09:28.449648 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:28.449621 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:09:28.530499 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:28.530398 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-tls\") pod \"2125c521-5e13-4541-9230-f8f93bd5cdbd\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " Sep 18 03:09:28.530499 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:28.530454 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2125c521-5e13-4541-9230-f8f93bd5cdbd-image-registry-private-configuration\") pod \"2125c521-5e13-4541-9230-f8f93bd5cdbd\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " Sep 18 03:09:28.530499 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:28.530482 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2125c521-5e13-4541-9230-f8f93bd5cdbd-installation-pull-secrets\") pod \"2125c521-5e13-4541-9230-f8f93bd5cdbd\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " Sep 18 03:09:28.530777 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:28.530543 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2125c521-5e13-4541-9230-f8f93bd5cdbd-ca-trust-extracted\") pod \"2125c521-5e13-4541-9230-f8f93bd5cdbd\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " Sep 18 03:09:28.530777 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:28.530597 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2125c521-5e13-4541-9230-f8f93bd5cdbd-trusted-ca\") pod \"2125c521-5e13-4541-9230-f8f93bd5cdbd\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " Sep 18 03:09:28.530777 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:28.530627 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-bound-sa-token\") pod \"2125c521-5e13-4541-9230-f8f93bd5cdbd\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " Sep 18 03:09:28.530777 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:28.530663 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nls76\" (UniqueName: \"kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-kube-api-access-nls76\") pod \"2125c521-5e13-4541-9230-f8f93bd5cdbd\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " Sep 18 03:09:28.530960 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:28.530827 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-certificates\") pod \"2125c521-5e13-4541-9230-f8f93bd5cdbd\" (UID: \"2125c521-5e13-4541-9230-f8f93bd5cdbd\") " Sep 18 03:09:28.531967 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:28.531217 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2125c521-5e13-4541-9230-f8f93bd5cdbd-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2125c521-5e13-4541-9230-f8f93bd5cdbd" (UID: "2125c521-5e13-4541-9230-f8f93bd5cdbd"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:09:28.531967 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:28.531930 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2125c521-5e13-4541-9230-f8f93bd5cdbd" (UID: "2125c521-5e13-4541-9230-f8f93bd5cdbd"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:09:28.533684 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:28.533588 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2125c521-5e13-4541-9230-f8f93bd5cdbd-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2125c521-5e13-4541-9230-f8f93bd5cdbd" (UID: "2125c521-5e13-4541-9230-f8f93bd5cdbd"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:09:28.533684 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:28.533644 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-kube-api-access-nls76" (OuterVolumeSpecName: "kube-api-access-nls76") pod "2125c521-5e13-4541-9230-f8f93bd5cdbd" (UID: "2125c521-5e13-4541-9230-f8f93bd5cdbd"). InnerVolumeSpecName "kube-api-access-nls76". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:09:28.533850 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:28.533679 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2125c521-5e13-4541-9230-f8f93bd5cdbd-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2125c521-5e13-4541-9230-f8f93bd5cdbd" (UID: "2125c521-5e13-4541-9230-f8f93bd5cdbd"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:09:28.533850 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:28.533759 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2125c521-5e13-4541-9230-f8f93bd5cdbd" (UID: "2125c521-5e13-4541-9230-f8f93bd5cdbd"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:09:28.533850 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:28.533763 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2125c521-5e13-4541-9230-f8f93bd5cdbd" (UID: "2125c521-5e13-4541-9230-f8f93bd5cdbd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:09:28.539872 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:28.539841 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2125c521-5e13-4541-9230-f8f93bd5cdbd-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2125c521-5e13-4541-9230-f8f93bd5cdbd" (UID: "2125c521-5e13-4541-9230-f8f93bd5cdbd"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 03:09:28.631856 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:28.631823 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2125c521-5e13-4541-9230-f8f93bd5cdbd-ca-trust-extracted\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Sep 18 03:09:28.631856 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:28.631853 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2125c521-5e13-4541-9230-f8f93bd5cdbd-trusted-ca\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Sep 18 03:09:28.631856 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:28.631864 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-bound-sa-token\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Sep 18 03:09:28.632064 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:28.631873 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nls76\" (UniqueName: \"kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-kube-api-access-nls76\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Sep 18 03:09:28.632064 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:28.631884 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-certificates\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Sep 18 03:09:28.632064 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:28.631892 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2125c521-5e13-4541-9230-f8f93bd5cdbd-registry-tls\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Sep 18 03:09:28.632064 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:28.631903 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2125c521-5e13-4541-9230-f8f93bd5cdbd-image-registry-private-configuration\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Sep 18 03:09:28.632064 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:28.631913 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2125c521-5e13-4541-9230-f8f93bd5cdbd-installation-pull-secrets\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Sep 18 03:09:29.218112 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:29.218076 2578 generic.go:356] "Generic (PLEG): container finished" podID="2125c521-5e13-4541-9230-f8f93bd5cdbd" containerID="e0ef14ba22f63fc82460450a522abfcc723876de5a8e88a6556a0d6d7e317812" exitCode=0 Sep 18 03:09:29.218545 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:29.218128 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d846bf499-n47kw" Sep 18 03:09:29.218545 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:29.218163 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d846bf499-n47kw" event={"ID":"2125c521-5e13-4541-9230-f8f93bd5cdbd","Type":"ContainerDied","Data":"e0ef14ba22f63fc82460450a522abfcc723876de5a8e88a6556a0d6d7e317812"} Sep 18 03:09:29.218545 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:29.218234 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d846bf499-n47kw" event={"ID":"2125c521-5e13-4541-9230-f8f93bd5cdbd","Type":"ContainerDied","Data":"609a24191d46e472cccea0a2be46a55d105cb758801863d8346f7ace8033d635"} Sep 18 03:09:29.218545 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:29.218267 2578 scope.go:117] "RemoveContainer" containerID="e0ef14ba22f63fc82460450a522abfcc723876de5a8e88a6556a0d6d7e317812" Sep 18 03:09:29.227369 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:29.227352 2578 scope.go:117] "RemoveContainer" containerID="e0ef14ba22f63fc82460450a522abfcc723876de5a8e88a6556a0d6d7e317812" Sep 18 03:09:29.227688 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:09:29.227669 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0ef14ba22f63fc82460450a522abfcc723876de5a8e88a6556a0d6d7e317812\": container with ID starting with e0ef14ba22f63fc82460450a522abfcc723876de5a8e88a6556a0d6d7e317812 not found: ID does not exist" containerID="e0ef14ba22f63fc82460450a522abfcc723876de5a8e88a6556a0d6d7e317812" Sep 18 03:09:29.227737 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:29.227696 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0ef14ba22f63fc82460450a522abfcc723876de5a8e88a6556a0d6d7e317812"} err="failed to get container status \"e0ef14ba22f63fc82460450a522abfcc723876de5a8e88a6556a0d6d7e317812\": rpc error: code = NotFound desc = could not find container \"e0ef14ba22f63fc82460450a522abfcc723876de5a8e88a6556a0d6d7e317812\": container with ID starting with e0ef14ba22f63fc82460450a522abfcc723876de5a8e88a6556a0d6d7e317812 not found: ID does not exist" Sep 18 03:09:29.258661 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:29.258624 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d846bf499-n47kw"] Sep 18 03:09:29.261774 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:29.261743 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5d846bf499-n47kw"] Sep 18 03:09:29.456831 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:29.456798 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2125c521-5e13-4541-9230-f8f93bd5cdbd" path="/var/lib/kubelet/pods/2125c521-5e13-4541-9230-f8f93bd5cdbd/volumes" Sep 18 03:09:40.263579 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:40.263545 2578 generic.go:356] "Generic (PLEG): container finished" podID="97141cd8-00c5-4fad-a218-c5536c869671" containerID="e15e9716ff46669507dc63ecba4dc453c95869f9d7e76fa9f2d0df98892f1a7c" exitCode=0 Sep 18 03:09:40.263976 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:40.263611 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-2rkw7" event={"ID":"97141cd8-00c5-4fad-a218-c5536c869671","Type":"ContainerDied","Data":"e15e9716ff46669507dc63ecba4dc453c95869f9d7e76fa9f2d0df98892f1a7c"} Sep 18 03:09:40.263976 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:40.263950 2578 scope.go:117] "RemoveContainer" containerID="e15e9716ff46669507dc63ecba4dc453c95869f9d7e76fa9f2d0df98892f1a7c" Sep 18 03:09:41.270329 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:41.270291 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-2rkw7" event={"ID":"97141cd8-00c5-4fad-a218-c5536c869671","Type":"ContainerStarted","Data":"5d528854f4df0ffc357712644a0410b2243284de7389bacf44c3cb34f1166e9c"} Sep 18 03:09:56.039859 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:56.039816 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:09:56.058636 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:56.058611 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:09:56.350059 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:09:56.350032 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:14.117578 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:14.117538 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 03:10:14.118301 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:14.117867 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerName="kube-rbac-proxy-web" containerID="cri-o://6342831fc876398676ffe68537840c38c5528cea1925f30f732cab65bd7dac8f" gracePeriod=600 Sep 18 03:10:14.118301 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:14.117864 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerName="prometheus" containerID="cri-o://e115d206282a672236fac8dd7c73ca38441a3718bc6363ffabffa60d763bc775" gracePeriod=600 Sep 18 03:10:14.118301 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:14.117865 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerName="kube-rbac-proxy" containerID="cri-o://f5e71e78e0d9129ca48926bd37f90b16c58466e70f13927f474bcdadb7e2ed6f" gracePeriod=600 Sep 18 03:10:14.118301 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:14.117900 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerName="config-reloader" containerID="cri-o://0c88bf188a2d769d8abe0395455e78ddd6677948411a8fcf6dd93053f6ecc2d8" gracePeriod=600 Sep 18 03:10:14.118301 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:14.117955 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a4f728a93f88f99157b415e2054e9c83b208e1453e31dbdc3cec10b2dbbedb5e" gracePeriod=600 Sep 18 03:10:14.118301 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:14.117888 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerName="thanos-sidecar" containerID="cri-o://28dfd08d72f7690b7f02da14951a83dffba8457b59f63f91bb54f819f1edda04" gracePeriod=600 Sep 18 03:10:14.409037 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:14.408946 2578 generic.go:356] "Generic (PLEG): container finished" podID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerID="a4f728a93f88f99157b415e2054e9c83b208e1453e31dbdc3cec10b2dbbedb5e" exitCode=0 Sep 18 03:10:14.409037 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:14.408971 2578 generic.go:356] "Generic (PLEG): container finished" podID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerID="f5e71e78e0d9129ca48926bd37f90b16c58466e70f13927f474bcdadb7e2ed6f" exitCode=0 Sep 18 03:10:14.409037 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:14.408978 2578 generic.go:356] "Generic (PLEG): container finished" podID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerID="28dfd08d72f7690b7f02da14951a83dffba8457b59f63f91bb54f819f1edda04" exitCode=0 Sep 18 03:10:14.409037 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:14.408984 2578 generic.go:356] "Generic (PLEG): container finished" podID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerID="0c88bf188a2d769d8abe0395455e78ddd6677948411a8fcf6dd93053f6ecc2d8" exitCode=0 Sep 18 03:10:14.409037 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:14.408989 2578 generic.go:356] "Generic (PLEG): container finished" podID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerID="e115d206282a672236fac8dd7c73ca38441a3718bc6363ffabffa60d763bc775" exitCode=0 Sep 18 03:10:14.409037 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:14.409018 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd0606f1-90a2-4e1d-adda-4de9923aabd8","Type":"ContainerDied","Data":"a4f728a93f88f99157b415e2054e9c83b208e1453e31dbdc3cec10b2dbbedb5e"} Sep 18 03:10:14.409410 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:14.409101 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd0606f1-90a2-4e1d-adda-4de9923aabd8","Type":"ContainerDied","Data":"f5e71e78e0d9129ca48926bd37f90b16c58466e70f13927f474bcdadb7e2ed6f"} Sep 18 03:10:14.409410 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:14.409138 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd0606f1-90a2-4e1d-adda-4de9923aabd8","Type":"ContainerDied","Data":"28dfd08d72f7690b7f02da14951a83dffba8457b59f63f91bb54f819f1edda04"} Sep 18 03:10:14.409410 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:14.409174 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd0606f1-90a2-4e1d-adda-4de9923aabd8","Type":"ContainerDied","Data":"0c88bf188a2d769d8abe0395455e78ddd6677948411a8fcf6dd93053f6ecc2d8"} Sep 18 03:10:14.409410 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:14.409237 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd0606f1-90a2-4e1d-adda-4de9923aabd8","Type":"ContainerDied","Data":"e115d206282a672236fac8dd7c73ca38441a3718bc6363ffabffa60d763bc775"} Sep 18 03:10:15.365517 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.365492 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:15.417164 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.417134 2578 generic.go:356] "Generic (PLEG): container finished" podID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerID="6342831fc876398676ffe68537840c38c5528cea1925f30f732cab65bd7dac8f" exitCode=0 Sep 18 03:10:15.417349 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.417222 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd0606f1-90a2-4e1d-adda-4de9923aabd8","Type":"ContainerDied","Data":"6342831fc876398676ffe68537840c38c5528cea1925f30f732cab65bd7dac8f"} Sep 18 03:10:15.417349 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.417300 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cd0606f1-90a2-4e1d-adda-4de9923aabd8","Type":"ContainerDied","Data":"06b9e40e6e4f2b686ad3affe57e3e7cb225ce0149bbb39165a018336307c02b7"} Sep 18 03:10:15.417349 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.417238 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:15.417349 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.417335 2578 scope.go:117] "RemoveContainer" containerID="a4f728a93f88f99157b415e2054e9c83b208e1453e31dbdc3cec10b2dbbedb5e" Sep 18 03:10:15.425963 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.425945 2578 scope.go:117] "RemoveContainer" containerID="f5e71e78e0d9129ca48926bd37f90b16c58466e70f13927f474bcdadb7e2ed6f" Sep 18 03:10:15.433092 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.433071 2578 scope.go:117] "RemoveContainer" containerID="6342831fc876398676ffe68537840c38c5528cea1925f30f732cab65bd7dac8f" Sep 18 03:10:15.443901 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.443880 2578 scope.go:117] "RemoveContainer" containerID="28dfd08d72f7690b7f02da14951a83dffba8457b59f63f91bb54f819f1edda04" Sep 18 03:10:15.450935 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.450916 2578 scope.go:117] "RemoveContainer" containerID="0c88bf188a2d769d8abe0395455e78ddd6677948411a8fcf6dd93053f6ecc2d8" Sep 18 03:10:15.458820 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.458789 2578 scope.go:117] "RemoveContainer" containerID="e115d206282a672236fac8dd7c73ca38441a3718bc6363ffabffa60d763bc775" Sep 18 03:10:15.466275 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.466251 2578 scope.go:117] "RemoveContainer" containerID="f026c23235538a8d1b7b52130d69cfddb694328831361e46b003d2c49f845e0c" Sep 18 03:10:15.472700 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.472683 2578 scope.go:117] "RemoveContainer" containerID="a4f728a93f88f99157b415e2054e9c83b208e1453e31dbdc3cec10b2dbbedb5e" Sep 18 03:10:15.472975 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:10:15.472958 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4f728a93f88f99157b415e2054e9c83b208e1453e31dbdc3cec10b2dbbedb5e\": container with ID starting with a4f728a93f88f99157b415e2054e9c83b208e1453e31dbdc3cec10b2dbbedb5e not found: ID does not exist" containerID="a4f728a93f88f99157b415e2054e9c83b208e1453e31dbdc3cec10b2dbbedb5e" Sep 18 03:10:15.473041 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.472986 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4f728a93f88f99157b415e2054e9c83b208e1453e31dbdc3cec10b2dbbedb5e"} err="failed to get container status \"a4f728a93f88f99157b415e2054e9c83b208e1453e31dbdc3cec10b2dbbedb5e\": rpc error: code = NotFound desc = could not find container \"a4f728a93f88f99157b415e2054e9c83b208e1453e31dbdc3cec10b2dbbedb5e\": container with ID starting with a4f728a93f88f99157b415e2054e9c83b208e1453e31dbdc3cec10b2dbbedb5e not found: ID does not exist" Sep 18 03:10:15.473041 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.473004 2578 scope.go:117] "RemoveContainer" containerID="f5e71e78e0d9129ca48926bd37f90b16c58466e70f13927f474bcdadb7e2ed6f" Sep 18 03:10:15.473254 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:10:15.473238 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5e71e78e0d9129ca48926bd37f90b16c58466e70f13927f474bcdadb7e2ed6f\": container with ID starting with f5e71e78e0d9129ca48926bd37f90b16c58466e70f13927f474bcdadb7e2ed6f not found: ID does not exist" containerID="f5e71e78e0d9129ca48926bd37f90b16c58466e70f13927f474bcdadb7e2ed6f" Sep 18 03:10:15.473307 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.473257 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5e71e78e0d9129ca48926bd37f90b16c58466e70f13927f474bcdadb7e2ed6f"} err="failed to get container status \"f5e71e78e0d9129ca48926bd37f90b16c58466e70f13927f474bcdadb7e2ed6f\": rpc error: code = NotFound desc = could not find container \"f5e71e78e0d9129ca48926bd37f90b16c58466e70f13927f474bcdadb7e2ed6f\": container with ID starting with f5e71e78e0d9129ca48926bd37f90b16c58466e70f13927f474bcdadb7e2ed6f not found: ID does not exist" Sep 18 03:10:15.473307 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.473271 2578 scope.go:117] "RemoveContainer" containerID="6342831fc876398676ffe68537840c38c5528cea1925f30f732cab65bd7dac8f" Sep 18 03:10:15.473497 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:10:15.473482 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6342831fc876398676ffe68537840c38c5528cea1925f30f732cab65bd7dac8f\": container with ID starting with 6342831fc876398676ffe68537840c38c5528cea1925f30f732cab65bd7dac8f not found: ID does not exist" containerID="6342831fc876398676ffe68537840c38c5528cea1925f30f732cab65bd7dac8f" Sep 18 03:10:15.473540 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.473499 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6342831fc876398676ffe68537840c38c5528cea1925f30f732cab65bd7dac8f"} err="failed to get container status \"6342831fc876398676ffe68537840c38c5528cea1925f30f732cab65bd7dac8f\": rpc error: code = NotFound desc = could not find container \"6342831fc876398676ffe68537840c38c5528cea1925f30f732cab65bd7dac8f\": container with ID starting with 6342831fc876398676ffe68537840c38c5528cea1925f30f732cab65bd7dac8f not found: ID does not exist" Sep 18 03:10:15.473540 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.473511 2578 scope.go:117] "RemoveContainer" containerID="28dfd08d72f7690b7f02da14951a83dffba8457b59f63f91bb54f819f1edda04" Sep 18 03:10:15.473698 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:10:15.473679 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28dfd08d72f7690b7f02da14951a83dffba8457b59f63f91bb54f819f1edda04\": container with ID starting with 28dfd08d72f7690b7f02da14951a83dffba8457b59f63f91bb54f819f1edda04 not found: ID does not exist" containerID="28dfd08d72f7690b7f02da14951a83dffba8457b59f63f91bb54f819f1edda04" Sep 18 03:10:15.473737 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.473701 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28dfd08d72f7690b7f02da14951a83dffba8457b59f63f91bb54f819f1edda04"} err="failed to get container status \"28dfd08d72f7690b7f02da14951a83dffba8457b59f63f91bb54f819f1edda04\": rpc error: code = NotFound desc = could not find container \"28dfd08d72f7690b7f02da14951a83dffba8457b59f63f91bb54f819f1edda04\": container with ID starting with 28dfd08d72f7690b7f02da14951a83dffba8457b59f63f91bb54f819f1edda04 not found: ID does not exist" Sep 18 03:10:15.473737 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.473713 2578 scope.go:117] "RemoveContainer" containerID="0c88bf188a2d769d8abe0395455e78ddd6677948411a8fcf6dd93053f6ecc2d8" Sep 18 03:10:15.473922 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:10:15.473908 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c88bf188a2d769d8abe0395455e78ddd6677948411a8fcf6dd93053f6ecc2d8\": container with ID starting with 0c88bf188a2d769d8abe0395455e78ddd6677948411a8fcf6dd93053f6ecc2d8 not found: ID does not exist" containerID="0c88bf188a2d769d8abe0395455e78ddd6677948411a8fcf6dd93053f6ecc2d8" Sep 18 03:10:15.473960 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.473924 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c88bf188a2d769d8abe0395455e78ddd6677948411a8fcf6dd93053f6ecc2d8"} err="failed to get container status \"0c88bf188a2d769d8abe0395455e78ddd6677948411a8fcf6dd93053f6ecc2d8\": rpc error: code = NotFound desc = could not find container \"0c88bf188a2d769d8abe0395455e78ddd6677948411a8fcf6dd93053f6ecc2d8\": container with ID starting with 0c88bf188a2d769d8abe0395455e78ddd6677948411a8fcf6dd93053f6ecc2d8 not found: ID does not exist" Sep 18 03:10:15.473960 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.473936 2578 scope.go:117] "RemoveContainer" containerID="e115d206282a672236fac8dd7c73ca38441a3718bc6363ffabffa60d763bc775" Sep 18 03:10:15.474196 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:10:15.474162 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e115d206282a672236fac8dd7c73ca38441a3718bc6363ffabffa60d763bc775\": container with ID starting with e115d206282a672236fac8dd7c73ca38441a3718bc6363ffabffa60d763bc775 not found: ID does not exist" containerID="e115d206282a672236fac8dd7c73ca38441a3718bc6363ffabffa60d763bc775" Sep 18 03:10:15.474250 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.474196 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e115d206282a672236fac8dd7c73ca38441a3718bc6363ffabffa60d763bc775"} err="failed to get container status \"e115d206282a672236fac8dd7c73ca38441a3718bc6363ffabffa60d763bc775\": rpc error: code = NotFound desc = could not find container \"e115d206282a672236fac8dd7c73ca38441a3718bc6363ffabffa60d763bc775\": container with ID starting with e115d206282a672236fac8dd7c73ca38441a3718bc6363ffabffa60d763bc775 not found: ID does not exist" Sep 18 03:10:15.474250 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.474211 2578 scope.go:117] "RemoveContainer" containerID="f026c23235538a8d1b7b52130d69cfddb694328831361e46b003d2c49f845e0c" Sep 18 03:10:15.474463 ip-10-0-138-38 kubenswrapper[2578]: E0918 03:10:15.474446 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f026c23235538a8d1b7b52130d69cfddb694328831361e46b003d2c49f845e0c\": container with ID starting with f026c23235538a8d1b7b52130d69cfddb694328831361e46b003d2c49f845e0c not found: ID does not exist" containerID="f026c23235538a8d1b7b52130d69cfddb694328831361e46b003d2c49f845e0c" Sep 18 03:10:15.474463 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.474462 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f026c23235538a8d1b7b52130d69cfddb694328831361e46b003d2c49f845e0c"} err="failed to get container status \"f026c23235538a8d1b7b52130d69cfddb694328831361e46b003d2c49f845e0c\": rpc error: code = NotFound desc = could not find container \"f026c23235538a8d1b7b52130d69cfddb694328831361e46b003d2c49f845e0c\": container with ID starting with f026c23235538a8d1b7b52130d69cfddb694328831361e46b003d2c49f845e0c not found: ID does not exist" Sep 18 03:10:15.529925 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.529893 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-thanos-prometheus-http-client-file\") pod \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " Sep 18 03:10:15.529925 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.529928 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " Sep 18 03:10:15.530172 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.529948 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-web-config\") pod \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " Sep 18 03:10:15.530172 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.529978 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-grpc-tls\") pod \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " Sep 18 03:10:15.530172 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.530007 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cd0606f1-90a2-4e1d-adda-4de9923aabd8-prometheus-k8s-db\") pod \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " Sep 18 03:10:15.530172 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.530034 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-config\") pod \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " Sep 18 03:10:15.530172 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.530084 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cd0606f1-90a2-4e1d-adda-4de9923aabd8-config-out\") pod \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " Sep 18 03:10:15.530172 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.530108 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cd0606f1-90a2-4e1d-adda-4de9923aabd8-tls-assets\") pod \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " Sep 18 03:10:15.530172 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.530132 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-prometheus-trusted-ca-bundle\") pod \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " Sep 18 03:10:15.530172 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.530158 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-prometheus-k8s-rulefiles-1\") pod \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " Sep 18 03:10:15.530599 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.530213 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-configmap-kubelet-serving-ca-bundle\") pod \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " Sep 18 03:10:15.530599 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.530255 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-prometheus-k8s-rulefiles-2\") pod \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " Sep 18 03:10:15.530599 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.530280 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-metrics-client-certs\") pod \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " Sep 18 03:10:15.530599 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.530303 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-configmap-metrics-client-ca\") pod \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " Sep 18 03:10:15.530599 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.530356 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftqdr\" (UniqueName: \"kubernetes.io/projected/cd0606f1-90a2-4e1d-adda-4de9923aabd8-kube-api-access-ftqdr\") pod \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " Sep 18 03:10:15.530599 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.530411 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-kube-rbac-proxy\") pod \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " Sep 18 03:10:15.530599 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.530445 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-prometheus-k8s-rulefiles-0\") pod \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " Sep 18 03:10:15.530599 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.530469 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " Sep 18 03:10:15.530599 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.530497 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-configmap-serving-certs-ca-bundle\") pod \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " Sep 18 03:10:15.530599 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.530526 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-prometheus-k8s-tls\") pod \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\" (UID: \"cd0606f1-90a2-4e1d-adda-4de9923aabd8\") " Sep 18 03:10:15.531601 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.531507 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd0606f1-90a2-4e1d-adda-4de9923aabd8-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "cd0606f1-90a2-4e1d-adda-4de9923aabd8" (UID: "cd0606f1-90a2-4e1d-adda-4de9923aabd8"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 03:10:15.531799 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.531753 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "cd0606f1-90a2-4e1d-adda-4de9923aabd8" (UID: "cd0606f1-90a2-4e1d-adda-4de9923aabd8"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:10:15.532670 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.532396 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "cd0606f1-90a2-4e1d-adda-4de9923aabd8" (UID: "cd0606f1-90a2-4e1d-adda-4de9923aabd8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:10:15.532670 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.532427 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "cd0606f1-90a2-4e1d-adda-4de9923aabd8" (UID: "cd0606f1-90a2-4e1d-adda-4de9923aabd8"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:10:15.533311 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.532828 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "cd0606f1-90a2-4e1d-adda-4de9923aabd8" (UID: "cd0606f1-90a2-4e1d-adda-4de9923aabd8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:10:15.533311 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.532969 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "cd0606f1-90a2-4e1d-adda-4de9923aabd8" (UID: "cd0606f1-90a2-4e1d-adda-4de9923aabd8"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:10:15.533311 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.533008 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "cd0606f1-90a2-4e1d-adda-4de9923aabd8" (UID: "cd0606f1-90a2-4e1d-adda-4de9923aabd8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:10:15.533311 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.533045 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-config" (OuterVolumeSpecName: "config") pod "cd0606f1-90a2-4e1d-adda-4de9923aabd8" (UID: "cd0606f1-90a2-4e1d-adda-4de9923aabd8"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:10:15.533555 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.533493 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "cd0606f1-90a2-4e1d-adda-4de9923aabd8" (UID: "cd0606f1-90a2-4e1d-adda-4de9923aabd8"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:10:15.533779 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.533741 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "cd0606f1-90a2-4e1d-adda-4de9923aabd8" (UID: "cd0606f1-90a2-4e1d-adda-4de9923aabd8"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:10:15.535176 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.534996 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "cd0606f1-90a2-4e1d-adda-4de9923aabd8" (UID: "cd0606f1-90a2-4e1d-adda-4de9923aabd8"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:10:15.535176 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.535133 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "cd0606f1-90a2-4e1d-adda-4de9923aabd8" (UID: "cd0606f1-90a2-4e1d-adda-4de9923aabd8"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:10:15.535176 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.535149 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "cd0606f1-90a2-4e1d-adda-4de9923aabd8" (UID: "cd0606f1-90a2-4e1d-adda-4de9923aabd8"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:10:15.535512 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.535471 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd0606f1-90a2-4e1d-adda-4de9923aabd8-config-out" (OuterVolumeSpecName: "config-out") pod "cd0606f1-90a2-4e1d-adda-4de9923aabd8" (UID: "cd0606f1-90a2-4e1d-adda-4de9923aabd8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 03:10:15.535683 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.535653 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "cd0606f1-90a2-4e1d-adda-4de9923aabd8" (UID: "cd0606f1-90a2-4e1d-adda-4de9923aabd8"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:10:15.535819 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.535795 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd0606f1-90a2-4e1d-adda-4de9923aabd8-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "cd0606f1-90a2-4e1d-adda-4de9923aabd8" (UID: "cd0606f1-90a2-4e1d-adda-4de9923aabd8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:10:15.535910 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.535875 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "cd0606f1-90a2-4e1d-adda-4de9923aabd8" (UID: "cd0606f1-90a2-4e1d-adda-4de9923aabd8"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:10:15.536111 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.536097 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "cd0606f1-90a2-4e1d-adda-4de9923aabd8" (UID: "cd0606f1-90a2-4e1d-adda-4de9923aabd8"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:10:15.536561 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.536536 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd0606f1-90a2-4e1d-adda-4de9923aabd8-kube-api-access-ftqdr" (OuterVolumeSpecName: "kube-api-access-ftqdr") pod "cd0606f1-90a2-4e1d-adda-4de9923aabd8" (UID: "cd0606f1-90a2-4e1d-adda-4de9923aabd8"). InnerVolumeSpecName "kube-api-access-ftqdr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:10:15.544547 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.544524 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-web-config" (OuterVolumeSpecName: "web-config") pod "cd0606f1-90a2-4e1d-adda-4de9923aabd8" (UID: "cd0606f1-90a2-4e1d-adda-4de9923aabd8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:10:15.631518 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.631490 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cd0606f1-90a2-4e1d-adda-4de9923aabd8-config-out\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Sep 18 03:10:15.631518 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.631512 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cd0606f1-90a2-4e1d-adda-4de9923aabd8-tls-assets\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Sep 18 03:10:15.631518 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.631523 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Sep 18 03:10:15.631811 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.631532 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Sep 18 03:10:15.631811 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.631544 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Sep 18 03:10:15.631811 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.631554 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Sep 18 03:10:15.631811 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.631563 2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-metrics-client-certs\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Sep 18 03:10:15.631811 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.631571 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-configmap-metrics-client-ca\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Sep 18 03:10:15.631811 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.631581 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftqdr\" (UniqueName: \"kubernetes.io/projected/cd0606f1-90a2-4e1d-adda-4de9923aabd8-kube-api-access-ftqdr\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Sep 18 03:10:15.631811 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.631590 2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-kube-rbac-proxy\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Sep 18 03:10:15.631811 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.631597 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Sep 18 03:10:15.631811 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.631606 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Sep 18 03:10:15.631811 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.631615 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd0606f1-90a2-4e1d-adda-4de9923aabd8-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Sep 18 03:10:15.631811 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.631624 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Sep 18 03:10:15.631811 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.631632 2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Sep 18 03:10:15.631811 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.631641 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Sep 18 03:10:15.631811 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.631649 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-web-config\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Sep 18 03:10:15.631811 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.631657 2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-secret-grpc-tls\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Sep 18 03:10:15.631811 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.631664 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cd0606f1-90a2-4e1d-adda-4de9923aabd8-prometheus-k8s-db\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Sep 18 03:10:15.631811 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.631671 2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/cd0606f1-90a2-4e1d-adda-4de9923aabd8-config\") on node \"ip-10-0-138-38.ec2.internal\" DevicePath \"\"" Sep 18 03:10:15.742992 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.742962 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 03:10:15.748690 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.748663 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 03:10:15.782091 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.782055 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 03:10:15.782343 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.782329 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerName="thanos-sidecar" Sep 18 03:10:15.782343 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.782344 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerName="thanos-sidecar" Sep 18 03:10:15.782413 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.782356 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2125c521-5e13-4541-9230-f8f93bd5cdbd" containerName="registry" Sep 18 03:10:15.782413 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.782362 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2125c521-5e13-4541-9230-f8f93bd5cdbd" containerName="registry" Sep 18 03:10:15.782413 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.782372 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerName="kube-rbac-proxy-thanos" Sep 18 03:10:15.782413 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.782378 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerName="kube-rbac-proxy-thanos" Sep 18 03:10:15.782413 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.782386 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerName="init-config-reloader" Sep 18 03:10:15.782413 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.782391 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerName="init-config-reloader" Sep 18 03:10:15.782413 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.782398 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerName="config-reloader" Sep 18 03:10:15.782413 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.782403 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerName="config-reloader" Sep 18 03:10:15.782413 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.782411 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerName="kube-rbac-proxy-web" Sep 18 03:10:15.782413 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.782415 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerName="kube-rbac-proxy-web" Sep 18 03:10:15.782689 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.782424 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerName="prometheus" Sep 18 03:10:15.782689 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.782429 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerName="prometheus" Sep 18 03:10:15.782689 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.782437 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerName="kube-rbac-proxy" Sep 18 03:10:15.782689 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.782442 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerName="kube-rbac-proxy" Sep 18 03:10:15.782689 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.782484 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerName="config-reloader" Sep 18 03:10:15.782689 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.782490 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerName="thanos-sidecar" Sep 18 03:10:15.782689 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.782496 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerName="prometheus" Sep 18 03:10:15.782689 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.782501 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerName="kube-rbac-proxy" Sep 18 03:10:15.782689 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.782505 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2125c521-5e13-4541-9230-f8f93bd5cdbd" containerName="registry" Sep 18 03:10:15.782689 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.782510 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerName="kube-rbac-proxy-web" Sep 18 03:10:15.782689 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.782516 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" containerName="kube-rbac-proxy-thanos" Sep 18 03:10:15.785959 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.785941 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:15.788202 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.788163 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 18 03:10:15.788305 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.788228 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 18 03:10:15.788771 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.788751 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 18 03:10:15.788936 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.788867 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 18 03:10:15.788936 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.788900 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 18 03:10:15.789084 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.789004 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 18 03:10:15.789084 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.789049 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 18 03:10:15.789258 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.789162 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 18 03:10:15.789325 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.789307 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-px7hk\"" Sep 18 03:10:15.789364 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.789313 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 18 03:10:15.789583 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.789571 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 18 03:10:15.789642 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.789572 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 18 03:10:15.789718 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.789702 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8gdluqf4hu0mt\"" Sep 18 03:10:15.789854 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.789824 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 18 03:10:15.789977 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.789896 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 18 03:10:15.798055 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.798032 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 18 03:10:15.799676 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.799654 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 18 03:10:15.804463 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.804442 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 03:10:15.933598 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.933564 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/576bb152-0e46-4280-8e23-e874e0d38673-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:15.933598 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.933602 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/576bb152-0e46-4280-8e23-e874e0d38673-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:15.933883 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.933623 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/576bb152-0e46-4280-8e23-e874e0d38673-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:15.933883 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.933688 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/576bb152-0e46-4280-8e23-e874e0d38673-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:15.933883 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.933726 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/576bb152-0e46-4280-8e23-e874e0d38673-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:15.933883 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.933760 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/576bb152-0e46-4280-8e23-e874e0d38673-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:15.933883 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.933795 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/576bb152-0e46-4280-8e23-e874e0d38673-web-config\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:15.933883 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.933826 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/576bb152-0e46-4280-8e23-e874e0d38673-config\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:15.933883 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.933847 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/576bb152-0e46-4280-8e23-e874e0d38673-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:15.934138 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.933890 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/576bb152-0e46-4280-8e23-e874e0d38673-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:15.934138 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.933922 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/576bb152-0e46-4280-8e23-e874e0d38673-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:15.934138 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.933941 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxzl6\" (UniqueName: \"kubernetes.io/projected/576bb152-0e46-4280-8e23-e874e0d38673-kube-api-access-dxzl6\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:15.934138 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.933992 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/576bb152-0e46-4280-8e23-e874e0d38673-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:15.934138 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.934032 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/576bb152-0e46-4280-8e23-e874e0d38673-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:15.934138 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.934056 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/576bb152-0e46-4280-8e23-e874e0d38673-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:15.934138 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.934074 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/576bb152-0e46-4280-8e23-e874e0d38673-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:15.934138 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.934099 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/576bb152-0e46-4280-8e23-e874e0d38673-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:15.934138 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.934118 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/576bb152-0e46-4280-8e23-e874e0d38673-config-out\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:15.934138 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.934139 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/576bb152-0e46-4280-8e23-e874e0d38673-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:15.934473 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:15.934155 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/576bb152-0e46-4280-8e23-e874e0d38673-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.034947 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.034844 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/576bb152-0e46-4280-8e23-e874e0d38673-web-config\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.034947 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.034900 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/576bb152-0e46-4280-8e23-e874e0d38673-config\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.034947 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.034924 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/576bb152-0e46-4280-8e23-e874e0d38673-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.034947 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.034952 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/576bb152-0e46-4280-8e23-e874e0d38673-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.035302 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.034978 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/576bb152-0e46-4280-8e23-e874e0d38673-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.035302 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.035044 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxzl6\" (UniqueName: \"kubernetes.io/projected/576bb152-0e46-4280-8e23-e874e0d38673-kube-api-access-dxzl6\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.035302 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.035076 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/576bb152-0e46-4280-8e23-e874e0d38673-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.035302 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.035093 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/576bb152-0e46-4280-8e23-e874e0d38673-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.035302 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.035120 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/576bb152-0e46-4280-8e23-e874e0d38673-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.035302 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.035148 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/576bb152-0e46-4280-8e23-e874e0d38673-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.035302 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.035217 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/576bb152-0e46-4280-8e23-e874e0d38673-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.035302 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.035245 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/576bb152-0e46-4280-8e23-e874e0d38673-config-out\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.035302 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.035268 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/576bb152-0e46-4280-8e23-e874e0d38673-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.035302 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.035294 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/576bb152-0e46-4280-8e23-e874e0d38673-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.035770 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.035317 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/576bb152-0e46-4280-8e23-e874e0d38673-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.035770 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.035346 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/576bb152-0e46-4280-8e23-e874e0d38673-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.035770 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.035372 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/576bb152-0e46-4280-8e23-e874e0d38673-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.035770 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.035397 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/576bb152-0e46-4280-8e23-e874e0d38673-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.035770 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.035416 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/576bb152-0e46-4280-8e23-e874e0d38673-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.035770 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.035438 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/576bb152-0e46-4280-8e23-e874e0d38673-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.036049 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.035838 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/576bb152-0e46-4280-8e23-e874e0d38673-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.036259 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.036229 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/576bb152-0e46-4280-8e23-e874e0d38673-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.036385 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.036360 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/576bb152-0e46-4280-8e23-e874e0d38673-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.036903 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.036882 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/576bb152-0e46-4280-8e23-e874e0d38673-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.037736 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.037712 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/576bb152-0e46-4280-8e23-e874e0d38673-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.038107 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.038081 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/576bb152-0e46-4280-8e23-e874e0d38673-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.038213 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.038081 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/576bb152-0e46-4280-8e23-e874e0d38673-web-config\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.038213 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.038169 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/576bb152-0e46-4280-8e23-e874e0d38673-config\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.038341 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.038326 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/576bb152-0e46-4280-8e23-e874e0d38673-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.038478 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.038388 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/576bb152-0e46-4280-8e23-e874e0d38673-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.038478 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.038443 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/576bb152-0e46-4280-8e23-e874e0d38673-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.038751 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.038693 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/576bb152-0e46-4280-8e23-e874e0d38673-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.038911 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.038867 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/576bb152-0e46-4280-8e23-e874e0d38673-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.039007 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.038983 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/576bb152-0e46-4280-8e23-e874e0d38673-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.040266 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.040238 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/576bb152-0e46-4280-8e23-e874e0d38673-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.040402 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.040381 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/576bb152-0e46-4280-8e23-e874e0d38673-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.040837 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.040817 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/576bb152-0e46-4280-8e23-e874e0d38673-config-out\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.040916 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.040899 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/576bb152-0e46-4280-8e23-e874e0d38673-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.041051 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.041035 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/576bb152-0e46-4280-8e23-e874e0d38673-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.045638 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.045622 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxzl6\" (UniqueName: \"kubernetes.io/projected/576bb152-0e46-4280-8e23-e874e0d38673-kube-api-access-dxzl6\") pod \"prometheus-k8s-0\" (UID: \"576bb152-0e46-4280-8e23-e874e0d38673\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.100834 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.100800 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:10:16.408780 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.408627 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 03:10:16.411235 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:10:16.411211 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod576bb152_0e46_4280_8e23_e874e0d38673.slice/crio-c1cfdbdcba9f0c0afdb41a001394bd9b6cf5c6eeb6f28124716ee36ae8ee5607 WatchSource:0}: Error finding container c1cfdbdcba9f0c0afdb41a001394bd9b6cf5c6eeb6f28124716ee36ae8ee5607: Status 404 returned error can't find the container with id c1cfdbdcba9f0c0afdb41a001394bd9b6cf5c6eeb6f28124716ee36ae8ee5607 Sep 18 03:10:16.422931 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:16.422904 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"576bb152-0e46-4280-8e23-e874e0d38673","Type":"ContainerStarted","Data":"c1cfdbdcba9f0c0afdb41a001394bd9b6cf5c6eeb6f28124716ee36ae8ee5607"} Sep 18 03:10:17.427265 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:17.427225 2578 generic.go:356] "Generic (PLEG): container finished" podID="576bb152-0e46-4280-8e23-e874e0d38673" containerID="16f1a92f102b4922425e90958574f5d3817f80f08f8e691d8ed850b3cb67667e" exitCode=0 Sep 18 03:10:17.427746 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:17.427287 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"576bb152-0e46-4280-8e23-e874e0d38673","Type":"ContainerDied","Data":"16f1a92f102b4922425e90958574f5d3817f80f08f8e691d8ed850b3cb67667e"} Sep 18 03:10:17.458864 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:17.458797 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd0606f1-90a2-4e1d-adda-4de9923aabd8" path="/var/lib/kubelet/pods/cd0606f1-90a2-4e1d-adda-4de9923aabd8/volumes" Sep 18 03:10:18.434727 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:18.434692 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"576bb152-0e46-4280-8e23-e874e0d38673","Type":"ContainerStarted","Data":"e91f1b040d753199614b56186d4511bd7a3e70bd12656fafb8e3cc5fd5aabab4"} Sep 18 03:10:18.435123 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:18.434784 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"576bb152-0e46-4280-8e23-e874e0d38673","Type":"ContainerStarted","Data":"b4117b6e223291b0d00dd365e1bccff467d7c3b860c43478640336088ef55ee4"} Sep 18 03:10:18.435123 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:18.434810 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"576bb152-0e46-4280-8e23-e874e0d38673","Type":"ContainerStarted","Data":"955a2920638b676fef4774dbbe16e126f43c69f2682d1fb56a929b87187f267c"} Sep 18 03:10:18.435123 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:18.434839 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"576bb152-0e46-4280-8e23-e874e0d38673","Type":"ContainerStarted","Data":"9dfda3232ea7e37d106660256127880a9fdea931d8fa5a1a3f031fe939d4a6b4"} Sep 18 03:10:18.435123 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:18.434863 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"576bb152-0e46-4280-8e23-e874e0d38673","Type":"ContainerStarted","Data":"e5c72c30765933eaf9dfddfdf0598da0ba0e50b9d79a2731041090add5cc0a06"} Sep 18 03:10:18.435123 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:18.434886 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"576bb152-0e46-4280-8e23-e874e0d38673","Type":"ContainerStarted","Data":"3d6505d1943d1d5db3c9e833b0c60c563a0db57e23bfff369997f06d2c8f136d"} Sep 18 03:10:18.483486 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:18.483426 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.460930903 podStartE2EDuration="3.483406768s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.475865ms" isStatefulPod=false podCreationTimestamp="2026-09-18 03:10:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:10:18.477380702 +0000 UTC m=+243.073333822" watchObservedRunningTime="2026-09-18 03:10:18.483406768 +0000 UTC m=+243.079359889" Sep 18 03:10:21.101772 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:10:21.101719 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:11:16.101448 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:11:16.101407 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:11:16.119878 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:11:16.119834 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:11:16.679905 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:11:16.679876 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:11:17.321543 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:11:17.321510 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mthtg_2f86f967-298e-4b3b-98fe-40efc67fdf9f/ovn-acl-logging/0.log" Sep 18 03:11:17.325699 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:11:17.325671 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mthtg_2f86f967-298e-4b3b-98fe-40efc67fdf9f/ovn-acl-logging/0.log" Sep 18 03:11:17.327935 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:11:17.327912 2578 kubelet.go:1648] "Image garbage collection succeeded" Sep 18 03:11:56.202162 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:11:56.202128 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-87gz6"] Sep 18 03:11:56.204370 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:11:56.204353 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-87gz6" Sep 18 03:11:56.207348 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:11:56.207323 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 18 03:11:56.208281 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:11:56.208258 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 18 03:11:56.231147 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:11:56.231114 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvbs7\" (UniqueName: \"kubernetes.io/projected/b33df689-33b0-41ce-b5ff-8026ad866c7a-kube-api-access-vvbs7\") pod \"cert-manager-webhook-6486ffd997-87gz6\" (UID: \"b33df689-33b0-41ce-b5ff-8026ad866c7a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-87gz6" Sep 18 03:11:56.231312 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:11:56.231196 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b33df689-33b0-41ce-b5ff-8026ad866c7a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-87gz6\" (UID: \"b33df689-33b0-41ce-b5ff-8026ad866c7a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-87gz6" Sep 18 03:11:56.235377 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:11:56.235348 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-87gz6"] Sep 18 03:11:56.332648 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:11:56.332605 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b33df689-33b0-41ce-b5ff-8026ad866c7a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-87gz6\" (UID: \"b33df689-33b0-41ce-b5ff-8026ad866c7a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-87gz6" Sep 18 03:11:56.332871 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:11:56.332692 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvbs7\" (UniqueName: \"kubernetes.io/projected/b33df689-33b0-41ce-b5ff-8026ad866c7a-kube-api-access-vvbs7\") pod \"cert-manager-webhook-6486ffd997-87gz6\" (UID: \"b33df689-33b0-41ce-b5ff-8026ad866c7a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-87gz6" Sep 18 03:11:56.356725 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:11:56.356683 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b33df689-33b0-41ce-b5ff-8026ad866c7a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-87gz6\" (UID: \"b33df689-33b0-41ce-b5ff-8026ad866c7a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-87gz6" Sep 18 03:11:56.359926 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:11:56.359894 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvbs7\" (UniqueName: \"kubernetes.io/projected/b33df689-33b0-41ce-b5ff-8026ad866c7a-kube-api-access-vvbs7\") pod \"cert-manager-webhook-6486ffd997-87gz6\" (UID: \"b33df689-33b0-41ce-b5ff-8026ad866c7a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-87gz6" Sep 18 03:11:56.522261 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:11:56.522147 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-87gz6" Sep 18 03:11:56.876680 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:11:56.876640 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-87gz6"] Sep 18 03:11:56.879695 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:11:56.879665 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb33df689_33b0_41ce_b5ff_8026ad866c7a.slice/crio-569f1af5532e713cffe71927e26e07fe73af4d54d7b25b68cc69458de955d1b1 WatchSource:0}: Error finding container 569f1af5532e713cffe71927e26e07fe73af4d54d7b25b68cc69458de955d1b1: Status 404 returned error can't find the container with id 569f1af5532e713cffe71927e26e07fe73af4d54d7b25b68cc69458de955d1b1 Sep 18 03:11:56.881599 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:11:56.881579 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 03:11:57.819914 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:11:57.819870 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-87gz6" event={"ID":"b33df689-33b0-41ce-b5ff-8026ad866c7a","Type":"ContainerStarted","Data":"569f1af5532e713cffe71927e26e07fe73af4d54d7b25b68cc69458de955d1b1"} Sep 18 03:11:59.829373 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:11:59.829331 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-87gz6" event={"ID":"b33df689-33b0-41ce-b5ff-8026ad866c7a","Type":"ContainerStarted","Data":"af3397d5587a5f43a4f3818120aee4895dbd523f609d411189c7e8b63f32e02d"} Sep 18 03:11:59.829800 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:11:59.829418 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-87gz6" Sep 18 03:11:59.857655 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:11:59.857604 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-87gz6" podStartSLOduration=1.049550014 podStartE2EDuration="3.857586385s" totalImagesPullingTime="2.808036371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:11:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:11:59.856908597 +0000 UTC m=+344.452861720" watchObservedRunningTime="2026-09-18 03:11:59.857586385 +0000 UTC m=+344.453539505" Sep 18 03:12:05.835882 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:12:05.835846 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-87gz6" Sep 18 03:12:22.749067 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:12:22.749029 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-xkpjq"] Sep 18 03:12:22.755917 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:12:22.755892 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-xkpjq" Sep 18 03:12:22.758776 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:12:22.758739 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Sep 18 03:12:22.759508 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:12:22.759490 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-zwcxg\"" Sep 18 03:12:22.759584 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:12:22.759516 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Sep 18 03:12:22.768438 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:12:22.768402 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-xkpjq"] Sep 18 03:12:22.846470 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:12:22.846429 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lwfm\" (UniqueName: \"kubernetes.io/projected/575aa79c-1343-4a5c-8d22-5a87eac31832-kube-api-access-2lwfm\") pod \"jobset-operator-5bc45f897-xkpjq\" (UID: \"575aa79c-1343-4a5c-8d22-5a87eac31832\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-xkpjq" Sep 18 03:12:22.846690 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:12:22.846491 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/575aa79c-1343-4a5c-8d22-5a87eac31832-tmp\") pod \"jobset-operator-5bc45f897-xkpjq\" (UID: \"575aa79c-1343-4a5c-8d22-5a87eac31832\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-xkpjq" Sep 18 03:12:22.947262 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:12:22.947217 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lwfm\" (UniqueName: \"kubernetes.io/projected/575aa79c-1343-4a5c-8d22-5a87eac31832-kube-api-access-2lwfm\") pod \"jobset-operator-5bc45f897-xkpjq\" (UID: \"575aa79c-1343-4a5c-8d22-5a87eac31832\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-xkpjq" Sep 18 03:12:22.947440 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:12:22.947280 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/575aa79c-1343-4a5c-8d22-5a87eac31832-tmp\") pod \"jobset-operator-5bc45f897-xkpjq\" (UID: \"575aa79c-1343-4a5c-8d22-5a87eac31832\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-xkpjq" Sep 18 03:12:22.947649 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:12:22.947632 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/575aa79c-1343-4a5c-8d22-5a87eac31832-tmp\") pod \"jobset-operator-5bc45f897-xkpjq\" (UID: \"575aa79c-1343-4a5c-8d22-5a87eac31832\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-xkpjq" Sep 18 03:12:22.956833 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:12:22.956802 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lwfm\" (UniqueName: \"kubernetes.io/projected/575aa79c-1343-4a5c-8d22-5a87eac31832-kube-api-access-2lwfm\") pod \"jobset-operator-5bc45f897-xkpjq\" (UID: \"575aa79c-1343-4a5c-8d22-5a87eac31832\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-xkpjq" Sep 18 03:12:23.065415 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:12:23.065384 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-xkpjq" Sep 18 03:12:23.344801 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:12:23.344612 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-xkpjq"] Sep 18 03:12:23.347514 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:12:23.347478 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod575aa79c_1343_4a5c_8d22_5a87eac31832.slice/crio-666a8ea9958f1c74c661235b3d6d59e42f6dfdfc003d852c6a74539bd1bbd97a WatchSource:0}: Error finding container 666a8ea9958f1c74c661235b3d6d59e42f6dfdfc003d852c6a74539bd1bbd97a: Status 404 returned error can't find the container with id 666a8ea9958f1c74c661235b3d6d59e42f6dfdfc003d852c6a74539bd1bbd97a Sep 18 03:12:23.925019 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:12:23.924981 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-xkpjq" event={"ID":"575aa79c-1343-4a5c-8d22-5a87eac31832","Type":"ContainerStarted","Data":"666a8ea9958f1c74c661235b3d6d59e42f6dfdfc003d852c6a74539bd1bbd97a"} Sep 18 03:12:26.940218 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:12:26.940098 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-xkpjq" event={"ID":"575aa79c-1343-4a5c-8d22-5a87eac31832","Type":"ContainerStarted","Data":"dfcf0b255eb534e70e269ff35ac4adbe7b95d659d152aab2406bef280b1fdf6b"} Sep 18 03:16:17.351253 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:17.351225 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mthtg_2f86f967-298e-4b3b-98fe-40efc67fdf9f/ovn-acl-logging/0.log" Sep 18 03:16:17.352363 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:17.352337 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mthtg_2f86f967-298e-4b3b-98fe-40efc67fdf9f/ovn-acl-logging/0.log" Sep 18 03:16:19.046388 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:19.046332 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-xkpjq" podStartSLOduration=233.8032264 podStartE2EDuration="3m57.046313583s" totalImagesPullingTime="3.243087183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:12:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:12:26.971695338 +0000 UTC m=+371.567648460" watchObservedRunningTime="2026-09-18 03:16:19.046313583 +0000 UTC m=+603.642266703" Sep 18 03:16:19.046890 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:19.046874 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7lhwn/must-gather-dckx7"] Sep 18 03:16:19.049158 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:19.049139 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7lhwn/must-gather-dckx7" Sep 18 03:16:19.051867 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:19.051845 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7lhwn\"/\"kube-root-ca.crt\"" Sep 18 03:16:19.052673 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:19.052654 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7lhwn\"/\"openshift-service-ca.crt\"" Sep 18 03:16:19.052673 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:19.052663 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7lhwn\"/\"default-dockercfg-vbhvb\"" Sep 18 03:16:19.068390 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:19.068361 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7lhwn/must-gather-dckx7"] Sep 18 03:16:19.164718 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:19.164683 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jczcv\" (UniqueName: \"kubernetes.io/projected/e88f422b-c085-4abf-8dd7-b09584fc030b-kube-api-access-jczcv\") pod \"must-gather-dckx7\" (UID: \"e88f422b-c085-4abf-8dd7-b09584fc030b\") " pod="openshift-must-gather-7lhwn/must-gather-dckx7" Sep 18 03:16:19.164956 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:19.164744 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e88f422b-c085-4abf-8dd7-b09584fc030b-must-gather-output\") pod \"must-gather-dckx7\" (UID: \"e88f422b-c085-4abf-8dd7-b09584fc030b\") " pod="openshift-must-gather-7lhwn/must-gather-dckx7" Sep 18 03:16:19.265509 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:19.265470 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e88f422b-c085-4abf-8dd7-b09584fc030b-must-gather-output\") pod \"must-gather-dckx7\" (UID: \"e88f422b-c085-4abf-8dd7-b09584fc030b\") " pod="openshift-must-gather-7lhwn/must-gather-dckx7" Sep 18 03:16:19.265675 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:19.265531 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jczcv\" (UniqueName: \"kubernetes.io/projected/e88f422b-c085-4abf-8dd7-b09584fc030b-kube-api-access-jczcv\") pod \"must-gather-dckx7\" (UID: \"e88f422b-c085-4abf-8dd7-b09584fc030b\") " pod="openshift-must-gather-7lhwn/must-gather-dckx7" Sep 18 03:16:19.265845 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:19.265818 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e88f422b-c085-4abf-8dd7-b09584fc030b-must-gather-output\") pod \"must-gather-dckx7\" (UID: \"e88f422b-c085-4abf-8dd7-b09584fc030b\") " pod="openshift-must-gather-7lhwn/must-gather-dckx7" Sep 18 03:16:19.273971 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:19.273939 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jczcv\" (UniqueName: \"kubernetes.io/projected/e88f422b-c085-4abf-8dd7-b09584fc030b-kube-api-access-jczcv\") pod \"must-gather-dckx7\" (UID: \"e88f422b-c085-4abf-8dd7-b09584fc030b\") " pod="openshift-must-gather-7lhwn/must-gather-dckx7" Sep 18 03:16:19.358300 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:19.358267 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7lhwn/must-gather-dckx7" Sep 18 03:16:19.638265 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:19.633427 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7lhwn/must-gather-dckx7"] Sep 18 03:16:19.638764 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:16:19.638731 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode88f422b_c085_4abf_8dd7_b09584fc030b.slice/crio-623f985e0a9df94822ebc5eea1a0516d1168150d9f470c4dbfe019a575bda3e1 WatchSource:0}: Error finding container 623f985e0a9df94822ebc5eea1a0516d1168150d9f470c4dbfe019a575bda3e1: Status 404 returned error can't find the container with id 623f985e0a9df94822ebc5eea1a0516d1168150d9f470c4dbfe019a575bda3e1 Sep 18 03:16:19.845987 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:19.845947 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7lhwn/must-gather-dckx7" event={"ID":"e88f422b-c085-4abf-8dd7-b09584fc030b","Type":"ContainerStarted","Data":"623f985e0a9df94822ebc5eea1a0516d1168150d9f470c4dbfe019a575bda3e1"} Sep 18 03:16:20.854640 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:20.854263 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7lhwn/must-gather-dckx7" event={"ID":"e88f422b-c085-4abf-8dd7-b09584fc030b","Type":"ContainerStarted","Data":"e2fc100af74ab37c0a28e19e83724162d1a979bc3b5eaa3bed1125bcdb47f2c9"} Sep 18 03:16:20.854640 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:20.854317 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7lhwn/must-gather-dckx7" event={"ID":"e88f422b-c085-4abf-8dd7-b09584fc030b","Type":"ContainerStarted","Data":"1bc50f759e63fbfbc612ecc0fc471311740826aff26047e4f030ec25eb878ee5"} Sep 18 03:16:20.876099 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:20.876033 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7lhwn/must-gather-dckx7" podStartSLOduration=1.138241582 podStartE2EDuration="1.876010411s" totalImagesPullingTime="737.768829ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:16:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:16:20.874149705 +0000 UTC m=+605.470102826" watchObservedRunningTime="2026-09-18 03:16:20.876010411 +0000 UTC m=+605.471963532" Sep 18 03:16:21.880674 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:21.880638 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fxdpf_03534b6e-babc-44ea-a841-499edea9d492/global-pull-secret-syncer/0.log" Sep 18 03:16:22.014224 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:22.014169 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-l6ln7_2ffb6d5a-a4e0-444c-986e-282a57ed1add/konnectivity-agent/0.log" Sep 18 03:16:22.142614 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:22.142534 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-38.ec2.internal_057a0ec2fb9c26d68b86efbdbfc5dfe9/haproxy/0.log" Sep 18 03:16:26.293436 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:26.293399 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-h2p9v_91811aa9-183f-4397-8bae-45a6a5555963/monitoring-plugin/0.log" Sep 18 03:16:26.589762 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:26.589730 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nl2mw_1f0f73a2-8b4e-4884-922e-94e17ef5df72/node-exporter/0.log" Sep 18 03:16:26.631419 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:26.631381 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nl2mw_1f0f73a2-8b4e-4884-922e-94e17ef5df72/kube-rbac-proxy/0.log" Sep 18 03:16:26.661947 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:26.661916 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nl2mw_1f0f73a2-8b4e-4884-922e-94e17ef5df72/init-textfile/0.log" Sep 18 03:16:26.698003 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:26.697966 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-fqs8x_6b7bf314-5d22-410b-a0a8-9b2602dd834e/kube-rbac-proxy-main/0.log" Sep 18 03:16:26.726284 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:26.726241 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-fqs8x_6b7bf314-5d22-410b-a0a8-9b2602dd834e/kube-rbac-proxy-self/0.log" Sep 18 03:16:26.759146 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:26.759111 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-fqs8x_6b7bf314-5d22-410b-a0a8-9b2602dd834e/openshift-state-metrics/0.log" Sep 18 03:16:26.814090 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:26.814053 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_576bb152-0e46-4280-8e23-e874e0d38673/prometheus/0.log" Sep 18 03:16:26.864020 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:26.863893 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_576bb152-0e46-4280-8e23-e874e0d38673/config-reloader/0.log" Sep 18 03:16:26.901423 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:26.901388 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_576bb152-0e46-4280-8e23-e874e0d38673/thanos-sidecar/0.log" Sep 18 03:16:26.940341 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:26.940309 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_576bb152-0e46-4280-8e23-e874e0d38673/kube-rbac-proxy-web/0.log" Sep 18 03:16:26.975818 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:26.975791 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_576bb152-0e46-4280-8e23-e874e0d38673/kube-rbac-proxy/0.log" Sep 18 03:16:27.014334 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:27.014291 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_576bb152-0e46-4280-8e23-e874e0d38673/kube-rbac-proxy-thanos/0.log" Sep 18 03:16:27.050448 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:27.050409 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_576bb152-0e46-4280-8e23-e874e0d38673/init-config-reloader/0.log" Sep 18 03:16:27.092116 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:27.092076 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-gtf25_2e8ad848-cb76-4121-b47b-e44c0c040a57/prometheus-operator/0.log" Sep 18 03:16:27.125217 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:27.125122 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-gtf25_2e8ad848-cb76-4121-b47b-e44c0c040a57/kube-rbac-proxy/0.log" Sep 18 03:16:27.161171 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:27.161146 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-sr9fn_8096db38-7db2-4f2a-a526-74f08e019726/prometheus-operator-admission-webhook/0.log" Sep 18 03:16:29.463244 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:29.463209 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7lhwn/perf-node-gather-daemonset-8cqqk"] Sep 18 03:16:29.466833 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:29.466798 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7lhwn/perf-node-gather-daemonset-8cqqk" Sep 18 03:16:29.477591 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:29.477162 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7lhwn/perf-node-gather-daemonset-8cqqk"] Sep 18 03:16:29.566964 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:29.566917 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/19020685-5360-42d7-8504-8fcb62d1ad92-proc\") pod \"perf-node-gather-daemonset-8cqqk\" (UID: \"19020685-5360-42d7-8504-8fcb62d1ad92\") " pod="openshift-must-gather-7lhwn/perf-node-gather-daemonset-8cqqk" Sep 18 03:16:29.567170 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:29.566986 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19020685-5360-42d7-8504-8fcb62d1ad92-lib-modules\") pod \"perf-node-gather-daemonset-8cqqk\" (UID: \"19020685-5360-42d7-8504-8fcb62d1ad92\") " pod="openshift-must-gather-7lhwn/perf-node-gather-daemonset-8cqqk" Sep 18 03:16:29.567170 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:29.567029 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19020685-5360-42d7-8504-8fcb62d1ad92-sys\") pod \"perf-node-gather-daemonset-8cqqk\" (UID: \"19020685-5360-42d7-8504-8fcb62d1ad92\") " pod="openshift-must-gather-7lhwn/perf-node-gather-daemonset-8cqqk" Sep 18 03:16:29.567170 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:29.567068 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/19020685-5360-42d7-8504-8fcb62d1ad92-podres\") pod \"perf-node-gather-daemonset-8cqqk\" (UID: \"19020685-5360-42d7-8504-8fcb62d1ad92\") " pod="openshift-must-gather-7lhwn/perf-node-gather-daemonset-8cqqk" Sep 18 03:16:29.567170 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:29.567098 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75x5t\" (UniqueName: \"kubernetes.io/projected/19020685-5360-42d7-8504-8fcb62d1ad92-kube-api-access-75x5t\") pod \"perf-node-gather-daemonset-8cqqk\" (UID: \"19020685-5360-42d7-8504-8fcb62d1ad92\") " pod="openshift-must-gather-7lhwn/perf-node-gather-daemonset-8cqqk" Sep 18 03:16:29.667643 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:29.667605 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/19020685-5360-42d7-8504-8fcb62d1ad92-proc\") pod \"perf-node-gather-daemonset-8cqqk\" (UID: \"19020685-5360-42d7-8504-8fcb62d1ad92\") " pod="openshift-must-gather-7lhwn/perf-node-gather-daemonset-8cqqk" Sep 18 03:16:29.667836 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:29.667662 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19020685-5360-42d7-8504-8fcb62d1ad92-lib-modules\") pod \"perf-node-gather-daemonset-8cqqk\" (UID: \"19020685-5360-42d7-8504-8fcb62d1ad92\") " pod="openshift-must-gather-7lhwn/perf-node-gather-daemonset-8cqqk" Sep 18 03:16:29.667836 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:29.667700 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19020685-5360-42d7-8504-8fcb62d1ad92-sys\") pod \"perf-node-gather-daemonset-8cqqk\" (UID: \"19020685-5360-42d7-8504-8fcb62d1ad92\") " pod="openshift-must-gather-7lhwn/perf-node-gather-daemonset-8cqqk" Sep 18 03:16:29.667836 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:29.667732 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/19020685-5360-42d7-8504-8fcb62d1ad92-podres\") pod \"perf-node-gather-daemonset-8cqqk\" (UID: \"19020685-5360-42d7-8504-8fcb62d1ad92\") " pod="openshift-must-gather-7lhwn/perf-node-gather-daemonset-8cqqk" Sep 18 03:16:29.667836 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:29.667733 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/19020685-5360-42d7-8504-8fcb62d1ad92-proc\") pod \"perf-node-gather-daemonset-8cqqk\" (UID: \"19020685-5360-42d7-8504-8fcb62d1ad92\") " pod="openshift-must-gather-7lhwn/perf-node-gather-daemonset-8cqqk" Sep 18 03:16:29.667836 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:29.667797 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75x5t\" (UniqueName: \"kubernetes.io/projected/19020685-5360-42d7-8504-8fcb62d1ad92-kube-api-access-75x5t\") pod \"perf-node-gather-daemonset-8cqqk\" (UID: \"19020685-5360-42d7-8504-8fcb62d1ad92\") " pod="openshift-must-gather-7lhwn/perf-node-gather-daemonset-8cqqk" Sep 18 03:16:29.668056 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:29.667803 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19020685-5360-42d7-8504-8fcb62d1ad92-sys\") pod \"perf-node-gather-daemonset-8cqqk\" (UID: \"19020685-5360-42d7-8504-8fcb62d1ad92\") " pod="openshift-must-gather-7lhwn/perf-node-gather-daemonset-8cqqk" Sep 18 03:16:29.668056 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:29.667863 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/19020685-5360-42d7-8504-8fcb62d1ad92-podres\") pod \"perf-node-gather-daemonset-8cqqk\" (UID: \"19020685-5360-42d7-8504-8fcb62d1ad92\") " pod="openshift-must-gather-7lhwn/perf-node-gather-daemonset-8cqqk" Sep 18 03:16:29.668056 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:29.667873 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19020685-5360-42d7-8504-8fcb62d1ad92-lib-modules\") pod \"perf-node-gather-daemonset-8cqqk\" (UID: \"19020685-5360-42d7-8504-8fcb62d1ad92\") " pod="openshift-must-gather-7lhwn/perf-node-gather-daemonset-8cqqk" Sep 18 03:16:29.677215 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:29.677158 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75x5t\" (UniqueName: \"kubernetes.io/projected/19020685-5360-42d7-8504-8fcb62d1ad92-kube-api-access-75x5t\") pod \"perf-node-gather-daemonset-8cqqk\" (UID: \"19020685-5360-42d7-8504-8fcb62d1ad92\") " pod="openshift-must-gather-7lhwn/perf-node-gather-daemonset-8cqqk" Sep 18 03:16:29.783475 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:29.783384 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7lhwn/perf-node-gather-daemonset-8cqqk" Sep 18 03:16:30.089735 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:30.089705 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7lhwn/perf-node-gather-daemonset-8cqqk"] Sep 18 03:16:30.091694 ip-10-0-138-38 kubenswrapper[2578]: W0918 03:16:30.091639 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod19020685_5360_42d7_8504_8fcb62d1ad92.slice/crio-752920a25b905a890686c495779b863dc4fed63e8d49bec0f4df674a5f5b83a9 WatchSource:0}: Error finding container 752920a25b905a890686c495779b863dc4fed63e8d49bec0f4df674a5f5b83a9: Status 404 returned error can't find the container with id 752920a25b905a890686c495779b863dc4fed63e8d49bec0f4df674a5f5b83a9 Sep 18 03:16:30.909415 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:30.909370 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7lhwn/perf-node-gather-daemonset-8cqqk" event={"ID":"19020685-5360-42d7-8504-8fcb62d1ad92","Type":"ContainerStarted","Data":"8fb7afff7566eb205f2a7846c27fd1cb5fceca5415bfacc05f697154c8a79e7b"} Sep 18 03:16:30.909944 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:30.909445 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7lhwn/perf-node-gather-daemonset-8cqqk" event={"ID":"19020685-5360-42d7-8504-8fcb62d1ad92","Type":"ContainerStarted","Data":"752920a25b905a890686c495779b863dc4fed63e8d49bec0f4df674a5f5b83a9"} Sep 18 03:16:30.909944 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:30.909587 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7lhwn/perf-node-gather-daemonset-8cqqk" Sep 18 03:16:30.934067 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:30.934002 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7lhwn/perf-node-gather-daemonset-8cqqk" podStartSLOduration=1.9339785269999998 podStartE2EDuration="1.933978527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:16:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:16:30.933040724 +0000 UTC m=+615.528993857" watchObservedRunningTime="2026-09-18 03:16:30.933978527 +0000 UTC m=+615.529931651" Sep 18 03:16:31.229773 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:31.229679 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kzq2n_851f3001-1c5d-4201-be57-76d2fb4c4e52/dns/0.log" Sep 18 03:16:31.255475 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:31.255444 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kzq2n_851f3001-1c5d-4201-be57-76d2fb4c4e52/kube-rbac-proxy/0.log" Sep 18 03:16:31.430290 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:31.430261 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8scdz_c2824667-7219-4da9-b4b4-125da30139e8/dns-node-resolver/0.log" Sep 18 03:16:31.985125 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:31.985097 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pjgpg_833a036f-c311-46c4-8ecf-16723e7ac9f8/node-ca/0.log" Sep 18 03:16:33.169830 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:33.169802 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vvz5b_b347ac1a-6339-4018-9726-ec04debd21e1/serve-healthcheck-canary/0.log" Sep 18 03:16:33.546755 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:33.546672 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-2rkw7_97141cd8-00c5-4fad-a218-c5536c869671/insights-operator/1.log" Sep 18 03:16:33.546928 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:33.546875 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-2rkw7_97141cd8-00c5-4fad-a218-c5536c869671/insights-operator/0.log" Sep 18 03:16:33.644639 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:33.644570 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rwffz_d42a764b-488c-4735-be3a-98a5487fb603/kube-rbac-proxy/0.log" Sep 18 03:16:33.667452 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:33.667426 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rwffz_d42a764b-488c-4735-be3a-98a5487fb603/exporter/0.log" Sep 18 03:16:33.691888 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:33.691862 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rwffz_d42a764b-488c-4735-be3a-98a5487fb603/extractor/0.log" Sep 18 03:16:35.559346 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:35.559315 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-xkpjq_575aa79c-1343-4a5c-8d22-5a87eac31832/jobset-operator/0.log" Sep 18 03:16:36.924533 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:36.924500 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7lhwn/perf-node-gather-daemonset-8cqqk" Sep 18 03:16:40.697235 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:40.697199 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7kb6r_b489d687-b213-4c1a-afb2-ed7e2f710493/kube-multus/0.log" Sep 18 03:16:40.886668 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:40.886639 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-csnc7_90b7b9fc-a4d0-4f78-b04a-723ab8565584/kube-multus-additional-cni-plugins/0.log" Sep 18 03:16:40.909320 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:40.909293 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-csnc7_90b7b9fc-a4d0-4f78-b04a-723ab8565584/egress-router-binary-copy/0.log" Sep 18 03:16:40.930606 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:40.930572 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-csnc7_90b7b9fc-a4d0-4f78-b04a-723ab8565584/cni-plugins/0.log" Sep 18 03:16:40.952194 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:40.952103 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-csnc7_90b7b9fc-a4d0-4f78-b04a-723ab8565584/bond-cni-plugin/0.log" Sep 18 03:16:40.980624 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:40.980591 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-csnc7_90b7b9fc-a4d0-4f78-b04a-723ab8565584/routeoverride-cni/0.log" Sep 18 03:16:41.010363 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:41.010330 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-csnc7_90b7b9fc-a4d0-4f78-b04a-723ab8565584/whereabouts-cni-bincopy/0.log" Sep 18 03:16:41.032388 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:41.032358 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-csnc7_90b7b9fc-a4d0-4f78-b04a-723ab8565584/whereabouts-cni/0.log" Sep 18 03:16:41.560690 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:41.560660 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zcq59_d8ba3428-efa3-42f0-acad-0e524f361a50/network-metrics-daemon/0.log" Sep 18 03:16:41.621345 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:41.621317 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zcq59_d8ba3428-efa3-42f0-acad-0e524f361a50/kube-rbac-proxy/0.log" Sep 18 03:16:42.575627 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:42.575589 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mthtg_2f86f967-298e-4b3b-98fe-40efc67fdf9f/ovn-controller/0.log" Sep 18 03:16:42.597148 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:42.597118 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mthtg_2f86f967-298e-4b3b-98fe-40efc67fdf9f/ovn-acl-logging/1.log" Sep 18 03:16:42.597341 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:42.597168 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mthtg_2f86f967-298e-4b3b-98fe-40efc67fdf9f/ovn-acl-logging/0.log" Sep 18 03:16:42.621450 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:42.621419 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mthtg_2f86f967-298e-4b3b-98fe-40efc67fdf9f/kube-rbac-proxy-node/0.log" Sep 18 03:16:42.650077 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:42.650042 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mthtg_2f86f967-298e-4b3b-98fe-40efc67fdf9f/kube-rbac-proxy-ovn-metrics/0.log" Sep 18 03:16:42.671961 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:42.671938 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mthtg_2f86f967-298e-4b3b-98fe-40efc67fdf9f/northd/0.log" Sep 18 03:16:42.694334 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:42.694304 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mthtg_2f86f967-298e-4b3b-98fe-40efc67fdf9f/nbdb/0.log" Sep 18 03:16:42.715458 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:42.715434 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mthtg_2f86f967-298e-4b3b-98fe-40efc67fdf9f/sbdb/0.log" Sep 18 03:16:42.768633 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:42.768602 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mthtg_2f86f967-298e-4b3b-98fe-40efc67fdf9f/ovnkube-controller/0.log" Sep 18 03:16:44.061613 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:44.061582 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-g4zw8_94f7ec49-0a27-460a-90cc-16cb68d9beb9/network-check-target-container/0.log" Sep 18 03:16:45.125958 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:45.125925 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-gm7zt_fb8a24bb-d540-4fb6-9be3-2af0bd8737ec/iptables-alerter/0.log" Sep 18 03:16:45.832497 ip-10-0-138-38 kubenswrapper[2578]: I0918 03:16:45.832469 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-5vv6r_f519c6c1-a46c-46a8-9911-0a795fdcf765/tuned/0.log"