Sep 18 11:59:17.551524 ip-10-0-136-137 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 18 11:59:17.551534 ip-10-0-136-137 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 18 11:59:17.551541 ip-10-0-136-137 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 18 11:59:17.551776 ip-10-0-136-137 systemd[1]: Failed to start Kubernetes Kubelet. Sep 18 11:59:26.935846 ip-10-0-136-137 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 18 11:59:26.935861 ip-10-0-136-137 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot b7b890ceca384bc8b0ce4b4b74546d6e -- Sep 18 12:01:16.892727 ip-10-0-136-137 systemd[1]: Starting Kubernetes Kubelet... Sep 18 12:01:17.255542 ip-10-0-136-137 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 12:01:17.255542 ip-10-0-136-137 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 18 12:01:17.255542 ip-10-0-136-137 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 12:01:17.255542 ip-10-0-136-137 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 18 12:01:17.255542 ip-10-0-136-137 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 12:01:17.256579 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.256448 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 18 12:01:17.261659 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261643 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 12:01:17.261659 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261658 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 12:01:17.261729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261663 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 12:01:17.261729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261667 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 12:01:17.261729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261670 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 12:01:17.261729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261673 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 12:01:17.261729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261676 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 12:01:17.261729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261679 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 12:01:17.261729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261681 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 12:01:17.261729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261684 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 12:01:17.261729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261687 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 12:01:17.261729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261689 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 12:01:17.261729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261692 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 12:01:17.261729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261694 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 12:01:17.261729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261697 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 12:01:17.261729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261699 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 12:01:17.261729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261702 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 12:01:17.261729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261705 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 12:01:17.261729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261707 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 12:01:17.261729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261710 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 12:01:17.261729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261714 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 12:01:17.261729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261719 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 12:01:17.262195 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261722 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 12:01:17.262195 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261725 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 12:01:17.262195 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261728 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 12:01:17.262195 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261731 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 12:01:17.262195 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261734 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 12:01:17.262195 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261736 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 12:01:17.262195 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261739 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 12:01:17.262195 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261742 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 12:01:17.262195 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261745 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 12:01:17.262195 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261748 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 12:01:17.262195 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261750 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 12:01:17.262195 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261753 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 12:01:17.262195 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261755 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 12:01:17.262195 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261758 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 12:01:17.262195 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261761 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 12:01:17.262195 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261763 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 12:01:17.262195 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261766 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 12:01:17.262195 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261768 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 12:01:17.262195 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261771 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 12:01:17.262195 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261773 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 12:01:17.262777 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261776 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 12:01:17.262777 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261778 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 12:01:17.262777 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261781 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 12:01:17.262777 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261783 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 12:01:17.262777 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261786 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 12:01:17.262777 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261788 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 12:01:17.262777 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261791 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 12:01:17.262777 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261794 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 12:01:17.262777 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261796 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 12:01:17.262777 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261799 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 12:01:17.262777 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261801 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 12:01:17.262777 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261804 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 12:01:17.262777 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261806 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 12:01:17.262777 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261810 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 12:01:17.262777 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261813 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 12:01:17.262777 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261816 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 12:01:17.262777 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261819 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 12:01:17.262777 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261822 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 12:01:17.262777 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261825 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 12:01:17.262777 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261827 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 12:01:17.263271 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261830 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 12:01:17.263271 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261833 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 12:01:17.263271 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261835 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 12:01:17.263271 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261838 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 12:01:17.263271 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261840 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 12:01:17.263271 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261843 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 12:01:17.263271 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261846 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 12:01:17.263271 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261849 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 12:01:17.263271 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261852 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 12:01:17.263271 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261855 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 12:01:17.263271 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261857 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 18 12:01:17.263271 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261860 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 12:01:17.263271 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261862 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 12:01:17.263271 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261865 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 12:01:17.263271 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261867 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 12:01:17.263271 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261872 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 12:01:17.263271 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261876 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 12:01:17.263271 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261879 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 12:01:17.263271 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261883 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 12:01:17.263271 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261886 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 12:01:17.263783 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261888 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 12:01:17.263783 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261892 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 12:01:17.263783 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261894 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 12:01:17.263783 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261897 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 12:01:17.263783 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261900 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 12:01:17.263783 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261904 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 12:01:17.263783 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261909 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 12:01:17.263783 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261913 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 12:01:17.263783 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261915 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 12:01:17.263783 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261918 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 12:01:17.263783 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261921 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 12:01:17.263783 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261924 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 12:01:17.263783 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261926 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 12:01:17.263783 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261928 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 12:01:17.263783 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261931 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 12:01:17.263783 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261934 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 12:01:17.263783 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.261937 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 12:01:17.263783 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262631 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 12:01:17.263783 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262638 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 12:01:17.264249 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262641 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 12:01:17.264249 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262644 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 12:01:17.264249 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262647 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 12:01:17.264249 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262650 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 12:01:17.264249 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262653 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 12:01:17.264249 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262656 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 12:01:17.264249 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262659 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 12:01:17.264249 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262661 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 12:01:17.264249 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262664 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 12:01:17.264249 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262666 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 12:01:17.264249 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262669 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 12:01:17.264249 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262672 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 12:01:17.264249 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262674 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 12:01:17.264249 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262678 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 12:01:17.264249 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262682 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 12:01:17.264249 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262685 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 12:01:17.264249 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262688 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 12:01:17.264249 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262690 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 12:01:17.264249 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262694 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 12:01:17.264740 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262697 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 12:01:17.264740 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262700 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 12:01:17.264740 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262702 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 12:01:17.264740 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262705 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 12:01:17.264740 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262707 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 12:01:17.264740 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262710 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 12:01:17.264740 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262713 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 12:01:17.264740 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262715 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 12:01:17.264740 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262718 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 12:01:17.264740 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262720 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 12:01:17.264740 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262723 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 12:01:17.264740 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262726 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 12:01:17.264740 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262728 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 12:01:17.264740 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262731 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 12:01:17.264740 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262735 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 12:01:17.264740 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262739 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 12:01:17.264740 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262742 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 12:01:17.264740 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262750 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 12:01:17.264740 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262753 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 12:01:17.264740 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262755 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 12:01:17.265250 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262758 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 12:01:17.265250 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262761 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 12:01:17.265250 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262763 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 12:01:17.265250 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262766 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 12:01:17.265250 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262769 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 12:01:17.265250 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262771 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 12:01:17.265250 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262773 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 12:01:17.265250 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262777 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 12:01:17.265250 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262781 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 12:01:17.265250 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262784 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 12:01:17.265250 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262787 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 12:01:17.265250 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262791 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 12:01:17.265250 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262794 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 12:01:17.265250 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262797 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 12:01:17.265250 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262800 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 12:01:17.265250 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262803 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 12:01:17.265250 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262805 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 12:01:17.265250 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262808 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 12:01:17.265250 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262811 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 12:01:17.265729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262814 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 12:01:17.265729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262817 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 12:01:17.265729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262819 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 12:01:17.265729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262822 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 12:01:17.265729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262825 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 12:01:17.265729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262828 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 12:01:17.265729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262830 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 12:01:17.265729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262833 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 12:01:17.265729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262836 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 12:01:17.265729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262838 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 12:01:17.265729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262841 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 12:01:17.265729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262844 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 12:01:17.265729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262847 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 12:01:17.265729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262849 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 12:01:17.265729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262852 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 12:01:17.265729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262854 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 12:01:17.265729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262857 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 12:01:17.265729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262860 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 12:01:17.265729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262862 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 12:01:17.265729 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262865 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 12:01:17.266214 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262867 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 12:01:17.266214 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262870 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 12:01:17.266214 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262873 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 12:01:17.266214 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262876 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 12:01:17.266214 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262881 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 12:01:17.266214 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262883 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 12:01:17.266214 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262886 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 12:01:17.266214 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262888 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 12:01:17.266214 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262891 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 12:01:17.266214 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262893 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 12:01:17.266214 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262896 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 12:01:17.266214 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262899 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 12:01:17.266214 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262901 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 12:01:17.266214 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262904 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 12:01:17.266214 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262906 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 12:01:17.266214 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262909 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 12:01:17.266214 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262912 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 12:01:17.266214 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262916 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 12:01:17.266214 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.262919 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 18 12:01:17.266214 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263285 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 12:01:17.266725 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263289 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 12:01:17.266725 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263292 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 12:01:17.266725 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263295 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 12:01:17.266725 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263298 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 12:01:17.266725 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263301 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 12:01:17.266725 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263304 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 12:01:17.266725 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263307 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 12:01:17.266725 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263311 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 12:01:17.266725 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263314 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 12:01:17.266725 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263316 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 12:01:17.266725 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263319 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 12:01:17.266725 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263321 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 12:01:17.266725 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263324 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 12:01:17.266725 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263327 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 12:01:17.266725 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263330 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 12:01:17.266725 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263332 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 12:01:17.266725 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263337 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 12:01:17.266725 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263339 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 12:01:17.266725 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263342 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 12:01:17.267173 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263344 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 12:01:17.267173 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263347 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 12:01:17.267173 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263350 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 12:01:17.267173 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263352 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 12:01:17.267173 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263355 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 12:01:17.267173 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263357 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 12:01:17.267173 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263360 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 12:01:17.267173 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263363 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 12:01:17.267173 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263367 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 12:01:17.267173 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263370 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 12:01:17.267173 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263376 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 12:01:17.267173 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263378 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 12:01:17.267173 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263382 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 12:01:17.267173 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263384 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 12:01:17.267173 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263387 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 12:01:17.267173 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263390 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 12:01:17.267173 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263392 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 12:01:17.267173 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263399 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 12:01:17.267173 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263402 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 12:01:17.267173 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263404 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 12:01:17.267684 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263407 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 12:01:17.267684 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263409 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 12:01:17.267684 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263412 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 12:01:17.267684 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263414 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 12:01:17.267684 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263417 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 12:01:17.267684 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263420 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 12:01:17.267684 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263422 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 12:01:17.267684 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263425 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 12:01:17.267684 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263427 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 12:01:17.267684 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263431 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 12:01:17.267684 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263448 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 12:01:17.267684 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263451 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 12:01:17.267684 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263454 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 12:01:17.267684 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263457 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 12:01:17.267684 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263459 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 12:01:17.267684 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263462 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 12:01:17.267684 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263464 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 12:01:17.267684 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263467 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 12:01:17.267684 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263470 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 12:01:17.267684 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263472 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 12:01:17.268200 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263475 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 12:01:17.268200 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263477 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 12:01:17.268200 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263481 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 12:01:17.268200 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263484 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 12:01:17.268200 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263487 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 12:01:17.268200 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263489 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 12:01:17.268200 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263492 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 12:01:17.268200 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263495 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 12:01:17.268200 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263497 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 12:01:17.268200 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263501 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 12:01:17.268200 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263504 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 12:01:17.268200 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263507 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 12:01:17.268200 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263511 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 12:01:17.268200 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263515 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 12:01:17.268200 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263518 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 12:01:17.268200 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263521 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 12:01:17.268200 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263524 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 12:01:17.268200 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263527 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 12:01:17.268200 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263529 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 12:01:17.268678 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263532 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 12:01:17.268678 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263535 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 12:01:17.268678 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263539 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 12:01:17.268678 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263542 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 12:01:17.268678 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263545 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 12:01:17.268678 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263548 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 12:01:17.268678 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263552 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 12:01:17.268678 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263554 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 18 12:01:17.268678 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263557 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 12:01:17.268678 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263560 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 12:01:17.268678 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263562 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 12:01:17.268678 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263565 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 12:01:17.268678 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263568 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 12:01:17.268678 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263571 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 12:01:17.268678 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263573 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 12:01:17.268678 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263577 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 12:01:17.268678 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263580 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 12:01:17.268678 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263583 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 12:01:17.268678 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263585 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 12:01:17.268678 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.263588 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 12:01:17.269161 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263666 2578 flags.go:64] FLAG: --address="0.0.0.0" Sep 18 12:01:17.269161 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263704 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 18 12:01:17.269161 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263710 2578 flags.go:64] FLAG: --anonymous-auth="true" Sep 18 12:01:17.269161 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263714 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 18 12:01:17.269161 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263719 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 18 12:01:17.269161 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263723 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 18 12:01:17.269161 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263727 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 18 12:01:17.269161 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263731 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 18 12:01:17.269161 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263734 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 18 12:01:17.269161 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263737 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 18 12:01:17.269161 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263740 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 18 12:01:17.269161 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263744 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 18 12:01:17.269161 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263747 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 18 12:01:17.269161 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263750 2578 flags.go:64] FLAG: --cgroup-root="" Sep 18 12:01:17.269161 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263755 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 18 12:01:17.269161 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263758 2578 flags.go:64] FLAG: --client-ca-file="" Sep 18 12:01:17.269161 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263761 2578 flags.go:64] FLAG: --cloud-provider="external" Sep 18 12:01:17.269161 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263764 2578 flags.go:64] FLAG: --cluster-dns="[]" Sep 18 12:01:17.269161 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263768 2578 flags.go:64] FLAG: --cluster-domain="" Sep 18 12:01:17.269161 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263771 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 18 12:01:17.269161 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263774 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 18 12:01:17.269161 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263777 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 18 12:01:17.269161 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263780 2578 flags.go:64] FLAG: --container-log-max-files="5" Sep 18 12:01:17.269161 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263784 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 18 12:01:17.269743 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263787 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 18 12:01:17.269743 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263790 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 18 12:01:17.269743 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263794 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 18 12:01:17.269743 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263799 2578 flags.go:64] FLAG: --contention-profiling="false" Sep 18 12:01:17.269743 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263802 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 18 12:01:17.269743 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263805 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 18 12:01:17.269743 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263808 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 18 12:01:17.269743 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263811 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 18 12:01:17.269743 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263815 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 18 12:01:17.269743 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263818 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 18 12:01:17.269743 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263821 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 18 12:01:17.269743 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263824 2578 flags.go:64] FLAG: --enable-load-reader="false" Sep 18 12:01:17.269743 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263826 2578 flags.go:64] FLAG: --enable-server="true" Sep 18 12:01:17.269743 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263830 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 18 12:01:17.269743 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263834 2578 flags.go:64] FLAG: --event-burst="100" Sep 18 12:01:17.269743 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263837 2578 flags.go:64] FLAG: --event-qps="50" Sep 18 12:01:17.269743 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263840 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 18 12:01:17.269743 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263843 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 18 12:01:17.269743 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263846 2578 flags.go:64] FLAG: --eviction-hard="" Sep 18 12:01:17.269743 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263850 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 18 12:01:17.269743 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263852 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 18 12:01:17.269743 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263855 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 18 12:01:17.269743 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263859 2578 flags.go:64] FLAG: --eviction-soft="" Sep 18 12:01:17.269743 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263862 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 18 12:01:17.269743 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263864 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 18 12:01:17.270409 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263867 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 18 12:01:17.270409 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263870 2578 flags.go:64] FLAG: --experimental-mounter-path="" Sep 18 12:01:17.270409 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263873 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 18 12:01:17.270409 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263876 2578 flags.go:64] FLAG: --fail-swap-on="true" Sep 18 12:01:17.270409 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263879 2578 flags.go:64] FLAG: --feature-gates="" Sep 18 12:01:17.270409 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263882 2578 flags.go:64] FLAG: --file-check-frequency="20s" Sep 18 12:01:17.270409 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263885 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 18 12:01:17.270409 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263888 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 18 12:01:17.270409 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263891 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 18 12:01:17.270409 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263894 2578 flags.go:64] FLAG: --healthz-port="10248" Sep 18 12:01:17.270409 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263898 2578 flags.go:64] FLAG: --help="false" Sep 18 12:01:17.270409 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263901 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-136-137.ec2.internal" Sep 18 12:01:17.270409 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263904 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 18 12:01:17.270409 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263907 2578 flags.go:64] FLAG: --http-check-frequency="20s" Sep 18 12:01:17.270409 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263910 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 18 12:01:17.270409 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263913 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 18 12:01:17.270409 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263917 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 18 12:01:17.270409 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263919 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 18 12:01:17.270409 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263922 2578 flags.go:64] FLAG: --image-service-endpoint="" Sep 18 12:01:17.270409 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263925 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 18 12:01:17.270409 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263928 2578 flags.go:64] FLAG: --kube-api-burst="100" Sep 18 12:01:17.270409 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263934 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 18 12:01:17.270409 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263937 2578 flags.go:64] FLAG: --kube-api-qps="50" Sep 18 12:01:17.270409 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263940 2578 flags.go:64] FLAG: --kube-reserved="" Sep 18 12:01:17.271031 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263942 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 18 12:01:17.271031 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263945 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 18 12:01:17.271031 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263948 2578 flags.go:64] FLAG: --kubelet-cgroups="" Sep 18 12:01:17.271031 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263951 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 18 12:01:17.271031 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263954 2578 flags.go:64] FLAG: --lock-file="" Sep 18 12:01:17.271031 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263957 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 18 12:01:17.271031 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263960 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 18 12:01:17.271031 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263963 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 18 12:01:17.271031 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263969 2578 flags.go:64] FLAG: --log-json-split-stream="false" Sep 18 12:01:17.271031 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263972 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 18 12:01:17.271031 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263974 2578 flags.go:64] FLAG: --log-text-split-stream="false" Sep 18 12:01:17.271031 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263977 2578 flags.go:64] FLAG: --logging-format="text" Sep 18 12:01:17.271031 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263980 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 18 12:01:17.271031 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263983 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 18 12:01:17.271031 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263986 2578 flags.go:64] FLAG: --manifest-url="" Sep 18 12:01:17.271031 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263989 2578 flags.go:64] FLAG: --manifest-url-header="" Sep 18 12:01:17.271031 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263993 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 18 12:01:17.271031 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.263997 2578 flags.go:64] FLAG: --max-open-files="1000000" Sep 18 12:01:17.271031 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264002 2578 flags.go:64] FLAG: --max-pods="110" Sep 18 12:01:17.271031 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264005 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 18 12:01:17.271031 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264008 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 18 12:01:17.271031 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264011 2578 flags.go:64] FLAG: --memory-manager-policy="None" Sep 18 12:01:17.271031 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264014 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 18 12:01:17.271031 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264017 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 18 12:01:17.271031 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264020 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 18 12:01:17.271675 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264023 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 18 12:01:17.271675 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264030 2578 flags.go:64] FLAG: --node-status-max-images="50" Sep 18 12:01:17.271675 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264033 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 18 12:01:17.271675 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264037 2578 flags.go:64] FLAG: --oom-score-adj="-999" Sep 18 12:01:17.271675 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264040 2578 flags.go:64] FLAG: --pod-cidr="" Sep 18 12:01:17.271675 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264043 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 18 12:01:17.271675 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264048 2578 flags.go:64] FLAG: --pod-manifest-path="" Sep 18 12:01:17.271675 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264051 2578 flags.go:64] FLAG: --pod-max-pids="-1" Sep 18 12:01:17.271675 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264054 2578 flags.go:64] FLAG: --pods-per-core="0" Sep 18 12:01:17.271675 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264057 2578 flags.go:64] FLAG: --port="10250" Sep 18 12:01:17.271675 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264060 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 18 12:01:17.271675 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264063 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07f41b8f0bcc98032" Sep 18 12:01:17.271675 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264066 2578 flags.go:64] FLAG: --qos-reserved="" Sep 18 12:01:17.271675 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264069 2578 flags.go:64] FLAG: --read-only-port="10255" Sep 18 12:01:17.271675 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264072 2578 flags.go:64] FLAG: --register-node="true" Sep 18 12:01:17.271675 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264075 2578 flags.go:64] FLAG: --register-with-taints="" Sep 18 12:01:17.271675 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264079 2578 flags.go:64] FLAG: --registry-burst="10" Sep 18 12:01:17.271675 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264082 2578 flags.go:64] FLAG: --registry-qps="5" Sep 18 12:01:17.271675 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264085 2578 flags.go:64] FLAG: --reserved-cpus="" Sep 18 12:01:17.271675 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264088 2578 flags.go:64] FLAG: --reserved-memory="" Sep 18 12:01:17.271675 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264092 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 18 12:01:17.271675 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264095 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 18 12:01:17.271675 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264098 2578 flags.go:64] FLAG: --rotate-certificates="false" Sep 18 12:01:17.271675 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264101 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 18 12:01:17.271675 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264104 2578 flags.go:64] FLAG: --runonce="false" Sep 18 12:01:17.272283 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264108 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 18 12:01:17.272283 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264111 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 18 12:01:17.272283 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264114 2578 flags.go:64] FLAG: --seccomp-default="false" Sep 18 12:01:17.272283 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264117 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 18 12:01:17.272283 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264120 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 18 12:01:17.272283 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264123 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 18 12:01:17.272283 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264126 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 18 12:01:17.272283 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264129 2578 flags.go:64] FLAG: --storage-driver-password="root" Sep 18 12:01:17.272283 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264132 2578 flags.go:64] FLAG: --storage-driver-secure="false" Sep 18 12:01:17.272283 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264135 2578 flags.go:64] FLAG: --storage-driver-table="stats" Sep 18 12:01:17.272283 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264138 2578 flags.go:64] FLAG: --storage-driver-user="root" Sep 18 12:01:17.272283 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264141 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 18 12:01:17.272283 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264144 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 18 12:01:17.272283 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264147 2578 flags.go:64] FLAG: --system-cgroups="" Sep 18 12:01:17.272283 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264150 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 18 12:01:17.272283 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264156 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 18 12:01:17.272283 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264159 2578 flags.go:64] FLAG: --tls-cert-file="" Sep 18 12:01:17.272283 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264162 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 18 12:01:17.272283 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264167 2578 flags.go:64] FLAG: --tls-min-version="" Sep 18 12:01:17.272283 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264170 2578 flags.go:64] FLAG: --tls-private-key-file="" Sep 18 12:01:17.272283 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264173 2578 flags.go:64] FLAG: --topology-manager-policy="none" Sep 18 12:01:17.272283 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264176 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 18 12:01:17.272283 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264179 2578 flags.go:64] FLAG: --topology-manager-scope="container" Sep 18 12:01:17.272283 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264182 2578 flags.go:64] FLAG: --v="2" Sep 18 12:01:17.272283 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264186 2578 flags.go:64] FLAG: --version="false" Sep 18 12:01:17.272904 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264190 2578 flags.go:64] FLAG: --vmodule="" Sep 18 12:01:17.272904 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264194 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 18 12:01:17.272904 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.264197 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 18 12:01:17.272904 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264312 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 12:01:17.272904 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264316 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 12:01:17.272904 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264319 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 12:01:17.272904 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264322 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 12:01:17.272904 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264325 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 12:01:17.272904 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264328 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 12:01:17.272904 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264331 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 12:01:17.272904 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264333 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 12:01:17.272904 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264336 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 12:01:17.272904 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264339 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 12:01:17.272904 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264341 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 12:01:17.272904 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264344 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 12:01:17.272904 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264346 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 12:01:17.272904 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264349 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 12:01:17.272904 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264351 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 12:01:17.272904 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264354 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 12:01:17.272904 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264357 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 12:01:17.273402 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264359 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 12:01:17.273402 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264363 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 12:01:17.273402 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264366 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 12:01:17.273402 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264368 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 12:01:17.273402 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264371 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 12:01:17.273402 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264374 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 12:01:17.273402 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264376 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 12:01:17.273402 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264380 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 12:01:17.273402 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264382 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 12:01:17.273402 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264385 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 12:01:17.273402 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264388 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 12:01:17.273402 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264390 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 12:01:17.273402 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264393 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 12:01:17.273402 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264397 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 12:01:17.273402 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264400 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 12:01:17.273402 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264403 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 12:01:17.273402 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264406 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 12:01:17.273402 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264410 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 12:01:17.273402 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264414 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 12:01:17.273890 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264417 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 12:01:17.273890 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264420 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 12:01:17.273890 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264423 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 12:01:17.273890 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264426 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 12:01:17.273890 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264429 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 12:01:17.273890 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264432 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 12:01:17.273890 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264448 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 12:01:17.273890 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264452 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 12:01:17.273890 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264454 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 12:01:17.273890 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264457 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 12:01:17.273890 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264460 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 12:01:17.273890 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264463 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 18 12:01:17.273890 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264465 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 12:01:17.273890 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264468 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 12:01:17.273890 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264471 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 12:01:17.273890 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264474 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 12:01:17.273890 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264477 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 12:01:17.273890 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264480 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 12:01:17.273890 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264483 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 12:01:17.273890 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264486 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 12:01:17.274377 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264490 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 12:01:17.274377 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264493 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 12:01:17.274377 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264496 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 12:01:17.274377 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264498 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 12:01:17.274377 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264502 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 12:01:17.274377 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264504 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 12:01:17.274377 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264507 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 12:01:17.274377 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264510 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 12:01:17.274377 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264512 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 12:01:17.274377 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264515 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 12:01:17.274377 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264517 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 12:01:17.274377 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264520 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 12:01:17.274377 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264523 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 12:01:17.274377 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264525 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 12:01:17.274377 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264528 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 12:01:17.274377 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264530 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 12:01:17.274377 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264534 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 12:01:17.274377 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264536 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 12:01:17.274377 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264539 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 12:01:17.274377 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264541 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 12:01:17.274872 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264544 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 12:01:17.274872 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264547 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 12:01:17.274872 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264558 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 12:01:17.274872 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264560 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 12:01:17.274872 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264563 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 12:01:17.274872 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264565 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 12:01:17.274872 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264569 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 12:01:17.274872 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264573 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 12:01:17.274872 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264580 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 12:01:17.274872 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264583 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 12:01:17.274872 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264586 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 12:01:17.274872 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264589 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 12:01:17.274872 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264593 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 12:01:17.274872 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264596 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 12:01:17.274872 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264599 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 12:01:17.274872 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264601 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 12:01:17.274872 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264604 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 12:01:17.274872 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264607 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 12:01:17.274872 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264609 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 12:01:17.274872 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264612 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 12:01:17.275357 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264615 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 12:01:17.275357 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264617 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 12:01:17.275357 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.264620 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 12:01:17.275357 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.265271 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 12:01:17.275357 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.272433 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 18 12:01:17.275357 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.272464 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 18 12:01:17.275357 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.273938 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 18 12:01:17.275357 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.273946 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 18 12:01:17.275357 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274012 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 12:01:17.275357 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274017 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 12:01:17.275357 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274021 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 12:01:17.275357 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274024 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 12:01:17.275357 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274027 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 12:01:17.275357 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274030 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 12:01:17.275357 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274032 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 12:01:17.275753 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274035 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 12:01:17.275753 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274038 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 12:01:17.275753 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274041 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 12:01:17.275753 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274044 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 12:01:17.275753 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274047 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 12:01:17.275753 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274050 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 12:01:17.275753 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274053 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 12:01:17.275753 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274056 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 12:01:17.275753 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274058 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 12:01:17.275753 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274061 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 12:01:17.275753 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274064 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 18 12:01:17.275753 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274067 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 12:01:17.275753 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274069 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 12:01:17.275753 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274072 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 12:01:17.275753 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274075 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 12:01:17.275753 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274078 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 12:01:17.275753 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274081 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 12:01:17.275753 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274083 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 12:01:17.275753 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274086 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 12:01:17.275753 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274088 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 12:01:17.276225 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274091 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 12:01:17.276225 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274094 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 12:01:17.276225 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274097 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 12:01:17.276225 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274100 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 12:01:17.276225 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274103 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 12:01:17.276225 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274106 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 12:01:17.276225 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274108 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 12:01:17.276225 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274111 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 12:01:17.276225 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274113 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 12:01:17.276225 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274116 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 12:01:17.276225 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274121 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 12:01:17.276225 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274125 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 12:01:17.276225 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274129 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 12:01:17.276225 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274131 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 12:01:17.276225 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274134 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 12:01:17.276225 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274137 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 12:01:17.276225 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274139 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 12:01:17.276225 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274142 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 12:01:17.276225 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274145 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 12:01:17.276704 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274148 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 12:01:17.276704 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274151 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 12:01:17.276704 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274154 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 12:01:17.276704 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274156 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 12:01:17.276704 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274159 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 12:01:17.276704 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274162 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 12:01:17.276704 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274164 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 12:01:17.276704 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274167 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 12:01:17.276704 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274169 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 12:01:17.276704 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274172 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 12:01:17.276704 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274175 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 12:01:17.276704 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274177 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 12:01:17.276704 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274180 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 12:01:17.276704 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274183 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 12:01:17.276704 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274186 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 12:01:17.276704 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274190 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 12:01:17.276704 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274194 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 12:01:17.276704 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274198 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 12:01:17.276704 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274200 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 12:01:17.277161 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274204 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 12:01:17.277161 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274207 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 12:01:17.277161 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274210 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 12:01:17.277161 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274213 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 12:01:17.277161 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274215 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 12:01:17.277161 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274218 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 12:01:17.277161 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274221 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 12:01:17.277161 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274224 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 12:01:17.277161 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274227 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 12:01:17.277161 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274230 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 12:01:17.277161 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274233 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 12:01:17.277161 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274236 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 12:01:17.277161 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274239 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 12:01:17.277161 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274242 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 12:01:17.277161 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274245 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 12:01:17.277161 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274248 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 12:01:17.277161 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274250 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 12:01:17.277161 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274254 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 12:01:17.277161 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274257 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 12:01:17.277739 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274260 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 12:01:17.277739 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274263 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 12:01:17.277739 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274266 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 12:01:17.277739 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274269 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 12:01:17.277739 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274272 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 12:01:17.277739 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274275 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 12:01:17.277739 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274279 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 12:01:17.277739 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274281 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 12:01:17.277739 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274284 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 12:01:17.277739 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274287 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 12:01:17.277739 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274290 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 12:01:17.277739 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274293 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 12:01:17.277739 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274295 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 12:01:17.277739 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274298 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 12:01:17.277739 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274301 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 12:01:17.278182 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.274306 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 12:01:17.278182 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274421 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 12:01:17.278182 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274426 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 12:01:17.278182 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274429 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 12:01:17.278182 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274432 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 12:01:17.278182 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274451 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 12:01:17.278182 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274455 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 12:01:17.278182 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274457 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 12:01:17.278182 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274460 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 12:01:17.278182 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274462 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 12:01:17.278182 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274465 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 12:01:17.278182 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274468 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 12:01:17.278182 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274471 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 12:01:17.278182 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274474 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 12:01:17.278182 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274476 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 12:01:17.278608 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274479 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 12:01:17.278608 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274483 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 12:01:17.278608 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274486 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 12:01:17.278608 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274489 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 12:01:17.278608 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274492 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 12:01:17.278608 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274495 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 12:01:17.278608 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274497 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 12:01:17.278608 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274500 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 12:01:17.278608 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274503 2578 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 12:01:17.278608 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274506 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 12:01:17.278608 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274508 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 12:01:17.278608 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274512 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 12:01:17.278608 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274514 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 12:01:17.278608 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274517 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 12:01:17.278608 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274520 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 12:01:17.278608 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274522 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 12:01:17.278608 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274525 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 12:01:17.278608 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274528 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 12:01:17.278608 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274530 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 12:01:17.279103 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274533 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 12:01:17.279103 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274536 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 12:01:17.279103 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274538 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 12:01:17.279103 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274541 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 12:01:17.279103 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274544 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 12:01:17.279103 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274546 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 12:01:17.279103 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274549 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 12:01:17.279103 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274551 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 12:01:17.279103 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274554 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 12:01:17.279103 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274556 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 12:01:17.279103 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274559 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 12:01:17.279103 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274562 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 12:01:17.279103 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274565 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 12:01:17.279103 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274568 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 12:01:17.279103 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274570 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 12:01:17.279103 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274573 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 12:01:17.279103 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274575 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 12:01:17.279103 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274578 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 12:01:17.279103 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274580 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 12:01:17.279103 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274583 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 12:01:17.279585 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274585 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 12:01:17.279585 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274588 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 12:01:17.279585 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274591 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 12:01:17.279585 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274593 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 12:01:17.279585 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274596 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 12:01:17.279585 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274599 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 12:01:17.279585 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274601 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 12:01:17.279585 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274604 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 12:01:17.279585 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274606 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 12:01:17.279585 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274609 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 12:01:17.279585 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274611 2578 feature_gate.go:328] unrecognized feature gate: Example Sep 18 12:01:17.279585 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274614 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 12:01:17.279585 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274616 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 12:01:17.279585 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274619 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 12:01:17.279585 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274622 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 12:01:17.279585 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274624 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 12:01:17.279585 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274627 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 12:01:17.279585 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274629 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 12:01:17.279585 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274632 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 12:01:17.279585 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274635 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 12:01:17.280082 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274637 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 12:01:17.280082 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274640 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 12:01:17.280082 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274642 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 12:01:17.280082 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274645 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 12:01:17.280082 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274648 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 12:01:17.280082 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274651 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 12:01:17.280082 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274653 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 12:01:17.280082 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274656 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 12:01:17.280082 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274658 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 12:01:17.280082 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274661 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 12:01:17.280082 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274664 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 12:01:17.280082 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274666 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 12:01:17.280082 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274668 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 12:01:17.280082 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274671 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 12:01:17.280082 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274674 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 12:01:17.280082 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274676 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 12:01:17.280082 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274679 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 12:01:17.280082 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274682 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 12:01:17.280082 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274684 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 12:01:17.280082 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274687 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 12:01:17.280616 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274691 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 12:01:17.280616 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274694 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 12:01:17.280616 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274698 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 12:01:17.280616 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274701 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 12:01:17.280616 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274704 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 12:01:17.280616 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:17.274708 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 12:01:17.280616 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.274713 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 12:01:17.280616 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.274810 2578 server.go:962] "Client rotation is on, will bootstrap in background" Sep 18 12:01:17.280616 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.276817 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 18 12:01:17.280616 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.277728 2578 server.go:1019] "Starting client certificate rotation" Sep 18 12:01:17.280616 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.277834 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 12:01:17.280616 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.277872 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 12:01:17.280921 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.280195 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 12:01:17.282755 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.282393 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 12:01:17.295260 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.295241 2578 log.go:25] "Validated CRI v1 runtime API" Sep 18 12:01:17.298383 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.298366 2578 log.go:25] "Validated CRI v1 image API" Sep 18 12:01:17.299252 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.299237 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 18 12:01:17.304908 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.304890 2578 fs.go:135] Filesystem UUIDs: map[49ca8855-454a-421b-898b-1c1190117b1e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 bc744d69-33d3-41d1-8546-27920bfedd82:/dev/nvme0n1p3] Sep 18 12:01:17.304974 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.304907 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 18 12:01:17.310042 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.309940 2578 manager.go:216] Machine: {Timestamp:2026-09-18 12:01:17.30875282 +0000 UTC m=+0.313440534 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3108400 MemoryCapacity:32812146688 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2626ff9dd60a8e422415b41cc1adfd SystemUUID:ec2626ff-9dd6-0a8e-4224-15b41cc1adfd BootID:b7b890ce-ca38-4bc8-b0ce-4b4b74546d6e Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406073344 Type:vfs Inodes:4005389 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406073344 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f1:f8:b6:81 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f1:f8:b6:81 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:ef:fc:b1:c2:3f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812146688 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 18 12:01:17.310042 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.310037 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 18 12:01:17.310142 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.310116 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 18 12:01:17.313826 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.313802 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 18 12:01:17.313996 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.313831 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-137.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 18 12:01:17.314785 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.314769 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 12:01:17.315050 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.315038 2578 topology_manager.go:138] "Creating topology manager with none policy" Sep 18 12:01:17.315081 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.315055 2578 container_manager_linux.go:309] "Creating device plugin manager" Sep 18 12:01:17.315081 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.315062 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 12:01:17.315809 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.315798 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 12:01:17.315883 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.315874 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 18 12:01:17.319686 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.319673 2578 state_mem.go:36] "Initialized new in-memory state store" Sep 18 12:01:17.319811 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.319801 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 18 12:01:17.319843 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.319831 2578 kubelet.go:486] "Attempting to sync node with API server" Sep 18 12:01:17.319873 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.319845 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 18 12:01:17.319873 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.319859 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 18 12:01:17.319873 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.319869 2578 kubelet.go:398] "Adding apiserver pod source" Sep 18 12:01:17.319986 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.319881 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 18 12:01:17.320260 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.320244 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 12:01:17.320328 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.320265 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 12:01:17.322355 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.322334 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 18 12:01:17.324680 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.324666 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 18 12:01:17.324743 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.324696 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 18 12:01:17.326236 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.326222 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 18 12:01:17.326274 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.326246 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 18 12:01:17.326274 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.326255 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 18 12:01:17.326274 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.326263 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 18 12:01:17.326346 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.326275 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 18 12:01:17.326346 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.326284 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 18 12:01:17.326346 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.326303 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 18 12:01:17.326346 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.326312 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 18 12:01:17.326346 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.326319 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 18 12:01:17.326346 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.326325 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 18 12:01:17.326346 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.326334 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 18 12:01:17.326346 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.326339 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 18 12:01:17.327956 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.327941 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 18 12:01:17.328003 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.327958 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 18 12:01:17.331296 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.331272 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-137.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 18 12:01:17.331382 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:17.331360 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 18 12:01:17.331900 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.331885 2578 server.go:1268] "Started kubelet" Sep 18 12:01:17.332002 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.331971 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 18 12:01:17.332168 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.332070 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 18 12:01:17.332336 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.332318 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 18 12:01:17.332889 ip-10-0-136-137 systemd[1]: Started Kubernetes Kubelet. Sep 18 12:01:17.337327 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.337116 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 18 12:01:17.340245 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.339351 2578 server.go:310] "Adding debug handlers to kubelet server" Sep 18 12:01:17.341576 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:17.341524 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 18 12:01:17.341576 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:17.341565 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-137.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 18 12:01:17.345997 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.345977 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 18 12:01:17.346637 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.346610 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 18 12:01:17.346820 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:17.346779 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-137.ec2.internal\" not found" Sep 18 12:01:17.347344 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.347328 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 18 12:01:17.347427 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.347379 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 18 12:01:17.347427 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.347396 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 18 12:01:17.347584 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.347568 2578 reconstruct.go:97] "Volume reconstruction finished" Sep 18 12:01:17.347584 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.347582 2578 reconciler.go:29] "Reconciler: start to sync state" Sep 18 12:01:17.347865 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.347849 2578 factory.go:55] Registering systemd factory Sep 18 12:01:17.347913 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.347871 2578 factory.go:223] Registration of the systemd container factory successfully Sep 18 12:01:17.348150 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.348132 2578 factory.go:153] Registering CRI-O factory Sep 18 12:01:17.348150 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.348152 2578 factory.go:223] Registration of the crio container factory successfully Sep 18 12:01:17.348314 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.348196 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 18 12:01:17.348314 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.348210 2578 factory.go:103] Registering Raw factory Sep 18 12:01:17.348314 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.348231 2578 manager.go:1196] Started watching for new ooms in manager Sep 18 12:01:17.348549 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.348533 2578 manager.go:349] Starting recovery of all containers Sep 18 12:01:17.349229 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:17.348123 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-137.ec2.internal.18d66891cc33fdb8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-137.ec2.internal,UID:ip-10-0-136-137.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-137.ec2.internal,},FirstTimestamp:2026-09-18 12:01:17.331856824 +0000 UTC m=+0.336544537,LastTimestamp:2026-09-18 12:01:17.331856824 +0000 UTC m=+0.336544537,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-137.ec2.internal,}" Sep 18 12:01:17.355827 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.355772 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 18 12:01:17.360261 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:17.360234 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 18 12:01:17.360392 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.360376 2578 manager.go:354] Recovery completed Sep 18 12:01:17.360705 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:17.360675 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-137.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 18 12:01:17.364817 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.364803 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 12:01:17.368211 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.368194 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientMemory" Sep 18 12:01:17.368304 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.368229 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 12:01:17.368304 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.368244 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientPID" Sep 18 12:01:17.368802 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.368790 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 18 12:01:17.368802 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.368800 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 12:01:17.368930 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.368800 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 18 12:01:17.368930 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.368857 2578 state_mem.go:36] "Initialized new in-memory state store" Sep 18 12:01:17.369628 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.369611 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientMemory" Sep 18 12:01:17.369765 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.369646 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 12:01:17.369765 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.369660 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientPID" Sep 18 12:01:17.370180 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.370168 2578 policy_none.go:49] "None policy: Start" Sep 18 12:01:17.370223 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.370184 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 18 12:01:17.370223 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.370194 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 18 12:01:17.370621 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:17.370557 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-137.ec2.internal.18d66891ce5ebad9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-137.ec2.internal,UID:ip-10-0-136-137.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-137.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-137.ec2.internal,},FirstTimestamp:2026-09-18 12:01:17.368212185 +0000 UTC m=+0.372899903,LastTimestamp:2026-09-18 12:01:17.368212185 +0000 UTC m=+0.372899903,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-137.ec2.internal,}" Sep 18 12:01:17.379122 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.379108 2578 policy_none.go:47] "Start" Sep 18 12:01:17.387352 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:17.387274 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-137.ec2.internal.18d66891ce5f1791 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-137.ec2.internal,UID:ip-10-0-136-137.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-137.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-137.ec2.internal,},FirstTimestamp:2026-09-18 12:01:17.368235921 +0000 UTC m=+0.372923636,LastTimestamp:2026-09-18 12:01:17.368235921 +0000 UTC m=+0.372923636,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-137.ec2.internal,}" Sep 18 12:01:17.399368 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:17.399281 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-137.ec2.internal.18d66891ce5f4e3a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-137.ec2.internal,UID:ip-10-0-136-137.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-137.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-137.ec2.internal,},FirstTimestamp:2026-09-18 12:01:17.368249914 +0000 UTC m=+0.372937629,LastTimestamp:2026-09-18 12:01:17.368249914 +0000 UTC m=+0.372937629,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-137.ec2.internal,}" Sep 18 12:01:17.408844 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.408826 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zwzgv" Sep 18 12:01:17.427362 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.414009 2578 manager.go:337] "Starting Device Plugin manager" Sep 18 12:01:17.427362 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:17.414042 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 18 12:01:17.427362 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.414051 2578 server.go:87] "Starting device plugin registration server" Sep 18 12:01:17.427362 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.414367 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 18 12:01:17.427362 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.414378 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 18 12:01:17.427362 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.414577 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 18 12:01:17.427362 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.414657 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 18 12:01:17.427362 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.414666 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 18 12:01:17.427362 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:17.414718 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-137.ec2.internal.18d66891ce5ebad9\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-137.ec2.internal.18d66891ce5ebad9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-137.ec2.internal,UID:ip-10-0-136-137.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-137.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-137.ec2.internal,},FirstTimestamp:2026-09-18 12:01:17.368212185 +0000 UTC m=+0.372899903,LastTimestamp:2026-09-18 12:01:17.369627151 +0000 UTC m=+0.374314869,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-137.ec2.internal,}" Sep 18 12:01:17.427362 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:17.415606 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 18 12:01:17.427362 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:17.415666 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-137.ec2.internal\" not found" Sep 18 12:01:17.427362 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.424573 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zwzgv" Sep 18 12:01:17.430036 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:17.429976 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-137.ec2.internal.18d66891ce5f1791\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-137.ec2.internal.18d66891ce5f1791 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-137.ec2.internal,UID:ip-10-0-136-137.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-137.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-137.ec2.internal,},FirstTimestamp:2026-09-18 12:01:17.368235921 +0000 UTC m=+0.372923636,LastTimestamp:2026-09-18 12:01:17.36965283 +0000 UTC m=+0.374340546,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-137.ec2.internal,}" Sep 18 12:01:17.459572 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.459546 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 18 12:01:17.459660 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.459596 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 18 12:01:17.459660 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.459615 2578 kubelet.go:2448] "Starting kubelet main sync loop" Sep 18 12:01:17.459734 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:17.459660 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 18 12:01:17.461603 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.461587 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 12:01:17.514839 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.514749 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 12:01:17.515592 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.515575 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientMemory" Sep 18 12:01:17.515679 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.515607 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 12:01:17.515679 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.515619 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientPID" Sep 18 12:01:17.515679 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.515654 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-137.ec2.internal" Sep 18 12:01:17.526484 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.526465 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-137.ec2.internal" Sep 18 12:01:17.526581 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:17.526491 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-137.ec2.internal\": node \"ip-10-0-136-137.ec2.internal\" not found" Sep 18 12:01:17.560423 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.560396 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-137.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal"] Sep 18 12:01:17.560534 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.560489 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 12:01:17.561293 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.561278 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientMemory" Sep 18 12:01:17.561363 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.561305 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 12:01:17.561363 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.561315 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientPID" Sep 18 12:01:17.562526 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.562514 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 12:01:17.562653 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.562630 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-137.ec2.internal" Sep 18 12:01:17.562684 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.562669 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 12:01:17.563211 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.563197 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientMemory" Sep 18 12:01:17.563276 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.563211 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientMemory" Sep 18 12:01:17.563276 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.563236 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 12:01:17.563276 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.563246 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientPID" Sep 18 12:01:17.563389 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.563219 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 12:01:17.563389 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.563303 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientPID" Sep 18 12:01:17.564419 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.564405 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal" Sep 18 12:01:17.564491 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.564431 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 12:01:17.565089 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.565078 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientMemory" Sep 18 12:01:17.565140 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.565099 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 12:01:17.565140 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.565108 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientPID" Sep 18 12:01:17.575976 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:17.575962 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-137.ec2.internal\" not found" Sep 18 12:01:17.589961 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:17.589943 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-137.ec2.internal\" not found" node="ip-10-0-136-137.ec2.internal" Sep 18 12:01:17.594131 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:17.594116 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-137.ec2.internal\" not found" node="ip-10-0-136-137.ec2.internal" Sep 18 12:01:17.650282 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.650253 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1159b62a0722daa58656ffb4cf50e6f2-config\") pod \"kube-apiserver-proxy-ip-10-0-136-137.ec2.internal\" (UID: \"1159b62a0722daa58656ffb4cf50e6f2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-137.ec2.internal" Sep 18 12:01:17.650364 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.650294 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a43f10e83b212fc99ba5e51c2dca4098-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal\" (UID: \"a43f10e83b212fc99ba5e51c2dca4098\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal" Sep 18 12:01:17.650364 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.650313 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a43f10e83b212fc99ba5e51c2dca4098-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal\" (UID: \"a43f10e83b212fc99ba5e51c2dca4098\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal" Sep 18 12:01:17.676555 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:17.676531 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-137.ec2.internal\" not found" Sep 18 12:01:17.751399 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.751370 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1159b62a0722daa58656ffb4cf50e6f2-config\") pod \"kube-apiserver-proxy-ip-10-0-136-137.ec2.internal\" (UID: \"1159b62a0722daa58656ffb4cf50e6f2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-137.ec2.internal" Sep 18 12:01:17.751399 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.751397 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a43f10e83b212fc99ba5e51c2dca4098-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal\" (UID: \"a43f10e83b212fc99ba5e51c2dca4098\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal" Sep 18 12:01:17.751601 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.751416 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a43f10e83b212fc99ba5e51c2dca4098-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal\" (UID: \"a43f10e83b212fc99ba5e51c2dca4098\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal" Sep 18 12:01:17.751601 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.751501 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1159b62a0722daa58656ffb4cf50e6f2-config\") pod \"kube-apiserver-proxy-ip-10-0-136-137.ec2.internal\" (UID: \"1159b62a0722daa58656ffb4cf50e6f2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-137.ec2.internal" Sep 18 12:01:17.751601 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.751504 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a43f10e83b212fc99ba5e51c2dca4098-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal\" (UID: \"a43f10e83b212fc99ba5e51c2dca4098\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal" Sep 18 12:01:17.751601 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.751504 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a43f10e83b212fc99ba5e51c2dca4098-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal\" (UID: \"a43f10e83b212fc99ba5e51c2dca4098\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal" Sep 18 12:01:17.776749 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:17.776690 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-137.ec2.internal\" not found" Sep 18 12:01:17.877077 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:17.877048 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-137.ec2.internal\" not found" Sep 18 12:01:17.893257 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.893236 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-137.ec2.internal" Sep 18 12:01:17.898298 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:17.898213 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal" Sep 18 12:01:17.977838 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:17.977803 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-137.ec2.internal\" not found" Sep 18 12:01:18.078334 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:18.078265 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-137.ec2.internal\" not found" Sep 18 12:01:18.178738 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:18.178709 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-137.ec2.internal\" not found" Sep 18 12:01:18.277128 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:18.277096 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 18 12:01:18.277595 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:18.277270 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 12:01:18.279245 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:18.279223 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-137.ec2.internal\" not found" Sep 18 12:01:18.379697 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:18.379670 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-137.ec2.internal\" not found" Sep 18 12:01:18.408230 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:18.408208 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 12:01:18.425090 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:18.425068 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 12:01:18.426200 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:18.426179 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientMemory" Sep 18 12:01:18.426290 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:18.426217 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 12:01:18.426290 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:18.426231 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeHasSufficientPID" Sep 18 12:01:18.429369 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:18.429341 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 11:56:18 +0000 UTC" deadline="2028-05-09 09:48:37.510707676 +0000 UTC" Sep 18 12:01:18.429369 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:18.429367 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14373h47m19.081343921s" Sep 18 12:01:18.480338 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:18.480314 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-137.ec2.internal\" not found" Sep 18 12:01:18.509020 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:18.508994 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 12:01:18.540382 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:18.540355 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1159b62a0722daa58656ffb4cf50e6f2.slice/crio-5e6becdce1d90611175299b4a9e31262da5c3356e486a6605fbe3410f7adbfbf WatchSource:0}: Error finding container 5e6becdce1d90611175299b4a9e31262da5c3356e486a6605fbe3410f7adbfbf: Status 404 returned error can't find the container with id 5e6becdce1d90611175299b4a9e31262da5c3356e486a6605fbe3410f7adbfbf Sep 18 12:01:18.540854 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:18.540830 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda43f10e83b212fc99ba5e51c2dca4098.slice/crio-868df3df345a4123732ad4d99cdfd86f8562a92535633b149fabbc8dd88b3aed WatchSource:0}: Error finding container 868df3df345a4123732ad4d99cdfd86f8562a92535633b149fabbc8dd88b3aed: Status 404 returned error can't find the container with id 868df3df345a4123732ad4d99cdfd86f8562a92535633b149fabbc8dd88b3aed Sep 18 12:01:18.547163 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:18.547146 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal" Sep 18 12:01:18.547688 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:18.547670 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 12:01:18.562261 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:18.562242 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 12:01:18.563503 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:18.563489 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-137.ec2.internal" Sep 18 12:01:18.571562 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:18.571548 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 12:01:18.611306 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:18.611289 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 12:01:19.321845 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.321500 2578 apiserver.go:52] "Watching apiserver" Sep 18 12:01:19.331904 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.331564 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 18 12:01:19.332900 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.332864 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-137.ec2.internal","openshift-cluster-node-tuning-operator/tuned-4ldj5","openshift-dns/node-resolver-rvwkx","openshift-multus/multus-z7phr","openshift-multus/network-metrics-daemon-lvx4s","openshift-ovn-kubernetes/ovnkube-node-5l7rg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk99x","openshift-image-registry/node-ca-72hfq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal","openshift-multus/multus-additional-cni-plugins-5n699","openshift-network-diagnostics/network-check-target-sbkdt","openshift-network-operator/iptables-alerter-xzqgp","kube-system/global-pull-secret-syncer-tpftw","kube-system/konnectivity-agent-hj8kz"] Sep 18 12:01:19.335726 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.334972 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk99x" Sep 18 12:01:19.337028 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.336994 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:19.337121 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:19.337074 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpftw" podUID="7e518e71-5f13-44e7-aeb5-4e7c1e6d4778" Sep 18 12:01:19.338272 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.337920 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 18 12:01:19.338272 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.338246 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rvwkx" Sep 18 12:01:19.339593 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.339354 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 18 12:01:19.340186 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.340008 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.340687 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.340319 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7qbqq\"" Sep 18 12:01:19.340687 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.340457 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 18 12:01:19.341939 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.341523 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:01:19.341939 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:19.341608 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvx4s" podUID="a7f89718-22f1-4c13-aff1-d2fa5ff92c55" Sep 18 12:01:19.343744 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.343496 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.344529 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.344342 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 18 12:01:19.344529 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.344377 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 18 12:01:19.345006 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.344985 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 18 12:01:19.345203 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.345186 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 18 12:01:19.345463 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.345446 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kkssb\"" Sep 18 12:01:19.345697 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.345679 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 18 12:01:19.346628 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.346604 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 18 12:01:19.346628 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.346621 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hj8kz" Sep 18 12:01:19.347107 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.347085 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 18 12:01:19.347191 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.347130 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4w75g\"" Sep 18 12:01:19.347191 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.347146 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 18 12:01:19.348313 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.348297 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-72hfq" Sep 18 12:01:19.351325 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.351305 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 18 12:01:19.351455 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.351439 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 18 12:01:19.353717 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.353693 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 18 12:01:19.353819 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.353731 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 18 12:01:19.354101 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.354081 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zjmsb\"" Sep 18 12:01:19.354205 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.354187 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cg2zf\"" Sep 18 12:01:19.354271 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.354239 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 18 12:01:19.354648 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.354626 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 18 12:01:19.354810 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.354793 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 18 12:01:19.354977 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.354961 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qppd6\"" Sep 18 12:01:19.355339 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.355319 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 18 12:01:19.355413 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.355389 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 18 12:01:19.355561 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.355538 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 18 12:01:19.355762 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.355743 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.356378 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.356357 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5n699" Sep 18 12:01:19.359634 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.359377 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbkdt" Sep 18 12:01:19.359634 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:19.359489 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbkdt" podUID="91599aa3-f0bc-4a4a-afa3-362851ac1783" Sep 18 12:01:19.359869 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.359754 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-host-run-multus-certs\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.359869 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.359787 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-metrics-certs\") pod \"network-metrics-daemon-lvx4s\" (UID: \"a7f89718-22f1-4c13-aff1-d2fa5ff92c55\") " pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:01:19.359869 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.359812 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-run-systemd\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.359869 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.359835 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-node-log\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.360086 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.359893 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-host-run-ovn-kubernetes\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.360086 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.359918 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shwjw\" (UniqueName: \"kubernetes.io/projected/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-kube-api-access-shwjw\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.360086 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.359938 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-multus-conf-dir\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.360086 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.359982 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-cnibin\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.360086 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.360001 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-ovn-node-metrics-cert\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.360086 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.360047 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e9f66a61-1fad-45c2-99e5-c634c8727fbe-device-dir\") pod \"aws-ebs-csi-driver-node-wk99x\" (UID: \"e9f66a61-1fad-45c2-99e5-c634c8727fbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk99x" Sep 18 12:01:19.360086 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.360071 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-systemd-units\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.360495 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.360096 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-etc-openvswitch\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.360495 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.360151 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d41ee317-2122-4ae3-b680-6b44e17f25a9-cni-binary-copy\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.360495 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.360187 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-host-run-k8s-cni-cncf-io\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.360495 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.360211 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65mc2\" (UniqueName: \"kubernetes.io/projected/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-kube-api-access-65mc2\") pod \"network-metrics-daemon-lvx4s\" (UID: \"a7f89718-22f1-4c13-aff1-d2fa5ff92c55\") " pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:01:19.360495 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.360276 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-multus-socket-dir-parent\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.360495 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.360333 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xzqgp" Sep 18 12:01:19.360495 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.360358 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-system-cni-dir\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.360495 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.360384 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-host-var-lib-cni-bin\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.360495 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.360440 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-ovnkube-config\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.360802 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.360510 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7e518e71-5f13-44e7-aeb5-4e7c1e6d4778-kubelet-config\") pod \"global-pull-secret-syncer-tpftw\" (UID: \"7e518e71-5f13-44e7-aeb5-4e7c1e6d4778\") " pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:19.360802 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.360536 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkd72\" (UniqueName: \"kubernetes.io/projected/d41ee317-2122-4ae3-b680-6b44e17f25a9-kube-api-access-rkd72\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.360802 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.360585 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dd9664b3-5cd3-4336-9a83-c1641b6801ae-serviceca\") pod \"node-ca-72hfq\" (UID: \"dd9664b3-5cd3-4336-9a83-c1641b6801ae\") " pod="openshift-image-registry/node-ca-72hfq" Sep 18 12:01:19.360802 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.360636 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-host-kubelet\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.360926 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.360819 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn6qm\" (UniqueName: \"kubernetes.io/projected/e518b32c-52bd-4209-a275-735bb0a88e9f-kube-api-access-hn6qm\") pod \"node-resolver-rvwkx\" (UID: \"e518b32c-52bd-4209-a275-735bb0a88e9f\") " pod="openshift-dns/node-resolver-rvwkx" Sep 18 12:01:19.360926 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.360873 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-etc-kubernetes\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.360989 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.360899 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d-agent-certs\") pod \"konnectivity-agent-hj8kz\" (UID: \"a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d\") " pod="kube-system/konnectivity-agent-hj8kz" Sep 18 12:01:19.360989 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.360962 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-run-ovn\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.361056 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.360986 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-host-cni-netd\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.361056 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.361031 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e518e71-5f13-44e7-aeb5-4e7c1e6d4778-original-pull-secret\") pod \"global-pull-secret-syncer-tpftw\" (UID: \"7e518e71-5f13-44e7-aeb5-4e7c1e6d4778\") " pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:19.361225 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.361134 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e9f66a61-1fad-45c2-99e5-c634c8727fbe-socket-dir\") pod \"aws-ebs-csi-driver-node-wk99x\" (UID: \"e9f66a61-1fad-45c2-99e5-c634c8727fbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk99x" Sep 18 12:01:19.361225 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.361164 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-var-lib-openvswitch\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.361225 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.361209 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d41ee317-2122-4ae3-b680-6b44e17f25a9-multus-daemon-config\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.361398 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.361230 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd9664b3-5cd3-4336-9a83-c1641b6801ae-host\") pod \"node-ca-72hfq\" (UID: \"dd9664b3-5cd3-4336-9a83-c1641b6801ae\") " pod="openshift-image-registry/node-ca-72hfq" Sep 18 12:01:19.361398 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.361254 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-host-run-netns\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.361398 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.361278 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-host-var-lib-kubelet\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.361398 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.361306 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e9f66a61-1fad-45c2-99e5-c634c8727fbe-etc-selinux\") pod \"aws-ebs-csi-driver-node-wk99x\" (UID: \"e9f66a61-1fad-45c2-99e5-c634c8727fbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk99x" Sep 18 12:01:19.361398 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.361339 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-run-openvswitch\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.361398 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.361377 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-ovnkube-script-lib\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.361398 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.361399 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d-konnectivity-ca\") pod \"konnectivity-agent-hj8kz\" (UID: \"a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d\") " pod="kube-system/konnectivity-agent-hj8kz" Sep 18 12:01:19.361763 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.361419 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-env-overrides\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.361763 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.361475 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-host-var-lib-cni-multus\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.361763 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.361514 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-hostroot\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.361763 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.361546 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-host-cni-bin\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.361763 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.361573 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-host-run-netns\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.361763 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.361597 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e518b32c-52bd-4209-a275-735bb0a88e9f-hosts-file\") pod \"node-resolver-rvwkx\" (UID: \"e518b32c-52bd-4209-a275-735bb0a88e9f\") " pod="openshift-dns/node-resolver-rvwkx" Sep 18 12:01:19.361763 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.361620 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e9f66a61-1fad-45c2-99e5-c634c8727fbe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wk99x\" (UID: \"e9f66a61-1fad-45c2-99e5-c634c8727fbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk99x" Sep 18 12:01:19.361763 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.361645 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e9f66a61-1fad-45c2-99e5-c634c8727fbe-registration-dir\") pod \"aws-ebs-csi-driver-node-wk99x\" (UID: \"e9f66a61-1fad-45c2-99e5-c634c8727fbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk99x" Sep 18 12:01:19.361763 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.361670 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.361763 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.361696 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgcpt\" (UniqueName: \"kubernetes.io/projected/e9f66a61-1fad-45c2-99e5-c634c8727fbe-kube-api-access-fgcpt\") pod \"aws-ebs-csi-driver-node-wk99x\" (UID: \"e9f66a61-1fad-45c2-99e5-c634c8727fbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk99x" Sep 18 12:01:19.361763 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.361745 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-host-slash\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.362304 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.361806 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7e518e71-5f13-44e7-aeb5-4e7c1e6d4778-dbus\") pod \"global-pull-secret-syncer-tpftw\" (UID: \"7e518e71-5f13-44e7-aeb5-4e7c1e6d4778\") " pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:19.362304 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.361834 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e518b32c-52bd-4209-a275-735bb0a88e9f-tmp-dir\") pod \"node-resolver-rvwkx\" (UID: \"e518b32c-52bd-4209-a275-735bb0a88e9f\") " pod="openshift-dns/node-resolver-rvwkx" Sep 18 12:01:19.362304 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.361886 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-multus-cni-dir\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.362304 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.361916 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4csw\" (UniqueName: \"kubernetes.io/projected/dd9664b3-5cd3-4336-9a83-c1641b6801ae-kube-api-access-b4csw\") pod \"node-ca-72hfq\" (UID: \"dd9664b3-5cd3-4336-9a83-c1641b6801ae\") " pod="openshift-image-registry/node-ca-72hfq" Sep 18 12:01:19.362304 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.361945 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e9f66a61-1fad-45c2-99e5-c634c8727fbe-sys-fs\") pod \"aws-ebs-csi-driver-node-wk99x\" (UID: \"e9f66a61-1fad-45c2-99e5-c634c8727fbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk99x" Sep 18 12:01:19.362304 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.361972 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-log-socket\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.364610 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.364579 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 18 12:01:19.364877 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.364858 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 18 12:01:19.365066 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.365050 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 18 12:01:19.365380 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.365362 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wvfgz\"" Sep 18 12:01:19.365661 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.365623 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qmczd\"" Sep 18 12:01:19.365920 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.365848 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 18 12:01:19.369718 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.369065 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 18 12:01:19.369718 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.369572 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 18 12:01:19.371029 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.369954 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 18 12:01:19.371029 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.371015 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wff4l\"" Sep 18 12:01:19.374062 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.374037 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 12:01:19.417133 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.417095 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xzc5v" Sep 18 12:01:19.430451 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.430071 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xzc5v" Sep 18 12:01:19.448820 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.448788 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 18 12:01:19.462483 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.462427 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-ovn-node-metrics-cert\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.462631 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.462490 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e9f66a61-1fad-45c2-99e5-c634c8727fbe-device-dir\") pod \"aws-ebs-csi-driver-node-wk99x\" (UID: \"e9f66a61-1fad-45c2-99e5-c634c8727fbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk99x" Sep 18 12:01:19.462631 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.462517 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-systemd-units\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.462631 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.462544 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-etc-openvswitch\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.462631 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.462607 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-etc-openvswitch\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.462631 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.462610 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-systemd-units\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.462631 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.462608 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e9f66a61-1fad-45c2-99e5-c634c8727fbe-device-dir\") pod \"aws-ebs-csi-driver-node-wk99x\" (UID: \"e9f66a61-1fad-45c2-99e5-c634c8727fbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk99x" Sep 18 12:01:19.462939 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.462664 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-lib-modules\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.462939 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.462720 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d41ee317-2122-4ae3-b680-6b44e17f25a9-cni-binary-copy\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.462939 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.462747 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-host-run-k8s-cni-cncf-io\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.462939 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.462783 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65mc2\" (UniqueName: \"kubernetes.io/projected/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-kube-api-access-65mc2\") pod \"network-metrics-daemon-lvx4s\" (UID: \"a7f89718-22f1-4c13-aff1-d2fa5ff92c55\") " pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:01:19.462939 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.462792 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-host-run-k8s-cni-cncf-io\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.462939 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.462816 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-etc-sysctl-conf\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.462939 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.462845 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x82bn\" (UniqueName: \"kubernetes.io/projected/91599aa3-f0bc-4a4a-afa3-362851ac1783-kube-api-access-x82bn\") pod \"network-check-target-sbkdt\" (UID: \"91599aa3-f0bc-4a4a-afa3-362851ac1783\") " pod="openshift-network-diagnostics/network-check-target-sbkdt" Sep 18 12:01:19.462939 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.462876 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fb3f8f64-6a47-42b0-a259-fd44f14570be-iptables-alerter-script\") pod \"iptables-alerter-xzqgp\" (UID: \"fb3f8f64-6a47-42b0-a259-fd44f14570be\") " pod="openshift-network-operator/iptables-alerter-xzqgp" Sep 18 12:01:19.462939 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.462904 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-multus-socket-dir-parent\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.462939 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.462930 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-system-cni-dir\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.463378 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.462960 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-host-var-lib-cni-bin\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.463378 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.462986 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-ovnkube-config\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.463378 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.463013 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-etc-kubernetes\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.463378 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.463037 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-sys\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.463378 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.463082 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chh52\" (UniqueName: \"kubernetes.io/projected/fb3f8f64-6a47-42b0-a259-fd44f14570be-kube-api-access-chh52\") pod \"iptables-alerter-xzqgp\" (UID: \"fb3f8f64-6a47-42b0-a259-fd44f14570be\") " pod="openshift-network-operator/iptables-alerter-xzqgp" Sep 18 12:01:19.463378 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.463108 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7e518e71-5f13-44e7-aeb5-4e7c1e6d4778-kubelet-config\") pod \"global-pull-secret-syncer-tpftw\" (UID: \"7e518e71-5f13-44e7-aeb5-4e7c1e6d4778\") " pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:19.463378 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.463128 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkd72\" (UniqueName: \"kubernetes.io/projected/d41ee317-2122-4ae3-b680-6b44e17f25a9-kube-api-access-rkd72\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.463378 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.463146 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dd9664b3-5cd3-4336-9a83-c1641b6801ae-serviceca\") pod \"node-ca-72hfq\" (UID: \"dd9664b3-5cd3-4336-9a83-c1641b6801ae\") " pod="openshift-image-registry/node-ca-72hfq" Sep 18 12:01:19.463378 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.463175 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-host-kubelet\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.463378 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.463193 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn6qm\" (UniqueName: \"kubernetes.io/projected/e518b32c-52bd-4209-a275-735bb0a88e9f-kube-api-access-hn6qm\") pod \"node-resolver-rvwkx\" (UID: \"e518b32c-52bd-4209-a275-735bb0a88e9f\") " pod="openshift-dns/node-resolver-rvwkx" Sep 18 12:01:19.463378 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.463208 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-etc-kubernetes\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.463378 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.463224 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d-agent-certs\") pod \"konnectivity-agent-hj8kz\" (UID: \"a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d\") " pod="kube-system/konnectivity-agent-hj8kz" Sep 18 12:01:19.463378 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.463311 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-run-ovn\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.463378 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.463327 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-host-cni-netd\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.463378 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.463342 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d43cab31-d29e-4d09-9b84-b59eff1e2163-tmp\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.463378 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.463356 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb3f8f64-6a47-42b0-a259-fd44f14570be-host-slash\") pod \"iptables-alerter-xzqgp\" (UID: \"fb3f8f64-6a47-42b0-a259-fd44f14570be\") " pod="openshift-network-operator/iptables-alerter-xzqgp" Sep 18 12:01:19.463378 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.463362 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 18 12:01:19.464166 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.463386 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e518e71-5f13-44e7-aeb5-4e7c1e6d4778-original-pull-secret\") pod \"global-pull-secret-syncer-tpftw\" (UID: \"7e518e71-5f13-44e7-aeb5-4e7c1e6d4778\") " pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:19.464166 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.463378 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d41ee317-2122-4ae3-b680-6b44e17f25a9-cni-binary-copy\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.464166 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.463420 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e9f66a61-1fad-45c2-99e5-c634c8727fbe-socket-dir\") pod \"aws-ebs-csi-driver-node-wk99x\" (UID: \"e9f66a61-1fad-45c2-99e5-c634c8727fbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk99x" Sep 18 12:01:19.464166 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.463465 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-var-lib-openvswitch\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.464166 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.463489 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9bb652de-6064-47b2-8a77-4ab4e7a7bc69-cni-binary-copy\") pod \"multus-additional-cni-plugins-5n699\" (UID: \"9bb652de-6064-47b2-8a77-4ab4e7a7bc69\") " pod="openshift-multus/multus-additional-cni-plugins-5n699" Sep 18 12:01:19.464166 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.463533 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c79gn\" (UniqueName: \"kubernetes.io/projected/9bb652de-6064-47b2-8a77-4ab4e7a7bc69-kube-api-access-c79gn\") pod \"multus-additional-cni-plugins-5n699\" (UID: \"9bb652de-6064-47b2-8a77-4ab4e7a7bc69\") " pod="openshift-multus/multus-additional-cni-plugins-5n699" Sep 18 12:01:19.464166 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.463549 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e9f66a61-1fad-45c2-99e5-c634c8727fbe-socket-dir\") pod \"aws-ebs-csi-driver-node-wk99x\" (UID: \"e9f66a61-1fad-45c2-99e5-c634c8727fbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk99x" Sep 18 12:01:19.464166 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.463554 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d41ee317-2122-4ae3-b680-6b44e17f25a9-multus-daemon-config\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.464166 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.463591 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd9664b3-5cd3-4336-9a83-c1641b6801ae-host\") pod \"node-ca-72hfq\" (UID: \"dd9664b3-5cd3-4336-9a83-c1641b6801ae\") " pod="openshift-image-registry/node-ca-72hfq" Sep 18 12:01:19.464166 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.463619 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-host-run-netns\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.464166 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.463642 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-host-var-lib-kubelet\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.464166 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.463668 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e9f66a61-1fad-45c2-99e5-c634c8727fbe-etc-selinux\") pod \"aws-ebs-csi-driver-node-wk99x\" (UID: \"e9f66a61-1fad-45c2-99e5-c634c8727fbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk99x" Sep 18 12:01:19.464166 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.463714 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-run-openvswitch\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.464166 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.463734 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-ovnkube-script-lib\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.464166 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.463763 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9bb652de-6064-47b2-8a77-4ab4e7a7bc69-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5n699\" (UID: \"9bb652de-6064-47b2-8a77-4ab4e7a7bc69\") " pod="openshift-multus/multus-additional-cni-plugins-5n699" Sep 18 12:01:19.464166 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.463799 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d-konnectivity-ca\") pod \"konnectivity-agent-hj8kz\" (UID: \"a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d\") " pod="kube-system/konnectivity-agent-hj8kz" Sep 18 12:01:19.464166 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.464019 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-system-cni-dir\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.465025 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.464085 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-env-overrides\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.465025 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.464128 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-host-var-lib-cni-multus\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.465025 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.464175 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-hostroot\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.465025 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.464211 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-host-cni-bin\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.465025 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.464314 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-etc-systemd\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.465025 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.464340 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-run\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.465025 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.464375 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-host-run-netns\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.465025 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.464392 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-multus-socket-dir-parent\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.465025 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.464433 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-host\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.465025 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.464465 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d43cab31-d29e-4d09-9b84-b59eff1e2163-etc-tuned\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.465025 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.464491 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9bb652de-6064-47b2-8a77-4ab4e7a7bc69-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5n699\" (UID: \"9bb652de-6064-47b2-8a77-4ab4e7a7bc69\") " pod="openshift-multus/multus-additional-cni-plugins-5n699" Sep 18 12:01:19.465025 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.464558 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e518b32c-52bd-4209-a275-735bb0a88e9f-hosts-file\") pod \"node-resolver-rvwkx\" (UID: \"e518b32c-52bd-4209-a275-735bb0a88e9f\") " pod="openshift-dns/node-resolver-rvwkx" Sep 18 12:01:19.465025 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.464619 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-run-ovn\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.465025 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.464623 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e518b32c-52bd-4209-a275-735bb0a88e9f-hosts-file\") pod \"node-resolver-rvwkx\" (UID: \"e518b32c-52bd-4209-a275-735bb0a88e9f\") " pod="openshift-dns/node-resolver-rvwkx" Sep 18 12:01:19.465025 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.464689 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-host-cni-netd\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.465025 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:19.464711 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 12:01:19.465025 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:19.464785 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e518e71-5f13-44e7-aeb5-4e7c1e6d4778-original-pull-secret podName:7e518e71-5f13-44e7-aeb5-4e7c1e6d4778 nodeName:}" failed. No retries permitted until 2026-09-18 12:01:19.964761426 +0000 UTC m=+2.969449135 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e518e71-5f13-44e7-aeb5-4e7c1e6d4778-original-pull-secret") pod "global-pull-secret-syncer-tpftw" (UID: "7e518e71-5f13-44e7-aeb5-4e7c1e6d4778") : object "kube-system"/"original-pull-secret" not registered Sep 18 12:01:19.465938 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.464838 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-etc-kubernetes\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.465938 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465020 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-host-kubelet\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.465938 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465082 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-host-var-lib-cni-bin\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.465938 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465115 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd9664b3-5cd3-4336-9a83-c1641b6801ae-host\") pod \"node-ca-72hfq\" (UID: \"dd9664b3-5cd3-4336-9a83-c1641b6801ae\") " pod="openshift-image-registry/node-ca-72hfq" Sep 18 12:01:19.465938 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465181 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dd9664b3-5cd3-4336-9a83-c1641b6801ae-serviceca\") pod \"node-ca-72hfq\" (UID: \"dd9664b3-5cd3-4336-9a83-c1641b6801ae\") " pod="openshift-image-registry/node-ca-72hfq" Sep 18 12:01:19.465938 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465190 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-host-run-netns\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.465938 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465233 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e9f66a61-1fad-45c2-99e5-c634c8727fbe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wk99x\" (UID: \"e9f66a61-1fad-45c2-99e5-c634c8727fbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk99x" Sep 18 12:01:19.465938 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465256 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-host-var-lib-kubelet\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.465938 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465266 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e9f66a61-1fad-45c2-99e5-c634c8727fbe-registration-dir\") pod \"aws-ebs-csi-driver-node-wk99x\" (UID: \"e9f66a61-1fad-45c2-99e5-c634c8727fbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk99x" Sep 18 12:01:19.465938 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465292 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.465938 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465326 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-etc-modprobe-d\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.465938 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465357 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-etc-sysconfig\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.465938 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465361 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e9f66a61-1fad-45c2-99e5-c634c8727fbe-etc-selinux\") pod \"aws-ebs-csi-driver-node-wk99x\" (UID: \"e9f66a61-1fad-45c2-99e5-c634c8727fbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk99x" Sep 18 12:01:19.465938 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465383 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-etc-sysctl-d\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.465938 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465438 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e9f66a61-1fad-45c2-99e5-c634c8727fbe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wk99x\" (UID: \"e9f66a61-1fad-45c2-99e5-c634c8727fbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk99x" Sep 18 12:01:19.465938 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465490 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7e518e71-5f13-44e7-aeb5-4e7c1e6d4778-kubelet-config\") pod \"global-pull-secret-syncer-tpftw\" (UID: \"7e518e71-5f13-44e7-aeb5-4e7c1e6d4778\") " pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:19.465938 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465496 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e9f66a61-1fad-45c2-99e5-c634c8727fbe-registration-dir\") pod \"aws-ebs-csi-driver-node-wk99x\" (UID: \"e9f66a61-1fad-45c2-99e5-c634c8727fbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk99x" Sep 18 12:01:19.466622 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465564 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.466622 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465611 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-var-lib-openvswitch\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.466622 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465606 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-ovnkube-config\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.466622 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465613 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmswv\" (UniqueName: \"kubernetes.io/projected/d43cab31-d29e-4d09-9b84-b59eff1e2163-kube-api-access-xmswv\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.466622 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465667 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgcpt\" (UniqueName: \"kubernetes.io/projected/e9f66a61-1fad-45c2-99e5-c634c8727fbe-kube-api-access-fgcpt\") pod \"aws-ebs-csi-driver-node-wk99x\" (UID: \"e9f66a61-1fad-45c2-99e5-c634c8727fbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk99x" Sep 18 12:01:19.466622 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465691 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-host-cni-bin\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.466622 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465696 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-host-slash\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.466622 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465727 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9bb652de-6064-47b2-8a77-4ab4e7a7bc69-cnibin\") pod \"multus-additional-cni-plugins-5n699\" (UID: \"9bb652de-6064-47b2-8a77-4ab4e7a7bc69\") " pod="openshift-multus/multus-additional-cni-plugins-5n699" Sep 18 12:01:19.466622 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465753 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7e518e71-5f13-44e7-aeb5-4e7c1e6d4778-dbus\") pod \"global-pull-secret-syncer-tpftw\" (UID: \"7e518e71-5f13-44e7-aeb5-4e7c1e6d4778\") " pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:19.466622 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465779 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e518b32c-52bd-4209-a275-735bb0a88e9f-tmp-dir\") pod \"node-resolver-rvwkx\" (UID: \"e518b32c-52bd-4209-a275-735bb0a88e9f\") " pod="openshift-dns/node-resolver-rvwkx" Sep 18 12:01:19.466622 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465807 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-multus-cni-dir\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.466622 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465851 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4csw\" (UniqueName: \"kubernetes.io/projected/dd9664b3-5cd3-4336-9a83-c1641b6801ae-kube-api-access-b4csw\") pod \"node-ca-72hfq\" (UID: \"dd9664b3-5cd3-4336-9a83-c1641b6801ae\") " pod="openshift-image-registry/node-ca-72hfq" Sep 18 12:01:19.466622 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465879 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e9f66a61-1fad-45c2-99e5-c634c8727fbe-sys-fs\") pod \"aws-ebs-csi-driver-node-wk99x\" (UID: \"e9f66a61-1fad-45c2-99e5-c634c8727fbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk99x" Sep 18 12:01:19.466622 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465905 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-log-socket\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.466622 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465937 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9bb652de-6064-47b2-8a77-4ab4e7a7bc69-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5n699\" (UID: \"9bb652de-6064-47b2-8a77-4ab4e7a7bc69\") " pod="openshift-multus/multus-additional-cni-plugins-5n699" Sep 18 12:01:19.466622 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465964 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-host-run-multus-certs\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.466622 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.465996 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-metrics-certs\") pod \"network-metrics-daemon-lvx4s\" (UID: \"a7f89718-22f1-4c13-aff1-d2fa5ff92c55\") " pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:01:19.467541 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.466020 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-run-systemd\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.467541 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.466021 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-env-overrides\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.467541 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.466048 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-node-log\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.467541 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.466062 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-ovnkube-script-lib\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.467541 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.466076 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-host-run-ovn-kubernetes\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.467541 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.466125 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-host-run-ovn-kubernetes\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.467541 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.466160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shwjw\" (UniqueName: \"kubernetes.io/projected/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-kube-api-access-shwjw\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.467541 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.466168 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d41ee317-2122-4ae3-b680-6b44e17f25a9-multus-daemon-config\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.467541 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.466192 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-host-var-lib-cni-multus\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.467541 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.466202 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-var-lib-kubelet\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.467541 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.466207 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d-konnectivity-ca\") pod \"konnectivity-agent-hj8kz\" (UID: \"a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d\") " pod="kube-system/konnectivity-agent-hj8kz" Sep 18 12:01:19.467541 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.466270 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bb652de-6064-47b2-8a77-4ab4e7a7bc69-system-cni-dir\") pod \"multus-additional-cni-plugins-5n699\" (UID: \"9bb652de-6064-47b2-8a77-4ab4e7a7bc69\") " pod="openshift-multus/multus-additional-cni-plugins-5n699" Sep 18 12:01:19.467541 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.466296 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-hostroot\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.467541 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.466306 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-multus-conf-dir\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.467541 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:19.466333 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 12:01:19.467541 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.466340 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-cnibin\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.467541 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.466368 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-run-systemd\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.467541 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.466374 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-run-openvswitch\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.468415 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:19.466392 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-metrics-certs podName:a7f89718-22f1-4c13-aff1-d2fa5ff92c55 nodeName:}" failed. No retries permitted until 2026-09-18 12:01:19.966375381 +0000 UTC m=+2.971063107 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-metrics-certs") pod "network-metrics-daemon-lvx4s" (UID: "a7f89718-22f1-4c13-aff1-d2fa5ff92c55") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 12:01:19.468415 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.466470 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e518b32c-52bd-4209-a275-735bb0a88e9f-tmp-dir\") pod \"node-resolver-rvwkx\" (UID: \"e518b32c-52bd-4209-a275-735bb0a88e9f\") " pod="openshift-dns/node-resolver-rvwkx" Sep 18 12:01:19.468415 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.466489 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-cnibin\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.468415 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.466545 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-host-slash\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.468415 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.466555 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-host-run-multus-certs\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.468415 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.466583 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-multus-conf-dir\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.468415 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.466618 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7e518e71-5f13-44e7-aeb5-4e7c1e6d4778-dbus\") pod \"global-pull-secret-syncer-tpftw\" (UID: \"7e518e71-5f13-44e7-aeb5-4e7c1e6d4778\") " pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:19.468415 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.466637 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e9f66a61-1fad-45c2-99e5-c634c8727fbe-sys-fs\") pod \"aws-ebs-csi-driver-node-wk99x\" (UID: \"e9f66a61-1fad-45c2-99e5-c634c8727fbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk99x" Sep 18 12:01:19.468415 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.466683 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-log-socket\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.468415 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.466753 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d41ee317-2122-4ae3-b680-6b44e17f25a9-multus-cni-dir\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.468415 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.466756 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-host-run-netns\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.468415 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.466788 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-node-log\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.469056 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.468753 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal" event={"ID":"a43f10e83b212fc99ba5e51c2dca4098","Type":"ContainerStarted","Data":"868df3df345a4123732ad4d99cdfd86f8562a92535633b149fabbc8dd88b3aed"} Sep 18 12:01:19.470112 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.470088 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-ovn-node-metrics-cert\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.470726 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.470696 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-137.ec2.internal" event={"ID":"1159b62a0722daa58656ffb4cf50e6f2","Type":"ContainerStarted","Data":"5e6becdce1d90611175299b4a9e31262da5c3356e486a6605fbe3410f7adbfbf"} Sep 18 12:01:19.471240 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.471219 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d-agent-certs\") pod \"konnectivity-agent-hj8kz\" (UID: \"a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d\") " pod="kube-system/konnectivity-agent-hj8kz" Sep 18 12:01:19.485443 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.485419 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65mc2\" (UniqueName: \"kubernetes.io/projected/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-kube-api-access-65mc2\") pod \"network-metrics-daemon-lvx4s\" (UID: \"a7f89718-22f1-4c13-aff1-d2fa5ff92c55\") " pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:01:19.499310 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.499242 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4csw\" (UniqueName: \"kubernetes.io/projected/dd9664b3-5cd3-4336-9a83-c1641b6801ae-kube-api-access-b4csw\") pod \"node-ca-72hfq\" (UID: \"dd9664b3-5cd3-4336-9a83-c1641b6801ae\") " pod="openshift-image-registry/node-ca-72hfq" Sep 18 12:01:19.499870 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.499836 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shwjw\" (UniqueName: \"kubernetes.io/projected/e4e24df3-32d9-47d5-bab8-3b6c6ab5451e-kube-api-access-shwjw\") pod \"ovnkube-node-5l7rg\" (UID: \"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e\") " pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.500510 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.500487 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn6qm\" (UniqueName: \"kubernetes.io/projected/e518b32c-52bd-4209-a275-735bb0a88e9f-kube-api-access-hn6qm\") pod \"node-resolver-rvwkx\" (UID: \"e518b32c-52bd-4209-a275-735bb0a88e9f\") " pod="openshift-dns/node-resolver-rvwkx" Sep 18 12:01:19.501715 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.501691 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkd72\" (UniqueName: \"kubernetes.io/projected/d41ee317-2122-4ae3-b680-6b44e17f25a9-kube-api-access-rkd72\") pod \"multus-z7phr\" (UID: \"d41ee317-2122-4ae3-b680-6b44e17f25a9\") " pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.501818 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.501694 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgcpt\" (UniqueName: \"kubernetes.io/projected/e9f66a61-1fad-45c2-99e5-c634c8727fbe-kube-api-access-fgcpt\") pod \"aws-ebs-csi-driver-node-wk99x\" (UID: \"e9f66a61-1fad-45c2-99e5-c634c8727fbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk99x" Sep 18 12:01:19.566868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.566822 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9bb652de-6064-47b2-8a77-4ab4e7a7bc69-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5n699\" (UID: \"9bb652de-6064-47b2-8a77-4ab4e7a7bc69\") " pod="openshift-multus/multus-additional-cni-plugins-5n699" Sep 18 12:01:19.566868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.566869 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-etc-modprobe-d\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.567107 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.566893 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-etc-sysconfig\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.567107 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.566916 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-etc-sysctl-d\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.567107 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.566939 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmswv\" (UniqueName: \"kubernetes.io/projected/d43cab31-d29e-4d09-9b84-b59eff1e2163-kube-api-access-xmswv\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.567107 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.566966 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9bb652de-6064-47b2-8a77-4ab4e7a7bc69-cnibin\") pod \"multus-additional-cni-plugins-5n699\" (UID: \"9bb652de-6064-47b2-8a77-4ab4e7a7bc69\") " pod="openshift-multus/multus-additional-cni-plugins-5n699" Sep 18 12:01:19.567107 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.567028 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9bb652de-6064-47b2-8a77-4ab4e7a7bc69-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5n699\" (UID: \"9bb652de-6064-47b2-8a77-4ab4e7a7bc69\") " pod="openshift-multus/multus-additional-cni-plugins-5n699" Sep 18 12:01:19.567107 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.567028 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-etc-modprobe-d\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.567107 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.567096 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-etc-sysconfig\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.567501 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.567127 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9bb652de-6064-47b2-8a77-4ab4e7a7bc69-cnibin\") pod \"multus-additional-cni-plugins-5n699\" (UID: \"9bb652de-6064-47b2-8a77-4ab4e7a7bc69\") " pod="openshift-multus/multus-additional-cni-plugins-5n699" Sep 18 12:01:19.567501 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.567182 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-etc-sysctl-d\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.567501 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.567374 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-var-lib-kubelet\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.567501 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.567425 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-var-lib-kubelet\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.567501 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.567453 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bb652de-6064-47b2-8a77-4ab4e7a7bc69-system-cni-dir\") pod \"multus-additional-cni-plugins-5n699\" (UID: \"9bb652de-6064-47b2-8a77-4ab4e7a7bc69\") " pod="openshift-multus/multus-additional-cni-plugins-5n699" Sep 18 12:01:19.567501 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.567485 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bb652de-6064-47b2-8a77-4ab4e7a7bc69-system-cni-dir\") pod \"multus-additional-cni-plugins-5n699\" (UID: \"9bb652de-6064-47b2-8a77-4ab4e7a7bc69\") " pod="openshift-multus/multus-additional-cni-plugins-5n699" Sep 18 12:01:19.567819 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.567496 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9bb652de-6064-47b2-8a77-4ab4e7a7bc69-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5n699\" (UID: \"9bb652de-6064-47b2-8a77-4ab4e7a7bc69\") " pod="openshift-multus/multus-additional-cni-plugins-5n699" Sep 18 12:01:19.567819 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.567543 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-lib-modules\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.567819 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.567567 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-etc-sysctl-conf\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.567819 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.567592 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x82bn\" (UniqueName: \"kubernetes.io/projected/91599aa3-f0bc-4a4a-afa3-362851ac1783-kube-api-access-x82bn\") pod \"network-check-target-sbkdt\" (UID: \"91599aa3-f0bc-4a4a-afa3-362851ac1783\") " pod="openshift-network-diagnostics/network-check-target-sbkdt" Sep 18 12:01:19.567819 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.567615 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fb3f8f64-6a47-42b0-a259-fd44f14570be-iptables-alerter-script\") pod \"iptables-alerter-xzqgp\" (UID: \"fb3f8f64-6a47-42b0-a259-fd44f14570be\") " pod="openshift-network-operator/iptables-alerter-xzqgp" Sep 18 12:01:19.567819 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.567642 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-etc-kubernetes\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.567819 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.567656 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-sys\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.567819 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.567681 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chh52\" (UniqueName: \"kubernetes.io/projected/fb3f8f64-6a47-42b0-a259-fd44f14570be-kube-api-access-chh52\") pod \"iptables-alerter-xzqgp\" (UID: \"fb3f8f64-6a47-42b0-a259-fd44f14570be\") " pod="openshift-network-operator/iptables-alerter-xzqgp" Sep 18 12:01:19.567819 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.567702 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d43cab31-d29e-4d09-9b84-b59eff1e2163-tmp\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.567819 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.567716 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb3f8f64-6a47-42b0-a259-fd44f14570be-host-slash\") pod \"iptables-alerter-xzqgp\" (UID: \"fb3f8f64-6a47-42b0-a259-fd44f14570be\") " pod="openshift-network-operator/iptables-alerter-xzqgp" Sep 18 12:01:19.567819 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.567743 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-etc-sysctl-conf\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.568370 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.567836 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-lib-modules\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.568370 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.567748 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9bb652de-6064-47b2-8a77-4ab4e7a7bc69-cni-binary-copy\") pod \"multus-additional-cni-plugins-5n699\" (UID: \"9bb652de-6064-47b2-8a77-4ab4e7a7bc69\") " pod="openshift-multus/multus-additional-cni-plugins-5n699" Sep 18 12:01:19.568370 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.567884 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c79gn\" (UniqueName: \"kubernetes.io/projected/9bb652de-6064-47b2-8a77-4ab4e7a7bc69-kube-api-access-c79gn\") pod \"multus-additional-cni-plugins-5n699\" (UID: \"9bb652de-6064-47b2-8a77-4ab4e7a7bc69\") " pod="openshift-multus/multus-additional-cni-plugins-5n699" Sep 18 12:01:19.568370 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.567917 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9bb652de-6064-47b2-8a77-4ab4e7a7bc69-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5n699\" (UID: \"9bb652de-6064-47b2-8a77-4ab4e7a7bc69\") " pod="openshift-multus/multus-additional-cni-plugins-5n699" Sep 18 12:01:19.568370 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.567948 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-etc-systemd\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.568370 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.567975 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-run\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.568370 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.568001 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-host\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.568370 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.568023 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d43cab31-d29e-4d09-9b84-b59eff1e2163-etc-tuned\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.568370 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.568215 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9bb652de-6064-47b2-8a77-4ab4e7a7bc69-cni-binary-copy\") pod \"multus-additional-cni-plugins-5n699\" (UID: \"9bb652de-6064-47b2-8a77-4ab4e7a7bc69\") " pod="openshift-multus/multus-additional-cni-plugins-5n699" Sep 18 12:01:19.568370 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.567743 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9bb652de-6064-47b2-8a77-4ab4e7a7bc69-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5n699\" (UID: \"9bb652de-6064-47b2-8a77-4ab4e7a7bc69\") " pod="openshift-multus/multus-additional-cni-plugins-5n699" Sep 18 12:01:19.568897 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.568376 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fb3f8f64-6a47-42b0-a259-fd44f14570be-iptables-alerter-script\") pod \"iptables-alerter-xzqgp\" (UID: \"fb3f8f64-6a47-42b0-a259-fd44f14570be\") " pod="openshift-network-operator/iptables-alerter-xzqgp" Sep 18 12:01:19.568897 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.568380 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-etc-kubernetes\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.568897 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.568419 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-sys\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.568897 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.568504 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-etc-systemd\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.568897 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.568667 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb3f8f64-6a47-42b0-a259-fd44f14570be-host-slash\") pod \"iptables-alerter-xzqgp\" (UID: \"fb3f8f64-6a47-42b0-a259-fd44f14570be\") " pod="openshift-network-operator/iptables-alerter-xzqgp" Sep 18 12:01:19.568897 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.568668 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9bb652de-6064-47b2-8a77-4ab4e7a7bc69-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5n699\" (UID: \"9bb652de-6064-47b2-8a77-4ab4e7a7bc69\") " pod="openshift-multus/multus-additional-cni-plugins-5n699" Sep 18 12:01:19.568897 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.568730 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-host\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.569260 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.568865 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d43cab31-d29e-4d09-9b84-b59eff1e2163-run\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.571043 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.571015 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d43cab31-d29e-4d09-9b84-b59eff1e2163-etc-tuned\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.571210 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.571188 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d43cab31-d29e-4d09-9b84-b59eff1e2163-tmp\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.578504 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.578441 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmswv\" (UniqueName: \"kubernetes.io/projected/d43cab31-d29e-4d09-9b84-b59eff1e2163-kube-api-access-xmswv\") pod \"tuned-4ldj5\" (UID: \"d43cab31-d29e-4d09-9b84-b59eff1e2163\") " pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.580225 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:19.580204 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 12:01:19.580332 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:19.580234 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 12:01:19.580332 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:19.580248 2578 projected.go:196] Error preparing data for projected volume kube-api-access-x82bn for pod openshift-network-diagnostics/network-check-target-sbkdt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 12:01:19.580332 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:19.580320 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91599aa3-f0bc-4a4a-afa3-362851ac1783-kube-api-access-x82bn podName:91599aa3-f0bc-4a4a-afa3-362851ac1783 nodeName:}" failed. No retries permitted until 2026-09-18 12:01:20.080300994 +0000 UTC m=+3.084988715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-x82bn" (UniqueName: "kubernetes.io/projected/91599aa3-f0bc-4a4a-afa3-362851ac1783-kube-api-access-x82bn") pod "network-check-target-sbkdt" (UID: "91599aa3-f0bc-4a4a-afa3-362851ac1783") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 12:01:19.586514 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.586483 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chh52\" (UniqueName: \"kubernetes.io/projected/fb3f8f64-6a47-42b0-a259-fd44f14570be-kube-api-access-chh52\") pod \"iptables-alerter-xzqgp\" (UID: \"fb3f8f64-6a47-42b0-a259-fd44f14570be\") " pod="openshift-network-operator/iptables-alerter-xzqgp" Sep 18 12:01:19.590304 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.590281 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c79gn\" (UniqueName: \"kubernetes.io/projected/9bb652de-6064-47b2-8a77-4ab4e7a7bc69-kube-api-access-c79gn\") pod \"multus-additional-cni-plugins-5n699\" (UID: \"9bb652de-6064-47b2-8a77-4ab4e7a7bc69\") " pod="openshift-multus/multus-additional-cni-plugins-5n699" Sep 18 12:01:19.653851 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.653815 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk99x" Sep 18 12:01:19.664640 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.664615 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rvwkx" Sep 18 12:01:19.674418 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.674390 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z7phr" Sep 18 12:01:19.681333 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.681313 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:19.689154 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.689133 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hj8kz" Sep 18 12:01:19.707245 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.707220 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-72hfq" Sep 18 12:01:19.714150 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.714128 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" Sep 18 12:01:19.722892 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.722873 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5n699" Sep 18 12:01:19.729813 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.729792 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xzqgp" Sep 18 12:01:19.731465 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.731431 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 12:01:19.970824 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.970783 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-metrics-certs\") pod \"network-metrics-daemon-lvx4s\" (UID: \"a7f89718-22f1-4c13-aff1-d2fa5ff92c55\") " pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:01:19.971007 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:19.970862 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e518e71-5f13-44e7-aeb5-4e7c1e6d4778-original-pull-secret\") pod \"global-pull-secret-syncer-tpftw\" (UID: \"7e518e71-5f13-44e7-aeb5-4e7c1e6d4778\") " pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:19.971007 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:19.970989 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 12:01:19.971113 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:19.971020 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 12:01:19.971113 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:19.971077 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-metrics-certs podName:a7f89718-22f1-4c13-aff1-d2fa5ff92c55 nodeName:}" failed. No retries permitted until 2026-09-18 12:01:20.971054153 +0000 UTC m=+3.975741878 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-metrics-certs") pod "network-metrics-daemon-lvx4s" (UID: "a7f89718-22f1-4c13-aff1-d2fa5ff92c55") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 12:01:19.971113 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:19.971094 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e518e71-5f13-44e7-aeb5-4e7c1e6d4778-original-pull-secret podName:7e518e71-5f13-44e7-aeb5-4e7c1e6d4778 nodeName:}" failed. No retries permitted until 2026-09-18 12:01:20.971086853 +0000 UTC m=+3.975774556 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e518e71-5f13-44e7-aeb5-4e7c1e6d4778-original-pull-secret") pod "global-pull-secret-syncer-tpftw" (UID: "7e518e71-5f13-44e7-aeb5-4e7c1e6d4778") : object "kube-system"/"original-pull-secret" not registered Sep 18 12:01:20.172477 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:20.172432 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x82bn\" (UniqueName: \"kubernetes.io/projected/91599aa3-f0bc-4a4a-afa3-362851ac1783-kube-api-access-x82bn\") pod \"network-check-target-sbkdt\" (UID: \"91599aa3-f0bc-4a4a-afa3-362851ac1783\") " pod="openshift-network-diagnostics/network-check-target-sbkdt" Sep 18 12:01:20.172673 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:20.172617 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 12:01:20.172673 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:20.172644 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 12:01:20.172673 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:20.172658 2578 projected.go:196] Error preparing data for projected volume kube-api-access-x82bn for pod openshift-network-diagnostics/network-check-target-sbkdt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 12:01:20.172796 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:20.172716 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91599aa3-f0bc-4a4a-afa3-362851ac1783-kube-api-access-x82bn podName:91599aa3-f0bc-4a4a-afa3-362851ac1783 nodeName:}" failed. No retries permitted until 2026-09-18 12:01:21.172700425 +0000 UTC m=+4.177388127 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-x82bn" (UniqueName: "kubernetes.io/projected/91599aa3-f0bc-4a4a-afa3-362851ac1783-kube-api-access-x82bn") pod "network-check-target-sbkdt" (UID: "91599aa3-f0bc-4a4a-afa3-362851ac1783") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 12:01:20.432593 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:20.432530 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 11:56:20 +0000 UTC" deadline="2028-06-08 08:27:50.376364192 +0000 UTC" Sep 18 12:01:20.432593 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:20.432597 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15092h26m29.94377884s" Sep 18 12:01:20.706813 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:20.706782 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd41ee317_2122_4ae3_b680_6b44e17f25a9.slice/crio-3ac392f18596ee14e7d12fb0c3b6b2554fc68a4bb03f67e4db4d68468328e1b4 WatchSource:0}: Error finding container 3ac392f18596ee14e7d12fb0c3b6b2554fc68a4bb03f67e4db4d68468328e1b4: Status 404 returned error can't find the container with id 3ac392f18596ee14e7d12fb0c3b6b2554fc68a4bb03f67e4db4d68468328e1b4 Sep 18 12:01:20.707603 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:20.707551 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bb652de_6064_47b2_8a77_4ab4e7a7bc69.slice/crio-7d75f29cfc0e6303890092185fe9c18c6fb386a5d6925f8370aac3b662b0acab WatchSource:0}: Error finding container 7d75f29cfc0e6303890092185fe9c18c6fb386a5d6925f8370aac3b662b0acab: Status 404 returned error can't find the container with id 7d75f29cfc0e6303890092185fe9c18c6fb386a5d6925f8370aac3b662b0acab Sep 18 12:01:20.708719 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:20.708697 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3ece8ac_c845_4c4a_bc4a_3cb23127eb7d.slice/crio-72a0cf093671bf6eddc4510f044b98b77a9c99d2243e819e3bfa3602ae94deab WatchSource:0}: Error finding container 72a0cf093671bf6eddc4510f044b98b77a9c99d2243e819e3bfa3602ae94deab: Status 404 returned error can't find the container with id 72a0cf093671bf6eddc4510f044b98b77a9c99d2243e819e3bfa3602ae94deab Sep 18 12:01:20.709808 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:20.709744 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd9664b3_5cd3_4336_9a83_c1641b6801ae.slice/crio-1800eca85a2afd397a8af51d1996b66f3ccc7cdf697c1233c04d9f5cf6ab7244 WatchSource:0}: Error finding container 1800eca85a2afd397a8af51d1996b66f3ccc7cdf697c1233c04d9f5cf6ab7244: Status 404 returned error can't find the container with id 1800eca85a2afd397a8af51d1996b66f3ccc7cdf697c1233c04d9f5cf6ab7244 Sep 18 12:01:20.711265 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:20.711238 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4e24df3_32d9_47d5_bab8_3b6c6ab5451e.slice/crio-e02106d940976d7d13a9ffc1042bbcd10f75e9f7c3139c445e517c606110b1c9 WatchSource:0}: Error finding container e02106d940976d7d13a9ffc1042bbcd10f75e9f7c3139c445e517c606110b1c9: Status 404 returned error can't find the container with id e02106d940976d7d13a9ffc1042bbcd10f75e9f7c3139c445e517c606110b1c9 Sep 18 12:01:20.715698 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:20.715672 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd43cab31_d29e_4d09_9b84_b59eff1e2163.slice/crio-35332010ef76ac73f469f4b05a5308010e3128ad754138bdb9da03257360f96c WatchSource:0}: Error finding container 35332010ef76ac73f469f4b05a5308010e3128ad754138bdb9da03257360f96c: Status 404 returned error can't find the container with id 35332010ef76ac73f469f4b05a5308010e3128ad754138bdb9da03257360f96c Sep 18 12:01:20.717128 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:20.717108 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb3f8f64_6a47_42b0_a259_fd44f14570be.slice/crio-a50c60bb3f679265357d8818e71fbdcb6dd91b145ff143c0bca57e8530cf7c42 WatchSource:0}: Error finding container a50c60bb3f679265357d8818e71fbdcb6dd91b145ff143c0bca57e8530cf7c42: Status 404 returned error can't find the container with id a50c60bb3f679265357d8818e71fbdcb6dd91b145ff143c0bca57e8530cf7c42 Sep 18 12:01:20.720309 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:20.720283 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9f66a61_1fad_45c2_99e5_c634c8727fbe.slice/crio-d3a4e340ce8e974bcf7f3458df0783f3ecaf9691aecb20b9f72273a2cb8411c7 WatchSource:0}: Error finding container d3a4e340ce8e974bcf7f3458df0783f3ecaf9691aecb20b9f72273a2cb8411c7: Status 404 returned error can't find the container with id d3a4e340ce8e974bcf7f3458df0783f3ecaf9691aecb20b9f72273a2cb8411c7 Sep 18 12:01:20.721550 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:20.721460 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode518b32c_52bd_4209_a275_735bb0a88e9f.slice/crio-318637c321491deed184a979440240a5a13e65c688ce403dff8838273be18bda WatchSource:0}: Error finding container 318637c321491deed184a979440240a5a13e65c688ce403dff8838273be18bda: Status 404 returned error can't find the container with id 318637c321491deed184a979440240a5a13e65c688ce403dff8838273be18bda Sep 18 12:01:20.980724 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:20.980696 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e518e71-5f13-44e7-aeb5-4e7c1e6d4778-original-pull-secret\") pod \"global-pull-secret-syncer-tpftw\" (UID: \"7e518e71-5f13-44e7-aeb5-4e7c1e6d4778\") " pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:20.980829 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:20.980745 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-metrics-certs\") pod \"network-metrics-daemon-lvx4s\" (UID: \"a7f89718-22f1-4c13-aff1-d2fa5ff92c55\") " pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:01:20.980872 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:20.980849 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 12:01:20.980872 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:20.980849 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 12:01:20.980939 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:20.980901 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-metrics-certs podName:a7f89718-22f1-4c13-aff1-d2fa5ff92c55 nodeName:}" failed. No retries permitted until 2026-09-18 12:01:22.980885839 +0000 UTC m=+5.985573544 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-metrics-certs") pod "network-metrics-daemon-lvx4s" (UID: "a7f89718-22f1-4c13-aff1-d2fa5ff92c55") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 12:01:20.980939 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:20.980916 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e518e71-5f13-44e7-aeb5-4e7c1e6d4778-original-pull-secret podName:7e518e71-5f13-44e7-aeb5-4e7c1e6d4778 nodeName:}" failed. No retries permitted until 2026-09-18 12:01:22.980909178 +0000 UTC m=+5.985596881 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e518e71-5f13-44e7-aeb5-4e7c1e6d4778-original-pull-secret") pod "global-pull-secret-syncer-tpftw" (UID: "7e518e71-5f13-44e7-aeb5-4e7c1e6d4778") : object "kube-system"/"original-pull-secret" not registered Sep 18 12:01:21.183301 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:21.183265 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x82bn\" (UniqueName: \"kubernetes.io/projected/91599aa3-f0bc-4a4a-afa3-362851ac1783-kube-api-access-x82bn\") pod \"network-check-target-sbkdt\" (UID: \"91599aa3-f0bc-4a4a-afa3-362851ac1783\") " pod="openshift-network-diagnostics/network-check-target-sbkdt" Sep 18 12:01:21.183498 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:21.183479 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 12:01:21.183565 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:21.183503 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 12:01:21.183565 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:21.183514 2578 projected.go:196] Error preparing data for projected volume kube-api-access-x82bn for pod openshift-network-diagnostics/network-check-target-sbkdt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 12:01:21.183641 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:21.183576 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91599aa3-f0bc-4a4a-afa3-362851ac1783-kube-api-access-x82bn podName:91599aa3-f0bc-4a4a-afa3-362851ac1783 nodeName:}" failed. No retries permitted until 2026-09-18 12:01:23.183557079 +0000 UTC m=+6.188244803 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-x82bn" (UniqueName: "kubernetes.io/projected/91599aa3-f0bc-4a4a-afa3-362851ac1783-kube-api-access-x82bn") pod "network-check-target-sbkdt" (UID: "91599aa3-f0bc-4a4a-afa3-362851ac1783") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 12:01:21.433795 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:21.433690 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 11:56:20 +0000 UTC" deadline="2028-03-16 19:12:40.266909226 +0000 UTC" Sep 18 12:01:21.433795 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:21.433751 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13087h11m18.833162972s" Sep 18 12:01:21.462571 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:21.462507 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:01:21.462721 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:21.462674 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvx4s" podUID="a7f89718-22f1-4c13-aff1-d2fa5ff92c55" Sep 18 12:01:21.463107 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:21.463085 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:21.463210 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:21.463190 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpftw" podUID="7e518e71-5f13-44e7-aeb5-4e7c1e6d4778" Sep 18 12:01:21.463288 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:21.463258 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbkdt" Sep 18 12:01:21.463346 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:21.463329 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbkdt" podUID="91599aa3-f0bc-4a4a-afa3-362851ac1783" Sep 18 12:01:21.485714 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:21.485677 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-137.ec2.internal" event={"ID":"1159b62a0722daa58656ffb4cf50e6f2","Type":"ContainerStarted","Data":"ef932686a0b2a93dff9de275b4ef4beb7972cf9264b5da49134bf34e2faf4fff"} Sep 18 12:01:21.490602 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:21.490563 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rvwkx" event={"ID":"e518b32c-52bd-4209-a275-735bb0a88e9f","Type":"ContainerStarted","Data":"318637c321491deed184a979440240a5a13e65c688ce403dff8838273be18bda"} Sep 18 12:01:21.496262 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:21.496233 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" event={"ID":"d43cab31-d29e-4d09-9b84-b59eff1e2163","Type":"ContainerStarted","Data":"35332010ef76ac73f469f4b05a5308010e3128ad754138bdb9da03257360f96c"} Sep 18 12:01:21.499923 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:21.499897 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xzqgp" event={"ID":"fb3f8f64-6a47-42b0-a259-fd44f14570be","Type":"ContainerStarted","Data":"a50c60bb3f679265357d8818e71fbdcb6dd91b145ff143c0bca57e8530cf7c42"} Sep 18 12:01:21.505057 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:21.505028 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" event={"ID":"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e","Type":"ContainerStarted","Data":"e02106d940976d7d13a9ffc1042bbcd10f75e9f7c3139c445e517c606110b1c9"} Sep 18 12:01:21.509230 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:21.509203 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5n699" event={"ID":"9bb652de-6064-47b2-8a77-4ab4e7a7bc69","Type":"ContainerStarted","Data":"7d75f29cfc0e6303890092185fe9c18c6fb386a5d6925f8370aac3b662b0acab"} Sep 18 12:01:21.515751 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:21.515723 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hj8kz" event={"ID":"a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d","Type":"ContainerStarted","Data":"72a0cf093671bf6eddc4510f044b98b77a9c99d2243e819e3bfa3602ae94deab"} Sep 18 12:01:21.529577 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:21.525790 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z7phr" event={"ID":"d41ee317-2122-4ae3-b680-6b44e17f25a9","Type":"ContainerStarted","Data":"3ac392f18596ee14e7d12fb0c3b6b2554fc68a4bb03f67e4db4d68468328e1b4"} Sep 18 12:01:21.550496 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:21.550458 2578 generic.go:356] "Generic (PLEG): container finished" podID="a43f10e83b212fc99ba5e51c2dca4098" containerID="c7076a652aaf77b37d27e3d12c1ccc2790847308069dc45169d3f3628244f9d8" exitCode=0 Sep 18 12:01:21.550699 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:21.550618 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal" event={"ID":"a43f10e83b212fc99ba5e51c2dca4098","Type":"ContainerDied","Data":"c7076a652aaf77b37d27e3d12c1ccc2790847308069dc45169d3f3628244f9d8"} Sep 18 12:01:21.576064 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:21.575977 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk99x" event={"ID":"e9f66a61-1fad-45c2-99e5-c634c8727fbe","Type":"ContainerStarted","Data":"d3a4e340ce8e974bcf7f3458df0783f3ecaf9691aecb20b9f72273a2cb8411c7"} Sep 18 12:01:21.579992 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:21.579934 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-137.ec2.internal" podStartSLOduration=2.579914119 podStartE2EDuration="2.579914119s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 12:01:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:01:21.512699609 +0000 UTC m=+4.517387337" watchObservedRunningTime="2026-09-18 12:01:21.579914119 +0000 UTC m=+4.584601847" Sep 18 12:01:21.585070 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:21.585037 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-72hfq" event={"ID":"dd9664b3-5cd3-4336-9a83-c1641b6801ae","Type":"ContainerStarted","Data":"1800eca85a2afd397a8af51d1996b66f3ccc7cdf697c1233c04d9f5cf6ab7244"} Sep 18 12:01:22.607817 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:22.607746 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal" event={"ID":"a43f10e83b212fc99ba5e51c2dca4098","Type":"ContainerStarted","Data":"29342220de450fbc0697f0d0ffac62a870709fd35f8fd110bc5e7b1a531c1ef4"} Sep 18 12:01:22.629289 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:22.628944 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-137.ec2.internal" podStartSLOduration=3.628922588 podStartE2EDuration="3.628922588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 12:01:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:01:22.627999643 +0000 UTC m=+5.632687371" watchObservedRunningTime="2026-09-18 12:01:22.628922588 +0000 UTC m=+5.633610317" Sep 18 12:01:23.000630 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:22.999766 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-metrics-certs\") pod \"network-metrics-daemon-lvx4s\" (UID: \"a7f89718-22f1-4c13-aff1-d2fa5ff92c55\") " pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:01:23.000630 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:22.999863 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e518e71-5f13-44e7-aeb5-4e7c1e6d4778-original-pull-secret\") pod \"global-pull-secret-syncer-tpftw\" (UID: \"7e518e71-5f13-44e7-aeb5-4e7c1e6d4778\") " pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:23.000630 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:23.000017 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 12:01:23.000630 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:23.000088 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e518e71-5f13-44e7-aeb5-4e7c1e6d4778-original-pull-secret podName:7e518e71-5f13-44e7-aeb5-4e7c1e6d4778 nodeName:}" failed. No retries permitted until 2026-09-18 12:01:27.000067462 +0000 UTC m=+10.004755193 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e518e71-5f13-44e7-aeb5-4e7c1e6d4778-original-pull-secret") pod "global-pull-secret-syncer-tpftw" (UID: "7e518e71-5f13-44e7-aeb5-4e7c1e6d4778") : object "kube-system"/"original-pull-secret" not registered Sep 18 12:01:23.000630 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:23.000536 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 12:01:23.000630 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:23.000591 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-metrics-certs podName:a7f89718-22f1-4c13-aff1-d2fa5ff92c55 nodeName:}" failed. No retries permitted until 2026-09-18 12:01:27.000573166 +0000 UTC m=+10.005260885 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-metrics-certs") pod "network-metrics-daemon-lvx4s" (UID: "a7f89718-22f1-4c13-aff1-d2fa5ff92c55") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 12:01:23.201291 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:23.201250 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x82bn\" (UniqueName: \"kubernetes.io/projected/91599aa3-f0bc-4a4a-afa3-362851ac1783-kube-api-access-x82bn\") pod \"network-check-target-sbkdt\" (UID: \"91599aa3-f0bc-4a4a-afa3-362851ac1783\") " pod="openshift-network-diagnostics/network-check-target-sbkdt" Sep 18 12:01:23.201568 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:23.201439 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 12:01:23.201568 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:23.201460 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 12:01:23.201568 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:23.201492 2578 projected.go:196] Error preparing data for projected volume kube-api-access-x82bn for pod openshift-network-diagnostics/network-check-target-sbkdt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 12:01:23.201568 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:23.201559 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91599aa3-f0bc-4a4a-afa3-362851ac1783-kube-api-access-x82bn podName:91599aa3-f0bc-4a4a-afa3-362851ac1783 nodeName:}" failed. No retries permitted until 2026-09-18 12:01:27.201538619 +0000 UTC m=+10.206226339 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-x82bn" (UniqueName: "kubernetes.io/projected/91599aa3-f0bc-4a4a-afa3-362851ac1783-kube-api-access-x82bn") pod "network-check-target-sbkdt" (UID: "91599aa3-f0bc-4a4a-afa3-362851ac1783") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 12:01:23.462670 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:23.462636 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbkdt" Sep 18 12:01:23.462862 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:23.462769 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbkdt" podUID="91599aa3-f0bc-4a4a-afa3-362851ac1783" Sep 18 12:01:23.463234 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:23.463210 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:01:23.463345 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:23.463327 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvx4s" podUID="a7f89718-22f1-4c13-aff1-d2fa5ff92c55" Sep 18 12:01:23.463417 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:23.463397 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:23.463829 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:23.463799 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpftw" podUID="7e518e71-5f13-44e7-aeb5-4e7c1e6d4778" Sep 18 12:01:25.461885 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:25.461610 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbkdt" Sep 18 12:01:25.462279 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:25.461998 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbkdt" podUID="91599aa3-f0bc-4a4a-afa3-362851ac1783" Sep 18 12:01:25.464061 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:25.464036 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:25.464191 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:25.464155 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpftw" podUID="7e518e71-5f13-44e7-aeb5-4e7c1e6d4778" Sep 18 12:01:25.464256 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:25.464207 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:01:25.464316 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:25.464282 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvx4s" podUID="a7f89718-22f1-4c13-aff1-d2fa5ff92c55" Sep 18 12:01:27.039007 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:27.038210 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e518e71-5f13-44e7-aeb5-4e7c1e6d4778-original-pull-secret\") pod \"global-pull-secret-syncer-tpftw\" (UID: \"7e518e71-5f13-44e7-aeb5-4e7c1e6d4778\") " pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:27.039007 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:27.038283 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-metrics-certs\") pod \"network-metrics-daemon-lvx4s\" (UID: \"a7f89718-22f1-4c13-aff1-d2fa5ff92c55\") " pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:01:27.039007 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:27.038410 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 12:01:27.039007 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:27.038494 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-metrics-certs podName:a7f89718-22f1-4c13-aff1-d2fa5ff92c55 nodeName:}" failed. No retries permitted until 2026-09-18 12:01:35.038456371 +0000 UTC m=+18.043144090 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-metrics-certs") pod "network-metrics-daemon-lvx4s" (UID: "a7f89718-22f1-4c13-aff1-d2fa5ff92c55") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 12:01:27.039007 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:27.038903 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 12:01:27.039007 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:27.038960 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e518e71-5f13-44e7-aeb5-4e7c1e6d4778-original-pull-secret podName:7e518e71-5f13-44e7-aeb5-4e7c1e6d4778 nodeName:}" failed. No retries permitted until 2026-09-18 12:01:35.038942193 +0000 UTC m=+18.043629911 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e518e71-5f13-44e7-aeb5-4e7c1e6d4778-original-pull-secret") pod "global-pull-secret-syncer-tpftw" (UID: "7e518e71-5f13-44e7-aeb5-4e7c1e6d4778") : object "kube-system"/"original-pull-secret" not registered Sep 18 12:01:27.240138 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:27.240101 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x82bn\" (UniqueName: \"kubernetes.io/projected/91599aa3-f0bc-4a4a-afa3-362851ac1783-kube-api-access-x82bn\") pod \"network-check-target-sbkdt\" (UID: \"91599aa3-f0bc-4a4a-afa3-362851ac1783\") " pod="openshift-network-diagnostics/network-check-target-sbkdt" Sep 18 12:01:27.240343 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:27.240311 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 12:01:27.240343 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:27.240330 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 12:01:27.240343 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:27.240340 2578 projected.go:196] Error preparing data for projected volume kube-api-access-x82bn for pod openshift-network-diagnostics/network-check-target-sbkdt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 12:01:27.240542 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:27.240393 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91599aa3-f0bc-4a4a-afa3-362851ac1783-kube-api-access-x82bn podName:91599aa3-f0bc-4a4a-afa3-362851ac1783 nodeName:}" failed. No retries permitted until 2026-09-18 12:01:35.240374506 +0000 UTC m=+18.245062208 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-x82bn" (UniqueName: "kubernetes.io/projected/91599aa3-f0bc-4a4a-afa3-362851ac1783-kube-api-access-x82bn") pod "network-check-target-sbkdt" (UID: "91599aa3-f0bc-4a4a-afa3-362851ac1783") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 12:01:27.461078 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:27.461042 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:27.461391 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:27.461359 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpftw" podUID="7e518e71-5f13-44e7-aeb5-4e7c1e6d4778" Sep 18 12:01:27.461778 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:27.461760 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbkdt" Sep 18 12:01:27.461878 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:27.461859 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbkdt" podUID="91599aa3-f0bc-4a4a-afa3-362851ac1783" Sep 18 12:01:27.461939 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:27.461924 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:01:27.462026 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:27.462008 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvx4s" podUID="a7f89718-22f1-4c13-aff1-d2fa5ff92c55" Sep 18 12:01:29.462500 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:29.462461 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:01:29.462988 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:29.462639 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvx4s" podUID="a7f89718-22f1-4c13-aff1-d2fa5ff92c55" Sep 18 12:01:29.463071 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:29.463046 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:29.463169 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:29.463148 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpftw" podUID="7e518e71-5f13-44e7-aeb5-4e7c1e6d4778" Sep 18 12:01:29.463229 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:29.463203 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbkdt" Sep 18 12:01:29.463363 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:29.463269 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbkdt" podUID="91599aa3-f0bc-4a4a-afa3-362851ac1783" Sep 18 12:01:31.460354 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:31.460323 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbkdt" Sep 18 12:01:31.460801 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:31.460364 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:31.460801 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:31.460334 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:01:31.460801 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:31.460468 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbkdt" podUID="91599aa3-f0bc-4a4a-afa3-362851ac1783" Sep 18 12:01:31.460801 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:31.460560 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvx4s" podUID="a7f89718-22f1-4c13-aff1-d2fa5ff92c55" Sep 18 12:01:31.460801 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:31.460673 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpftw" podUID="7e518e71-5f13-44e7-aeb5-4e7c1e6d4778" Sep 18 12:01:33.460234 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:33.460197 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:01:33.460234 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:33.460235 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbkdt" Sep 18 12:01:33.460785 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:33.460197 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:33.460785 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:33.460332 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvx4s" podUID="a7f89718-22f1-4c13-aff1-d2fa5ff92c55" Sep 18 12:01:33.460785 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:33.460463 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbkdt" podUID="91599aa3-f0bc-4a4a-afa3-362851ac1783" Sep 18 12:01:33.460785 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:33.460542 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpftw" podUID="7e518e71-5f13-44e7-aeb5-4e7c1e6d4778" Sep 18 12:01:35.110189 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:35.110149 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-metrics-certs\") pod \"network-metrics-daemon-lvx4s\" (UID: \"a7f89718-22f1-4c13-aff1-d2fa5ff92c55\") " pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:01:35.110717 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:35.110242 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e518e71-5f13-44e7-aeb5-4e7c1e6d4778-original-pull-secret\") pod \"global-pull-secret-syncer-tpftw\" (UID: \"7e518e71-5f13-44e7-aeb5-4e7c1e6d4778\") " pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:35.110717 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:35.110347 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 12:01:35.110717 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:35.110359 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 12:01:35.110717 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:35.110430 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e518e71-5f13-44e7-aeb5-4e7c1e6d4778-original-pull-secret podName:7e518e71-5f13-44e7-aeb5-4e7c1e6d4778 nodeName:}" failed. No retries permitted until 2026-09-18 12:01:51.110411419 +0000 UTC m=+34.115099139 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e518e71-5f13-44e7-aeb5-4e7c1e6d4778-original-pull-secret") pod "global-pull-secret-syncer-tpftw" (UID: "7e518e71-5f13-44e7-aeb5-4e7c1e6d4778") : object "kube-system"/"original-pull-secret" not registered Sep 18 12:01:35.110717 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:35.110467 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-metrics-certs podName:a7f89718-22f1-4c13-aff1-d2fa5ff92c55 nodeName:}" failed. No retries permitted until 2026-09-18 12:01:51.110456321 +0000 UTC m=+34.115144023 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-metrics-certs") pod "network-metrics-daemon-lvx4s" (UID: "a7f89718-22f1-4c13-aff1-d2fa5ff92c55") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 12:01:35.312127 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:35.312089 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x82bn\" (UniqueName: \"kubernetes.io/projected/91599aa3-f0bc-4a4a-afa3-362851ac1783-kube-api-access-x82bn\") pod \"network-check-target-sbkdt\" (UID: \"91599aa3-f0bc-4a4a-afa3-362851ac1783\") " pod="openshift-network-diagnostics/network-check-target-sbkdt" Sep 18 12:01:35.312301 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:35.312285 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 12:01:35.312351 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:35.312310 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 12:01:35.312351 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:35.312321 2578 projected.go:196] Error preparing data for projected volume kube-api-access-x82bn for pod openshift-network-diagnostics/network-check-target-sbkdt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 12:01:35.312424 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:35.312393 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91599aa3-f0bc-4a4a-afa3-362851ac1783-kube-api-access-x82bn podName:91599aa3-f0bc-4a4a-afa3-362851ac1783 nodeName:}" failed. No retries permitted until 2026-09-18 12:01:51.312372188 +0000 UTC m=+34.317059939 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-x82bn" (UniqueName: "kubernetes.io/projected/91599aa3-f0bc-4a4a-afa3-362851ac1783-kube-api-access-x82bn") pod "network-check-target-sbkdt" (UID: "91599aa3-f0bc-4a4a-afa3-362851ac1783") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 12:01:35.460583 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:35.460547 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:35.460752 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:35.460548 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:01:35.460752 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:35.460687 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpftw" podUID="7e518e71-5f13-44e7-aeb5-4e7c1e6d4778" Sep 18 12:01:35.460752 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:35.460746 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbkdt" Sep 18 12:01:35.460922 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:35.460841 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvx4s" podUID="a7f89718-22f1-4c13-aff1-d2fa5ff92c55" Sep 18 12:01:35.460922 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:35.460907 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbkdt" podUID="91599aa3-f0bc-4a4a-afa3-362851ac1783" Sep 18 12:01:37.461914 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:37.461871 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbkdt" Sep 18 12:01:37.461914 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:37.461897 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:01:37.462370 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:37.461996 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:37.462370 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:37.462025 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbkdt" podUID="91599aa3-f0bc-4a4a-afa3-362851ac1783" Sep 18 12:01:37.462370 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:37.462073 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpftw" podUID="7e518e71-5f13-44e7-aeb5-4e7c1e6d4778" Sep 18 12:01:37.462370 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:37.462132 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvx4s" podUID="a7f89718-22f1-4c13-aff1-d2fa5ff92c55" Sep 18 12:01:39.460024 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:39.459990 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbkdt" Sep 18 12:01:39.460024 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:39.460026 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:39.460714 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:39.459992 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:01:39.460714 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:39.460102 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbkdt" podUID="91599aa3-f0bc-4a4a-afa3-362851ac1783" Sep 18 12:01:39.460714 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:39.460199 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvx4s" podUID="a7f89718-22f1-4c13-aff1-d2fa5ff92c55" Sep 18 12:01:39.460714 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:39.460281 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpftw" podUID="7e518e71-5f13-44e7-aeb5-4e7c1e6d4778" Sep 18 12:01:40.649683 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:40.649456 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rvwkx" event={"ID":"e518b32c-52bd-4209-a275-735bb0a88e9f","Type":"ContainerStarted","Data":"f7fba543e9747646278a7c86a018796f00d57fa250edfaf756c3c7b624a9129d"} Sep 18 12:01:40.651000 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:40.650971 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" event={"ID":"d43cab31-d29e-4d09-9b84-b59eff1e2163","Type":"ContainerStarted","Data":"22e5e76789d29e6e3f889f6ed90456ae438fa128b68ee391e42377a1bbb2a350"} Sep 18 12:01:40.653910 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:40.653888 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" event={"ID":"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e","Type":"ContainerStarted","Data":"4c5b235c9041c1fd3a9d8daf1e9018fb23a25e7e0555f111410628886c8b1627"} Sep 18 12:01:40.654039 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:40.653963 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" event={"ID":"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e","Type":"ContainerStarted","Data":"fc076f5bb77a8267a308249465674c2a57a7ff035059b542908cd65d3a34c3dc"} Sep 18 12:01:40.654039 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:40.654018 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" event={"ID":"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e","Type":"ContainerStarted","Data":"c22a635ec0af1c25e92fd4e89abe3cc43d34ac2dee177a69dcd92e4dcc6a2e08"} Sep 18 12:01:40.654110 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:40.654064 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" event={"ID":"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e","Type":"ContainerStarted","Data":"b441fdb4299cad93d103f59c9af602a418158f064aff40bb221ce76c4f0a7f8a"} Sep 18 12:01:40.654153 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:40.654110 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" event={"ID":"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e","Type":"ContainerStarted","Data":"dba8ee989eb773ee7d29a31654aa5872344552f73c8b5b6740bbd706581725bc"} Sep 18 12:01:40.654153 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:40.654148 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" event={"ID":"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e","Type":"ContainerStarted","Data":"f29b9cd35f4cc84d6d2551aa7b29677ca24a1f4cd2e07a2ef8e1632f49ef4a61"} Sep 18 12:01:40.655450 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:40.655411 2578 generic.go:356] "Generic (PLEG): container finished" podID="9bb652de-6064-47b2-8a77-4ab4e7a7bc69" containerID="8fd3b44bc01b3347d11cb98c8d878810390f063d84c2b712d0de8107aba5f418" exitCode=0 Sep 18 12:01:40.655560 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:40.655477 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5n699" event={"ID":"9bb652de-6064-47b2-8a77-4ab4e7a7bc69","Type":"ContainerDied","Data":"8fd3b44bc01b3347d11cb98c8d878810390f063d84c2b712d0de8107aba5f418"} Sep 18 12:01:40.657002 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:40.656984 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hj8kz" event={"ID":"a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d","Type":"ContainerStarted","Data":"830ba3123114d25b1901641a61b0b88b1298809f6999901057a0d64d614f0f2d"} Sep 18 12:01:40.658469 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:40.658428 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z7phr" event={"ID":"d41ee317-2122-4ae3-b680-6b44e17f25a9","Type":"ContainerStarted","Data":"1305881bd2094fa0970554878aec4b857e60a8ba6dc386a7281565012f0915ef"} Sep 18 12:01:40.659812 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:40.659794 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk99x" event={"ID":"e9f66a61-1fad-45c2-99e5-c634c8727fbe","Type":"ContainerStarted","Data":"5fd87e50b7a918359a977e2271097543db57cdb9fd0b40b0b667d66fa0c5bf0c"} Sep 18 12:01:40.661070 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:40.661052 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-72hfq" event={"ID":"dd9664b3-5cd3-4336-9a83-c1641b6801ae","Type":"ContainerStarted","Data":"85d61ef1067755e3cda561567ef848f06755fa010a9357e6f0b709eacdce1946"} Sep 18 12:01:40.709656 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:40.709604 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rvwkx" podStartSLOduration=3.767220027 podStartE2EDuration="22.709584984s" totalImagesPullingTime="18.942364957s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 12:01:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:01:40.677656117 +0000 UTC m=+23.682343841" watchObservedRunningTime="2026-09-18 12:01:40.709584984 +0000 UTC m=+23.714272768" Sep 18 12:01:40.740345 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:40.740280 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-72hfq" podStartSLOduration=3.792744924 podStartE2EDuration="22.740265025s" totalImagesPullingTime="18.947520101s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 12:01:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:01:40.710300209 +0000 UTC m=+23.714987933" watchObservedRunningTime="2026-09-18 12:01:40.740265025 +0000 UTC m=+23.744952748" Sep 18 12:01:40.740663 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:40.740637 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4ldj5" podStartSLOduration=3.798046547 podStartE2EDuration="22.740630791s" totalImagesPullingTime="18.942584244s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 12:01:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:01:40.740194368 +0000 UTC m=+23.744882100" watchObservedRunningTime="2026-09-18 12:01:40.740630791 +0000 UTC m=+23.745318514" Sep 18 12:01:40.794456 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:40.794394 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hj8kz" podStartSLOduration=3.8453451530000002 podStartE2EDuration="22.794374413s" totalImagesPullingTime="18.94902926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 12:01:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:01:40.79425924 +0000 UTC m=+23.798946963" watchObservedRunningTime="2026-09-18 12:01:40.794374413 +0000 UTC m=+23.799062137" Sep 18 12:01:40.827120 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:40.827070 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-z7phr" podStartSLOduration=3.828651648 podStartE2EDuration="22.827055361s" totalImagesPullingTime="18.998403713s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 12:01:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:01:40.826677724 +0000 UTC m=+23.831365448" watchObservedRunningTime="2026-09-18 12:01:40.827055361 +0000 UTC m=+23.831743084" Sep 18 12:01:41.272174 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:41.272027 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 18 12:01:41.428511 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:41.428407 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T12:01:41.272169586Z","UUID":"0b3aac69-9766-471d-9048-66cf7a942221","Handler":null,"Name":"","Endpoint":""} Sep 18 12:01:41.429737 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:41.429721 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 18 12:01:41.429828 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:41.429748 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 18 12:01:41.460706 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:41.460670 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbkdt" Sep 18 12:01:41.460849 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:41.460676 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:01:41.460849 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:41.460771 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbkdt" podUID="91599aa3-f0bc-4a4a-afa3-362851ac1783" Sep 18 12:01:41.460849 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:41.460782 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:41.460849 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:41.460841 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvx4s" podUID="a7f89718-22f1-4c13-aff1-d2fa5ff92c55" Sep 18 12:01:41.460985 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:41.460962 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpftw" podUID="7e518e71-5f13-44e7-aeb5-4e7c1e6d4778" Sep 18 12:01:41.665162 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:41.665127 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk99x" event={"ID":"e9f66a61-1fad-45c2-99e5-c634c8727fbe","Type":"ContainerStarted","Data":"fce3e7ee71d081597468d7ba14d4c121e07fdf14a4af7ec294cff06a1a72122d"} Sep 18 12:01:41.666665 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:41.666638 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xzqgp" event={"ID":"fb3f8f64-6a47-42b0-a259-fd44f14570be","Type":"ContainerStarted","Data":"43e770359bb946b1a1c36618dcad47a7653dd33f2e6eca947a13dd8bb1354274"} Sep 18 12:01:42.674486 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:42.674453 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" event={"ID":"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e","Type":"ContainerStarted","Data":"a9eb9b5fa31432ad2874b340405a4d99376eedbea86578f4a6b24558d89bf999"} Sep 18 12:01:42.676904 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:42.676871 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk99x" event={"ID":"e9f66a61-1fad-45c2-99e5-c634c8727fbe","Type":"ContainerStarted","Data":"b3a122a90101de7d169cba3838bb275c0e5de8b52fc7bb66f973093809671d64"} Sep 18 12:01:42.709740 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:42.709698 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xzqgp" podStartSLOduration=5.770272139 podStartE2EDuration="24.709682793s" totalImagesPullingTime="18.939410654s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 12:01:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:01:41.690033737 +0000 UTC m=+24.694721462" watchObservedRunningTime="2026-09-18 12:01:42.709682793 +0000 UTC m=+25.714370535" Sep 18 12:01:42.710154 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:42.710126 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wk99x" podStartSLOduration=3.523190673 podStartE2EDuration="24.710119392s" totalImagesPullingTime="21.186928719s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 12:01:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:01:42.709524242 +0000 UTC m=+25.714211966" watchObservedRunningTime="2026-09-18 12:01:42.710119392 +0000 UTC m=+25.714807115" Sep 18 12:01:43.460533 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:43.460500 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:01:43.460692 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:43.460500 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbkdt" Sep 18 12:01:43.460692 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:43.460637 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvx4s" podUID="a7f89718-22f1-4c13-aff1-d2fa5ff92c55" Sep 18 12:01:43.460806 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:43.460730 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbkdt" podUID="91599aa3-f0bc-4a4a-afa3-362851ac1783" Sep 18 12:01:43.460806 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:43.460500 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:43.460888 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:43.460831 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpftw" podUID="7e518e71-5f13-44e7-aeb5-4e7c1e6d4778" Sep 18 12:01:44.685665 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:44.685589 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" event={"ID":"e4e24df3-32d9-47d5-bab8-3b6c6ab5451e","Type":"ContainerStarted","Data":"a77e505ea30046ccb319a04aba24054a8cb205aafc0f38c9c8255e3bf06ecd08"} Sep 18 12:01:44.686061 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:44.686036 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:44.686194 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:44.686180 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:44.703117 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:44.702959 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:44.703262 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:44.703200 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:44.729621 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:44.729575 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" podStartSLOduration=7.696410718 podStartE2EDuration="26.729559411s" totalImagesPullingTime="19.033148693s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 12:01:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:01:44.729003531 +0000 UTC m=+27.733691257" watchObservedRunningTime="2026-09-18 12:01:44.729559411 +0000 UTC m=+27.734247349" Sep 18 12:01:45.460688 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:45.460651 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbkdt" Sep 18 12:01:45.460866 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:45.460769 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbkdt" podUID="91599aa3-f0bc-4a4a-afa3-362851ac1783" Sep 18 12:01:45.460866 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:45.460652 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:01:45.460996 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:45.460881 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvx4s" podUID="a7f89718-22f1-4c13-aff1-d2fa5ff92c55" Sep 18 12:01:45.460996 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:45.460651 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:45.460996 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:45.460958 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpftw" podUID="7e518e71-5f13-44e7-aeb5-4e7c1e6d4778" Sep 18 12:01:45.563494 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:45.563455 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hj8kz" Sep 18 12:01:45.564117 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:45.564097 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hj8kz" Sep 18 12:01:45.688638 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:45.688611 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 18 12:01:45.689894 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:45.689508 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hj8kz" Sep 18 12:01:45.694523 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:45.694493 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hj8kz" Sep 18 12:01:45.977663 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:45.977618 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:01:46.525847 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:46.525819 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sbkdt"] Sep 18 12:01:46.526010 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:46.525930 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbkdt" Sep 18 12:01:46.526070 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:46.526016 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbkdt" podUID="91599aa3-f0bc-4a4a-afa3-362851ac1783" Sep 18 12:01:46.531385 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:46.531356 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lvx4s"] Sep 18 12:01:46.531537 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:46.531520 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:01:46.531670 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:46.531648 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvx4s" podUID="a7f89718-22f1-4c13-aff1-d2fa5ff92c55" Sep 18 12:01:46.538202 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:46.538177 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tpftw"] Sep 18 12:01:46.538312 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:46.538284 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:46.538403 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:46.538383 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpftw" podUID="7e518e71-5f13-44e7-aeb5-4e7c1e6d4778" Sep 18 12:01:46.692386 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:46.692349 2578 generic.go:356] "Generic (PLEG): container finished" podID="9bb652de-6064-47b2-8a77-4ab4e7a7bc69" containerID="e2bf3ca1222049ae8f6554137845bdb92c9c8c39ef8cf19a0778352939554c55" exitCode=0 Sep 18 12:01:46.692986 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:46.692409 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5n699" event={"ID":"9bb652de-6064-47b2-8a77-4ab4e7a7bc69","Type":"ContainerDied","Data":"e2bf3ca1222049ae8f6554137845bdb92c9c8c39ef8cf19a0778352939554c55"} Sep 18 12:01:47.696961 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:47.696923 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5n699" event={"ID":"9bb652de-6064-47b2-8a77-4ab4e7a7bc69","Type":"ContainerStarted","Data":"d77cd3935a2e1f0a4f898affd11e6fa683453709a2d31a64f7edddca28f96b56"} Sep 18 12:01:48.460316 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:48.460277 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:48.460480 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:48.460326 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbkdt" Sep 18 12:01:48.460480 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:48.460292 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:01:48.460480 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:48.460395 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpftw" podUID="7e518e71-5f13-44e7-aeb5-4e7c1e6d4778" Sep 18 12:01:48.460595 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:48.460509 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvx4s" podUID="a7f89718-22f1-4c13-aff1-d2fa5ff92c55" Sep 18 12:01:48.460595 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:48.460585 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbkdt" podUID="91599aa3-f0bc-4a4a-afa3-362851ac1783" Sep 18 12:01:48.700617 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:48.700578 2578 generic.go:356] "Generic (PLEG): container finished" podID="9bb652de-6064-47b2-8a77-4ab4e7a7bc69" containerID="d77cd3935a2e1f0a4f898affd11e6fa683453709a2d31a64f7edddca28f96b56" exitCode=0 Sep 18 12:01:48.700976 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:48.700641 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5n699" event={"ID":"9bb652de-6064-47b2-8a77-4ab4e7a7bc69","Type":"ContainerDied","Data":"d77cd3935a2e1f0a4f898affd11e6fa683453709a2d31a64f7edddca28f96b56"} Sep 18 12:01:49.705203 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:49.704994 2578 generic.go:356] "Generic (PLEG): container finished" podID="9bb652de-6064-47b2-8a77-4ab4e7a7bc69" containerID="ba3b8f8cdf6d016673328d6c78ded713f6a39ad7549dfb77d2d3f5a98f88e371" exitCode=0 Sep 18 12:01:49.705203 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:49.705075 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5n699" event={"ID":"9bb652de-6064-47b2-8a77-4ab4e7a7bc69","Type":"ContainerDied","Data":"ba3b8f8cdf6d016673328d6c78ded713f6a39ad7549dfb77d2d3f5a98f88e371"} Sep 18 12:01:50.460473 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:50.460426 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbkdt" Sep 18 12:01:50.460748 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:50.460431 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:50.460748 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:50.460563 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sbkdt" podUID="91599aa3-f0bc-4a4a-afa3-362851ac1783" Sep 18 12:01:50.460748 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:50.460431 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:01:50.460748 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:50.460659 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpftw" podUID="7e518e71-5f13-44e7-aeb5-4e7c1e6d4778" Sep 18 12:01:50.460748 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:50.460715 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lvx4s" podUID="a7f89718-22f1-4c13-aff1-d2fa5ff92c55" Sep 18 12:01:51.126455 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:51.126395 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e518e71-5f13-44e7-aeb5-4e7c1e6d4778-original-pull-secret\") pod \"global-pull-secret-syncer-tpftw\" (UID: \"7e518e71-5f13-44e7-aeb5-4e7c1e6d4778\") " pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:51.126943 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:51.126489 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-metrics-certs\") pod \"network-metrics-daemon-lvx4s\" (UID: \"a7f89718-22f1-4c13-aff1-d2fa5ff92c55\") " pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:01:51.126943 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:51.126552 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 12:01:51.126943 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:51.126598 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 12:01:51.126943 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:51.126621 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e518e71-5f13-44e7-aeb5-4e7c1e6d4778-original-pull-secret podName:7e518e71-5f13-44e7-aeb5-4e7c1e6d4778 nodeName:}" failed. No retries permitted until 2026-09-18 12:02:23.126602917 +0000 UTC m=+66.131290638 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e518e71-5f13-44e7-aeb5-4e7c1e6d4778-original-pull-secret") pod "global-pull-secret-syncer-tpftw" (UID: "7e518e71-5f13-44e7-aeb5-4e7c1e6d4778") : object "kube-system"/"original-pull-secret" not registered Sep 18 12:01:51.126943 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:51.126639 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-metrics-certs podName:a7f89718-22f1-4c13-aff1-d2fa5ff92c55 nodeName:}" failed. No retries permitted until 2026-09-18 12:02:23.12662815 +0000 UTC m=+66.131315871 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-metrics-certs") pod "network-metrics-daemon-lvx4s" (UID: "a7f89718-22f1-4c13-aff1-d2fa5ff92c55") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 12:01:51.327720 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:51.327689 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x82bn\" (UniqueName: \"kubernetes.io/projected/91599aa3-f0bc-4a4a-afa3-362851ac1783-kube-api-access-x82bn\") pod \"network-check-target-sbkdt\" (UID: \"91599aa3-f0bc-4a4a-afa3-362851ac1783\") " pod="openshift-network-diagnostics/network-check-target-sbkdt" Sep 18 12:01:51.327880 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:51.327819 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 12:01:51.327880 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:51.327838 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 12:01:51.327880 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:51.327850 2578 projected.go:196] Error preparing data for projected volume kube-api-access-x82bn for pod openshift-network-diagnostics/network-check-target-sbkdt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 12:01:51.327988 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:51.327913 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/91599aa3-f0bc-4a4a-afa3-362851ac1783-kube-api-access-x82bn podName:91599aa3-f0bc-4a4a-afa3-362851ac1783 nodeName:}" failed. No retries permitted until 2026-09-18 12:02:23.327894671 +0000 UTC m=+66.332582386 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-x82bn" (UniqueName: "kubernetes.io/projected/91599aa3-f0bc-4a4a-afa3-362851ac1783-kube-api-access-x82bn") pod "network-check-target-sbkdt" (UID: "91599aa3-f0bc-4a4a-afa3-362851ac1783") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 12:01:52.330792 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.330760 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-137.ec2.internal" event="NodeReady" Sep 18 12:01:52.331136 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.330880 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 18 12:01:52.374358 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.374321 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8bc5597b7-jd884"] Sep 18 12:01:52.376504 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.376480 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:01:52.380101 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.380079 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 18 12:01:52.380243 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.380189 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 18 12:01:52.380349 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.380325 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 18 12:01:52.380477 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.380463 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zr922\"" Sep 18 12:01:52.387912 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.387893 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 18 12:01:52.396184 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.396161 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7xktt"] Sep 18 12:01:52.398212 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.398185 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7xktt" Sep 18 12:01:52.398477 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.398456 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8bc5597b7-jd884"] Sep 18 12:01:52.401672 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.401520 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 18 12:01:52.401672 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.401618 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 18 12:01:52.402966 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.402551 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xvqgc\"" Sep 18 12:01:52.402966 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.402797 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 18 12:01:52.403487 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.403466 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fzjc7"] Sep 18 12:01:52.405253 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.405234 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fzjc7" Sep 18 12:01:52.407946 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.407930 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6t8bg\"" Sep 18 12:01:52.408052 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.408035 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 18 12:01:52.408233 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.408216 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 18 12:01:52.420945 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.420926 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7xktt"] Sep 18 12:01:52.421717 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.421694 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fzjc7"] Sep 18 12:01:52.460102 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.460024 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbkdt" Sep 18 12:01:52.460255 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.460126 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:01:52.460314 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.460283 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:01:52.464472 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.463161 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ktknz\"" Sep 18 12:01:52.464472 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.463419 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 12:01:52.464472 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.463810 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 12:01:52.464472 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.464065 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dg4h6\"" Sep 18 12:01:52.465529 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.464797 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 12:01:52.465529 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.465151 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 12:01:52.536363 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.536329 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-ca-trust-extracted\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:01:52.536511 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.536378 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-image-registry-private-configuration\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:01:52.536511 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.536429 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-trusted-ca\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:01:52.536511 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.536477 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/234d0ce2-2eb9-4560-9208-1c28699d7263-config-volume\") pod \"dns-default-fzjc7\" (UID: \"234d0ce2-2eb9-4560-9208-1c28699d7263\") " pod="openshift-dns/dns-default-fzjc7" Sep 18 12:01:52.536511 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.536501 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgvtz\" (UniqueName: \"kubernetes.io/projected/fcbeeb9d-952c-4a61-a38f-6c338e380647-kube-api-access-vgvtz\") pod \"ingress-canary-7xktt\" (UID: \"fcbeeb9d-952c-4a61-a38f-6c338e380647\") " pod="openshift-ingress-canary/ingress-canary-7xktt" Sep 18 12:01:52.536712 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.536554 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/234d0ce2-2eb9-4560-9208-1c28699d7263-metrics-tls\") pod \"dns-default-fzjc7\" (UID: \"234d0ce2-2eb9-4560-9208-1c28699d7263\") " pod="openshift-dns/dns-default-fzjc7" Sep 18 12:01:52.536712 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.536573 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-installation-pull-secrets\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:01:52.536712 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.536588 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-bound-sa-token\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:01:52.536712 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.536614 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/234d0ce2-2eb9-4560-9208-1c28699d7263-tmp-dir\") pod \"dns-default-fzjc7\" (UID: \"234d0ce2-2eb9-4560-9208-1c28699d7263\") " pod="openshift-dns/dns-default-fzjc7" Sep 18 12:01:52.536712 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.536688 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fcbeeb9d-952c-4a61-a38f-6c338e380647-cert\") pod \"ingress-canary-7xktt\" (UID: \"fcbeeb9d-952c-4a61-a38f-6c338e380647\") " pod="openshift-ingress-canary/ingress-canary-7xktt" Sep 18 12:01:52.536898 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.536726 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhdws\" (UniqueName: \"kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-kube-api-access-fhdws\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:01:52.536898 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.536756 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-tls\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:01:52.536898 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.536795 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-certificates\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:01:52.536898 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.536833 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f9sd\" (UniqueName: \"kubernetes.io/projected/234d0ce2-2eb9-4560-9208-1c28699d7263-kube-api-access-4f9sd\") pod \"dns-default-fzjc7\" (UID: \"234d0ce2-2eb9-4560-9208-1c28699d7263\") " pod="openshift-dns/dns-default-fzjc7" Sep 18 12:01:52.621423 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.621385 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:01:52.637408 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.637382 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/234d0ce2-2eb9-4560-9208-1c28699d7263-metrics-tls\") pod \"dns-default-fzjc7\" (UID: \"234d0ce2-2eb9-4560-9208-1c28699d7263\") " pod="openshift-dns/dns-default-fzjc7" Sep 18 12:01:52.637408 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.637415 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-installation-pull-secrets\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:01:52.637623 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.637455 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-bound-sa-token\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:01:52.637623 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.637482 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/234d0ce2-2eb9-4560-9208-1c28699d7263-tmp-dir\") pod \"dns-default-fzjc7\" (UID: \"234d0ce2-2eb9-4560-9208-1c28699d7263\") " pod="openshift-dns/dns-default-fzjc7" Sep 18 12:01:52.637623 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.637513 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fcbeeb9d-952c-4a61-a38f-6c338e380647-cert\") pod \"ingress-canary-7xktt\" (UID: \"fcbeeb9d-952c-4a61-a38f-6c338e380647\") " pod="openshift-ingress-canary/ingress-canary-7xktt" Sep 18 12:01:52.637623 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:52.637537 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 12:01:52.637623 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.637541 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhdws\" (UniqueName: \"kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-kube-api-access-fhdws\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:01:52.637623 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:52.637595 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/234d0ce2-2eb9-4560-9208-1c28699d7263-metrics-tls podName:234d0ce2-2eb9-4560-9208-1c28699d7263 nodeName:}" failed. No retries permitted until 2026-09-18 12:01:53.137575472 +0000 UTC m=+36.142263193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/234d0ce2-2eb9-4560-9208-1c28699d7263-metrics-tls") pod "dns-default-fzjc7" (UID: "234d0ce2-2eb9-4560-9208-1c28699d7263") : secret "dns-default-metrics-tls" not found Sep 18 12:01:52.637891 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.637835 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-tls\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:01:52.637891 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.637854 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/234d0ce2-2eb9-4560-9208-1c28699d7263-tmp-dir\") pod \"dns-default-fzjc7\" (UID: \"234d0ce2-2eb9-4560-9208-1c28699d7263\") " pod="openshift-dns/dns-default-fzjc7" Sep 18 12:01:52.637891 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.637868 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-certificates\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:01:52.638020 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.637913 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f9sd\" (UniqueName: \"kubernetes.io/projected/234d0ce2-2eb9-4560-9208-1c28699d7263-kube-api-access-4f9sd\") pod \"dns-default-fzjc7\" (UID: \"234d0ce2-2eb9-4560-9208-1c28699d7263\") " pod="openshift-dns/dns-default-fzjc7" Sep 18 12:01:52.638020 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:52.637949 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 12:01:52.638020 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:52.637965 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8bc5597b7-jd884: secret "image-registry-tls" not found Sep 18 12:01:52.638020 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.637985 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-ca-trust-extracted\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:01:52.638020 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:52.638013 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-tls podName:1224ce74-74ed-47ba-b9f4-3b1c79ef5933 nodeName:}" failed. No retries permitted until 2026-09-18 12:01:53.137994393 +0000 UTC m=+36.142682111 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-tls") pod "image-registry-8bc5597b7-jd884" (UID: "1224ce74-74ed-47ba-b9f4-3b1c79ef5933") : secret "image-registry-tls" not found Sep 18 12:01:52.638250 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.638049 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-image-registry-private-configuration\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:01:52.638250 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.638092 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-trusted-ca\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:01:52.638250 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.638117 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/234d0ce2-2eb9-4560-9208-1c28699d7263-config-volume\") pod \"dns-default-fzjc7\" (UID: \"234d0ce2-2eb9-4560-9208-1c28699d7263\") " pod="openshift-dns/dns-default-fzjc7" Sep 18 12:01:52.638250 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.638143 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgvtz\" (UniqueName: \"kubernetes.io/projected/fcbeeb9d-952c-4a61-a38f-6c338e380647-kube-api-access-vgvtz\") pod \"ingress-canary-7xktt\" (UID: \"fcbeeb9d-952c-4a61-a38f-6c338e380647\") " pod="openshift-ingress-canary/ingress-canary-7xktt" Sep 18 12:01:52.638462 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.638287 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-ca-trust-extracted\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:01:52.638516 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.638476 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-certificates\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:01:52.638996 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.638892 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/234d0ce2-2eb9-4560-9208-1c28699d7263-config-volume\") pod \"dns-default-fzjc7\" (UID: \"234d0ce2-2eb9-4560-9208-1c28699d7263\") " pod="openshift-dns/dns-default-fzjc7" Sep 18 12:01:52.639274 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.639254 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-trusted-ca\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:01:52.642464 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.642424 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-image-registry-private-configuration\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:01:52.642464 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.642450 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-installation-pull-secrets\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:01:52.642874 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.642855 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fcbeeb9d-952c-4a61-a38f-6c338e380647-cert\") pod \"ingress-canary-7xktt\" (UID: \"fcbeeb9d-952c-4a61-a38f-6c338e380647\") " pod="openshift-ingress-canary/ingress-canary-7xktt" Sep 18 12:01:52.653165 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.653139 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f9sd\" (UniqueName: \"kubernetes.io/projected/234d0ce2-2eb9-4560-9208-1c28699d7263-kube-api-access-4f9sd\") pod \"dns-default-fzjc7\" (UID: \"234d0ce2-2eb9-4560-9208-1c28699d7263\") " pod="openshift-dns/dns-default-fzjc7" Sep 18 12:01:52.653620 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.653560 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-bound-sa-token\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:01:52.653891 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.653871 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhdws\" (UniqueName: \"kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-kube-api-access-fhdws\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:01:52.654302 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.654284 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgvtz\" (UniqueName: \"kubernetes.io/projected/fcbeeb9d-952c-4a61-a38f-6c338e380647-kube-api-access-vgvtz\") pod \"ingress-canary-7xktt\" (UID: \"fcbeeb9d-952c-4a61-a38f-6c338e380647\") " pod="openshift-ingress-canary/ingress-canary-7xktt" Sep 18 12:01:52.709268 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.709234 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7xktt" Sep 18 12:01:52.803596 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:52.803561 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:01:53.005028 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:53.004947 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7xktt"] Sep 18 12:01:53.011463 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:01:53.011413 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcbeeb9d_952c_4a61_a38f_6c338e380647.slice/crio-d4ffff518d20e98e206262524eeee83365773333b0b28c2b789649867c3b7100 WatchSource:0}: Error finding container d4ffff518d20e98e206262524eeee83365773333b0b28c2b789649867c3b7100: Status 404 returned error can't find the container with id d4ffff518d20e98e206262524eeee83365773333b0b28c2b789649867c3b7100 Sep 18 12:01:53.142829 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:53.142655 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-tls\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:01:53.142978 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:53.142878 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/234d0ce2-2eb9-4560-9208-1c28699d7263-metrics-tls\") pod \"dns-default-fzjc7\" (UID: \"234d0ce2-2eb9-4560-9208-1c28699d7263\") " pod="openshift-dns/dns-default-fzjc7" Sep 18 12:01:53.142978 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:53.142799 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 12:01:53.142978 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:53.142905 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8bc5597b7-jd884: secret "image-registry-tls" not found Sep 18 12:01:53.142978 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:53.142968 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-tls podName:1224ce74-74ed-47ba-b9f4-3b1c79ef5933 nodeName:}" failed. No retries permitted until 2026-09-18 12:01:54.142953363 +0000 UTC m=+37.147641083 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-tls") pod "image-registry-8bc5597b7-jd884" (UID: "1224ce74-74ed-47ba-b9f4-3b1c79ef5933") : secret "image-registry-tls" not found Sep 18 12:01:53.143108 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:53.143003 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 12:01:53.143108 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:53.143053 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/234d0ce2-2eb9-4560-9208-1c28699d7263-metrics-tls podName:234d0ce2-2eb9-4560-9208-1c28699d7263 nodeName:}" failed. No retries permitted until 2026-09-18 12:01:54.143037236 +0000 UTC m=+37.147724940 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/234d0ce2-2eb9-4560-9208-1c28699d7263-metrics-tls") pod "dns-default-fzjc7" (UID: "234d0ce2-2eb9-4560-9208-1c28699d7263") : secret "dns-default-metrics-tls" not found Sep 18 12:01:53.716391 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:53.716339 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7xktt" event={"ID":"fcbeeb9d-952c-4a61-a38f-6c338e380647","Type":"ContainerStarted","Data":"d4ffff518d20e98e206262524eeee83365773333b0b28c2b789649867c3b7100"} Sep 18 12:01:54.151225 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:54.151177 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-tls\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:01:54.151406 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:54.151280 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/234d0ce2-2eb9-4560-9208-1c28699d7263-metrics-tls\") pod \"dns-default-fzjc7\" (UID: \"234d0ce2-2eb9-4560-9208-1c28699d7263\") " pod="openshift-dns/dns-default-fzjc7" Sep 18 12:01:54.151406 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:54.151367 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 12:01:54.151406 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:54.151392 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8bc5597b7-jd884: secret "image-registry-tls" not found Sep 18 12:01:54.151406 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:54.151392 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 12:01:54.151643 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:54.151481 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-tls podName:1224ce74-74ed-47ba-b9f4-3b1c79ef5933 nodeName:}" failed. No retries permitted until 2026-09-18 12:01:56.15145689 +0000 UTC m=+39.156144608 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-tls") pod "image-registry-8bc5597b7-jd884" (UID: "1224ce74-74ed-47ba-b9f4-3b1c79ef5933") : secret "image-registry-tls" not found Sep 18 12:01:54.151643 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:54.151501 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/234d0ce2-2eb9-4560-9208-1c28699d7263-metrics-tls podName:234d0ce2-2eb9-4560-9208-1c28699d7263 nodeName:}" failed. No retries permitted until 2026-09-18 12:01:56.15149042 +0000 UTC m=+39.156178124 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/234d0ce2-2eb9-4560-9208-1c28699d7263-metrics-tls") pod "dns-default-fzjc7" (UID: "234d0ce2-2eb9-4560-9208-1c28699d7263") : secret "dns-default-metrics-tls" not found Sep 18 12:01:55.057099 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:55.057061 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:01:55.154833 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:55.154802 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:01:55.259867 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:55.259832 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:01:55.724432 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:55.724400 2578 generic.go:356] "Generic (PLEG): container finished" podID="9bb652de-6064-47b2-8a77-4ab4e7a7bc69" containerID="dc3237fb0409a07c8b06e4757cce4a69ff90fc3ef39cc7f46fe9e17803116860" exitCode=0 Sep 18 12:01:55.724624 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:55.724475 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5n699" event={"ID":"9bb652de-6064-47b2-8a77-4ab4e7a7bc69","Type":"ContainerDied","Data":"dc3237fb0409a07c8b06e4757cce4a69ff90fc3ef39cc7f46fe9e17803116860"} Sep 18 12:01:56.128992 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:56.128960 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:01:56.168014 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:56.167757 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/234d0ce2-2eb9-4560-9208-1c28699d7263-metrics-tls\") pod \"dns-default-fzjc7\" (UID: \"234d0ce2-2eb9-4560-9208-1c28699d7263\") " pod="openshift-dns/dns-default-fzjc7" Sep 18 12:01:56.168014 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:56.167836 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-tls\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:01:56.168014 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:56.167962 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 12:01:56.168014 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:56.167976 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8bc5597b7-jd884: secret "image-registry-tls" not found Sep 18 12:01:56.168291 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:56.168033 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-tls podName:1224ce74-74ed-47ba-b9f4-3b1c79ef5933 nodeName:}" failed. No retries permitted until 2026-09-18 12:02:00.168014822 +0000 UTC m=+43.172702543 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-tls") pod "image-registry-8bc5597b7-jd884" (UID: "1224ce74-74ed-47ba-b9f4-3b1c79ef5933") : secret "image-registry-tls" not found Sep 18 12:01:56.168291 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:56.168110 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 12:01:56.168291 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:01:56.168170 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/234d0ce2-2eb9-4560-9208-1c28699d7263-metrics-tls podName:234d0ce2-2eb9-4560-9208-1c28699d7263 nodeName:}" failed. No retries permitted until 2026-09-18 12:02:00.168151998 +0000 UTC m=+43.172839718 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/234d0ce2-2eb9-4560-9208-1c28699d7263-metrics-tls") pod "dns-default-fzjc7" (UID: "234d0ce2-2eb9-4560-9208-1c28699d7263") : secret "dns-default-metrics-tls" not found Sep 18 12:01:56.232269 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:56.232226 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:01:56.318924 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:56.318828 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:01:56.731245 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:56.731216 2578 generic.go:356] "Generic (PLEG): container finished" podID="9bb652de-6064-47b2-8a77-4ab4e7a7bc69" containerID="1fc91ccbafdd65f02d3e9e7a3047e079a120de2cc0a6881114229cdb9fd461f8" exitCode=0 Sep 18 12:01:56.731456 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:56.731272 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5n699" event={"ID":"9bb652de-6064-47b2-8a77-4ab4e7a7bc69","Type":"ContainerDied","Data":"1fc91ccbafdd65f02d3e9e7a3047e079a120de2cc0a6881114229cdb9fd461f8"} Sep 18 12:01:57.735377 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:57.735090 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7xktt" event={"ID":"fcbeeb9d-952c-4a61-a38f-6c338e380647","Type":"ContainerStarted","Data":"0e580a05b5d8c5e7b72482ed279ad5a49f57d0a244c419433d25f31b44ba41fc"} Sep 18 12:01:57.738575 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:57.738549 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5n699" event={"ID":"9bb652de-6064-47b2-8a77-4ab4e7a7bc69","Type":"ContainerStarted","Data":"d44a8adc1ddf1c7d158fbd9c6dcff32408e1c45fcc531668f3a7c1cc0669f072"} Sep 18 12:01:57.795549 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:57.795487 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5n699" podStartSLOduration=8.085173088 podStartE2EDuration="39.795465083s" totalImagesPullingTime="31.710291995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 12:01:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:01:57.794120257 +0000 UTC m=+40.798807979" watchObservedRunningTime="2026-09-18 12:01:57.795465083 +0000 UTC m=+40.800152808" Sep 18 12:01:57.795822 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:57.795790 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7xktt" podStartSLOduration=1.413348541 podStartE2EDuration="5.795776966s" totalImagesPullingTime="4.382428425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 12:01:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:01:57.7617075 +0000 UTC m=+40.766395223" watchObservedRunningTime="2026-09-18 12:01:57.795776966 +0000 UTC m=+40.800464690" Sep 18 12:01:57.933285 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:57.933251 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:01:58.031609 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:58.031495 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:01:58.113138 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:01:58.113072 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:02:00.008765 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:00.008736 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:02:00.197890 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:00.197850 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/234d0ce2-2eb9-4560-9208-1c28699d7263-metrics-tls\") pod \"dns-default-fzjc7\" (UID: \"234d0ce2-2eb9-4560-9208-1c28699d7263\") " pod="openshift-dns/dns-default-fzjc7" Sep 18 12:02:00.198045 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:00.197923 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-tls\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:02:00.198045 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:02:00.198004 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 12:02:00.198115 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:02:00.198064 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/234d0ce2-2eb9-4560-9208-1c28699d7263-metrics-tls podName:234d0ce2-2eb9-4560-9208-1c28699d7263 nodeName:}" failed. No retries permitted until 2026-09-18 12:02:08.198048392 +0000 UTC m=+51.202736092 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/234d0ce2-2eb9-4560-9208-1c28699d7263-metrics-tls") pod "dns-default-fzjc7" (UID: "234d0ce2-2eb9-4560-9208-1c28699d7263") : secret "dns-default-metrics-tls" not found Sep 18 12:02:00.198115 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:02:00.198072 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 12:02:00.198115 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:02:00.198091 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8bc5597b7-jd884: secret "image-registry-tls" not found Sep 18 12:02:00.198215 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:02:00.198137 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-tls podName:1224ce74-74ed-47ba-b9f4-3b1c79ef5933 nodeName:}" failed. No retries permitted until 2026-09-18 12:02:08.19812431 +0000 UTC m=+51.202812011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-tls") pod "image-registry-8bc5597b7-jd884" (UID: "1224ce74-74ed-47ba-b9f4-3b1c79ef5933") : secret "image-registry-tls" not found Sep 18 12:02:01.401355 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:01.401325 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:02:03.909313 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:03.909277 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:02:04.009850 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:04.009821 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:02:04.089780 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:04.089747 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:02:04.323166 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:04.323078 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:02:04.426368 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:04.426338 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:02:07.433841 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:07.433800 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:02:07.571280 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:07.571245 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:02:08.252392 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:08.252354 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/234d0ce2-2eb9-4560-9208-1c28699d7263-metrics-tls\") pod \"dns-default-fzjc7\" (UID: \"234d0ce2-2eb9-4560-9208-1c28699d7263\") " pod="openshift-dns/dns-default-fzjc7" Sep 18 12:02:08.252625 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:08.252412 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-tls\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:02:08.252625 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:02:08.252526 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 12:02:08.252625 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:02:08.252534 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 12:02:08.252625 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:02:08.252537 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8bc5597b7-jd884: secret "image-registry-tls" not found Sep 18 12:02:08.252834 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:02:08.252632 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/234d0ce2-2eb9-4560-9208-1c28699d7263-metrics-tls podName:234d0ce2-2eb9-4560-9208-1c28699d7263 nodeName:}" failed. No retries permitted until 2026-09-18 12:02:24.252589426 +0000 UTC m=+67.257277140 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/234d0ce2-2eb9-4560-9208-1c28699d7263-metrics-tls") pod "dns-default-fzjc7" (UID: "234d0ce2-2eb9-4560-9208-1c28699d7263") : secret "dns-default-metrics-tls" not found Sep 18 12:02:08.252834 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:02:08.252674 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-tls podName:1224ce74-74ed-47ba-b9f4-3b1c79ef5933 nodeName:}" failed. No retries permitted until 2026-09-18 12:02:24.252659705 +0000 UTC m=+67.257347440 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-tls") pod "image-registry-8bc5597b7-jd884" (UID: "1224ce74-74ed-47ba-b9f4-3b1c79ef5933") : secret "image-registry-tls" not found Sep 18 12:02:12.264568 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:12.264538 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:02:12.370952 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:12.370920 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:02:13.220155 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:13.220126 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:02:13.296065 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:13.296035 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:02:17.718847 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:17.718813 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5l7rg" Sep 18 12:02:17.913648 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:17.913615 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:02:18.012823 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:18.012741 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:02:23.159212 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:23.159174 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-metrics-certs\") pod \"network-metrics-daemon-lvx4s\" (UID: \"a7f89718-22f1-4c13-aff1-d2fa5ff92c55\") " pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:02:23.159608 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:23.159259 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e518e71-5f13-44e7-aeb5-4e7c1e6d4778-original-pull-secret\") pod \"global-pull-secret-syncer-tpftw\" (UID: \"7e518e71-5f13-44e7-aeb5-4e7c1e6d4778\") " pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:02:23.162540 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:23.162519 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 12:02:23.162731 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:23.162720 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 12:02:23.169845 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:02:23.169828 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 18 12:02:23.169922 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:02:23.169909 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-metrics-certs podName:a7f89718-22f1-4c13-aff1-d2fa5ff92c55 nodeName:}" failed. No retries permitted until 2026-09-18 12:03:27.16988704 +0000 UTC m=+130.174574757 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-metrics-certs") pod "network-metrics-daemon-lvx4s" (UID: "a7f89718-22f1-4c13-aff1-d2fa5ff92c55") : secret "metrics-daemon-secret" not found Sep 18 12:02:23.173093 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:23.173059 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e518e71-5f13-44e7-aeb5-4e7c1e6d4778-original-pull-secret\") pod \"global-pull-secret-syncer-tpftw\" (UID: \"7e518e71-5f13-44e7-aeb5-4e7c1e6d4778\") " pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:02:23.361146 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:23.361103 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x82bn\" (UniqueName: \"kubernetes.io/projected/91599aa3-f0bc-4a4a-afa3-362851ac1783-kube-api-access-x82bn\") pod \"network-check-target-sbkdt\" (UID: \"91599aa3-f0bc-4a4a-afa3-362851ac1783\") " pod="openshift-network-diagnostics/network-check-target-sbkdt" Sep 18 12:02:23.364361 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:23.364337 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 12:02:23.374580 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:23.374558 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 12:02:23.382212 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:23.382187 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpftw" Sep 18 12:02:23.385128 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:23.384806 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x82bn\" (UniqueName: \"kubernetes.io/projected/91599aa3-f0bc-4a4a-afa3-362851ac1783-kube-api-access-x82bn\") pod \"network-check-target-sbkdt\" (UID: \"91599aa3-f0bc-4a4a-afa3-362851ac1783\") " pod="openshift-network-diagnostics/network-check-target-sbkdt" Sep 18 12:02:23.656961 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:23.656931 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tpftw"] Sep 18 12:02:23.659847 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:02:23.659822 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e518e71_5f13_44e7_aeb5_4e7c1e6d4778.slice/crio-688bdd424538b3777c3ff85b7fdb831df764536fcb19d8877898034f0e27af9c WatchSource:0}: Error finding container 688bdd424538b3777c3ff85b7fdb831df764536fcb19d8877898034f0e27af9c: Status 404 returned error can't find the container with id 688bdd424538b3777c3ff85b7fdb831df764536fcb19d8877898034f0e27af9c Sep 18 12:02:23.675404 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:23.675382 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ktknz\"" Sep 18 12:02:23.683010 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:23.682966 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sbkdt" Sep 18 12:02:23.803614 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:23.803584 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tpftw" event={"ID":"7e518e71-5f13-44e7-aeb5-4e7c1e6d4778","Type":"ContainerStarted","Data":"688bdd424538b3777c3ff85b7fdb831df764536fcb19d8877898034f0e27af9c"} Sep 18 12:02:23.956002 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:23.955978 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sbkdt"] Sep 18 12:02:23.958074 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:02:23.958046 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91599aa3_f0bc_4a4a_afa3_362851ac1783.slice/crio-e64e0206f8f4a38cf5c50ea1446f13a11f89759fdcb38549e6039b2391e446fd WatchSource:0}: Error finding container e64e0206f8f4a38cf5c50ea1446f13a11f89759fdcb38549e6039b2391e446fd: Status 404 returned error can't find the container with id e64e0206f8f4a38cf5c50ea1446f13a11f89759fdcb38549e6039b2391e446fd Sep 18 12:02:24.267809 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:24.267715 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-tls\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:02:24.267809 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:24.267779 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/234d0ce2-2eb9-4560-9208-1c28699d7263-metrics-tls\") pod \"dns-default-fzjc7\" (UID: \"234d0ce2-2eb9-4560-9208-1c28699d7263\") " pod="openshift-dns/dns-default-fzjc7" Sep 18 12:02:24.268213 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:02:24.267868 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 12:02:24.268213 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:02:24.267875 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 12:02:24.268213 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:02:24.267893 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8bc5597b7-jd884: secret "image-registry-tls" not found Sep 18 12:02:24.268213 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:02:24.267922 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/234d0ce2-2eb9-4560-9208-1c28699d7263-metrics-tls podName:234d0ce2-2eb9-4560-9208-1c28699d7263 nodeName:}" failed. No retries permitted until 2026-09-18 12:02:56.267907814 +0000 UTC m=+99.272595515 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/234d0ce2-2eb9-4560-9208-1c28699d7263-metrics-tls") pod "dns-default-fzjc7" (UID: "234d0ce2-2eb9-4560-9208-1c28699d7263") : secret "dns-default-metrics-tls" not found Sep 18 12:02:24.268213 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:02:24.267940 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-tls podName:1224ce74-74ed-47ba-b9f4-3b1c79ef5933 nodeName:}" failed. No retries permitted until 2026-09-18 12:02:56.267927477 +0000 UTC m=+99.272615194 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-tls") pod "image-registry-8bc5597b7-jd884" (UID: "1224ce74-74ed-47ba-b9f4-3b1c79ef5933") : secret "image-registry-tls" not found Sep 18 12:02:24.811394 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:24.811347 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sbkdt" event={"ID":"91599aa3-f0bc-4a4a-afa3-362851ac1783","Type":"ContainerStarted","Data":"e64e0206f8f4a38cf5c50ea1446f13a11f89759fdcb38549e6039b2391e446fd"} Sep 18 12:02:25.002838 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:25.002772 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:02:25.109916 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:25.109823 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:02:26.980428 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:26.980387 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:02:27.081915 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:27.081874 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:02:28.824632 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:28.824590 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tpftw" event={"ID":"7e518e71-5f13-44e7-aeb5-4e7c1e6d4778","Type":"ContainerStarted","Data":"7df62eeff2926da1f4f2156860c787fe576d23327120ee93d6712f4d2d85ffc3"} Sep 18 12:02:28.826250 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:28.826222 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sbkdt" event={"ID":"91599aa3-f0bc-4a4a-afa3-362851ac1783","Type":"ContainerStarted","Data":"cbb42d2a12daf1ab096adf4398118fe7cbcfdedcfc95ba05f822c5761a021bc1"} Sep 18 12:02:28.826375 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:28.826364 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-sbkdt" Sep 18 12:02:28.843390 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:28.843350 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tpftw" podStartSLOduration=65.896256627 podStartE2EDuration="1m10.84333735s" totalImagesPullingTime="4.947080723s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 12:01:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:02:28.842329522 +0000 UTC m=+71.847017245" watchObservedRunningTime="2026-09-18 12:02:28.84333735 +0000 UTC m=+71.848025073" Sep 18 12:02:28.862948 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:28.862864 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-sbkdt" podStartSLOduration=66.215316754 podStartE2EDuration="1m10.862850482s" totalImagesPullingTime="4.647533728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 12:01:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:02:28.861646664 +0000 UTC m=+71.866334392" watchObservedRunningTime="2026-09-18 12:02:28.862850482 +0000 UTC m=+71.867538204" Sep 18 12:02:33.170141 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:33.170103 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:02:33.290883 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:33.290853 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:02:56.299143 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:56.299109 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-tls\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:02:56.299553 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:56.299164 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/234d0ce2-2eb9-4560-9208-1c28699d7263-metrics-tls\") pod \"dns-default-fzjc7\" (UID: \"234d0ce2-2eb9-4560-9208-1c28699d7263\") " pod="openshift-dns/dns-default-fzjc7" Sep 18 12:02:56.299553 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:02:56.299262 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 12:02:56.299553 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:02:56.299265 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 12:02:56.299553 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:02:56.299277 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8bc5597b7-jd884: secret "image-registry-tls" not found Sep 18 12:02:56.299553 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:02:56.299345 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-tls podName:1224ce74-74ed-47ba-b9f4-3b1c79ef5933 nodeName:}" failed. No retries permitted until 2026-09-18 12:04:00.299326202 +0000 UTC m=+163.304013918 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-tls") pod "image-registry-8bc5597b7-jd884" (UID: "1224ce74-74ed-47ba-b9f4-3b1c79ef5933") : secret "image-registry-tls" not found Sep 18 12:02:56.299553 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:02:56.299358 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/234d0ce2-2eb9-4560-9208-1c28699d7263-metrics-tls podName:234d0ce2-2eb9-4560-9208-1c28699d7263 nodeName:}" failed. No retries permitted until 2026-09-18 12:04:00.299352824 +0000 UTC m=+163.304040525 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/234d0ce2-2eb9-4560-9208-1c28699d7263-metrics-tls") pod "dns-default-fzjc7" (UID: "234d0ce2-2eb9-4560-9208-1c28699d7263") : secret "dns-default-metrics-tls" not found Sep 18 12:02:59.830923 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:02:59.830896 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-sbkdt" Sep 18 12:03:06.518230 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:06.518198 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:09.088268 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.088219 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:09.146225 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.146190 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-2fxjh"] Sep 18 12:03:09.148393 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.148372 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-2fxjh" Sep 18 12:03:09.150824 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.150807 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-qhs47\"" Sep 18 12:03:09.164003 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.163981 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-2fxjh"] Sep 18 12:03:09.168898 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.168877 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:09.290532 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.290497 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glbz2\" (UniqueName: \"kubernetes.io/projected/e5aba236-fa70-4052-b440-0092f82308c0-kube-api-access-glbz2\") pod \"network-check-source-7cbc45fddc-2fxjh\" (UID: \"e5aba236-fa70-4052-b440-0092f82308c0\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-2fxjh" Sep 18 12:03:09.390912 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.390880 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glbz2\" (UniqueName: \"kubernetes.io/projected/e5aba236-fa70-4052-b440-0092f82308c0-kube-api-access-glbz2\") pod \"network-check-source-7cbc45fddc-2fxjh\" (UID: \"e5aba236-fa70-4052-b440-0092f82308c0\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-2fxjh" Sep 18 12:03:09.406591 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.406568 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glbz2\" (UniqueName: \"kubernetes.io/projected/e5aba236-fa70-4052-b440-0092f82308c0-kube-api-access-glbz2\") pod \"network-check-source-7cbc45fddc-2fxjh\" (UID: \"e5aba236-fa70-4052-b440-0092f82308c0\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-2fxjh" Sep 18 12:03:09.457026 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.456995 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-2fxjh" Sep 18 12:03:09.513225 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.509983 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-fc7vn"] Sep 18 12:03:09.513225 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.512393 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-fc7vn" Sep 18 12:03:09.515807 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.515780 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 18 12:03:09.516069 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.516048 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 18 12:03:09.516259 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.516242 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 18 12:03:09.516505 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.516486 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 18 12:03:09.522572 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.519764 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-jglk5\"" Sep 18 12:03:09.525549 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.525532 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 18 12:03:09.534528 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.533879 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-fc7vn"] Sep 18 12:03:09.592950 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.592922 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6629efd-ffee-4ff0-bb6c-530f4ac96793-serving-cert\") pod \"console-operator-fd4bb46c-fc7vn\" (UID: \"a6629efd-ffee-4ff0-bb6c-530f4ac96793\") " pod="openshift-console-operator/console-operator-fd4bb46c-fc7vn" Sep 18 12:03:09.593118 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.592991 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a6629efd-ffee-4ff0-bb6c-530f4ac96793-trusted-ca\") pod \"console-operator-fd4bb46c-fc7vn\" (UID: \"a6629efd-ffee-4ff0-bb6c-530f4ac96793\") " pod="openshift-console-operator/console-operator-fd4bb46c-fc7vn" Sep 18 12:03:09.593118 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.593042 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9kjr\" (UniqueName: \"kubernetes.io/projected/a6629efd-ffee-4ff0-bb6c-530f4ac96793-kube-api-access-c9kjr\") pod \"console-operator-fd4bb46c-fc7vn\" (UID: \"a6629efd-ffee-4ff0-bb6c-530f4ac96793\") " pod="openshift-console-operator/console-operator-fd4bb46c-fc7vn" Sep 18 12:03:09.593118 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.593071 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a6629efd-ffee-4ff0-bb6c-530f4ac96793-config\") pod \"console-operator-fd4bb46c-fc7vn\" (UID: \"a6629efd-ffee-4ff0-bb6c-530f4ac96793\") " pod="openshift-console-operator/console-operator-fd4bb46c-fc7vn" Sep 18 12:03:09.693829 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.693752 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6629efd-ffee-4ff0-bb6c-530f4ac96793-serving-cert\") pod \"console-operator-fd4bb46c-fc7vn\" (UID: \"a6629efd-ffee-4ff0-bb6c-530f4ac96793\") " pod="openshift-console-operator/console-operator-fd4bb46c-fc7vn" Sep 18 12:03:09.693829 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.693806 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a6629efd-ffee-4ff0-bb6c-530f4ac96793-trusted-ca\") pod \"console-operator-fd4bb46c-fc7vn\" (UID: \"a6629efd-ffee-4ff0-bb6c-530f4ac96793\") " pod="openshift-console-operator/console-operator-fd4bb46c-fc7vn" Sep 18 12:03:09.694014 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.693917 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9kjr\" (UniqueName: \"kubernetes.io/projected/a6629efd-ffee-4ff0-bb6c-530f4ac96793-kube-api-access-c9kjr\") pod \"console-operator-fd4bb46c-fc7vn\" (UID: \"a6629efd-ffee-4ff0-bb6c-530f4ac96793\") " pod="openshift-console-operator/console-operator-fd4bb46c-fc7vn" Sep 18 12:03:09.694014 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.693951 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a6629efd-ffee-4ff0-bb6c-530f4ac96793-config\") pod \"console-operator-fd4bb46c-fc7vn\" (UID: \"a6629efd-ffee-4ff0-bb6c-530f4ac96793\") " pod="openshift-console-operator/console-operator-fd4bb46c-fc7vn" Sep 18 12:03:09.694486 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.694468 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a6629efd-ffee-4ff0-bb6c-530f4ac96793-config\") pod \"console-operator-fd4bb46c-fc7vn\" (UID: \"a6629efd-ffee-4ff0-bb6c-530f4ac96793\") " pod="openshift-console-operator/console-operator-fd4bb46c-fc7vn" Sep 18 12:03:09.694603 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.694588 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a6629efd-ffee-4ff0-bb6c-530f4ac96793-trusted-ca\") pod \"console-operator-fd4bb46c-fc7vn\" (UID: \"a6629efd-ffee-4ff0-bb6c-530f4ac96793\") " pod="openshift-console-operator/console-operator-fd4bb46c-fc7vn" Sep 18 12:03:09.696206 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.696186 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6629efd-ffee-4ff0-bb6c-530f4ac96793-serving-cert\") pod \"console-operator-fd4bb46c-fc7vn\" (UID: \"a6629efd-ffee-4ff0-bb6c-530f4ac96793\") " pod="openshift-console-operator/console-operator-fd4bb46c-fc7vn" Sep 18 12:03:09.702936 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.702915 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9kjr\" (UniqueName: \"kubernetes.io/projected/a6629efd-ffee-4ff0-bb6c-530f4ac96793-kube-api-access-c9kjr\") pod \"console-operator-fd4bb46c-fc7vn\" (UID: \"a6629efd-ffee-4ff0-bb6c-530f4ac96793\") " pod="openshift-console-operator/console-operator-fd4bb46c-fc7vn" Sep 18 12:03:09.744388 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.744361 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-2fxjh"] Sep 18 12:03:09.747177 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:03:09.747155 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5aba236_fa70_4052_b440_0092f82308c0.slice/crio-88669195ea42c6e10f886f77b414d54ad4ccb6fb0f480cc92359a5303efd5586 WatchSource:0}: Error finding container 88669195ea42c6e10f886f77b414d54ad4ccb6fb0f480cc92359a5303efd5586: Status 404 returned error can't find the container with id 88669195ea42c6e10f886f77b414d54ad4ccb6fb0f480cc92359a5303efd5586 Sep 18 12:03:09.833689 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.833657 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-fc7vn" Sep 18 12:03:09.930689 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.930654 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-2fxjh" event={"ID":"e5aba236-fa70-4052-b440-0092f82308c0","Type":"ContainerStarted","Data":"a424ceb197278ab5e76513ea752470643cd49607043f562f50cccdbc5aa352d5"} Sep 18 12:03:09.930847 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.930715 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-2fxjh" event={"ID":"e5aba236-fa70-4052-b440-0092f82308c0","Type":"ContainerStarted","Data":"88669195ea42c6e10f886f77b414d54ad4ccb6fb0f480cc92359a5303efd5586"} Sep 18 12:03:09.948676 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:09.948517 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-2fxjh" podStartSLOduration=0.948500531 podStartE2EDuration="948.500531ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 12:03:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:03:09.94805138 +0000 UTC m=+112.952739105" watchObservedRunningTime="2026-09-18 12:03:09.948500531 +0000 UTC m=+112.953188255" Sep 18 12:03:10.104738 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:10.104702 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-fc7vn"] Sep 18 12:03:10.107497 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:03:10.107470 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6629efd_ffee_4ff0_bb6c_530f4ac96793.slice/crio-e6406bd3ed21649a7a892f3109a2c28ee6e49d56c3acd16d839ce83e630249d3 WatchSource:0}: Error finding container e6406bd3ed21649a7a892f3109a2c28ee6e49d56c3acd16d839ce83e630249d3: Status 404 returned error can't find the container with id e6406bd3ed21649a7a892f3109a2c28ee6e49d56c3acd16d839ce83e630249d3 Sep 18 12:03:10.935114 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:10.935079 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-fc7vn" event={"ID":"a6629efd-ffee-4ff0-bb6c-530f4ac96793","Type":"ContainerStarted","Data":"e6406bd3ed21649a7a892f3109a2c28ee6e49d56c3acd16d839ce83e630249d3"} Sep 18 12:03:11.299665 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:11.299576 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:11.404536 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:11.404506 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:12.941842 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:12.941815 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-fc7vn_a6629efd-ffee-4ff0-bb6c-530f4ac96793/console-operator/0.log" Sep 18 12:03:12.942216 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:12.941853 2578 generic.go:356] "Generic (PLEG): container finished" podID="a6629efd-ffee-4ff0-bb6c-530f4ac96793" containerID="1931d879971755d22894e3de8b35844f80bbff77ae4abeb1a6298195e4461c3a" exitCode=255 Sep 18 12:03:12.942216 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:12.941893 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-fc7vn" event={"ID":"a6629efd-ffee-4ff0-bb6c-530f4ac96793","Type":"ContainerDied","Data":"1931d879971755d22894e3de8b35844f80bbff77ae4abeb1a6298195e4461c3a"} Sep 18 12:03:12.942216 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:12.942107 2578 scope.go:117] "RemoveContainer" containerID="1931d879971755d22894e3de8b35844f80bbff77ae4abeb1a6298195e4461c3a" Sep 18 12:03:13.946768 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:13.946742 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-fc7vn_a6629efd-ffee-4ff0-bb6c-530f4ac96793/console-operator/1.log" Sep 18 12:03:13.947154 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:13.947095 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-fc7vn_a6629efd-ffee-4ff0-bb6c-530f4ac96793/console-operator/0.log" Sep 18 12:03:13.947154 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:13.947130 2578 generic.go:356] "Generic (PLEG): container finished" podID="a6629efd-ffee-4ff0-bb6c-530f4ac96793" containerID="ef79205093c3bfd8c49cb1b18f93647704af797c3679f47600954e1cd25ef4ac" exitCode=255 Sep 18 12:03:13.947229 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:13.947189 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-fc7vn" event={"ID":"a6629efd-ffee-4ff0-bb6c-530f4ac96793","Type":"ContainerDied","Data":"ef79205093c3bfd8c49cb1b18f93647704af797c3679f47600954e1cd25ef4ac"} Sep 18 12:03:13.947273 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:13.947260 2578 scope.go:117] "RemoveContainer" containerID="1931d879971755d22894e3de8b35844f80bbff77ae4abeb1a6298195e4461c3a" Sep 18 12:03:13.947481 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:13.947468 2578 scope.go:117] "RemoveContainer" containerID="ef79205093c3bfd8c49cb1b18f93647704af797c3679f47600954e1cd25ef4ac" Sep 18 12:03:13.947674 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:03:13.947656 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-fc7vn_openshift-console-operator(a6629efd-ffee-4ff0-bb6c-530f4ac96793)\"" pod="openshift-console-operator/console-operator-fd4bb46c-fc7vn" podUID="a6629efd-ffee-4ff0-bb6c-530f4ac96793" Sep 18 12:03:14.299172 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:14.299084 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:14.396637 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:14.396593 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:14.951061 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:14.951040 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-fc7vn_a6629efd-ffee-4ff0-bb6c-530f4ac96793/console-operator/1.log" Sep 18 12:03:14.951429 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:14.951376 2578 scope.go:117] "RemoveContainer" containerID="ef79205093c3bfd8c49cb1b18f93647704af797c3679f47600954e1cd25ef4ac" Sep 18 12:03:14.951574 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:03:14.951556 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-fc7vn_openshift-console-operator(a6629efd-ffee-4ff0-bb6c-530f4ac96793)\"" pod="openshift-console-operator/console-operator-fd4bb46c-fc7vn" podUID="a6629efd-ffee-4ff0-bb6c-530f4ac96793" Sep 18 12:03:15.041303 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:15.041262 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:15.195116 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:15.195085 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:15.228104 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:15.228017 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-992hx"] Sep 18 12:03:15.230781 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:15.230759 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-992hx" Sep 18 12:03:15.233328 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:15.233311 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-krrgg\"" Sep 18 12:03:15.233469 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:15.233408 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 18 12:03:15.233563 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:15.233532 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 18 12:03:15.233631 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:15.233608 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 18 12:03:15.233685 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:15.233647 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 18 12:03:15.259583 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:15.259552 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-992hx"] Sep 18 12:03:15.334405 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:15.334371 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6663817-d441-4a33-82a1-c7cb1d185808-data-volume\") pod \"insights-runtime-extractor-992hx\" (UID: \"d6663817-d441-4a33-82a1-c7cb1d185808\") " pod="openshift-insights/insights-runtime-extractor-992hx" Sep 18 12:03:15.334727 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:15.334704 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jmvb\" (UniqueName: \"kubernetes.io/projected/d6663817-d441-4a33-82a1-c7cb1d185808-kube-api-access-6jmvb\") pod \"insights-runtime-extractor-992hx\" (UID: \"d6663817-d441-4a33-82a1-c7cb1d185808\") " pod="openshift-insights/insights-runtime-extractor-992hx" Sep 18 12:03:15.334845 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:15.334831 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6663817-d441-4a33-82a1-c7cb1d185808-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-992hx\" (UID: \"d6663817-d441-4a33-82a1-c7cb1d185808\") " pod="openshift-insights/insights-runtime-extractor-992hx" Sep 18 12:03:15.334949 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:15.334935 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6663817-d441-4a33-82a1-c7cb1d185808-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-992hx\" (UID: \"d6663817-d441-4a33-82a1-c7cb1d185808\") " pod="openshift-insights/insights-runtime-extractor-992hx" Sep 18 12:03:15.335103 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:15.335086 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d6663817-d441-4a33-82a1-c7cb1d185808-crio-socket\") pod \"insights-runtime-extractor-992hx\" (UID: \"d6663817-d441-4a33-82a1-c7cb1d185808\") " pod="openshift-insights/insights-runtime-extractor-992hx" Sep 18 12:03:15.389336 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:15.389304 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:15.436432 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:15.436397 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6663817-d441-4a33-82a1-c7cb1d185808-data-volume\") pod \"insights-runtime-extractor-992hx\" (UID: \"d6663817-d441-4a33-82a1-c7cb1d185808\") " pod="openshift-insights/insights-runtime-extractor-992hx" Sep 18 12:03:15.436547 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:15.436499 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jmvb\" (UniqueName: \"kubernetes.io/projected/d6663817-d441-4a33-82a1-c7cb1d185808-kube-api-access-6jmvb\") pod \"insights-runtime-extractor-992hx\" (UID: \"d6663817-d441-4a33-82a1-c7cb1d185808\") " pod="openshift-insights/insights-runtime-extractor-992hx" Sep 18 12:03:15.436547 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:15.436522 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6663817-d441-4a33-82a1-c7cb1d185808-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-992hx\" (UID: \"d6663817-d441-4a33-82a1-c7cb1d185808\") " pod="openshift-insights/insights-runtime-extractor-992hx" Sep 18 12:03:15.436547 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:15.436539 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6663817-d441-4a33-82a1-c7cb1d185808-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-992hx\" (UID: \"d6663817-d441-4a33-82a1-c7cb1d185808\") " pod="openshift-insights/insights-runtime-extractor-992hx" Sep 18 12:03:15.436697 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:15.436584 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d6663817-d441-4a33-82a1-c7cb1d185808-crio-socket\") pod \"insights-runtime-extractor-992hx\" (UID: \"d6663817-d441-4a33-82a1-c7cb1d185808\") " pod="openshift-insights/insights-runtime-extractor-992hx" Sep 18 12:03:15.436697 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:03:15.436672 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 12:03:15.436788 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:03:15.436715 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 12:03:15.436788 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:15.436676 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d6663817-d441-4a33-82a1-c7cb1d185808-crio-socket\") pod \"insights-runtime-extractor-992hx\" (UID: \"d6663817-d441-4a33-82a1-c7cb1d185808\") " pod="openshift-insights/insights-runtime-extractor-992hx" Sep 18 12:03:15.436788 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:15.436746 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6663817-d441-4a33-82a1-c7cb1d185808-data-volume\") pod \"insights-runtime-extractor-992hx\" (UID: \"d6663817-d441-4a33-82a1-c7cb1d185808\") " pod="openshift-insights/insights-runtime-extractor-992hx" Sep 18 12:03:15.436788 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:03:15.436771 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6663817-d441-4a33-82a1-c7cb1d185808-kube-rbac-proxy-cm podName:d6663817-d441-4a33-82a1-c7cb1d185808 nodeName:}" failed. No retries permitted until 2026-09-18 12:03:15.936749463 +0000 UTC m=+118.941437187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d6663817-d441-4a33-82a1-c7cb1d185808-kube-rbac-proxy-cm") pod "insights-runtime-extractor-992hx" (UID: "d6663817-d441-4a33-82a1-c7cb1d185808") : configmap "kube-rbac-proxy" not found Sep 18 12:03:15.436937 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:03:15.436792 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6663817-d441-4a33-82a1-c7cb1d185808-insights-runtime-extractor-tls podName:d6663817-d441-4a33-82a1-c7cb1d185808 nodeName:}" failed. No retries permitted until 2026-09-18 12:03:15.936782515 +0000 UTC m=+118.941470219 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6663817-d441-4a33-82a1-c7cb1d185808-insights-runtime-extractor-tls") pod "insights-runtime-extractor-992hx" (UID: "d6663817-d441-4a33-82a1-c7cb1d185808") : secret "insights-runtime-extractor-tls" not found Sep 18 12:03:15.448907 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:15.448884 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jmvb\" (UniqueName: \"kubernetes.io/projected/d6663817-d441-4a33-82a1-c7cb1d185808-kube-api-access-6jmvb\") pod \"insights-runtime-extractor-992hx\" (UID: \"d6663817-d441-4a33-82a1-c7cb1d185808\") " pod="openshift-insights/insights-runtime-extractor-992hx" Sep 18 12:03:15.940034 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:15.940004 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6663817-d441-4a33-82a1-c7cb1d185808-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-992hx\" (UID: \"d6663817-d441-4a33-82a1-c7cb1d185808\") " pod="openshift-insights/insights-runtime-extractor-992hx" Sep 18 12:03:15.940034 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:15.940036 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6663817-d441-4a33-82a1-c7cb1d185808-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-992hx\" (UID: \"d6663817-d441-4a33-82a1-c7cb1d185808\") " pod="openshift-insights/insights-runtime-extractor-992hx" Sep 18 12:03:15.940275 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:03:15.940129 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 12:03:15.940275 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:03:15.940152 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 12:03:15.940275 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:03:15.940189 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6663817-d441-4a33-82a1-c7cb1d185808-kube-rbac-proxy-cm podName:d6663817-d441-4a33-82a1-c7cb1d185808 nodeName:}" failed. No retries permitted until 2026-09-18 12:03:16.940176034 +0000 UTC m=+119.944863736 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d6663817-d441-4a33-82a1-c7cb1d185808-kube-rbac-proxy-cm") pod "insights-runtime-extractor-992hx" (UID: "d6663817-d441-4a33-82a1-c7cb1d185808") : configmap "kube-rbac-proxy" not found Sep 18 12:03:15.940275 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:03:15.940202 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6663817-d441-4a33-82a1-c7cb1d185808-insights-runtime-extractor-tls podName:d6663817-d441-4a33-82a1-c7cb1d185808 nodeName:}" failed. No retries permitted until 2026-09-18 12:03:16.940196462 +0000 UTC m=+119.944884164 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6663817-d441-4a33-82a1-c7cb1d185808-insights-runtime-extractor-tls") pod "insights-runtime-extractor-992hx" (UID: "d6663817-d441-4a33-82a1-c7cb1d185808") : secret "insights-runtime-extractor-tls" not found Sep 18 12:03:16.000869 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.000841 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-qg6qk"] Sep 18 12:03:16.002933 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.002918 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-qg6qk" Sep 18 12:03:16.005773 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.005756 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 18 12:03:16.006818 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.006803 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-5n656\"" Sep 18 12:03:16.006903 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.006839 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 18 12:03:16.014312 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.014292 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-qg6qk"] Sep 18 12:03:16.049450 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.049420 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:16.133652 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.133629 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:16.141929 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.141907 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfkdr\" (UniqueName: \"kubernetes.io/projected/ea6a79a3-3841-46e7-b434-aaeebd930356-kube-api-access-mfkdr\") pod \"migrator-76794cbd6c-qg6qk\" (UID: \"ea6a79a3-3841-46e7-b434-aaeebd930356\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-qg6qk" Sep 18 12:03:16.243160 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.243089 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfkdr\" (UniqueName: \"kubernetes.io/projected/ea6a79a3-3841-46e7-b434-aaeebd930356-kube-api-access-mfkdr\") pod \"migrator-76794cbd6c-qg6qk\" (UID: \"ea6a79a3-3841-46e7-b434-aaeebd930356\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-qg6qk" Sep 18 12:03:16.252365 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.252338 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfkdr\" (UniqueName: \"kubernetes.io/projected/ea6a79a3-3841-46e7-b434-aaeebd930356-kube-api-access-mfkdr\") pod \"migrator-76794cbd6c-qg6qk\" (UID: \"ea6a79a3-3841-46e7-b434-aaeebd930356\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-qg6qk" Sep 18 12:03:16.311619 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.311593 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-qg6qk" Sep 18 12:03:16.579967 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.579892 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-qg6qk"] Sep 18 12:03:16.582971 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:03:16.582948 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea6a79a3_3841_46e7_b434_aaeebd930356.slice/crio-2620d4a40b513f40e116d081b2f14543818e6034c0217b0ae822a7b9ef039969 WatchSource:0}: Error finding container 2620d4a40b513f40e116d081b2f14543818e6034c0217b0ae822a7b9ef039969: Status 404 returned error can't find the container with id 2620d4a40b513f40e116d081b2f14543818e6034c0217b0ae822a7b9ef039969 Sep 18 12:03:16.587095 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.587074 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-pjpqc"] Sep 18 12:03:16.589319 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.589304 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-pjpqc" Sep 18 12:03:16.592098 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.592081 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 18 12:03:16.592184 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.592082 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 18 12:03:16.592387 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.592372 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-j2nsg\"" Sep 18 12:03:16.592484 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.592406 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 18 12:03:16.592484 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.592472 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 18 12:03:16.599752 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.599732 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-pjpqc"] Sep 18 12:03:16.653722 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.653693 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:16.747394 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.747353 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7d622f8f-3614-4504-8a2b-f75e6aef99ba-signing-key\") pod \"service-ca-55f6fc7b86-pjpqc\" (UID: \"7d622f8f-3614-4504-8a2b-f75e6aef99ba\") " pod="openshift-service-ca/service-ca-55f6fc7b86-pjpqc" Sep 18 12:03:16.747550 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.747407 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tqcd\" (UniqueName: \"kubernetes.io/projected/7d622f8f-3614-4504-8a2b-f75e6aef99ba-kube-api-access-4tqcd\") pod \"service-ca-55f6fc7b86-pjpqc\" (UID: \"7d622f8f-3614-4504-8a2b-f75e6aef99ba\") " pod="openshift-service-ca/service-ca-55f6fc7b86-pjpqc" Sep 18 12:03:16.747550 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.747461 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7d622f8f-3614-4504-8a2b-f75e6aef99ba-signing-cabundle\") pod \"service-ca-55f6fc7b86-pjpqc\" (UID: \"7d622f8f-3614-4504-8a2b-f75e6aef99ba\") " pod="openshift-service-ca/service-ca-55f6fc7b86-pjpqc" Sep 18 12:03:16.754294 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.754262 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:16.847795 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.847725 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tqcd\" (UniqueName: \"kubernetes.io/projected/7d622f8f-3614-4504-8a2b-f75e6aef99ba-kube-api-access-4tqcd\") pod \"service-ca-55f6fc7b86-pjpqc\" (UID: \"7d622f8f-3614-4504-8a2b-f75e6aef99ba\") " pod="openshift-service-ca/service-ca-55f6fc7b86-pjpqc" Sep 18 12:03:16.847795 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.847757 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7d622f8f-3614-4504-8a2b-f75e6aef99ba-signing-cabundle\") pod \"service-ca-55f6fc7b86-pjpqc\" (UID: \"7d622f8f-3614-4504-8a2b-f75e6aef99ba\") " pod="openshift-service-ca/service-ca-55f6fc7b86-pjpqc" Sep 18 12:03:16.847967 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.847843 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7d622f8f-3614-4504-8a2b-f75e6aef99ba-signing-key\") pod \"service-ca-55f6fc7b86-pjpqc\" (UID: \"7d622f8f-3614-4504-8a2b-f75e6aef99ba\") " pod="openshift-service-ca/service-ca-55f6fc7b86-pjpqc" Sep 18 12:03:16.848568 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.848551 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7d622f8f-3614-4504-8a2b-f75e6aef99ba-signing-cabundle\") pod \"service-ca-55f6fc7b86-pjpqc\" (UID: \"7d622f8f-3614-4504-8a2b-f75e6aef99ba\") " pod="openshift-service-ca/service-ca-55f6fc7b86-pjpqc" Sep 18 12:03:16.850391 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.850374 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7d622f8f-3614-4504-8a2b-f75e6aef99ba-signing-key\") pod \"service-ca-55f6fc7b86-pjpqc\" (UID: \"7d622f8f-3614-4504-8a2b-f75e6aef99ba\") " pod="openshift-service-ca/service-ca-55f6fc7b86-pjpqc" Sep 18 12:03:16.857083 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.857051 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tqcd\" (UniqueName: \"kubernetes.io/projected/7d622f8f-3614-4504-8a2b-f75e6aef99ba-kube-api-access-4tqcd\") pod \"service-ca-55f6fc7b86-pjpqc\" (UID: \"7d622f8f-3614-4504-8a2b-f75e6aef99ba\") " pod="openshift-service-ca/service-ca-55f6fc7b86-pjpqc" Sep 18 12:03:16.897973 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.897950 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-pjpqc" Sep 18 12:03:16.949009 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.948975 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6663817-d441-4a33-82a1-c7cb1d185808-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-992hx\" (UID: \"d6663817-d441-4a33-82a1-c7cb1d185808\") " pod="openshift-insights/insights-runtime-extractor-992hx" Sep 18 12:03:16.949127 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.949027 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6663817-d441-4a33-82a1-c7cb1d185808-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-992hx\" (UID: \"d6663817-d441-4a33-82a1-c7cb1d185808\") " pod="openshift-insights/insights-runtime-extractor-992hx" Sep 18 12:03:16.949127 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:03:16.949114 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 12:03:16.949241 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:03:16.949197 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6663817-d441-4a33-82a1-c7cb1d185808-kube-rbac-proxy-cm podName:d6663817-d441-4a33-82a1-c7cb1d185808 nodeName:}" failed. No retries permitted until 2026-09-18 12:03:18.949176789 +0000 UTC m=+121.953864519 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d6663817-d441-4a33-82a1-c7cb1d185808-kube-rbac-proxy-cm") pod "insights-runtime-extractor-992hx" (UID: "d6663817-d441-4a33-82a1-c7cb1d185808") : configmap "kube-rbac-proxy" not found Sep 18 12:03:16.949241 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:03:16.949204 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 12:03:16.949349 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:03:16.949258 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6663817-d441-4a33-82a1-c7cb1d185808-insights-runtime-extractor-tls podName:d6663817-d441-4a33-82a1-c7cb1d185808 nodeName:}" failed. No retries permitted until 2026-09-18 12:03:18.94924062 +0000 UTC m=+121.953928340 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6663817-d441-4a33-82a1-c7cb1d185808-insights-runtime-extractor-tls") pod "insights-runtime-extractor-992hx" (UID: "d6663817-d441-4a33-82a1-c7cb1d185808") : secret "insights-runtime-extractor-tls" not found Sep 18 12:03:16.957711 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:16.957685 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-qg6qk" event={"ID":"ea6a79a3-3841-46e7-b434-aaeebd930356","Type":"ContainerStarted","Data":"2620d4a40b513f40e116d081b2f14543818e6034c0217b0ae822a7b9ef039969"} Sep 18 12:03:17.139122 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:17.139097 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rvwkx_e518b32c-52bd-4209-a275-735bb0a88e9f/dns-node-resolver/0.log" Sep 18 12:03:17.168094 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:17.168070 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-pjpqc"] Sep 18 12:03:17.170871 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:03:17.170843 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d622f8f_3614_4504_8a2b_f75e6aef99ba.slice/crio-6ff1ef5ee829c0053650553f398a293771444ef4f65c7d9422dfbc58d9b93b65 WatchSource:0}: Error finding container 6ff1ef5ee829c0053650553f398a293771444ef4f65c7d9422dfbc58d9b93b65: Status 404 returned error can't find the container with id 6ff1ef5ee829c0053650553f398a293771444ef4f65c7d9422dfbc58d9b93b65 Sep 18 12:03:17.937191 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:17.937162 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-72hfq_dd9664b3-5cd3-4336-9a83-c1641b6801ae/node-ca/0.log" Sep 18 12:03:17.963398 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:17.962884 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-qg6qk" event={"ID":"ea6a79a3-3841-46e7-b434-aaeebd930356","Type":"ContainerStarted","Data":"f639b68a3be42e21e216291d0e93085bc30e10cb44d59bf49fa9bcbcb48b65c5"} Sep 18 12:03:17.963398 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:17.962990 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-qg6qk" event={"ID":"ea6a79a3-3841-46e7-b434-aaeebd930356","Type":"ContainerStarted","Data":"eaf4433b10f938b4677bd3aa7b044d62aa936ee6e01af03ad63a7c03177e58a5"} Sep 18 12:03:17.964305 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:17.964267 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-pjpqc" event={"ID":"7d622f8f-3614-4504-8a2b-f75e6aef99ba","Type":"ContainerStarted","Data":"6ff1ef5ee829c0053650553f398a293771444ef4f65c7d9422dfbc58d9b93b65"} Sep 18 12:03:17.984172 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:17.984121 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-qg6qk" podStartSLOduration=1.942790616 podStartE2EDuration="2.98410803s" totalImagesPullingTime="1.041317414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 12:03:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:03:17.983056463 +0000 UTC m=+120.987744189" watchObservedRunningTime="2026-09-18 12:03:17.98410803 +0000 UTC m=+120.988795755" Sep 18 12:03:18.333546 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:18.333464 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:18.738163 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:18.738127 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7xktt_fcbeeb9d-952c-4a61-a38f-6c338e380647/serve-healthcheck-canary/0.log" Sep 18 12:03:18.966377 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:18.966348 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6663817-d441-4a33-82a1-c7cb1d185808-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-992hx\" (UID: \"d6663817-d441-4a33-82a1-c7cb1d185808\") " pod="openshift-insights/insights-runtime-extractor-992hx" Sep 18 12:03:18.966377 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:18.966381 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6663817-d441-4a33-82a1-c7cb1d185808-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-992hx\" (UID: \"d6663817-d441-4a33-82a1-c7cb1d185808\") " pod="openshift-insights/insights-runtime-extractor-992hx" Sep 18 12:03:18.966684 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:03:18.966498 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 12:03:18.966684 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:03:18.966535 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 12:03:18.966684 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:03:18.966573 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6663817-d441-4a33-82a1-c7cb1d185808-kube-rbac-proxy-cm podName:d6663817-d441-4a33-82a1-c7cb1d185808 nodeName:}" failed. No retries permitted until 2026-09-18 12:03:22.966551676 +0000 UTC m=+125.971239392 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d6663817-d441-4a33-82a1-c7cb1d185808-kube-rbac-proxy-cm") pod "insights-runtime-extractor-992hx" (UID: "d6663817-d441-4a33-82a1-c7cb1d185808") : configmap "kube-rbac-proxy" not found Sep 18 12:03:18.966684 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:03:18.966592 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6663817-d441-4a33-82a1-c7cb1d185808-insights-runtime-extractor-tls podName:d6663817-d441-4a33-82a1-c7cb1d185808 nodeName:}" failed. No retries permitted until 2026-09-18 12:03:22.966583537 +0000 UTC m=+125.971271238 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6663817-d441-4a33-82a1-c7cb1d185808-insights-runtime-extractor-tls") pod "insights-runtime-extractor-992hx" (UID: "d6663817-d441-4a33-82a1-c7cb1d185808") : secret "insights-runtime-extractor-tls" not found Sep 18 12:03:19.834187 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:19.834156 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-fc7vn" Sep 18 12:03:19.834542 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:19.834211 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-fc7vn" Sep 18 12:03:19.834542 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:19.834536 2578 scope.go:117] "RemoveContainer" containerID="ef79205093c3bfd8c49cb1b18f93647704af797c3679f47600954e1cd25ef4ac" Sep 18 12:03:19.834691 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:03:19.834673 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-fc7vn_openshift-console-operator(a6629efd-ffee-4ff0-bb6c-530f4ac96793)\"" pod="openshift-console-operator/console-operator-fd4bb46c-fc7vn" podUID="a6629efd-ffee-4ff0-bb6c-530f4ac96793" Sep 18 12:03:19.972328 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:19.972287 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-pjpqc" event={"ID":"7d622f8f-3614-4504-8a2b-f75e6aef99ba","Type":"ContainerStarted","Data":"539de267c86e832274a4a31a8e91b46b10a386f6cf1387ca7a4ac7c344e12cdb"} Sep 18 12:03:19.993223 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:19.993170 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-pjpqc" podStartSLOduration=2.182856144 podStartE2EDuration="3.99315516s" totalImagesPullingTime="1.810299016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 12:03:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:03:19.991808156 +0000 UTC m=+122.996495878" watchObservedRunningTime="2026-09-18 12:03:19.99315516 +0000 UTC m=+122.997842882" Sep 18 12:03:20.274672 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:20.274638 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:20.530155 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:20.530066 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:20.709470 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:20.709421 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:20.816090 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:20.815971 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:20.963451 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:20.963395 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:21.097963 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:21.097844 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:21.331002 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:21.330963 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:22.521997 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:22.521966 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:22.735846 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:22.735815 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:22.947224 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:22.947195 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:23.001086 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:23.001055 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6663817-d441-4a33-82a1-c7cb1d185808-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-992hx\" (UID: \"d6663817-d441-4a33-82a1-c7cb1d185808\") " pod="openshift-insights/insights-runtime-extractor-992hx" Sep 18 12:03:23.001086 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:23.001085 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6663817-d441-4a33-82a1-c7cb1d185808-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-992hx\" (UID: \"d6663817-d441-4a33-82a1-c7cb1d185808\") " pod="openshift-insights/insights-runtime-extractor-992hx" Sep 18 12:03:23.001258 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:03:23.001168 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 12:03:23.001258 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:03:23.001228 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6663817-d441-4a33-82a1-c7cb1d185808-kube-rbac-proxy-cm podName:d6663817-d441-4a33-82a1-c7cb1d185808 nodeName:}" failed. No retries permitted until 2026-09-18 12:03:31.001211282 +0000 UTC m=+134.005898983 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d6663817-d441-4a33-82a1-c7cb1d185808-kube-rbac-proxy-cm") pod "insights-runtime-extractor-992hx" (UID: "d6663817-d441-4a33-82a1-c7cb1d185808") : configmap "kube-rbac-proxy" not found Sep 18 12:03:23.001258 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:03:23.001238 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 12:03:23.001399 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:03:23.001284 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6663817-d441-4a33-82a1-c7cb1d185808-insights-runtime-extractor-tls podName:d6663817-d441-4a33-82a1-c7cb1d185808 nodeName:}" failed. No retries permitted until 2026-09-18 12:03:31.001267237 +0000 UTC m=+134.005954938 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6663817-d441-4a33-82a1-c7cb1d185808-insights-runtime-extractor-tls") pod "insights-runtime-extractor-992hx" (UID: "d6663817-d441-4a33-82a1-c7cb1d185808") : secret "insights-runtime-extractor-tls" not found Sep 18 12:03:23.234979 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:23.234887 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:23.494054 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:23.493971 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:23.608138 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:23.608105 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:24.072030 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:24.071997 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:24.170194 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:24.170166 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:24.553802 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:24.553776 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:24.730451 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:24.730403 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:24.925142 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:24.925111 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:25.007639 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:25.007603 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:25.135792 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:25.135767 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:25.425920 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:25.425892 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:26.330582 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:26.330546 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:26.538316 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:26.538282 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:26.759332 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:26.759300 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:26.929397 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:26.929364 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:27.124850 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:27.124765 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:27.231603 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:27.231567 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-metrics-certs\") pod \"network-metrics-daemon-lvx4s\" (UID: \"a7f89718-22f1-4c13-aff1-d2fa5ff92c55\") " pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:03:27.231756 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:03:27.231709 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 18 12:03:27.231797 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:03:27.231771 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-metrics-certs podName:a7f89718-22f1-4c13-aff1-d2fa5ff92c55 nodeName:}" failed. No retries permitted until 2026-09-18 12:05:29.231755701 +0000 UTC m=+252.236443406 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-metrics-certs") pod "network-metrics-daemon-lvx4s" (UID: "a7f89718-22f1-4c13-aff1-d2fa5ff92c55") : secret "metrics-daemon-secret" not found Sep 18 12:03:27.551896 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:27.551866 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:27.734272 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:27.734239 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:27.922208 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:27.922175 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:28.527940 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:28.527906 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:29.127157 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:29.127125 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:29.325991 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:29.325952 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:29.726935 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:29.726898 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:29.868188 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:29.868154 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:30.011408 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:30.011314 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:30.350160 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:30.350066 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:30.738374 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:30.738345 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:30.933319 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:30.933288 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:31.063749 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:31.063650 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6663817-d441-4a33-82a1-c7cb1d185808-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-992hx\" (UID: \"d6663817-d441-4a33-82a1-c7cb1d185808\") " pod="openshift-insights/insights-runtime-extractor-992hx" Sep 18 12:03:31.063749 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:31.063694 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6663817-d441-4a33-82a1-c7cb1d185808-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-992hx\" (UID: \"d6663817-d441-4a33-82a1-c7cb1d185808\") " pod="openshift-insights/insights-runtime-extractor-992hx" Sep 18 12:03:31.064219 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:31.064196 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6663817-d441-4a33-82a1-c7cb1d185808-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-992hx\" (UID: \"d6663817-d441-4a33-82a1-c7cb1d185808\") " pod="openshift-insights/insights-runtime-extractor-992hx" Sep 18 12:03:31.066133 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:31.066105 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6663817-d441-4a33-82a1-c7cb1d185808-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-992hx\" (UID: \"d6663817-d441-4a33-82a1-c7cb1d185808\") " pod="openshift-insights/insights-runtime-extractor-992hx" Sep 18 12:03:31.142541 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:31.142510 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-krrgg\"" Sep 18 12:03:31.150328 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:31.150308 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-992hx" Sep 18 12:03:31.421347 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:31.421324 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-992hx"] Sep 18 12:03:31.423840 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:03:31.423813 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6663817_d441_4a33_82a1_c7cb1d185808.slice/crio-b276559da028842060edc4ba847c5e9ba512917633c642bd27ef7953d8557258 WatchSource:0}: Error finding container b276559da028842060edc4ba847c5e9ba512917633c642bd27ef7953d8557258: Status 404 returned error can't find the container with id b276559da028842060edc4ba847c5e9ba512917633c642bd27ef7953d8557258 Sep 18 12:03:32.011824 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:32.011794 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-992hx" event={"ID":"d6663817-d441-4a33-82a1-c7cb1d185808","Type":"ContainerStarted","Data":"6f3f7ef73a2f69386cd70d6f2c5ad3ab5136fd5755cbc12b4d5c76c5198433e8"} Sep 18 12:03:32.011986 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:32.011858 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-992hx" event={"ID":"d6663817-d441-4a33-82a1-c7cb1d185808","Type":"ContainerStarted","Data":"b276559da028842060edc4ba847c5e9ba512917633c642bd27ef7953d8557258"} Sep 18 12:03:33.017246 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:33.017212 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-992hx" event={"ID":"d6663817-d441-4a33-82a1-c7cb1d185808","Type":"ContainerStarted","Data":"43152290e7e2ec48d6835bbfb1cd2bcda05f9c253ee418bbf2825c8f58d55ded"} Sep 18 12:03:33.460210 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:33.460188 2578 scope.go:117] "RemoveContainer" containerID="ef79205093c3bfd8c49cb1b18f93647704af797c3679f47600954e1cd25ef4ac" Sep 18 12:03:34.026624 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:34.026586 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-992hx" event={"ID":"d6663817-d441-4a33-82a1-c7cb1d185808","Type":"ContainerStarted","Data":"bdbf53e6e704921d8d24dd0c5e76af2cd06352dc6c0ab7f0da3d2a6b6d05a8aa"} Sep 18 12:03:34.028534 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:34.028510 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-fc7vn_a6629efd-ffee-4ff0-bb6c-530f4ac96793/console-operator/1.log" Sep 18 12:03:34.028643 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:34.028579 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-fc7vn" event={"ID":"a6629efd-ffee-4ff0-bb6c-530f4ac96793","Type":"ContainerStarted","Data":"cf088b5fca29d9ee0c9151cf83902c2b583b2091b021f4fe7918ea6342b78248"} Sep 18 12:03:34.028837 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:34.028821 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-fc7vn" Sep 18 12:03:34.048802 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:34.048761 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-992hx" podStartSLOduration=17.113537277 podStartE2EDuration="19.048747272s" totalImagesPullingTime="1.935209995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 12:03:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:03:34.047009126 +0000 UTC m=+137.051696849" watchObservedRunningTime="2026-09-18 12:03:34.048747272 +0000 UTC m=+137.053434995" Sep 18 12:03:34.067475 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:34.067412 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-fd4bb46c-fc7vn" podStartSLOduration=23.236363334 podStartE2EDuration="25.067401035s" totalImagesPullingTime="1.831037701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 12:03:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:03:34.066821835 +0000 UTC m=+137.071509571" watchObservedRunningTime="2026-09-18 12:03:34.067401035 +0000 UTC m=+137.072088786" Sep 18 12:03:34.822587 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:34.822559 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-fd4bb46c-fc7vn" Sep 18 12:03:35.031020 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:35.030972 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:35.131301 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:35.131272 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:35.320581 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:35.320541 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:35.703519 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:35.703488 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:35.782763 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:35.782726 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:36.093427 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:36.093356 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:36.168419 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:36.168377 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:36.510408 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:36.510367 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:36.687165 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:36.687118 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:36.795412 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:36.795321 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:36.917067 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:36.917036 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:37.040815 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:37.040766 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:37.539544 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:37.539509 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:37.636138 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:37.636108 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:40.028195 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:40.028155 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:40.129235 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:40.129205 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:40.234014 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:40.233982 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:41.236218 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:41.236190 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:41.327903 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:41.327873 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:43.338183 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:43.338154 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:43.439361 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:43.439323 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:43.463753 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:43.463729 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-982w4"] Sep 18 12:03:43.465779 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:43.465765 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-982w4" Sep 18 12:03:43.468179 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:43.468153 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 18 12:03:43.468364 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:43.468348 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-vzlxs\"" Sep 18 12:03:43.483381 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:43.483360 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-982w4"] Sep 18 12:03:43.557100 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:43.557074 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/28ea6a59-c01c-471c-b7c7-74ce5f7de1a9-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-982w4\" (UID: \"28ea6a59-c01c-471c-b7c7-74ce5f7de1a9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-982w4" Sep 18 12:03:43.629869 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:43.629845 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:43.657983 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:43.657958 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/28ea6a59-c01c-471c-b7c7-74ce5f7de1a9-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-982w4\" (UID: \"28ea6a59-c01c-471c-b7c7-74ce5f7de1a9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-982w4" Sep 18 12:03:43.660467 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:43.660421 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/28ea6a59-c01c-471c-b7c7-74ce5f7de1a9-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-982w4\" (UID: \"28ea6a59-c01c-471c-b7c7-74ce5f7de1a9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-982w4" Sep 18 12:03:43.774870 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:43.774817 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-982w4" Sep 18 12:03:43.781660 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:43.781637 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:43.940827 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:43.940753 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:43.960926 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:43.960896 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7489b9c6d4-lp795"] Sep 18 12:03:43.962771 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:43.962751 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7489b9c6d4-lp795" Sep 18 12:03:43.971311 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:43.971292 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 18 12:03:43.971496 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:43.971481 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zgddd\"" Sep 18 12:03:43.971578 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:43.971553 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 18 12:03:43.971640 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:43.971578 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 18 12:03:43.971796 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:43.971780 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 18 12:03:43.971920 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:43.971836 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 18 12:03:43.971920 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:43.971869 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 18 12:03:43.971920 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:43.971896 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 18 12:03:43.976824 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:43.976769 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7489b9c6d4-lp795"] Sep 18 12:03:44.020990 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:44.020963 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:44.041888 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:44.041865 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-982w4"] Sep 18 12:03:44.044506 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:03:44.044486 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28ea6a59_c01c_471c_b7c7_74ce5f7de1a9.slice/crio-852a5b7762bcaa82f6a7e8df92ec038422b5a5b2a5c2490140bfa55e6e0c00d9 WatchSource:0}: Error finding container 852a5b7762bcaa82f6a7e8df92ec038422b5a5b2a5c2490140bfa55e6e0c00d9: Status 404 returned error can't find the container with id 852a5b7762bcaa82f6a7e8df92ec038422b5a5b2a5c2490140bfa55e6e0c00d9 Sep 18 12:03:44.060064 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:44.060041 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-982w4" event={"ID":"28ea6a59-c01c-471c-b7c7-74ce5f7de1a9","Type":"ContainerStarted","Data":"852a5b7762bcaa82f6a7e8df92ec038422b5a5b2a5c2490140bfa55e6e0c00d9"} Sep 18 12:03:44.062350 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:44.062332 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8521b30f-b709-4088-8560-d3c8a4da8318-console-serving-cert\") pod \"console-7489b9c6d4-lp795\" (UID: \"8521b30f-b709-4088-8560-d3c8a4da8318\") " pod="openshift-console/console-7489b9c6d4-lp795" Sep 18 12:03:44.062429 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:44.062387 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8521b30f-b709-4088-8560-d3c8a4da8318-console-config\") pod \"console-7489b9c6d4-lp795\" (UID: \"8521b30f-b709-4088-8560-d3c8a4da8318\") " pod="openshift-console/console-7489b9c6d4-lp795" Sep 18 12:03:44.062499 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:44.062479 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd2r5\" (UniqueName: \"kubernetes.io/projected/8521b30f-b709-4088-8560-d3c8a4da8318-kube-api-access-kd2r5\") pod \"console-7489b9c6d4-lp795\" (UID: \"8521b30f-b709-4088-8560-d3c8a4da8318\") " pod="openshift-console/console-7489b9c6d4-lp795" Sep 18 12:03:44.062542 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:44.062506 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8521b30f-b709-4088-8560-d3c8a4da8318-service-ca\") pod \"console-7489b9c6d4-lp795\" (UID: \"8521b30f-b709-4088-8560-d3c8a4da8318\") " pod="openshift-console/console-7489b9c6d4-lp795" Sep 18 12:03:44.062542 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:44.062532 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8521b30f-b709-4088-8560-d3c8a4da8318-console-oauth-config\") pod \"console-7489b9c6d4-lp795\" (UID: \"8521b30f-b709-4088-8560-d3c8a4da8318\") " pod="openshift-console/console-7489b9c6d4-lp795" Sep 18 12:03:44.062639 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:44.062567 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8521b30f-b709-4088-8560-d3c8a4da8318-oauth-serving-cert\") pod \"console-7489b9c6d4-lp795\" (UID: \"8521b30f-b709-4088-8560-d3c8a4da8318\") " pod="openshift-console/console-7489b9c6d4-lp795" Sep 18 12:03:44.163773 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:44.163744 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8521b30f-b709-4088-8560-d3c8a4da8318-console-oauth-config\") pod \"console-7489b9c6d4-lp795\" (UID: \"8521b30f-b709-4088-8560-d3c8a4da8318\") " pod="openshift-console/console-7489b9c6d4-lp795" Sep 18 12:03:44.163904 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:44.163794 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8521b30f-b709-4088-8560-d3c8a4da8318-oauth-serving-cert\") pod \"console-7489b9c6d4-lp795\" (UID: \"8521b30f-b709-4088-8560-d3c8a4da8318\") " pod="openshift-console/console-7489b9c6d4-lp795" Sep 18 12:03:44.163904 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:44.163833 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8521b30f-b709-4088-8560-d3c8a4da8318-console-serving-cert\") pod \"console-7489b9c6d4-lp795\" (UID: \"8521b30f-b709-4088-8560-d3c8a4da8318\") " pod="openshift-console/console-7489b9c6d4-lp795" Sep 18 12:03:44.163904 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:44.163864 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8521b30f-b709-4088-8560-d3c8a4da8318-console-config\") pod \"console-7489b9c6d4-lp795\" (UID: \"8521b30f-b709-4088-8560-d3c8a4da8318\") " pod="openshift-console/console-7489b9c6d4-lp795" Sep 18 12:03:44.164060 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:44.163919 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd2r5\" (UniqueName: \"kubernetes.io/projected/8521b30f-b709-4088-8560-d3c8a4da8318-kube-api-access-kd2r5\") pod \"console-7489b9c6d4-lp795\" (UID: \"8521b30f-b709-4088-8560-d3c8a4da8318\") " pod="openshift-console/console-7489b9c6d4-lp795" Sep 18 12:03:44.164060 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:44.163955 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8521b30f-b709-4088-8560-d3c8a4da8318-service-ca\") pod \"console-7489b9c6d4-lp795\" (UID: \"8521b30f-b709-4088-8560-d3c8a4da8318\") " pod="openshift-console/console-7489b9c6d4-lp795" Sep 18 12:03:44.164580 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:44.164557 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8521b30f-b709-4088-8560-d3c8a4da8318-oauth-serving-cert\") pod \"console-7489b9c6d4-lp795\" (UID: \"8521b30f-b709-4088-8560-d3c8a4da8318\") " pod="openshift-console/console-7489b9c6d4-lp795" Sep 18 12:03:44.164684 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:44.164579 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8521b30f-b709-4088-8560-d3c8a4da8318-console-config\") pod \"console-7489b9c6d4-lp795\" (UID: \"8521b30f-b709-4088-8560-d3c8a4da8318\") " pod="openshift-console/console-7489b9c6d4-lp795" Sep 18 12:03:44.164974 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:44.164954 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8521b30f-b709-4088-8560-d3c8a4da8318-service-ca\") pod \"console-7489b9c6d4-lp795\" (UID: \"8521b30f-b709-4088-8560-d3c8a4da8318\") " pod="openshift-console/console-7489b9c6d4-lp795" Sep 18 12:03:44.166324 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:44.166297 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8521b30f-b709-4088-8560-d3c8a4da8318-console-serving-cert\") pod \"console-7489b9c6d4-lp795\" (UID: \"8521b30f-b709-4088-8560-d3c8a4da8318\") " pod="openshift-console/console-7489b9c6d4-lp795" Sep 18 12:03:44.166406 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:44.166357 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8521b30f-b709-4088-8560-d3c8a4da8318-console-oauth-config\") pod \"console-7489b9c6d4-lp795\" (UID: \"8521b30f-b709-4088-8560-d3c8a4da8318\") " pod="openshift-console/console-7489b9c6d4-lp795" Sep 18 12:03:44.175138 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:44.175114 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd2r5\" (UniqueName: \"kubernetes.io/projected/8521b30f-b709-4088-8560-d3c8a4da8318-kube-api-access-kd2r5\") pod \"console-7489b9c6d4-lp795\" (UID: \"8521b30f-b709-4088-8560-d3c8a4da8318\") " pod="openshift-console/console-7489b9c6d4-lp795" Sep 18 12:03:44.232032 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:44.231964 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:44.272100 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:44.272069 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7489b9c6d4-lp795" Sep 18 12:03:44.310050 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:44.310023 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:44.543037 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:44.542947 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7489b9c6d4-lp795"] Sep 18 12:03:44.546645 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:03:44.546623 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8521b30f_b709_4088_8560_d3c8a4da8318.slice/crio-b804b69569647e3a5eab0c8b5f7de81652ecdc7869025a50fb392e2162857c4e WatchSource:0}: Error finding container b804b69569647e3a5eab0c8b5f7de81652ecdc7869025a50fb392e2162857c4e: Status 404 returned error can't find the container with id b804b69569647e3a5eab0c8b5f7de81652ecdc7869025a50fb392e2162857c4e Sep 18 12:03:45.065001 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:45.064975 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7489b9c6d4-lp795" event={"ID":"8521b30f-b709-4088-8560-d3c8a4da8318","Type":"ContainerStarted","Data":"b804b69569647e3a5eab0c8b5f7de81652ecdc7869025a50fb392e2162857c4e"} Sep 18 12:03:46.072117 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.072079 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-982w4" event={"ID":"28ea6a59-c01c-471c-b7c7-74ce5f7de1a9","Type":"ContainerStarted","Data":"b9503b41b182a11e6ace8c359f89e266f94115715b61aff9ab9cf4989a424deb"} Sep 18 12:03:46.072552 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.072417 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-982w4" Sep 18 12:03:46.078174 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.078149 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-982w4" Sep 18 12:03:46.092579 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.092527 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-982w4" podStartSLOduration=2.091173813 podStartE2EDuration="3.092468763s" totalImagesPullingTime="1.00129495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 12:03:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:03:46.09170409 +0000 UTC m=+149.096391814" watchObservedRunningTime="2026-09-18 12:03:46.092468763 +0000 UTC m=+149.097156487" Sep 18 12:03:46.142633 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.142528 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78c5f6c6b7-6nvqq"] Sep 18 12:03:46.149557 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.149424 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78c5f6c6b7-6nvqq" Sep 18 12:03:46.157516 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.157452 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78c5f6c6b7-6nvqq"] Sep 18 12:03:46.157825 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.157663 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 18 12:03:46.185645 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.185583 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:46.282669 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.282638 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:46.289103 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.289071 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f38c726d-39d9-4ff4-87a5-e23ce290d469-console-config\") pod \"console-78c5f6c6b7-6nvqq\" (UID: \"f38c726d-39d9-4ff4-87a5-e23ce290d469\") " pod="openshift-console/console-78c5f6c6b7-6nvqq" Sep 18 12:03:46.289241 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.289208 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f38c726d-39d9-4ff4-87a5-e23ce290d469-trusted-ca-bundle\") pod \"console-78c5f6c6b7-6nvqq\" (UID: \"f38c726d-39d9-4ff4-87a5-e23ce290d469\") " pod="openshift-console/console-78c5f6c6b7-6nvqq" Sep 18 12:03:46.289382 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.289359 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f38c726d-39d9-4ff4-87a5-e23ce290d469-console-oauth-config\") pod \"console-78c5f6c6b7-6nvqq\" (UID: \"f38c726d-39d9-4ff4-87a5-e23ce290d469\") " pod="openshift-console/console-78c5f6c6b7-6nvqq" Sep 18 12:03:46.289475 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.289418 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f38c726d-39d9-4ff4-87a5-e23ce290d469-console-serving-cert\") pod \"console-78c5f6c6b7-6nvqq\" (UID: \"f38c726d-39d9-4ff4-87a5-e23ce290d469\") " pod="openshift-console/console-78c5f6c6b7-6nvqq" Sep 18 12:03:46.289475 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.289464 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f38c726d-39d9-4ff4-87a5-e23ce290d469-oauth-serving-cert\") pod \"console-78c5f6c6b7-6nvqq\" (UID: \"f38c726d-39d9-4ff4-87a5-e23ce290d469\") " pod="openshift-console/console-78c5f6c6b7-6nvqq" Sep 18 12:03:46.289589 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.289520 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pwcs\" (UniqueName: \"kubernetes.io/projected/f38c726d-39d9-4ff4-87a5-e23ce290d469-kube-api-access-2pwcs\") pod \"console-78c5f6c6b7-6nvqq\" (UID: \"f38c726d-39d9-4ff4-87a5-e23ce290d469\") " pod="openshift-console/console-78c5f6c6b7-6nvqq" Sep 18 12:03:46.289589 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.289548 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f38c726d-39d9-4ff4-87a5-e23ce290d469-service-ca\") pod \"console-78c5f6c6b7-6nvqq\" (UID: \"f38c726d-39d9-4ff4-87a5-e23ce290d469\") " pod="openshift-console/console-78c5f6c6b7-6nvqq" Sep 18 12:03:46.390947 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.390906 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f38c726d-39d9-4ff4-87a5-e23ce290d469-console-oauth-config\") pod \"console-78c5f6c6b7-6nvqq\" (UID: \"f38c726d-39d9-4ff4-87a5-e23ce290d469\") " pod="openshift-console/console-78c5f6c6b7-6nvqq" Sep 18 12:03:46.391127 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.390975 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f38c726d-39d9-4ff4-87a5-e23ce290d469-console-serving-cert\") pod \"console-78c5f6c6b7-6nvqq\" (UID: \"f38c726d-39d9-4ff4-87a5-e23ce290d469\") " pod="openshift-console/console-78c5f6c6b7-6nvqq" Sep 18 12:03:46.391127 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.391003 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f38c726d-39d9-4ff4-87a5-e23ce290d469-oauth-serving-cert\") pod \"console-78c5f6c6b7-6nvqq\" (UID: \"f38c726d-39d9-4ff4-87a5-e23ce290d469\") " pod="openshift-console/console-78c5f6c6b7-6nvqq" Sep 18 12:03:46.391127 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.391059 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pwcs\" (UniqueName: \"kubernetes.io/projected/f38c726d-39d9-4ff4-87a5-e23ce290d469-kube-api-access-2pwcs\") pod \"console-78c5f6c6b7-6nvqq\" (UID: \"f38c726d-39d9-4ff4-87a5-e23ce290d469\") " pod="openshift-console/console-78c5f6c6b7-6nvqq" Sep 18 12:03:46.391127 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.391087 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f38c726d-39d9-4ff4-87a5-e23ce290d469-service-ca\") pod \"console-78c5f6c6b7-6nvqq\" (UID: \"f38c726d-39d9-4ff4-87a5-e23ce290d469\") " pod="openshift-console/console-78c5f6c6b7-6nvqq" Sep 18 12:03:46.391127 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.391126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f38c726d-39d9-4ff4-87a5-e23ce290d469-console-config\") pod \"console-78c5f6c6b7-6nvqq\" (UID: \"f38c726d-39d9-4ff4-87a5-e23ce290d469\") " pod="openshift-console/console-78c5f6c6b7-6nvqq" Sep 18 12:03:46.391384 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.391196 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f38c726d-39d9-4ff4-87a5-e23ce290d469-trusted-ca-bundle\") pod \"console-78c5f6c6b7-6nvqq\" (UID: \"f38c726d-39d9-4ff4-87a5-e23ce290d469\") " pod="openshift-console/console-78c5f6c6b7-6nvqq" Sep 18 12:03:46.392679 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.392105 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f38c726d-39d9-4ff4-87a5-e23ce290d469-service-ca\") pod \"console-78c5f6c6b7-6nvqq\" (UID: \"f38c726d-39d9-4ff4-87a5-e23ce290d469\") " pod="openshift-console/console-78c5f6c6b7-6nvqq" Sep 18 12:03:46.392679 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.392110 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f38c726d-39d9-4ff4-87a5-e23ce290d469-trusted-ca-bundle\") pod \"console-78c5f6c6b7-6nvqq\" (UID: \"f38c726d-39d9-4ff4-87a5-e23ce290d469\") " pod="openshift-console/console-78c5f6c6b7-6nvqq" Sep 18 12:03:46.392679 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.392202 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f38c726d-39d9-4ff4-87a5-e23ce290d469-oauth-serving-cert\") pod \"console-78c5f6c6b7-6nvqq\" (UID: \"f38c726d-39d9-4ff4-87a5-e23ce290d469\") " pod="openshift-console/console-78c5f6c6b7-6nvqq" Sep 18 12:03:46.392679 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.392634 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f38c726d-39d9-4ff4-87a5-e23ce290d469-console-config\") pod \"console-78c5f6c6b7-6nvqq\" (UID: \"f38c726d-39d9-4ff4-87a5-e23ce290d469\") " pod="openshift-console/console-78c5f6c6b7-6nvqq" Sep 18 12:03:46.394542 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.394497 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f38c726d-39d9-4ff4-87a5-e23ce290d469-console-oauth-config\") pod \"console-78c5f6c6b7-6nvqq\" (UID: \"f38c726d-39d9-4ff4-87a5-e23ce290d469\") " pod="openshift-console/console-78c5f6c6b7-6nvqq" Sep 18 12:03:46.395017 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.394974 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f38c726d-39d9-4ff4-87a5-e23ce290d469-console-serving-cert\") pod \"console-78c5f6c6b7-6nvqq\" (UID: \"f38c726d-39d9-4ff4-87a5-e23ce290d469\") " pod="openshift-console/console-78c5f6c6b7-6nvqq" Sep 18 12:03:46.408164 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.408138 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pwcs\" (UniqueName: \"kubernetes.io/projected/f38c726d-39d9-4ff4-87a5-e23ce290d469-kube-api-access-2pwcs\") pod \"console-78c5f6c6b7-6nvqq\" (UID: \"f38c726d-39d9-4ff4-87a5-e23ce290d469\") " pod="openshift-console/console-78c5f6c6b7-6nvqq" Sep 18 12:03:46.433818 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.433788 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:46.462941 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.462913 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78c5f6c6b7-6nvqq" Sep 18 12:03:46.533832 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.533585 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:46.543254 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.543198 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-tm2vd"] Sep 18 12:03:46.548607 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.548582 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tm2vd" Sep 18 12:03:46.551683 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.551617 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 18 12:03:46.551880 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.551851 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pf46z\"" Sep 18 12:03:46.552056 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.552043 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 18 12:03:46.552466 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.552372 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 18 12:03:46.552578 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.552372 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 18 12:03:46.552827 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.552639 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 18 12:03:46.560198 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.558270 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-tm2vd"] Sep 18 12:03:46.694427 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.694339 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ed018f8-4a30-40b1-8e9a-1fc37f4893c4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-tm2vd\" (UID: \"7ed018f8-4a30-40b1-8e9a-1fc37f4893c4\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tm2vd" Sep 18 12:03:46.694427 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.694402 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ed018f8-4a30-40b1-8e9a-1fc37f4893c4-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-tm2vd\" (UID: \"7ed018f8-4a30-40b1-8e9a-1fc37f4893c4\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tm2vd" Sep 18 12:03:46.694664 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.694592 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ed018f8-4a30-40b1-8e9a-1fc37f4893c4-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-tm2vd\" (UID: \"7ed018f8-4a30-40b1-8e9a-1fc37f4893c4\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tm2vd" Sep 18 12:03:46.694664 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.694620 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24fnr\" (UniqueName: \"kubernetes.io/projected/7ed018f8-4a30-40b1-8e9a-1fc37f4893c4-kube-api-access-24fnr\") pod \"prometheus-operator-7bd5d56d6-tm2vd\" (UID: \"7ed018f8-4a30-40b1-8e9a-1fc37f4893c4\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tm2vd" Sep 18 12:03:46.795483 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.795422 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ed018f8-4a30-40b1-8e9a-1fc37f4893c4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-tm2vd\" (UID: \"7ed018f8-4a30-40b1-8e9a-1fc37f4893c4\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tm2vd" Sep 18 12:03:46.795669 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.795511 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ed018f8-4a30-40b1-8e9a-1fc37f4893c4-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-tm2vd\" (UID: \"7ed018f8-4a30-40b1-8e9a-1fc37f4893c4\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tm2vd" Sep 18 12:03:46.795669 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.795574 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ed018f8-4a30-40b1-8e9a-1fc37f4893c4-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-tm2vd\" (UID: \"7ed018f8-4a30-40b1-8e9a-1fc37f4893c4\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tm2vd" Sep 18 12:03:46.795669 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.795601 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24fnr\" (UniqueName: \"kubernetes.io/projected/7ed018f8-4a30-40b1-8e9a-1fc37f4893c4-kube-api-access-24fnr\") pod \"prometheus-operator-7bd5d56d6-tm2vd\" (UID: \"7ed018f8-4a30-40b1-8e9a-1fc37f4893c4\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tm2vd" Sep 18 12:03:46.796333 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.796247 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ed018f8-4a30-40b1-8e9a-1fc37f4893c4-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-tm2vd\" (UID: \"7ed018f8-4a30-40b1-8e9a-1fc37f4893c4\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tm2vd" Sep 18 12:03:46.798391 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.798366 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ed018f8-4a30-40b1-8e9a-1fc37f4893c4-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-tm2vd\" (UID: \"7ed018f8-4a30-40b1-8e9a-1fc37f4893c4\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tm2vd" Sep 18 12:03:46.798510 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.798377 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ed018f8-4a30-40b1-8e9a-1fc37f4893c4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-tm2vd\" (UID: \"7ed018f8-4a30-40b1-8e9a-1fc37f4893c4\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tm2vd" Sep 18 12:03:46.802920 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.802830 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:46.805151 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.804958 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24fnr\" (UniqueName: \"kubernetes.io/projected/7ed018f8-4a30-40b1-8e9a-1fc37f4893c4-kube-api-access-24fnr\") pod \"prometheus-operator-7bd5d56d6-tm2vd\" (UID: \"7ed018f8-4a30-40b1-8e9a-1fc37f4893c4\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tm2vd" Sep 18 12:03:46.862023 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:46.861994 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tm2vd" Sep 18 12:03:48.860942 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:03:48.860912 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf38c726d_39d9_4ff4_87a5_e23ce290d469.slice/crio-df1aa2e1b654092df6828e399dc4ee8af6a45bd6c3878d9250e5f7ad57a17ccd WatchSource:0}: Error finding container df1aa2e1b654092df6828e399dc4ee8af6a45bd6c3878d9250e5f7ad57a17ccd: Status 404 returned error can't find the container with id df1aa2e1b654092df6828e399dc4ee8af6a45bd6c3878d9250e5f7ad57a17ccd Sep 18 12:03:48.862332 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:03:48.862303 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ed018f8_4a30_40b1_8e9a_1fc37f4893c4.slice/crio-1a5c264769ab1b3165a3a2bd03698928744eee7a28e4f54071cc70713d273ef3 WatchSource:0}: Error finding container 1a5c264769ab1b3165a3a2bd03698928744eee7a28e4f54071cc70713d273ef3: Status 404 returned error can't find the container with id 1a5c264769ab1b3165a3a2bd03698928744eee7a28e4f54071cc70713d273ef3 Sep 18 12:03:48.879513 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:48.879486 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78c5f6c6b7-6nvqq"] Sep 18 12:03:48.880494 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:48.880470 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-tm2vd"] Sep 18 12:03:49.090803 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:49.090771 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tm2vd" event={"ID":"7ed018f8-4a30-40b1-8e9a-1fc37f4893c4","Type":"ContainerStarted","Data":"1a5c264769ab1b3165a3a2bd03698928744eee7a28e4f54071cc70713d273ef3"} Sep 18 12:03:49.092278 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:49.092250 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78c5f6c6b7-6nvqq" event={"ID":"f38c726d-39d9-4ff4-87a5-e23ce290d469","Type":"ContainerStarted","Data":"05f6096166a06671475e403237cecff3334c80fe277bbaff68d78ef7011c575e"} Sep 18 12:03:49.092412 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:49.092296 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78c5f6c6b7-6nvqq" event={"ID":"f38c726d-39d9-4ff4-87a5-e23ce290d469","Type":"ContainerStarted","Data":"df1aa2e1b654092df6828e399dc4ee8af6a45bd6c3878d9250e5f7ad57a17ccd"} Sep 18 12:03:49.093744 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:49.093723 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7489b9c6d4-lp795" event={"ID":"8521b30f-b709-4088-8560-d3c8a4da8318","Type":"ContainerStarted","Data":"18dd27ccb0beabb9f8ec8868be5cd0925752e5e7eb907cc0914de3c0d7e371e2"} Sep 18 12:03:49.112574 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:49.112505 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78c5f6c6b7-6nvqq" podStartSLOduration=3.112492348 podStartE2EDuration="3.112492348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 12:03:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:03:49.111554709 +0000 UTC m=+152.116242432" watchObservedRunningTime="2026-09-18 12:03:49.112492348 +0000 UTC m=+152.117180124" Sep 18 12:03:49.132161 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:49.132118 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7489b9c6d4-lp795" podStartSLOduration=2.032807763 podStartE2EDuration="6.132106159s" totalImagesPullingTime="4.099298396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 12:03:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:03:49.130683736 +0000 UTC m=+152.135371458" watchObservedRunningTime="2026-09-18 12:03:49.132106159 +0000 UTC m=+152.136793881" Sep 18 12:03:50.427552 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:50.427521 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:51.103332 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:51.103294 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tm2vd" event={"ID":"7ed018f8-4a30-40b1-8e9a-1fc37f4893c4","Type":"ContainerStarted","Data":"59dc2bbe3c07739ac87633c3a312a0a826c34d602014e5a51ab1c4594e152390"} Sep 18 12:03:51.103520 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:51.103353 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tm2vd" event={"ID":"7ed018f8-4a30-40b1-8e9a-1fc37f4893c4","Type":"ContainerStarted","Data":"aaec990125db89cdffb5294b2bb4c9cc799a2e53557ec8ab08a243300878501b"} Sep 18 12:03:51.122897 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:51.122856 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-tm2vd" podStartSLOduration=3.876618862 podStartE2EDuration="5.122840827s" totalImagesPullingTime="1.246221965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 12:03:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:03:51.121729573 +0000 UTC m=+154.126417296" watchObservedRunningTime="2026-09-18 12:03:51.122840827 +0000 UTC m=+154.127528550" Sep 18 12:03:52.668870 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:52.668836 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:52.763812 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:52.763778 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:52.884543 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:52.884502 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:52.908928 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:52.908899 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-9wwlp"] Sep 18 12:03:52.915019 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:52.915000 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9wwlp" Sep 18 12:03:52.917549 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:52.917526 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 18 12:03:52.917675 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:52.917578 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-6kcr2\"" Sep 18 12:03:52.917675 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:52.917648 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 18 12:03:52.922717 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:52.922334 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-tqxsv"] Sep 18 12:03:52.926629 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:52.926608 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-9wwlp"] Sep 18 12:03:52.926722 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:52.926715 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-tqxsv" Sep 18 12:03:52.929349 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:52.929329 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 18 12:03:52.929653 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:52.929637 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-px88t\"" Sep 18 12:03:52.929789 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:52.929723 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 18 12:03:52.930350 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:52.930333 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 18 12:03:52.931882 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:52.931862 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gbwgw"] Sep 18 12:03:52.935772 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:52.935753 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gbwgw" Sep 18 12:03:52.941920 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:52.941903 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2rmb8\"" Sep 18 12:03:52.942252 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:52.942238 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 18 12:03:52.942308 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:52.942277 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 18 12:03:52.942506 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:52.942494 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 18 12:03:52.955183 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:52.955149 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-tqxsv"] Sep 18 12:03:53.012795 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.012768 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:53.046333 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.046304 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn8l2\" (UniqueName: \"kubernetes.io/projected/f8bbc657-9de5-4b0d-8876-abfd078f9062-kube-api-access-pn8l2\") pod \"kube-state-metrics-84c885658c-tqxsv\" (UID: \"f8bbc657-9de5-4b0d-8876-abfd078f9062\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tqxsv" Sep 18 12:03:53.046482 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.046347 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7129b91a-b429-4bb0-b6a4-c7b541960a03-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-9wwlp\" (UID: \"7129b91a-b429-4bb0-b6a4-c7b541960a03\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9wwlp" Sep 18 12:03:53.046482 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.046379 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f8bbc657-9de5-4b0d-8876-abfd078f9062-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-tqxsv\" (UID: \"f8bbc657-9de5-4b0d-8876-abfd078f9062\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tqxsv" Sep 18 12:03:53.046482 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.046408 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f8bbc657-9de5-4b0d-8876-abfd078f9062-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-tqxsv\" (UID: \"f8bbc657-9de5-4b0d-8876-abfd078f9062\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tqxsv" Sep 18 12:03:53.046482 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.046430 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8bbc657-9de5-4b0d-8876-abfd078f9062-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-tqxsv\" (UID: \"f8bbc657-9de5-4b0d-8876-abfd078f9062\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tqxsv" Sep 18 12:03:53.046482 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.046462 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7129b91a-b429-4bb0-b6a4-c7b541960a03-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-9wwlp\" (UID: \"7129b91a-b429-4bb0-b6a4-c7b541960a03\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9wwlp" Sep 18 12:03:53.046883 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.046488 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3e92bbb-d31f-4b16-a16b-76b8d8641290-metrics-client-ca\") pod \"node-exporter-gbwgw\" (UID: \"b3e92bbb-d31f-4b16-a16b-76b8d8641290\") " pod="openshift-monitoring/node-exporter-gbwgw" Sep 18 12:03:53.046883 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.046511 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8bbc657-9de5-4b0d-8876-abfd078f9062-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-tqxsv\" (UID: \"f8bbc657-9de5-4b0d-8876-abfd078f9062\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tqxsv" Sep 18 12:03:53.046883 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.046539 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b3e92bbb-d31f-4b16-a16b-76b8d8641290-root\") pod \"node-exporter-gbwgw\" (UID: \"b3e92bbb-d31f-4b16-a16b-76b8d8641290\") " pod="openshift-monitoring/node-exporter-gbwgw" Sep 18 12:03:53.046883 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.046559 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqcq6\" (UniqueName: \"kubernetes.io/projected/7129b91a-b429-4bb0-b6a4-c7b541960a03-kube-api-access-zqcq6\") pod \"openshift-state-metrics-86c5bc79d6-9wwlp\" (UID: \"7129b91a-b429-4bb0-b6a4-c7b541960a03\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9wwlp" Sep 18 12:03:53.046883 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.046572 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b3e92bbb-d31f-4b16-a16b-76b8d8641290-node-exporter-textfile\") pod \"node-exporter-gbwgw\" (UID: \"b3e92bbb-d31f-4b16-a16b-76b8d8641290\") " pod="openshift-monitoring/node-exporter-gbwgw" Sep 18 12:03:53.046883 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.046587 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfb2s\" (UniqueName: \"kubernetes.io/projected/b3e92bbb-d31f-4b16-a16b-76b8d8641290-kube-api-access-gfb2s\") pod \"node-exporter-gbwgw\" (UID: \"b3e92bbb-d31f-4b16-a16b-76b8d8641290\") " pod="openshift-monitoring/node-exporter-gbwgw" Sep 18 12:03:53.046883 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.046658 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7129b91a-b429-4bb0-b6a4-c7b541960a03-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-9wwlp\" (UID: \"7129b91a-b429-4bb0-b6a4-c7b541960a03\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9wwlp" Sep 18 12:03:53.046883 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.046684 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b3e92bbb-d31f-4b16-a16b-76b8d8641290-node-exporter-accelerators-collector-config\") pod \"node-exporter-gbwgw\" (UID: \"b3e92bbb-d31f-4b16-a16b-76b8d8641290\") " pod="openshift-monitoring/node-exporter-gbwgw" Sep 18 12:03:53.046883 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.046703 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3e92bbb-d31f-4b16-a16b-76b8d8641290-sys\") pod \"node-exporter-gbwgw\" (UID: \"b3e92bbb-d31f-4b16-a16b-76b8d8641290\") " pod="openshift-monitoring/node-exporter-gbwgw" Sep 18 12:03:53.046883 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.046717 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b3e92bbb-d31f-4b16-a16b-76b8d8641290-node-exporter-tls\") pod \"node-exporter-gbwgw\" (UID: \"b3e92bbb-d31f-4b16-a16b-76b8d8641290\") " pod="openshift-monitoring/node-exporter-gbwgw" Sep 18 12:03:53.046883 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.046734 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b3e92bbb-d31f-4b16-a16b-76b8d8641290-node-exporter-wtmp\") pod \"node-exporter-gbwgw\" (UID: \"b3e92bbb-d31f-4b16-a16b-76b8d8641290\") " pod="openshift-monitoring/node-exporter-gbwgw" Sep 18 12:03:53.046883 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.046767 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b3e92bbb-d31f-4b16-a16b-76b8d8641290-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gbwgw\" (UID: \"b3e92bbb-d31f-4b16-a16b-76b8d8641290\") " pod="openshift-monitoring/node-exporter-gbwgw" Sep 18 12:03:53.046883 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.046827 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8bbc657-9de5-4b0d-8876-abfd078f9062-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-tqxsv\" (UID: \"f8bbc657-9de5-4b0d-8876-abfd078f9062\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tqxsv" Sep 18 12:03:53.110230 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.110206 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:53.147265 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.147248 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7129b91a-b429-4bb0-b6a4-c7b541960a03-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-9wwlp\" (UID: \"7129b91a-b429-4bb0-b6a4-c7b541960a03\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9wwlp" Sep 18 12:03:53.147342 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.147277 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b3e92bbb-d31f-4b16-a16b-76b8d8641290-node-exporter-accelerators-collector-config\") pod \"node-exporter-gbwgw\" (UID: \"b3e92bbb-d31f-4b16-a16b-76b8d8641290\") " pod="openshift-monitoring/node-exporter-gbwgw" Sep 18 12:03:53.147342 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.147295 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3e92bbb-d31f-4b16-a16b-76b8d8641290-sys\") pod \"node-exporter-gbwgw\" (UID: \"b3e92bbb-d31f-4b16-a16b-76b8d8641290\") " pod="openshift-monitoring/node-exporter-gbwgw" Sep 18 12:03:53.147342 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.147317 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b3e92bbb-d31f-4b16-a16b-76b8d8641290-node-exporter-tls\") pod \"node-exporter-gbwgw\" (UID: \"b3e92bbb-d31f-4b16-a16b-76b8d8641290\") " pod="openshift-monitoring/node-exporter-gbwgw" Sep 18 12:03:53.147509 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.147337 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b3e92bbb-d31f-4b16-a16b-76b8d8641290-node-exporter-wtmp\") pod \"node-exporter-gbwgw\" (UID: \"b3e92bbb-d31f-4b16-a16b-76b8d8641290\") " pod="openshift-monitoring/node-exporter-gbwgw" Sep 18 12:03:53.147509 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.147392 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3e92bbb-d31f-4b16-a16b-76b8d8641290-sys\") pod \"node-exporter-gbwgw\" (UID: \"b3e92bbb-d31f-4b16-a16b-76b8d8641290\") " pod="openshift-monitoring/node-exporter-gbwgw" Sep 18 12:03:53.147509 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.147407 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b3e92bbb-d31f-4b16-a16b-76b8d8641290-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gbwgw\" (UID: \"b3e92bbb-d31f-4b16-a16b-76b8d8641290\") " pod="openshift-monitoring/node-exporter-gbwgw" Sep 18 12:03:53.147617 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.147513 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8bbc657-9de5-4b0d-8876-abfd078f9062-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-tqxsv\" (UID: \"f8bbc657-9de5-4b0d-8876-abfd078f9062\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tqxsv" Sep 18 12:03:53.147617 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.147547 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn8l2\" (UniqueName: \"kubernetes.io/projected/f8bbc657-9de5-4b0d-8876-abfd078f9062-kube-api-access-pn8l2\") pod \"kube-state-metrics-84c885658c-tqxsv\" (UID: \"f8bbc657-9de5-4b0d-8876-abfd078f9062\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tqxsv" Sep 18 12:03:53.147617 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.147544 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b3e92bbb-d31f-4b16-a16b-76b8d8641290-node-exporter-wtmp\") pod \"node-exporter-gbwgw\" (UID: \"b3e92bbb-d31f-4b16-a16b-76b8d8641290\") " pod="openshift-monitoring/node-exporter-gbwgw" Sep 18 12:03:53.147852 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.147812 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7129b91a-b429-4bb0-b6a4-c7b541960a03-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-9wwlp\" (UID: \"7129b91a-b429-4bb0-b6a4-c7b541960a03\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9wwlp" Sep 18 12:03:53.147984 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.147877 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f8bbc657-9de5-4b0d-8876-abfd078f9062-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-tqxsv\" (UID: \"f8bbc657-9de5-4b0d-8876-abfd078f9062\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tqxsv" Sep 18 12:03:53.147984 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.147908 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f8bbc657-9de5-4b0d-8876-abfd078f9062-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-tqxsv\" (UID: \"f8bbc657-9de5-4b0d-8876-abfd078f9062\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tqxsv" Sep 18 12:03:53.147984 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.147941 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8bbc657-9de5-4b0d-8876-abfd078f9062-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-tqxsv\" (UID: \"f8bbc657-9de5-4b0d-8876-abfd078f9062\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tqxsv" Sep 18 12:03:53.147984 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.147965 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7129b91a-b429-4bb0-b6a4-c7b541960a03-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-9wwlp\" (UID: \"7129b91a-b429-4bb0-b6a4-c7b541960a03\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9wwlp" Sep 18 12:03:53.148203 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.147987 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3e92bbb-d31f-4b16-a16b-76b8d8641290-metrics-client-ca\") pod \"node-exporter-gbwgw\" (UID: \"b3e92bbb-d31f-4b16-a16b-76b8d8641290\") " pod="openshift-monitoring/node-exporter-gbwgw" Sep 18 12:03:53.148203 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.148006 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b3e92bbb-d31f-4b16-a16b-76b8d8641290-node-exporter-accelerators-collector-config\") pod \"node-exporter-gbwgw\" (UID: \"b3e92bbb-d31f-4b16-a16b-76b8d8641290\") " pod="openshift-monitoring/node-exporter-gbwgw" Sep 18 12:03:53.148203 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.148080 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7129b91a-b429-4bb0-b6a4-c7b541960a03-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-9wwlp\" (UID: \"7129b91a-b429-4bb0-b6a4-c7b541960a03\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9wwlp" Sep 18 12:03:53.148203 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.148012 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8bbc657-9de5-4b0d-8876-abfd078f9062-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-tqxsv\" (UID: \"f8bbc657-9de5-4b0d-8876-abfd078f9062\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tqxsv" Sep 18 12:03:53.148203 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.148147 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b3e92bbb-d31f-4b16-a16b-76b8d8641290-root\") pod \"node-exporter-gbwgw\" (UID: \"b3e92bbb-d31f-4b16-a16b-76b8d8641290\") " pod="openshift-monitoring/node-exporter-gbwgw" Sep 18 12:03:53.148203 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.148179 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqcq6\" (UniqueName: \"kubernetes.io/projected/7129b91a-b429-4bb0-b6a4-c7b541960a03-kube-api-access-zqcq6\") pod \"openshift-state-metrics-86c5bc79d6-9wwlp\" (UID: \"7129b91a-b429-4bb0-b6a4-c7b541960a03\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9wwlp" Sep 18 12:03:53.148203 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.148197 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8bbc657-9de5-4b0d-8876-abfd078f9062-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-tqxsv\" (UID: \"f8bbc657-9de5-4b0d-8876-abfd078f9062\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tqxsv" Sep 18 12:03:53.148699 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.148205 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b3e92bbb-d31f-4b16-a16b-76b8d8641290-node-exporter-textfile\") pod \"node-exporter-gbwgw\" (UID: \"b3e92bbb-d31f-4b16-a16b-76b8d8641290\") " pod="openshift-monitoring/node-exporter-gbwgw" Sep 18 12:03:53.148699 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.148242 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfb2s\" (UniqueName: \"kubernetes.io/projected/b3e92bbb-d31f-4b16-a16b-76b8d8641290-kube-api-access-gfb2s\") pod \"node-exporter-gbwgw\" (UID: \"b3e92bbb-d31f-4b16-a16b-76b8d8641290\") " pod="openshift-monitoring/node-exporter-gbwgw" Sep 18 12:03:53.148699 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.148429 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b3e92bbb-d31f-4b16-a16b-76b8d8641290-node-exporter-textfile\") pod \"node-exporter-gbwgw\" (UID: \"b3e92bbb-d31f-4b16-a16b-76b8d8641290\") " pod="openshift-monitoring/node-exporter-gbwgw" Sep 18 12:03:53.148699 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.148503 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b3e92bbb-d31f-4b16-a16b-76b8d8641290-root\") pod \"node-exporter-gbwgw\" (UID: \"b3e92bbb-d31f-4b16-a16b-76b8d8641290\") " pod="openshift-monitoring/node-exporter-gbwgw" Sep 18 12:03:53.149049 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.148973 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f8bbc657-9de5-4b0d-8876-abfd078f9062-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-tqxsv\" (UID: \"f8bbc657-9de5-4b0d-8876-abfd078f9062\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tqxsv" Sep 18 12:03:53.149732 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.149700 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f8bbc657-9de5-4b0d-8876-abfd078f9062-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-tqxsv\" (UID: \"f8bbc657-9de5-4b0d-8876-abfd078f9062\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tqxsv" Sep 18 12:03:53.149899 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.149840 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3e92bbb-d31f-4b16-a16b-76b8d8641290-metrics-client-ca\") pod \"node-exporter-gbwgw\" (UID: \"b3e92bbb-d31f-4b16-a16b-76b8d8641290\") " pod="openshift-monitoring/node-exporter-gbwgw" Sep 18 12:03:53.150692 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.150653 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b3e92bbb-d31f-4b16-a16b-76b8d8641290-node-exporter-tls\") pod \"node-exporter-gbwgw\" (UID: \"b3e92bbb-d31f-4b16-a16b-76b8d8641290\") " pod="openshift-monitoring/node-exporter-gbwgw" Sep 18 12:03:53.150947 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.150923 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b3e92bbb-d31f-4b16-a16b-76b8d8641290-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gbwgw\" (UID: \"b3e92bbb-d31f-4b16-a16b-76b8d8641290\") " pod="openshift-monitoring/node-exporter-gbwgw" Sep 18 12:03:53.151175 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.151143 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7129b91a-b429-4bb0-b6a4-c7b541960a03-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-9wwlp\" (UID: \"7129b91a-b429-4bb0-b6a4-c7b541960a03\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9wwlp" Sep 18 12:03:53.151175 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.151167 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8bbc657-9de5-4b0d-8876-abfd078f9062-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-tqxsv\" (UID: \"f8bbc657-9de5-4b0d-8876-abfd078f9062\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tqxsv" Sep 18 12:03:53.151280 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.151193 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7129b91a-b429-4bb0-b6a4-c7b541960a03-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-9wwlp\" (UID: \"7129b91a-b429-4bb0-b6a4-c7b541960a03\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9wwlp" Sep 18 12:03:53.151359 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.151342 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8bbc657-9de5-4b0d-8876-abfd078f9062-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-tqxsv\" (UID: \"f8bbc657-9de5-4b0d-8876-abfd078f9062\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tqxsv" Sep 18 12:03:53.159543 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.159518 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn8l2\" (UniqueName: \"kubernetes.io/projected/f8bbc657-9de5-4b0d-8876-abfd078f9062-kube-api-access-pn8l2\") pod \"kube-state-metrics-84c885658c-tqxsv\" (UID: \"f8bbc657-9de5-4b0d-8876-abfd078f9062\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-tqxsv" Sep 18 12:03:53.162374 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.162338 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfb2s\" (UniqueName: \"kubernetes.io/projected/b3e92bbb-d31f-4b16-a16b-76b8d8641290-kube-api-access-gfb2s\") pod \"node-exporter-gbwgw\" (UID: \"b3e92bbb-d31f-4b16-a16b-76b8d8641290\") " pod="openshift-monitoring/node-exporter-gbwgw" Sep 18 12:03:53.162951 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.162930 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqcq6\" (UniqueName: \"kubernetes.io/projected/7129b91a-b429-4bb0-b6a4-c7b541960a03-kube-api-access-zqcq6\") pod \"openshift-state-metrics-86c5bc79d6-9wwlp\" (UID: \"7129b91a-b429-4bb0-b6a4-c7b541960a03\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9wwlp" Sep 18 12:03:53.212070 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.212007 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:53.225381 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.225360 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9wwlp" Sep 18 12:03:53.236535 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.236503 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-tqxsv" Sep 18 12:03:53.245019 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.244997 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gbwgw" Sep 18 12:03:53.258151 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:03:53.258124 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3e92bbb_d31f_4b16_a16b_76b8d8641290.slice/crio-10fa23260224b216b6176bc80d4eb4568a1f06b0156a3d1242a35be0bde9b30d WatchSource:0}: Error finding container 10fa23260224b216b6176bc80d4eb4568a1f06b0156a3d1242a35be0bde9b30d: Status 404 returned error can't find the container with id 10fa23260224b216b6176bc80d4eb4568a1f06b0156a3d1242a35be0bde9b30d Sep 18 12:03:53.342411 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.342381 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:53.515688 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.515660 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-9wwlp"] Sep 18 12:03:53.518298 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:03:53.518273 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7129b91a_b429_4bb0_b6a4_c7b541960a03.slice/crio-20f609fef3020876e5fb77ef713b668ad636b50a33ace24f8487853a3e64f317 WatchSource:0}: Error finding container 20f609fef3020876e5fb77ef713b668ad636b50a33ace24f8487853a3e64f317: Status 404 returned error can't find the container with id 20f609fef3020876e5fb77ef713b668ad636b50a33ace24f8487853a3e64f317 Sep 18 12:03:53.521607 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.521566 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-tqxsv"] Sep 18 12:03:53.524243 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:03:53.524222 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8bbc657_9de5_4b0d_8876_abfd078f9062.slice/crio-702a2cc4aa2f3b1e1da51416cc368b6334cae1d2828ea55571d82eb0b0f143f4 WatchSource:0}: Error finding container 702a2cc4aa2f3b1e1da51416cc368b6334cae1d2828ea55571d82eb0b0f143f4: Status 404 returned error can't find the container with id 702a2cc4aa2f3b1e1da51416cc368b6334cae1d2828ea55571d82eb0b0f143f4 Sep 18 12:03:53.587242 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.587215 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:53.930021 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:53.929974 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:54.051122 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.051091 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 12:03:54.056145 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.056125 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.059004 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.058973 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 18 12:03:54.060600 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.059913 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 18 12:03:54.060600 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.059933 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 18 12:03:54.060600 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.059967 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 18 12:03:54.060600 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.059923 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 18 12:03:54.060600 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.059974 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 18 12:03:54.060600 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.060318 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9vzhk\"" Sep 18 12:03:54.060937 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.060758 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 18 12:03:54.062587 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.062564 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 18 12:03:54.081212 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.081182 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 18 12:03:54.089151 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.089035 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 12:03:54.109750 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.109721 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:54.120237 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.120203 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9wwlp" event={"ID":"7129b91a-b429-4bb0-b6a4-c7b541960a03","Type":"ContainerStarted","Data":"7c90150108de0f9d13029ada760ab4e91d9b91dc1285d89fb2be96940c2e401b"} Sep 18 12:03:54.120380 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.120277 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9wwlp" event={"ID":"7129b91a-b429-4bb0-b6a4-c7b541960a03","Type":"ContainerStarted","Data":"049a1f7905718757e87f165a32cf6a48ec79b77ac9dc44ac0d9a671aea52d0b1"} Sep 18 12:03:54.120380 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.120308 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9wwlp" event={"ID":"7129b91a-b429-4bb0-b6a4-c7b541960a03","Type":"ContainerStarted","Data":"20f609fef3020876e5fb77ef713b668ad636b50a33ace24f8487853a3e64f317"} Sep 18 12:03:54.122647 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.122619 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gbwgw" event={"ID":"b3e92bbb-d31f-4b16-a16b-76b8d8641290","Type":"ContainerStarted","Data":"10fa23260224b216b6176bc80d4eb4568a1f06b0156a3d1242a35be0bde9b30d"} Sep 18 12:03:54.124257 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.124233 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-tqxsv" event={"ID":"f8bbc657-9de5-4b0d-8876-abfd078f9062","Type":"ContainerStarted","Data":"702a2cc4aa2f3b1e1da51416cc368b6334cae1d2828ea55571d82eb0b0f143f4"} Sep 18 12:03:54.159412 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.158757 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-config-volume\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.159412 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.158801 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3086576-e665-4430-81ed-3c61cf08b127-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.159412 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.158850 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-web-config\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.159412 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.158905 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wss65\" (UniqueName: \"kubernetes.io/projected/d3086576-e665-4430-81ed-3c61cf08b127-kube-api-access-wss65\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.159412 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.158956 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d3086576-e665-4430-81ed-3c61cf08b127-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.159412 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.158982 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.159412 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.159010 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.159412 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.159046 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d3086576-e665-4430-81ed-3c61cf08b127-config-out\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.159412 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.159078 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.159412 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.159108 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3086576-e665-4430-81ed-3c61cf08b127-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.159412 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.159134 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.159412 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.159165 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.159412 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.159236 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d3086576-e665-4430-81ed-3c61cf08b127-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.260470 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.260364 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d3086576-e665-4430-81ed-3c61cf08b127-config-out\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.260470 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.260421 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.260962 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.260477 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3086576-e665-4430-81ed-3c61cf08b127-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.260962 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.260505 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.260962 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.260536 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.260962 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.260612 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d3086576-e665-4430-81ed-3c61cf08b127-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.261238 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.260961 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-config-volume\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.261238 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.261006 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3086576-e665-4430-81ed-3c61cf08b127-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.261238 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.261060 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-web-config\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.261238 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.261116 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wss65\" (UniqueName: \"kubernetes.io/projected/d3086576-e665-4430-81ed-3c61cf08b127-kube-api-access-wss65\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.261238 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.261151 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d3086576-e665-4430-81ed-3c61cf08b127-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.261238 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.261178 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.261238 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.261206 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.261606 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:03:54.261321 2578 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 18 12:03:54.261606 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:03:54.261394 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-secret-alertmanager-main-tls podName:d3086576-e665-4430-81ed-3c61cf08b127 nodeName:}" failed. No retries permitted until 2026-09-18 12:03:54.761375187 +0000 UTC m=+157.766062895 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "d3086576-e665-4430-81ed-3c61cf08b127") : secret "alertmanager-main-tls" not found Sep 18 12:03:54.263016 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.262695 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3086576-e665-4430-81ed-3c61cf08b127-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.263016 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.262848 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3086576-e665-4430-81ed-3c61cf08b127-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.263878 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.263549 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d3086576-e665-4430-81ed-3c61cf08b127-config-out\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.263878 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.263813 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d3086576-e665-4430-81ed-3c61cf08b127-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.267077 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.267005 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.267077 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.267052 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.268019 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.267973 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-config-volume\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.268019 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.267997 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.268623 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.268505 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d3086576-e665-4430-81ed-3c61cf08b127-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.268623 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.268588 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-web-config\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.269625 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.269591 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.272337 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.272317 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7489b9c6d4-lp795" Sep 18 12:03:54.272508 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.272464 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7489b9c6d4-lp795" Sep 18 12:03:54.273796 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.273736 2578 patch_prober.go:28] interesting pod/console-7489b9c6d4-lp795 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.15:8443/health\": dial tcp 10.132.0.15:8443: connect: connection refused" start-of-body= Sep 18 12:03:54.273885 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.273794 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7489b9c6d4-lp795" podUID="8521b30f-b709-4088-8560-d3c8a4da8318" containerName="console" probeResult="failure" output="Get \"https://10.132.0.15:8443/health\": dial tcp 10.132.0.15:8443: connect: connection refused" Sep 18 12:03:54.277937 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.277912 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wss65\" (UniqueName: \"kubernetes.io/projected/d3086576-e665-4430-81ed-3c61cf08b127-kube-api-access-wss65\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.624296 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.624226 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:54.766319 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.766290 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.769033 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.769009 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:54.968605 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:54.968574 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:03:55.131392 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:55.131172 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9wwlp" event={"ID":"7129b91a-b429-4bb0-b6a4-c7b541960a03","Type":"ContainerStarted","Data":"49c8dc368963ad615679464714cc8d781e8810eebcdeb23025927c0008a42ea2"} Sep 18 12:03:55.135219 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:55.135192 2578 generic.go:356] "Generic (PLEG): container finished" podID="b3e92bbb-d31f-4b16-a16b-76b8d8641290" containerID="ddea936fb9a499ca389f95d8dc31d965d2dc7ba6d1a7549edd231e076cbe5869" exitCode=0 Sep 18 12:03:55.135349 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:55.135279 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gbwgw" event={"ID":"b3e92bbb-d31f-4b16-a16b-76b8d8641290","Type":"ContainerDied","Data":"ddea936fb9a499ca389f95d8dc31d965d2dc7ba6d1a7549edd231e076cbe5869"} Sep 18 12:03:55.137264 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:55.137200 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-tqxsv" event={"ID":"f8bbc657-9de5-4b0d-8876-abfd078f9062","Type":"ContainerStarted","Data":"63a1052f1effc0dc79367ec730823cf039b6f4d69b274e79a00e8e8eb88bb58a"} Sep 18 12:03:55.181526 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:55.181423 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9wwlp" podStartSLOduration=2.139820888 podStartE2EDuration="3.181398958s" totalImagesPullingTime="1.04157807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 12:03:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:03:55.15693345 +0000 UTC m=+158.161621174" watchObservedRunningTime="2026-09-18 12:03:55.181398958 +0000 UTC m=+158.186086872" Sep 18 12:03:55.295853 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:55.295823 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 12:03:55.298592 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:03:55.298560 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3086576_e665_4430_81ed_3c61cf08b127.slice/crio-7af69b89dc67f4e8f8c9da08e0b0438410ca8ba1636232fee74dd07cb235891b WatchSource:0}: Error finding container 7af69b89dc67f4e8f8c9da08e0b0438410ca8ba1636232fee74dd07cb235891b: Status 404 returned error can't find the container with id 7af69b89dc67f4e8f8c9da08e0b0438410ca8ba1636232fee74dd07cb235891b Sep 18 12:03:55.387491 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:03:55.387449 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-8bc5597b7-jd884" podUID="1224ce74-74ed-47ba-b9f4-3b1c79ef5933" Sep 18 12:03:55.416724 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:03:55.416682 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-fzjc7" podUID="234d0ce2-2eb9-4560-9208-1c28699d7263" Sep 18 12:03:55.478706 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:03:55.478620 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-lvx4s" podUID="a7f89718-22f1-4c13-aff1-d2fa5ff92c55" Sep 18 12:03:55.858061 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:55.857972 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:55.945827 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:55.945793 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:56.037544 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:56.037505 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:56.143786 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:56.143747 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gbwgw" event={"ID":"b3e92bbb-d31f-4b16-a16b-76b8d8641290","Type":"ContainerStarted","Data":"d8c7e350c3e3662cf145f3640f83b0a06cf1d5dd23d6baf81fd3f4ac43ffe52a"} Sep 18 12:03:56.143951 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:56.143815 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gbwgw" event={"ID":"b3e92bbb-d31f-4b16-a16b-76b8d8641290","Type":"ContainerStarted","Data":"40159b1f9c05d162d6e21c09239078461e62673a528cd4f98e916bce004db2f1"} Sep 18 12:03:56.146258 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:56.146224 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-tqxsv" event={"ID":"f8bbc657-9de5-4b0d-8876-abfd078f9062","Type":"ContainerStarted","Data":"1085e1a355d4a66af53f4c949cc59966bc2fad124276ee0be0cc10980df3c57c"} Sep 18 12:03:56.146399 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:56.146281 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-tqxsv" event={"ID":"f8bbc657-9de5-4b0d-8876-abfd078f9062","Type":"ContainerStarted","Data":"e0596a838a819c7145177b91e7cba3256135bea4a7ce31e6be2501288bcd5805"} Sep 18 12:03:56.147923 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:56.147905 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fzjc7" Sep 18 12:03:56.148021 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:56.147949 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3086576-e665-4430-81ed-3c61cf08b127","Type":"ContainerStarted","Data":"7af69b89dc67f4e8f8c9da08e0b0438410ca8ba1636232fee74dd07cb235891b"} Sep 18 12:03:56.148325 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:56.148300 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:03:56.167660 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:56.167614 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gbwgw" podStartSLOduration=3.047602919 podStartE2EDuration="4.167599583s" totalImagesPullingTime="1.03858007s" totalInitContainerRuntime="81.416594ms" isStatefulPod=true podCreationTimestamp="2026-09-18 12:03:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:03:56.165815143 +0000 UTC m=+159.170502868" watchObservedRunningTime="2026-09-18 12:03:56.167599583 +0000 UTC m=+159.172287305" Sep 18 12:03:56.193119 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:56.193071 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-tqxsv" podStartSLOduration=2.654818571 podStartE2EDuration="4.193055745s" totalImagesPullingTime="1.538237174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 12:03:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:03:56.19168522 +0000 UTC m=+159.196372944" watchObservedRunningTime="2026-09-18 12:03:56.193055745 +0000 UTC m=+159.197743468" Sep 18 12:03:56.277120 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:56.277074 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:56.463486 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:56.463459 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78c5f6c6b7-6nvqq" Sep 18 12:03:56.463599 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:56.463505 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78c5f6c6b7-6nvqq" Sep 18 12:03:56.464903 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:56.464881 2578 patch_prober.go:28] interesting pod/console-78c5f6c6b7-6nvqq container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.16:8443/health\": dial tcp 10.132.0.16:8443: connect: connection refused" start-of-body= Sep 18 12:03:56.465063 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:56.464919 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-78c5f6c6b7-6nvqq" podUID="f38c726d-39d9-4ff4-87a5-e23ce290d469" containerName="console" probeResult="failure" output="Get \"https://10.132.0.16:8443/health\": dial tcp 10.132.0.16:8443: connect: connection refused" Sep 18 12:03:57.153419 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.153384 2578 generic.go:356] "Generic (PLEG): container finished" podID="d3086576-e665-4430-81ed-3c61cf08b127" containerID="e9b4e1495643666251a80613a1da5860b9104a74807eb922e17757793d943cb7" exitCode=0 Sep 18 12:03:57.153910 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.153468 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3086576-e665-4430-81ed-3c61cf08b127","Type":"ContainerDied","Data":"e9b4e1495643666251a80613a1da5860b9104a74807eb922e17757793d943cb7"} Sep 18 12:03:57.256938 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.256910 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5df5475c48-btngp"] Sep 18 12:03:57.261235 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.261209 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5df5475c48-btngp" Sep 18 12:03:57.263876 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.263853 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vmwlq\"" Sep 18 12:03:57.264028 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.263894 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 18 12:03:57.264028 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.263931 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-aecfnt9iajsa3\"" Sep 18 12:03:57.264028 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.264014 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 18 12:03:57.264893 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.264872 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 18 12:03:57.265012 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.264954 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 18 12:03:57.272899 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.272882 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5df5475c48-btngp"] Sep 18 12:03:57.394000 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.393968 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9s7s\" (UniqueName: \"kubernetes.io/projected/3a0e8d85-19cc-4600-a88b-6f93f31cde7c-kube-api-access-f9s7s\") pod \"metrics-server-5df5475c48-btngp\" (UID: \"3a0e8d85-19cc-4600-a88b-6f93f31cde7c\") " pod="openshift-monitoring/metrics-server-5df5475c48-btngp" Sep 18 12:03:57.394000 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.394002 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3a0e8d85-19cc-4600-a88b-6f93f31cde7c-secret-metrics-server-client-certs\") pod \"metrics-server-5df5475c48-btngp\" (UID: \"3a0e8d85-19cc-4600-a88b-6f93f31cde7c\") " pod="openshift-monitoring/metrics-server-5df5475c48-btngp" Sep 18 12:03:57.394183 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.394039 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a0e8d85-19cc-4600-a88b-6f93f31cde7c-client-ca-bundle\") pod \"metrics-server-5df5475c48-btngp\" (UID: \"3a0e8d85-19cc-4600-a88b-6f93f31cde7c\") " pod="openshift-monitoring/metrics-server-5df5475c48-btngp" Sep 18 12:03:57.394183 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.394082 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a0e8d85-19cc-4600-a88b-6f93f31cde7c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5df5475c48-btngp\" (UID: \"3a0e8d85-19cc-4600-a88b-6f93f31cde7c\") " pod="openshift-monitoring/metrics-server-5df5475c48-btngp" Sep 18 12:03:57.394183 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.394101 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3a0e8d85-19cc-4600-a88b-6f93f31cde7c-metrics-server-audit-profiles\") pod \"metrics-server-5df5475c48-btngp\" (UID: \"3a0e8d85-19cc-4600-a88b-6f93f31cde7c\") " pod="openshift-monitoring/metrics-server-5df5475c48-btngp" Sep 18 12:03:57.394183 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.394155 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3a0e8d85-19cc-4600-a88b-6f93f31cde7c-audit-log\") pod \"metrics-server-5df5475c48-btngp\" (UID: \"3a0e8d85-19cc-4600-a88b-6f93f31cde7c\") " pod="openshift-monitoring/metrics-server-5df5475c48-btngp" Sep 18 12:03:57.394295 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.394199 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3a0e8d85-19cc-4600-a88b-6f93f31cde7c-secret-metrics-server-tls\") pod \"metrics-server-5df5475c48-btngp\" (UID: \"3a0e8d85-19cc-4600-a88b-6f93f31cde7c\") " pod="openshift-monitoring/metrics-server-5df5475c48-btngp" Sep 18 12:03:57.495267 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.495183 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3a0e8d85-19cc-4600-a88b-6f93f31cde7c-secret-metrics-server-tls\") pod \"metrics-server-5df5475c48-btngp\" (UID: \"3a0e8d85-19cc-4600-a88b-6f93f31cde7c\") " pod="openshift-monitoring/metrics-server-5df5475c48-btngp" Sep 18 12:03:57.495267 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.495219 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9s7s\" (UniqueName: \"kubernetes.io/projected/3a0e8d85-19cc-4600-a88b-6f93f31cde7c-kube-api-access-f9s7s\") pod \"metrics-server-5df5475c48-btngp\" (UID: \"3a0e8d85-19cc-4600-a88b-6f93f31cde7c\") " pod="openshift-monitoring/metrics-server-5df5475c48-btngp" Sep 18 12:03:57.495267 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.495246 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3a0e8d85-19cc-4600-a88b-6f93f31cde7c-secret-metrics-server-client-certs\") pod \"metrics-server-5df5475c48-btngp\" (UID: \"3a0e8d85-19cc-4600-a88b-6f93f31cde7c\") " pod="openshift-monitoring/metrics-server-5df5475c48-btngp" Sep 18 12:03:57.495267 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.495262 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a0e8d85-19cc-4600-a88b-6f93f31cde7c-client-ca-bundle\") pod \"metrics-server-5df5475c48-btngp\" (UID: \"3a0e8d85-19cc-4600-a88b-6f93f31cde7c\") " pod="openshift-monitoring/metrics-server-5df5475c48-btngp" Sep 18 12:03:57.495614 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.495309 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a0e8d85-19cc-4600-a88b-6f93f31cde7c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5df5475c48-btngp\" (UID: \"3a0e8d85-19cc-4600-a88b-6f93f31cde7c\") " pod="openshift-monitoring/metrics-server-5df5475c48-btngp" Sep 18 12:03:57.495614 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.495327 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3a0e8d85-19cc-4600-a88b-6f93f31cde7c-metrics-server-audit-profiles\") pod \"metrics-server-5df5475c48-btngp\" (UID: \"3a0e8d85-19cc-4600-a88b-6f93f31cde7c\") " pod="openshift-monitoring/metrics-server-5df5475c48-btngp" Sep 18 12:03:57.495614 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.495370 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3a0e8d85-19cc-4600-a88b-6f93f31cde7c-audit-log\") pod \"metrics-server-5df5475c48-btngp\" (UID: \"3a0e8d85-19cc-4600-a88b-6f93f31cde7c\") " pod="openshift-monitoring/metrics-server-5df5475c48-btngp" Sep 18 12:03:57.495771 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.495749 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3a0e8d85-19cc-4600-a88b-6f93f31cde7c-audit-log\") pod \"metrics-server-5df5475c48-btngp\" (UID: \"3a0e8d85-19cc-4600-a88b-6f93f31cde7c\") " pod="openshift-monitoring/metrics-server-5df5475c48-btngp" Sep 18 12:03:57.496097 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.496074 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a0e8d85-19cc-4600-a88b-6f93f31cde7c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5df5475c48-btngp\" (UID: \"3a0e8d85-19cc-4600-a88b-6f93f31cde7c\") " pod="openshift-monitoring/metrics-server-5df5475c48-btngp" Sep 18 12:03:57.496677 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.496655 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3a0e8d85-19cc-4600-a88b-6f93f31cde7c-metrics-server-audit-profiles\") pod \"metrics-server-5df5475c48-btngp\" (UID: \"3a0e8d85-19cc-4600-a88b-6f93f31cde7c\") " pod="openshift-monitoring/metrics-server-5df5475c48-btngp" Sep 18 12:03:57.497891 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.497860 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3a0e8d85-19cc-4600-a88b-6f93f31cde7c-secret-metrics-server-client-certs\") pod \"metrics-server-5df5475c48-btngp\" (UID: \"3a0e8d85-19cc-4600-a88b-6f93f31cde7c\") " pod="openshift-monitoring/metrics-server-5df5475c48-btngp" Sep 18 12:03:57.497967 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.497937 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3a0e8d85-19cc-4600-a88b-6f93f31cde7c-secret-metrics-server-tls\") pod \"metrics-server-5df5475c48-btngp\" (UID: \"3a0e8d85-19cc-4600-a88b-6f93f31cde7c\") " pod="openshift-monitoring/metrics-server-5df5475c48-btngp" Sep 18 12:03:57.498021 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.498006 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3a0e8d85-19cc-4600-a88b-6f93f31cde7c-client-ca-bundle\") pod \"metrics-server-5df5475c48-btngp\" (UID: \"3a0e8d85-19cc-4600-a88b-6f93f31cde7c\") " pod="openshift-monitoring/metrics-server-5df5475c48-btngp" Sep 18 12:03:57.504662 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.504643 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9s7s\" (UniqueName: \"kubernetes.io/projected/3a0e8d85-19cc-4600-a88b-6f93f31cde7c-kube-api-access-f9s7s\") pod \"metrics-server-5df5475c48-btngp\" (UID: \"3a0e8d85-19cc-4600-a88b-6f93f31cde7c\") " pod="openshift-monitoring/metrics-server-5df5475c48-btngp" Sep 18 12:03:57.570409 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.570382 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5df5475c48-btngp" Sep 18 12:03:57.686325 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.686277 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:57.701106 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.701075 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7489b9c6d4-lp795"] Sep 18 12:03:57.708935 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.708907 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-64pmv"] Sep 18 12:03:57.715315 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.715294 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-64pmv" Sep 18 12:03:57.718182 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.717996 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 18 12:03:57.718730 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.718636 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rfxx8\"" Sep 18 12:03:57.730632 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.730220 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-64pmv"] Sep 18 12:03:57.793280 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.793196 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:57.798467 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.798411 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm9h6\" (UniqueName: \"kubernetes.io/projected/06f17360-3b6f-4781-ab7f-c2a03ff519d9-kube-api-access-nm9h6\") pod \"monitoring-plugin-5984459ff8-64pmv\" (UID: \"06f17360-3b6f-4781-ab7f-c2a03ff519d9\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-64pmv" Sep 18 12:03:57.798647 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.798619 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/06f17360-3b6f-4781-ab7f-c2a03ff519d9-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-64pmv\" (UID: \"06f17360-3b6f-4781-ab7f-c2a03ff519d9\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-64pmv" Sep 18 12:03:57.850765 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.850741 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5df5475c48-btngp"] Sep 18 12:03:57.853279 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:03:57.853250 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a0e8d85_19cc_4600_a88b_6f93f31cde7c.slice/crio-aa4a58f76a96f6fadfee5334d377366bf99d46e67ccb37f745ad720b73176721 WatchSource:0}: Error finding container aa4a58f76a96f6fadfee5334d377366bf99d46e67ccb37f745ad720b73176721: Status 404 returned error can't find the container with id aa4a58f76a96f6fadfee5334d377366bf99d46e67ccb37f745ad720b73176721 Sep 18 12:03:57.900068 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.900035 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/06f17360-3b6f-4781-ab7f-c2a03ff519d9-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-64pmv\" (UID: \"06f17360-3b6f-4781-ab7f-c2a03ff519d9\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-64pmv" Sep 18 12:03:57.900749 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.900118 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm9h6\" (UniqueName: \"kubernetes.io/projected/06f17360-3b6f-4781-ab7f-c2a03ff519d9-kube-api-access-nm9h6\") pod \"monitoring-plugin-5984459ff8-64pmv\" (UID: \"06f17360-3b6f-4781-ab7f-c2a03ff519d9\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-64pmv" Sep 18 12:03:57.903413 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.903391 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/06f17360-3b6f-4781-ab7f-c2a03ff519d9-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-64pmv\" (UID: \"06f17360-3b6f-4781-ab7f-c2a03ff519d9\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-64pmv" Sep 18 12:03:57.909732 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.909708 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm9h6\" (UniqueName: \"kubernetes.io/projected/06f17360-3b6f-4781-ab7f-c2a03ff519d9-kube-api-access-nm9h6\") pod \"monitoring-plugin-5984459ff8-64pmv\" (UID: \"06f17360-3b6f-4781-ab7f-c2a03ff519d9\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-64pmv" Sep 18 12:03:57.912590 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:57.912559 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:58.032631 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:58.032593 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-64pmv" Sep 18 12:03:58.158933 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:58.158902 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5df5475c48-btngp" event={"ID":"3a0e8d85-19cc-4600-a88b-6f93f31cde7c","Type":"ContainerStarted","Data":"aa4a58f76a96f6fadfee5334d377366bf99d46e67ccb37f745ad720b73176721"} Sep 18 12:03:58.333580 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:58.333423 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-64pmv"] Sep 18 12:03:58.714547 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:03:58.714511 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06f17360_3b6f_4781_ab7f_c2a03ff519d9.slice/crio-c8eee28796144ef7633d96ce1e0378d63c930eec12575e741f6b1198ffa20af7 WatchSource:0}: Error finding container c8eee28796144ef7633d96ce1e0378d63c930eec12575e741f6b1198ffa20af7: Status 404 returned error can't find the container with id c8eee28796144ef7633d96ce1e0378d63c930eec12575e741f6b1198ffa20af7 Sep 18 12:03:59.170019 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.169986 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 12:03:59.174068 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.174008 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:03:59.174844 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.174792 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3086576-e665-4430-81ed-3c61cf08b127","Type":"ContainerStarted","Data":"f93c01278c4a43a1742c20713b6981517989cc430fec7a1ae8f6e151c1df05e8"} Sep 18 12:03:59.175136 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.175120 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-64pmv" event={"ID":"06f17360-3b6f-4781-ab7f-c2a03ff519d9","Type":"ContainerStarted","Data":"c8eee28796144ef7633d96ce1e0378d63c930eec12575e741f6b1198ffa20af7"} Sep 18 12:03:59.175254 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.175058 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.179328 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.179307 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 18 12:03:59.179483 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.179347 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 18 12:03:59.179483 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.179374 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 18 12:03:59.179951 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.179822 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7geol4575n70j\"" Sep 18 12:03:59.179951 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.179838 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 18 12:03:59.182025 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.181988 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 18 12:03:59.182025 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.182009 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-98g9h\"" Sep 18 12:03:59.182356 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.182337 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 18 12:03:59.182479 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.182383 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 18 12:03:59.182479 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.182392 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 18 12:03:59.182591 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.182481 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 18 12:03:59.182591 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.182548 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 18 12:03:59.182691 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.182640 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 18 12:03:59.182691 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.182665 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 18 12:03:59.183131 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.183112 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 18 12:03:59.184337 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.184319 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 18 12:03:59.196418 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.196392 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 12:03:59.315181 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.315159 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.315286 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.315188 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfm2f\" (UniqueName: \"kubernetes.io/projected/8abab63f-e025-41d6-b087-5b54732fc49c-kube-api-access-pfm2f\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.315286 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.315219 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-config\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.315286 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.315256 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.315463 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.315338 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.315463 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.315363 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.315463 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.315393 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8abab63f-e025-41d6-b087-5b54732fc49c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.315463 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.315409 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.315463 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.315428 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.315730 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.315554 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8abab63f-e025-41d6-b087-5b54732fc49c-config-out\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.315730 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.315583 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.315730 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.315612 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.315730 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.315649 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.315730 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.315674 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.315730 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.315693 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.315730 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.315706 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-web-config\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.315730 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.315720 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.316118 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.315761 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8abab63f-e025-41d6-b087-5b54732fc49c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.316118 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.315783 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.316118 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.315802 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.416900 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.416869 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8abab63f-e025-41d6-b087-5b54732fc49c-config-out\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.416996 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.416924 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.416996 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.416958 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.417118 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.417008 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.417118 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.417036 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.417118 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.417060 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.417118 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.417085 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-web-config\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.417118 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.417111 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.417344 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.417146 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8abab63f-e025-41d6-b087-5b54732fc49c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.417344 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.417172 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.417344 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.417205 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.417344 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.417233 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.417344 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.417256 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfm2f\" (UniqueName: \"kubernetes.io/projected/8abab63f-e025-41d6-b087-5b54732fc49c-kube-api-access-pfm2f\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.417344 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.417300 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-config\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.417344 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.417324 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.417688 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.417384 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.417688 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.417414 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.417688 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.417466 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8abab63f-e025-41d6-b087-5b54732fc49c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.417688 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.417490 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.417688 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.417519 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.422391 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.418732 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.422391 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.419190 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.422391 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.419258 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.422391 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.419418 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.422391 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.419567 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8abab63f-e025-41d6-b087-5b54732fc49c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.422391 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.420392 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.422391 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.421775 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.423055 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.422541 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.423677 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.423528 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.423677 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.423557 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.423677 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.423594 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.425230 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.425204 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.425413 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.425387 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.425616 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.425574 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.425837 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.425786 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8abab63f-e025-41d6-b087-5b54732fc49c-config-out\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.427127 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.427104 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8abab63f-e025-41d6-b087-5b54732fc49c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.427598 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.427576 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-config\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.427953 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.427931 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-web-config\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.428798 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.428757 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.434480 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.434039 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfm2f\" (UniqueName: \"kubernetes.io/projected/8abab63f-e025-41d6-b087-5b54732fc49c-kube-api-access-pfm2f\") pod \"prometheus-k8s-0\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.488979 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.488850 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:03:59.809278 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:03:59.808866 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 12:03:59.811636 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:03:59.811606 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8abab63f_e025_41d6_b087_5b54732fc49c.slice/crio-bebe8144ef02df7db4240864d0e833d923e27452ac1567c3fceaaed26c50a363 WatchSource:0}: Error finding container bebe8144ef02df7db4240864d0e833d923e27452ac1567c3fceaaed26c50a363: Status 404 returned error can't find the container with id bebe8144ef02df7db4240864d0e833d923e27452ac1567c3fceaaed26c50a363 Sep 18 12:04:00.180855 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:00.180818 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3086576-e665-4430-81ed-3c61cf08b127","Type":"ContainerStarted","Data":"0e04b929390045246cc896077c9aff0e695911b0ec70d5e5b6f28f6be1d0b3ec"} Sep 18 12:04:00.181361 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:00.180901 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3086576-e665-4430-81ed-3c61cf08b127","Type":"ContainerStarted","Data":"0fb467ea614481bdbbc765d4132240cd256b08053e23242d024ee3acd397b775"} Sep 18 12:04:00.181361 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:00.180943 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3086576-e665-4430-81ed-3c61cf08b127","Type":"ContainerStarted","Data":"4252704c3cec22fae5681b8abac6ccf83f4fc9bf3dcb06e941fc483863c97faf"} Sep 18 12:04:00.181361 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:00.180985 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3086576-e665-4430-81ed-3c61cf08b127","Type":"ContainerStarted","Data":"e0dc4c97e78e5282df5a2b30520d3480e45e4074fed53c3d7b4a97372d7d8205"} Sep 18 12:04:00.182693 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:00.182581 2578 generic.go:356] "Generic (PLEG): container finished" podID="8abab63f-e025-41d6-b087-5b54732fc49c" containerID="c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d" exitCode=0 Sep 18 12:04:00.182693 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:00.182662 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8abab63f-e025-41d6-b087-5b54732fc49c","Type":"ContainerDied","Data":"c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d"} Sep 18 12:04:00.182865 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:00.182729 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8abab63f-e025-41d6-b087-5b54732fc49c","Type":"ContainerStarted","Data":"bebe8144ef02df7db4240864d0e833d923e27452ac1567c3fceaaed26c50a363"} Sep 18 12:04:00.184624 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:00.184499 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5df5475c48-btngp" event={"ID":"3a0e8d85-19cc-4600-a88b-6f93f31cde7c","Type":"ContainerStarted","Data":"d032d5fd9f43450eb1b45226afd58658cc851e63205ca4f07bbc907b2e80708e"} Sep 18 12:04:00.239920 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:00.239861 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5df5475c48-btngp" podStartSLOduration=1.749431823 podStartE2EDuration="3.239837478s" totalImagesPullingTime="1.490405655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 12:03:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:04:00.238481872 +0000 UTC m=+163.243169596" watchObservedRunningTime="2026-09-18 12:04:00.239837478 +0000 UTC m=+163.244525202" Sep 18 12:04:00.331671 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:00.330279 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-tls\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:04:00.331671 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:00.330690 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/234d0ce2-2eb9-4560-9208-1c28699d7263-metrics-tls\") pod \"dns-default-fzjc7\" (UID: \"234d0ce2-2eb9-4560-9208-1c28699d7263\") " pod="openshift-dns/dns-default-fzjc7" Sep 18 12:04:00.333709 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:00.333683 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-tls\") pod \"image-registry-8bc5597b7-jd884\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:04:00.333918 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:00.333901 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/234d0ce2-2eb9-4560-9208-1c28699d7263-metrics-tls\") pod \"dns-default-fzjc7\" (UID: \"234d0ce2-2eb9-4560-9208-1c28699d7263\") " pod="openshift-dns/dns-default-fzjc7" Sep 18 12:04:00.351848 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:00.351823 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6t8bg\"" Sep 18 12:04:00.351968 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:00.351919 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zr922\"" Sep 18 12:04:00.359291 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:00.359260 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:04:00.359413 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:00.359376 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fzjc7" Sep 18 12:04:00.779635 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:00.779557 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fzjc7"] Sep 18 12:04:00.782081 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:04:00.781978 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod234d0ce2_2eb9_4560_9208_1c28699d7263.slice/crio-bc158441e97f990be66340cf018f6af54c5b7df3199b223c5b69c7ab1e1508e9 WatchSource:0}: Error finding container bc158441e97f990be66340cf018f6af54c5b7df3199b223c5b69c7ab1e1508e9: Status 404 returned error can't find the container with id bc158441e97f990be66340cf018f6af54c5b7df3199b223c5b69c7ab1e1508e9 Sep 18 12:04:00.783761 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:00.783737 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8bc5597b7-jd884"] Sep 18 12:04:00.785153 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:04:00.785123 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1224ce74_74ed_47ba_b9f4_3b1c79ef5933.slice/crio-2315f2d12bb43aa7cda807be13516423a8403a38480690dce26152eedb26e533 WatchSource:0}: Error finding container 2315f2d12bb43aa7cda807be13516423a8403a38480690dce26152eedb26e533: Status 404 returned error can't find the container with id 2315f2d12bb43aa7cda807be13516423a8403a38480690dce26152eedb26e533 Sep 18 12:04:01.193825 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:01.193793 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-64pmv" event={"ID":"06f17360-3b6f-4781-ab7f-c2a03ff519d9","Type":"ContainerStarted","Data":"25859736d1c81b694211f6a36b64d848fd7201224a2d2565651e3ba07b541213"} Sep 18 12:04:01.194272 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:01.193926 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-64pmv" Sep 18 12:04:01.195167 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:01.195141 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fzjc7" event={"ID":"234d0ce2-2eb9-4560-9208-1c28699d7263","Type":"ContainerStarted","Data":"bc158441e97f990be66340cf018f6af54c5b7df3199b223c5b69c7ab1e1508e9"} Sep 18 12:04:01.196896 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:01.196874 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8bc5597b7-jd884" event={"ID":"1224ce74-74ed-47ba-b9f4-3b1c79ef5933","Type":"ContainerStarted","Data":"b113ba5c666c1b8002348d013b3379647f3aacdb66342acb0e213cbf4170452b"} Sep 18 12:04:01.196997 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:01.196919 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8bc5597b7-jd884" event={"ID":"1224ce74-74ed-47ba-b9f4-3b1c79ef5933","Type":"ContainerStarted","Data":"2315f2d12bb43aa7cda807be13516423a8403a38480690dce26152eedb26e533"} Sep 18 12:04:01.196997 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:01.196945 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:04:01.198971 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:01.198956 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-64pmv" Sep 18 12:04:01.200834 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:01.200815 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3086576-e665-4430-81ed-3c61cf08b127","Type":"ContainerStarted","Data":"eb11012bcf39409e205092b6edf18112bde08f57ad49a975f9ac435a4859f082"} Sep 18 12:04:01.212422 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:01.212387 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-64pmv" podStartSLOduration=2.421565784 podStartE2EDuration="4.212350221s" totalImagesPullingTime="1.790784437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 12:03:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:04:01.211790437 +0000 UTC m=+164.216478163" watchObservedRunningTime="2026-09-18 12:04:01.212350221 +0000 UTC m=+164.217037985" Sep 18 12:04:01.263301 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:01.263239 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.625088118 podStartE2EDuration="7.263216109s" totalImagesPullingTime="3.622503685s" totalInitContainerRuntime="15.624306ms" isStatefulPod=false podCreationTimestamp="2026-09-18 12:03:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:04:01.260711564 +0000 UTC m=+164.265399287" watchObservedRunningTime="2026-09-18 12:04:01.263216109 +0000 UTC m=+164.267903833" Sep 18 12:04:01.291503 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:01.291356 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8bc5597b7-jd884" podStartSLOduration=162.291333637 podStartE2EDuration="2m42.291333637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 12:01:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:04:01.288402795 +0000 UTC m=+164.293090519" watchObservedRunningTime="2026-09-18 12:04:01.291333637 +0000 UTC m=+164.296021360" Sep 18 12:04:03.213629 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:03.213588 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fzjc7" event={"ID":"234d0ce2-2eb9-4560-9208-1c28699d7263","Type":"ContainerStarted","Data":"4d588cf56b545d7a28a0c872a3cdeaf8acbdfd7fdfcd119455442b351525e350"} Sep 18 12:04:04.220577 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:04.220540 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fzjc7" event={"ID":"234d0ce2-2eb9-4560-9208-1c28699d7263","Type":"ContainerStarted","Data":"6533fd8123563cde24a8ad796f0a89cfd25e54c9fe6f473acdfb24ee7b990c45"} Sep 18 12:04:04.221051 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:04.220735 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fzjc7" Sep 18 12:04:04.223294 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:04.223263 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8abab63f-e025-41d6-b087-5b54732fc49c","Type":"ContainerStarted","Data":"8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c"} Sep 18 12:04:04.223416 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:04.223339 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8abab63f-e025-41d6-b087-5b54732fc49c","Type":"ContainerStarted","Data":"ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5"} Sep 18 12:04:04.242032 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:04.241988 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fzjc7" podStartSLOduration=130.419449017 podStartE2EDuration="2m12.241973119s" totalImagesPullingTime="1.822524102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 12:01:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:04:04.240451387 +0000 UTC m=+167.245139102" watchObservedRunningTime="2026-09-18 12:04:04.241973119 +0000 UTC m=+167.246660869" Sep 18 12:04:04.953638 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:04.953600 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:05.045897 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:05.045867 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:06.236008 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:06.235976 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8abab63f-e025-41d6-b087-5b54732fc49c","Type":"ContainerStarted","Data":"d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24"} Sep 18 12:04:06.236367 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:06.236069 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8abab63f-e025-41d6-b087-5b54732fc49c","Type":"ContainerStarted","Data":"a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88"} Sep 18 12:04:06.236367 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:06.236098 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8abab63f-e025-41d6-b087-5b54732fc49c","Type":"ContainerStarted","Data":"4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317"} Sep 18 12:04:06.236367 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:06.236130 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8abab63f-e025-41d6-b087-5b54732fc49c","Type":"ContainerStarted","Data":"00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602"} Sep 18 12:04:06.278566 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:06.278504 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.7935726509999999 podStartE2EDuration="7.278482959s" totalImagesPullingTime="5.461430447s" totalInitContainerRuntime="23.479861ms" isStatefulPod=false podCreationTimestamp="2026-09-18 12:03:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:04:06.278189532 +0000 UTC m=+169.282877279" watchObservedRunningTime="2026-09-18 12:04:06.278482959 +0000 UTC m=+169.283170683" Sep 18 12:04:06.464221 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:06.464182 2578 patch_prober.go:28] interesting pod/console-78c5f6c6b7-6nvqq container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.16:8443/health\": dial tcp 10.132.0.16:8443: connect: connection refused" start-of-body= Sep 18 12:04:06.464363 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:06.464233 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-78c5f6c6b7-6nvqq" podUID="f38c726d-39d9-4ff4-87a5-e23ce290d469" containerName="console" probeResult="failure" output="Get \"https://10.132.0.16:8443/health\": dial tcp 10.132.0.16:8443: connect: connection refused" Sep 18 12:04:09.460942 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:09.460864 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:04:09.489998 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:09.489969 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:04:11.222260 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:11.222203 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:11.306331 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:11.306298 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:13.201153 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:13.201121 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:13.305557 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:13.305522 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:14.230403 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:14.230374 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fzjc7" Sep 18 12:04:14.641398 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:14.641362 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:14.715992 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:14.715964 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:16.463670 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:16.463633 2578 patch_prober.go:28] interesting pod/console-78c5f6c6b7-6nvqq container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.16:8443/health\": dial tcp 10.132.0.16:8443: connect: connection refused" start-of-body= Sep 18 12:04:16.464050 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:16.463689 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-78c5f6c6b7-6nvqq" podUID="f38c726d-39d9-4ff4-87a5-e23ce290d469" containerName="console" probeResult="failure" output="Get \"https://10.132.0.16:8443/health\": dial tcp 10.132.0.16:8443: connect: connection refused" Sep 18 12:04:17.571344 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:17.571302 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5df5475c48-btngp" Sep 18 12:04:17.571749 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:17.571367 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5df5475c48-btngp" Sep 18 12:04:18.166422 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:18.166388 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78c5f6c6b7-6nvqq"] Sep 18 12:04:18.302848 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:18.302811 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:18.404111 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:18.404079 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:18.505676 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:18.505599 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:18.987538 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:18.987500 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:19.071160 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:19.071125 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:20.364086 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:20.364054 2578 patch_prober.go:28] interesting pod/image-registry-8bc5597b7-jd884 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 18 12:04:20.364473 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:20.364111 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-8bc5597b7-jd884" podUID="1224ce74-74ed-47ba-b9f4-3b1c79ef5933" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 18 12:04:22.211005 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:22.210972 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:04:22.448673 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:22.448636 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:22.551686 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:22.551599 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:22.731319 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:22.731275 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7489b9c6d4-lp795" podUID="8521b30f-b709-4088-8560-d3c8a4da8318" containerName="console" containerID="cri-o://18dd27ccb0beabb9f8ec8868be5cd0925752e5e7eb907cc0914de3c0d7e371e2" gracePeriod=15 Sep 18 12:04:22.969956 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:22.969931 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7489b9c6d4-lp795" Sep 18 12:04:23.055645 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:23.055618 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kd2r5\" (UniqueName: \"kubernetes.io/projected/8521b30f-b709-4088-8560-d3c8a4da8318-kube-api-access-kd2r5\") pod \"8521b30f-b709-4088-8560-d3c8a4da8318\" (UID: \"8521b30f-b709-4088-8560-d3c8a4da8318\") " Sep 18 12:04:23.055810 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:23.055661 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8521b30f-b709-4088-8560-d3c8a4da8318-console-serving-cert\") pod \"8521b30f-b709-4088-8560-d3c8a4da8318\" (UID: \"8521b30f-b709-4088-8560-d3c8a4da8318\") " Sep 18 12:04:23.055810 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:23.055680 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8521b30f-b709-4088-8560-d3c8a4da8318-console-oauth-config\") pod \"8521b30f-b709-4088-8560-d3c8a4da8318\" (UID: \"8521b30f-b709-4088-8560-d3c8a4da8318\") " Sep 18 12:04:23.055810 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:23.055714 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8521b30f-b709-4088-8560-d3c8a4da8318-oauth-serving-cert\") pod \"8521b30f-b709-4088-8560-d3c8a4da8318\" (UID: \"8521b30f-b709-4088-8560-d3c8a4da8318\") " Sep 18 12:04:23.055810 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:23.055746 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8521b30f-b709-4088-8560-d3c8a4da8318-service-ca\") pod \"8521b30f-b709-4088-8560-d3c8a4da8318\" (UID: \"8521b30f-b709-4088-8560-d3c8a4da8318\") " Sep 18 12:04:23.055810 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:23.055767 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8521b30f-b709-4088-8560-d3c8a4da8318-console-config\") pod \"8521b30f-b709-4088-8560-d3c8a4da8318\" (UID: \"8521b30f-b709-4088-8560-d3c8a4da8318\") " Sep 18 12:04:23.056211 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:23.056180 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8521b30f-b709-4088-8560-d3c8a4da8318-service-ca" (OuterVolumeSpecName: "service-ca") pod "8521b30f-b709-4088-8560-d3c8a4da8318" (UID: "8521b30f-b709-4088-8560-d3c8a4da8318"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 12:04:23.056211 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:23.056193 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8521b30f-b709-4088-8560-d3c8a4da8318-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8521b30f-b709-4088-8560-d3c8a4da8318" (UID: "8521b30f-b709-4088-8560-d3c8a4da8318"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 12:04:23.056361 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:23.056223 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8521b30f-b709-4088-8560-d3c8a4da8318-console-config" (OuterVolumeSpecName: "console-config") pod "8521b30f-b709-4088-8560-d3c8a4da8318" (UID: "8521b30f-b709-4088-8560-d3c8a4da8318"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 12:04:23.058173 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:23.058145 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8521b30f-b709-4088-8560-d3c8a4da8318-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8521b30f-b709-4088-8560-d3c8a4da8318" (UID: "8521b30f-b709-4088-8560-d3c8a4da8318"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 12:04:23.058173 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:23.058157 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8521b30f-b709-4088-8560-d3c8a4da8318-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8521b30f-b709-4088-8560-d3c8a4da8318" (UID: "8521b30f-b709-4088-8560-d3c8a4da8318"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 12:04:23.058173 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:23.058158 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8521b30f-b709-4088-8560-d3c8a4da8318-kube-api-access-kd2r5" (OuterVolumeSpecName: "kube-api-access-kd2r5") pod "8521b30f-b709-4088-8560-d3c8a4da8318" (UID: "8521b30f-b709-4088-8560-d3c8a4da8318"). InnerVolumeSpecName "kube-api-access-kd2r5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 12:04:23.157402 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:23.157362 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8521b30f-b709-4088-8560-d3c8a4da8318-console-serving-cert\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:04:23.157550 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:23.157409 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8521b30f-b709-4088-8560-d3c8a4da8318-console-oauth-config\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:04:23.157550 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:23.157425 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8521b30f-b709-4088-8560-d3c8a4da8318-oauth-serving-cert\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:04:23.157550 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:23.157464 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8521b30f-b709-4088-8560-d3c8a4da8318-service-ca\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:04:23.157550 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:23.157477 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8521b30f-b709-4088-8560-d3c8a4da8318-console-config\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:04:23.157550 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:23.157488 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kd2r5\" (UniqueName: \"kubernetes.io/projected/8521b30f-b709-4088-8560-d3c8a4da8318-kube-api-access-kd2r5\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:04:23.307462 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:23.307411 2578 generic.go:356] "Generic (PLEG): container finished" podID="8521b30f-b709-4088-8560-d3c8a4da8318" containerID="18dd27ccb0beabb9f8ec8868be5cd0925752e5e7eb907cc0914de3c0d7e371e2" exitCode=0 Sep 18 12:04:23.307904 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:23.307491 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7489b9c6d4-lp795" Sep 18 12:04:23.307904 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:23.307500 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7489b9c6d4-lp795" event={"ID":"8521b30f-b709-4088-8560-d3c8a4da8318","Type":"ContainerDied","Data":"18dd27ccb0beabb9f8ec8868be5cd0925752e5e7eb907cc0914de3c0d7e371e2"} Sep 18 12:04:23.307904 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:23.307553 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7489b9c6d4-lp795" event={"ID":"8521b30f-b709-4088-8560-d3c8a4da8318","Type":"ContainerDied","Data":"b804b69569647e3a5eab0c8b5f7de81652ecdc7869025a50fb392e2162857c4e"} Sep 18 12:04:23.307904 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:23.307576 2578 scope.go:117] "RemoveContainer" containerID="18dd27ccb0beabb9f8ec8868be5cd0925752e5e7eb907cc0914de3c0d7e371e2" Sep 18 12:04:23.319526 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:23.319497 2578 scope.go:117] "RemoveContainer" containerID="18dd27ccb0beabb9f8ec8868be5cd0925752e5e7eb907cc0914de3c0d7e371e2" Sep 18 12:04:23.319837 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:04:23.319808 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18dd27ccb0beabb9f8ec8868be5cd0925752e5e7eb907cc0914de3c0d7e371e2\": container with ID starting with 18dd27ccb0beabb9f8ec8868be5cd0925752e5e7eb907cc0914de3c0d7e371e2 not found: ID does not exist" containerID="18dd27ccb0beabb9f8ec8868be5cd0925752e5e7eb907cc0914de3c0d7e371e2" Sep 18 12:04:23.319947 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:23.319843 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18dd27ccb0beabb9f8ec8868be5cd0925752e5e7eb907cc0914de3c0d7e371e2"} err="failed to get container status \"18dd27ccb0beabb9f8ec8868be5cd0925752e5e7eb907cc0914de3c0d7e371e2\": rpc error: code = NotFound desc = could not find container \"18dd27ccb0beabb9f8ec8868be5cd0925752e5e7eb907cc0914de3c0d7e371e2\": container with ID starting with 18dd27ccb0beabb9f8ec8868be5cd0925752e5e7eb907cc0914de3c0d7e371e2 not found: ID does not exist" Sep 18 12:04:23.334326 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:23.334302 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7489b9c6d4-lp795"] Sep 18 12:04:23.340472 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:23.340451 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7489b9c6d4-lp795"] Sep 18 12:04:23.433517 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:23.433427 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:23.464975 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:23.464953 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8521b30f-b709-4088-8560-d3c8a4da8318" path="/var/lib/kubelet/pods/8521b30f-b709-4088-8560-d3c8a4da8318/volumes" Sep 18 12:04:30.418318 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:30.418284 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8bc5597b7-jd884"] Sep 18 12:04:30.527490 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:30.527462 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:30.625142 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:30.625106 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:30.730962 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:30.730897 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:36.780357 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:36.780299 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fzjc7_234d0ce2-2eb9-4560-9208-1c28699d7263/dns/0.log" Sep 18 12:04:36.980865 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:36.980826 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fzjc7_234d0ce2-2eb9-4560-9208-1c28699d7263/kube-rbac-proxy/0.log" Sep 18 12:04:37.576523 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:37.576488 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5df5475c48-btngp" Sep 18 12:04:37.580264 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:37.580244 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5df5475c48-btngp" Sep 18 12:04:37.608892 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:37.608866 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:37.717793 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:37.717761 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:38.180993 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:38.180964 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rvwkx_e518b32c-52bd-4209-a275-735bb0a88e9f/dns-node-resolver/0.log" Sep 18 12:04:38.779705 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:38.779676 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7xktt_fcbeeb9d-952c-4a61-a38f-6c338e380647/serve-healthcheck-canary/0.log" Sep 18 12:04:39.724280 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:39.724246 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:39.799962 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:39.799917 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:41.249899 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:41.249868 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:41.333735 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:41.333700 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:43.187402 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:43.187365 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78c5f6c6b7-6nvqq" podUID="f38c726d-39d9-4ff4-87a5-e23ce290d469" containerName="console" containerID="cri-o://05f6096166a06671475e403237cecff3334c80fe277bbaff68d78ef7011c575e" gracePeriod=15 Sep 18 12:04:43.393353 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:43.393321 2578 generic.go:356] "Generic (PLEG): container finished" podID="f38c726d-39d9-4ff4-87a5-e23ce290d469" containerID="05f6096166a06671475e403237cecff3334c80fe277bbaff68d78ef7011c575e" exitCode=0 Sep 18 12:04:43.393530 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:43.393387 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78c5f6c6b7-6nvqq" event={"ID":"f38c726d-39d9-4ff4-87a5-e23ce290d469","Type":"ContainerDied","Data":"05f6096166a06671475e403237cecff3334c80fe277bbaff68d78ef7011c575e"} Sep 18 12:04:43.437568 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:43.437516 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78c5f6c6b7-6nvqq" Sep 18 12:04:43.543325 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:43.543297 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f38c726d-39d9-4ff4-87a5-e23ce290d469-oauth-serving-cert\") pod \"f38c726d-39d9-4ff4-87a5-e23ce290d469\" (UID: \"f38c726d-39d9-4ff4-87a5-e23ce290d469\") " Sep 18 12:04:43.543325 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:43.543329 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f38c726d-39d9-4ff4-87a5-e23ce290d469-console-config\") pod \"f38c726d-39d9-4ff4-87a5-e23ce290d469\" (UID: \"f38c726d-39d9-4ff4-87a5-e23ce290d469\") " Sep 18 12:04:43.543592 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:43.543346 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f38c726d-39d9-4ff4-87a5-e23ce290d469-console-oauth-config\") pod \"f38c726d-39d9-4ff4-87a5-e23ce290d469\" (UID: \"f38c726d-39d9-4ff4-87a5-e23ce290d469\") " Sep 18 12:04:43.543592 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:43.543371 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f38c726d-39d9-4ff4-87a5-e23ce290d469-trusted-ca-bundle\") pod \"f38c726d-39d9-4ff4-87a5-e23ce290d469\" (UID: \"f38c726d-39d9-4ff4-87a5-e23ce290d469\") " Sep 18 12:04:43.543592 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:43.543392 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f38c726d-39d9-4ff4-87a5-e23ce290d469-console-serving-cert\") pod \"f38c726d-39d9-4ff4-87a5-e23ce290d469\" (UID: \"f38c726d-39d9-4ff4-87a5-e23ce290d469\") " Sep 18 12:04:43.543592 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:43.543501 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pwcs\" (UniqueName: \"kubernetes.io/projected/f38c726d-39d9-4ff4-87a5-e23ce290d469-kube-api-access-2pwcs\") pod \"f38c726d-39d9-4ff4-87a5-e23ce290d469\" (UID: \"f38c726d-39d9-4ff4-87a5-e23ce290d469\") " Sep 18 12:04:43.543592 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:43.543540 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f38c726d-39d9-4ff4-87a5-e23ce290d469-service-ca\") pod \"f38c726d-39d9-4ff4-87a5-e23ce290d469\" (UID: \"f38c726d-39d9-4ff4-87a5-e23ce290d469\") " Sep 18 12:04:43.543849 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:43.543829 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f38c726d-39d9-4ff4-87a5-e23ce290d469-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f38c726d-39d9-4ff4-87a5-e23ce290d469" (UID: "f38c726d-39d9-4ff4-87a5-e23ce290d469"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 12:04:43.543901 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:43.543871 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f38c726d-39d9-4ff4-87a5-e23ce290d469-console-config" (OuterVolumeSpecName: "console-config") pod "f38c726d-39d9-4ff4-87a5-e23ce290d469" (UID: "f38c726d-39d9-4ff4-87a5-e23ce290d469"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 12:04:43.543901 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:43.543885 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f38c726d-39d9-4ff4-87a5-e23ce290d469-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f38c726d-39d9-4ff4-87a5-e23ce290d469" (UID: "f38c726d-39d9-4ff4-87a5-e23ce290d469"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 12:04:43.544075 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:43.544056 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f38c726d-39d9-4ff4-87a5-e23ce290d469-service-ca" (OuterVolumeSpecName: "service-ca") pod "f38c726d-39d9-4ff4-87a5-e23ce290d469" (UID: "f38c726d-39d9-4ff4-87a5-e23ce290d469"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 12:04:43.545725 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:43.545698 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f38c726d-39d9-4ff4-87a5-e23ce290d469-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f38c726d-39d9-4ff4-87a5-e23ce290d469" (UID: "f38c726d-39d9-4ff4-87a5-e23ce290d469"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 12:04:43.545821 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:43.545802 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f38c726d-39d9-4ff4-87a5-e23ce290d469-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f38c726d-39d9-4ff4-87a5-e23ce290d469" (UID: "f38c726d-39d9-4ff4-87a5-e23ce290d469"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 12:04:43.545905 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:43.545884 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f38c726d-39d9-4ff4-87a5-e23ce290d469-kube-api-access-2pwcs" (OuterVolumeSpecName: "kube-api-access-2pwcs") pod "f38c726d-39d9-4ff4-87a5-e23ce290d469" (UID: "f38c726d-39d9-4ff4-87a5-e23ce290d469"). InnerVolumeSpecName "kube-api-access-2pwcs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 12:04:43.644995 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:43.644956 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pwcs\" (UniqueName: \"kubernetes.io/projected/f38c726d-39d9-4ff4-87a5-e23ce290d469-kube-api-access-2pwcs\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:04:43.644995 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:43.644993 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f38c726d-39d9-4ff4-87a5-e23ce290d469-service-ca\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:04:43.644995 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:43.645003 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f38c726d-39d9-4ff4-87a5-e23ce290d469-oauth-serving-cert\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:04:43.645192 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:43.645011 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f38c726d-39d9-4ff4-87a5-e23ce290d469-console-config\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:04:43.645192 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:43.645019 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f38c726d-39d9-4ff4-87a5-e23ce290d469-console-oauth-config\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:04:43.645192 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:43.645027 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f38c726d-39d9-4ff4-87a5-e23ce290d469-trusted-ca-bundle\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:04:43.645192 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:43.645035 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f38c726d-39d9-4ff4-87a5-e23ce290d469-console-serving-cert\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:04:44.399198 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:44.399168 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78c5f6c6b7-6nvqq" Sep 18 12:04:44.399198 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:44.399185 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78c5f6c6b7-6nvqq" event={"ID":"f38c726d-39d9-4ff4-87a5-e23ce290d469","Type":"ContainerDied","Data":"df1aa2e1b654092df6828e399dc4ee8af6a45bd6c3878d9250e5f7ad57a17ccd"} Sep 18 12:04:44.399723 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:44.399238 2578 scope.go:117] "RemoveContainer" containerID="05f6096166a06671475e403237cecff3334c80fe277bbaff68d78ef7011c575e" Sep 18 12:04:44.421818 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:44.421786 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78c5f6c6b7-6nvqq"] Sep 18 12:04:44.424269 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:44.424246 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78c5f6c6b7-6nvqq"] Sep 18 12:04:45.464763 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:45.464725 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f38c726d-39d9-4ff4-87a5-e23ce290d469" path="/var/lib/kubelet/pods/f38c726d-39d9-4ff4-87a5-e23ce290d469/volumes" Sep 18 12:04:46.655984 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:46.655953 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:46.758008 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:46.757975 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:47.654254 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:47.654224 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:47.777959 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:47.777913 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:50.045547 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:50.045506 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:50.217987 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:50.217952 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:50.332066 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:50.331976 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:55.438516 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:55.438468 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8bc5597b7-jd884" podUID="1224ce74-74ed-47ba-b9f4-3b1c79ef5933" containerName="registry" containerID="cri-o://b113ba5c666c1b8002348d013b3379647f3aacdb66342acb0e213cbf4170452b" gracePeriod=30 Sep 18 12:04:55.680194 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:55.680171 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:04:55.759957 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:55.759869 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-bound-sa-token\") pod \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " Sep 18 12:04:55.759957 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:55.759953 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-installation-pull-secrets\") pod \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " Sep 18 12:04:55.760192 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:55.760058 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-image-registry-private-configuration\") pod \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " Sep 18 12:04:55.760192 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:55.760114 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-ca-trust-extracted\") pod \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " Sep 18 12:04:55.760192 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:55.760155 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhdws\" (UniqueName: \"kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-kube-api-access-fhdws\") pod \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " Sep 18 12:04:55.760338 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:55.760200 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-trusted-ca\") pod \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " Sep 18 12:04:55.760338 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:55.760225 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-certificates\") pod \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " Sep 18 12:04:55.760338 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:55.760255 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-tls\") pod \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\" (UID: \"1224ce74-74ed-47ba-b9f4-3b1c79ef5933\") " Sep 18 12:04:55.760963 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:55.760928 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1224ce74-74ed-47ba-b9f4-3b1c79ef5933" (UID: "1224ce74-74ed-47ba-b9f4-3b1c79ef5933"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 12:04:55.761950 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:55.761906 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1224ce74-74ed-47ba-b9f4-3b1c79ef5933" (UID: "1224ce74-74ed-47ba-b9f4-3b1c79ef5933"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 12:04:55.763762 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:55.763723 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1224ce74-74ed-47ba-b9f4-3b1c79ef5933" (UID: "1224ce74-74ed-47ba-b9f4-3b1c79ef5933"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 12:04:55.764120 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:55.764090 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1224ce74-74ed-47ba-b9f4-3b1c79ef5933" (UID: "1224ce74-74ed-47ba-b9f4-3b1c79ef5933"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 12:04:55.764256 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:55.764139 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-kube-api-access-fhdws" (OuterVolumeSpecName: "kube-api-access-fhdws") pod "1224ce74-74ed-47ba-b9f4-3b1c79ef5933" (UID: "1224ce74-74ed-47ba-b9f4-3b1c79ef5933"). InnerVolumeSpecName "kube-api-access-fhdws". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 12:04:55.764256 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:55.764179 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1224ce74-74ed-47ba-b9f4-3b1c79ef5933" (UID: "1224ce74-74ed-47ba-b9f4-3b1c79ef5933"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 12:04:55.764256 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:55.764180 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1224ce74-74ed-47ba-b9f4-3b1c79ef5933" (UID: "1224ce74-74ed-47ba-b9f4-3b1c79ef5933"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 12:04:55.770129 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:55.770102 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1224ce74-74ed-47ba-b9f4-3b1c79ef5933" (UID: "1224ce74-74ed-47ba-b9f4-3b1c79ef5933"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 12:04:55.861968 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:55.861931 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-bound-sa-token\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:04:55.861968 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:55.861963 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-installation-pull-secrets\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:04:55.861968 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:55.861974 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-image-registry-private-configuration\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:04:55.862204 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:55.861983 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-ca-trust-extracted\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:04:55.862204 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:55.861992 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhdws\" (UniqueName: \"kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-kube-api-access-fhdws\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:04:55.862204 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:55.862001 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-trusted-ca\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:04:55.862204 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:55.862008 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-certificates\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:04:55.862204 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:55.862016 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1224ce74-74ed-47ba-b9f4-3b1c79ef5933-registry-tls\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:04:56.230945 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:56.230908 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:56.325276 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:56.325193 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:04:56.454131 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:56.454097 2578 generic.go:356] "Generic (PLEG): container finished" podID="1224ce74-74ed-47ba-b9f4-3b1c79ef5933" containerID="b113ba5c666c1b8002348d013b3379647f3aacdb66342acb0e213cbf4170452b" exitCode=0 Sep 18 12:04:56.454614 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:56.454165 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8bc5597b7-jd884" Sep 18 12:04:56.454614 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:56.454184 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8bc5597b7-jd884" event={"ID":"1224ce74-74ed-47ba-b9f4-3b1c79ef5933","Type":"ContainerDied","Data":"b113ba5c666c1b8002348d013b3379647f3aacdb66342acb0e213cbf4170452b"} Sep 18 12:04:56.454614 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:56.454262 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8bc5597b7-jd884" event={"ID":"1224ce74-74ed-47ba-b9f4-3b1c79ef5933","Type":"ContainerDied","Data":"2315f2d12bb43aa7cda807be13516423a8403a38480690dce26152eedb26e533"} Sep 18 12:04:56.454614 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:56.454282 2578 scope.go:117] "RemoveContainer" containerID="b113ba5c666c1b8002348d013b3379647f3aacdb66342acb0e213cbf4170452b" Sep 18 12:04:56.463385 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:56.463370 2578 scope.go:117] "RemoveContainer" containerID="b113ba5c666c1b8002348d013b3379647f3aacdb66342acb0e213cbf4170452b" Sep 18 12:04:56.463679 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:04:56.463661 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b113ba5c666c1b8002348d013b3379647f3aacdb66342acb0e213cbf4170452b\": container with ID starting with b113ba5c666c1b8002348d013b3379647f3aacdb66342acb0e213cbf4170452b not found: ID does not exist" containerID="b113ba5c666c1b8002348d013b3379647f3aacdb66342acb0e213cbf4170452b" Sep 18 12:04:56.463720 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:56.463688 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b113ba5c666c1b8002348d013b3379647f3aacdb66342acb0e213cbf4170452b"} err="failed to get container status \"b113ba5c666c1b8002348d013b3379647f3aacdb66342acb0e213cbf4170452b\": rpc error: code = NotFound desc = could not find container \"b113ba5c666c1b8002348d013b3379647f3aacdb66342acb0e213cbf4170452b\": container with ID starting with b113ba5c666c1b8002348d013b3379647f3aacdb66342acb0e213cbf4170452b not found: ID does not exist" Sep 18 12:04:56.479233 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:56.479207 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8bc5597b7-jd884"] Sep 18 12:04:56.484453 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:56.484418 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8bc5597b7-jd884"] Sep 18 12:04:57.465596 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:57.465565 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1224ce74-74ed-47ba-b9f4-3b1c79ef5933" path="/var/lib/kubelet/pods/1224ce74-74ed-47ba-b9f4-3b1c79ef5933/volumes" Sep 18 12:04:59.490230 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:59.490193 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:04:59.511020 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:04:59.510990 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:00.152349 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:00.152320 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:05:00.486991 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:00.486916 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:08.783908 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:08.783872 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:05:08.865241 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:08.865199 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:05:11.485908 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:11.485876 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:05:11.602901 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:11.602863 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:05:12.194032 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:12.194001 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:05:12.658260 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:12.658228 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:05:13.298864 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:13.298829 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 12:05:13.299131 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:13.299109 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d3086576-e665-4430-81ed-3c61cf08b127" containerName="alertmanager" containerID="cri-o://f93c01278c4a43a1742c20713b6981517989cc430fec7a1ae8f6e151c1df05e8" gracePeriod=120 Sep 18 12:05:13.299199 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:13.299170 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d3086576-e665-4430-81ed-3c61cf08b127" containerName="kube-rbac-proxy-metric" containerID="cri-o://0e04b929390045246cc896077c9aff0e695911b0ec70d5e5b6f28f6be1d0b3ec" gracePeriod=120 Sep 18 12:05:13.299250 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:13.299206 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d3086576-e665-4430-81ed-3c61cf08b127" containerName="prom-label-proxy" containerID="cri-o://eb11012bcf39409e205092b6edf18112bde08f57ad49a975f9ac435a4859f082" gracePeriod=120 Sep 18 12:05:13.299299 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:13.299244 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d3086576-e665-4430-81ed-3c61cf08b127" containerName="kube-rbac-proxy-web" containerID="cri-o://4252704c3cec22fae5681b8abac6ccf83f4fc9bf3dcb06e941fc483863c97faf" gracePeriod=120 Sep 18 12:05:13.299347 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:13.299266 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d3086576-e665-4430-81ed-3c61cf08b127" containerName="kube-rbac-proxy" containerID="cri-o://0fb467ea614481bdbbc765d4132240cd256b08053e23242d024ee3acd397b775" gracePeriod=120 Sep 18 12:05:13.299402 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:13.299266 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d3086576-e665-4430-81ed-3c61cf08b127" containerName="config-reloader" containerID="cri-o://e0dc4c97e78e5282df5a2b30520d3480e45e4074fed53c3d7b4a97372d7d8205" gracePeriod=120 Sep 18 12:05:13.524567 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:13.524535 2578 generic.go:356] "Generic (PLEG): container finished" podID="d3086576-e665-4430-81ed-3c61cf08b127" containerID="eb11012bcf39409e205092b6edf18112bde08f57ad49a975f9ac435a4859f082" exitCode=0 Sep 18 12:05:13.524567 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:13.524560 2578 generic.go:356] "Generic (PLEG): container finished" podID="d3086576-e665-4430-81ed-3c61cf08b127" containerID="0fb467ea614481bdbbc765d4132240cd256b08053e23242d024ee3acd397b775" exitCode=0 Sep 18 12:05:13.524567 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:13.524570 2578 generic.go:356] "Generic (PLEG): container finished" podID="d3086576-e665-4430-81ed-3c61cf08b127" containerID="e0dc4c97e78e5282df5a2b30520d3480e45e4074fed53c3d7b4a97372d7d8205" exitCode=0 Sep 18 12:05:13.524800 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:13.524578 2578 generic.go:356] "Generic (PLEG): container finished" podID="d3086576-e665-4430-81ed-3c61cf08b127" containerID="f93c01278c4a43a1742c20713b6981517989cc430fec7a1ae8f6e151c1df05e8" exitCode=0 Sep 18 12:05:13.524800 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:13.524607 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3086576-e665-4430-81ed-3c61cf08b127","Type":"ContainerDied","Data":"eb11012bcf39409e205092b6edf18112bde08f57ad49a975f9ac435a4859f082"} Sep 18 12:05:13.524800 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:13.524673 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3086576-e665-4430-81ed-3c61cf08b127","Type":"ContainerDied","Data":"0fb467ea614481bdbbc765d4132240cd256b08053e23242d024ee3acd397b775"} Sep 18 12:05:13.524800 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:13.524701 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3086576-e665-4430-81ed-3c61cf08b127","Type":"ContainerDied","Data":"e0dc4c97e78e5282df5a2b30520d3480e45e4074fed53c3d7b4a97372d7d8205"} Sep 18 12:05:13.524800 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:13.524725 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3086576-e665-4430-81ed-3c61cf08b127","Type":"ContainerDied","Data":"f93c01278c4a43a1742c20713b6981517989cc430fec7a1ae8f6e151c1df05e8"} Sep 18 12:05:14.532451 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.532416 2578 generic.go:356] "Generic (PLEG): container finished" podID="d3086576-e665-4430-81ed-3c61cf08b127" containerID="0e04b929390045246cc896077c9aff0e695911b0ec70d5e5b6f28f6be1d0b3ec" exitCode=0 Sep 18 12:05:14.532750 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.532455 2578 generic.go:356] "Generic (PLEG): container finished" podID="d3086576-e665-4430-81ed-3c61cf08b127" containerID="4252704c3cec22fae5681b8abac6ccf83f4fc9bf3dcb06e941fc483863c97faf" exitCode=0 Sep 18 12:05:14.532750 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.532477 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3086576-e665-4430-81ed-3c61cf08b127","Type":"ContainerDied","Data":"0e04b929390045246cc896077c9aff0e695911b0ec70d5e5b6f28f6be1d0b3ec"} Sep 18 12:05:14.532750 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.532602 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3086576-e665-4430-81ed-3c61cf08b127","Type":"ContainerDied","Data":"4252704c3cec22fae5681b8abac6ccf83f4fc9bf3dcb06e941fc483863c97faf"} Sep 18 12:05:14.532750 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.532683 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d3086576-e665-4430-81ed-3c61cf08b127","Type":"ContainerDied","Data":"7af69b89dc67f4e8f8c9da08e0b0438410ca8ba1636232fee74dd07cb235891b"} Sep 18 12:05:14.532750 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.532729 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7af69b89dc67f4e8f8c9da08e0b0438410ca8ba1636232fee74dd07cb235891b" Sep 18 12:05:14.541584 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.541564 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:05:14.629151 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.629129 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-cluster-tls-config\") pod \"d3086576-e665-4430-81ed-3c61cf08b127\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " Sep 18 12:05:14.629302 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.629166 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d3086576-e665-4430-81ed-3c61cf08b127\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " Sep 18 12:05:14.629302 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.629198 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wss65\" (UniqueName: \"kubernetes.io/projected/d3086576-e665-4430-81ed-3c61cf08b127-kube-api-access-wss65\") pod \"d3086576-e665-4430-81ed-3c61cf08b127\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " Sep 18 12:05:14.629302 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.629246 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-web-config\") pod \"d3086576-e665-4430-81ed-3c61cf08b127\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " Sep 18 12:05:14.629302 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.629275 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-secret-alertmanager-kube-rbac-proxy\") pod \"d3086576-e665-4430-81ed-3c61cf08b127\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " Sep 18 12:05:14.629534 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.629304 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3086576-e665-4430-81ed-3c61cf08b127-alertmanager-trusted-ca-bundle\") pod \"d3086576-e665-4430-81ed-3c61cf08b127\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " Sep 18 12:05:14.629534 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.629331 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-config-volume\") pod \"d3086576-e665-4430-81ed-3c61cf08b127\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " Sep 18 12:05:14.629534 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.629355 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3086576-e665-4430-81ed-3c61cf08b127-metrics-client-ca\") pod \"d3086576-e665-4430-81ed-3c61cf08b127\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " Sep 18 12:05:14.629534 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.629403 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d3086576-e665-4430-81ed-3c61cf08b127-alertmanager-main-db\") pod \"d3086576-e665-4430-81ed-3c61cf08b127\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " Sep 18 12:05:14.629534 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.629464 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-secret-alertmanager-main-tls\") pod \"d3086576-e665-4430-81ed-3c61cf08b127\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " Sep 18 12:05:14.629534 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.629506 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d3086576-e665-4430-81ed-3c61cf08b127-tls-assets\") pod \"d3086576-e665-4430-81ed-3c61cf08b127\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " Sep 18 12:05:14.629534 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.629530 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d3086576-e665-4430-81ed-3c61cf08b127-config-out\") pod \"d3086576-e665-4430-81ed-3c61cf08b127\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " Sep 18 12:05:14.630044 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.629577 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-secret-alertmanager-kube-rbac-proxy-web\") pod \"d3086576-e665-4430-81ed-3c61cf08b127\" (UID: \"d3086576-e665-4430-81ed-3c61cf08b127\") " Sep 18 12:05:14.630935 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.630874 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3086576-e665-4430-81ed-3c61cf08b127-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "d3086576-e665-4430-81ed-3c61cf08b127" (UID: "d3086576-e665-4430-81ed-3c61cf08b127"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 12:05:14.630935 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.630888 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3086576-e665-4430-81ed-3c61cf08b127-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "d3086576-e665-4430-81ed-3c61cf08b127" (UID: "d3086576-e665-4430-81ed-3c61cf08b127"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 12:05:14.631120 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.631079 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3086576-e665-4430-81ed-3c61cf08b127-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "d3086576-e665-4430-81ed-3c61cf08b127" (UID: "d3086576-e665-4430-81ed-3c61cf08b127"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 12:05:14.631919 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.631893 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3086576-e665-4430-81ed-3c61cf08b127-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:14.632026 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.631923 2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3086576-e665-4430-81ed-3c61cf08b127-metrics-client-ca\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:14.632026 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.631938 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d3086576-e665-4430-81ed-3c61cf08b127-alertmanager-main-db\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:14.632329 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.632302 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "d3086576-e665-4430-81ed-3c61cf08b127" (UID: "d3086576-e665-4430-81ed-3c61cf08b127"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 12:05:14.634005 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.633976 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "d3086576-e665-4430-81ed-3c61cf08b127" (UID: "d3086576-e665-4430-81ed-3c61cf08b127"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 12:05:14.634247 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.634213 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "d3086576-e665-4430-81ed-3c61cf08b127" (UID: "d3086576-e665-4430-81ed-3c61cf08b127"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 12:05:14.634605 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.634583 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3086576-e665-4430-81ed-3c61cf08b127-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d3086576-e665-4430-81ed-3c61cf08b127" (UID: "d3086576-e665-4430-81ed-3c61cf08b127"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 12:05:14.634698 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.634637 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3086576-e665-4430-81ed-3c61cf08b127-kube-api-access-wss65" (OuterVolumeSpecName: "kube-api-access-wss65") pod "d3086576-e665-4430-81ed-3c61cf08b127" (UID: "d3086576-e665-4430-81ed-3c61cf08b127"). InnerVolumeSpecName "kube-api-access-wss65". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 12:05:14.634873 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.634847 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-config-volume" (OuterVolumeSpecName: "config-volume") pod "d3086576-e665-4430-81ed-3c61cf08b127" (UID: "d3086576-e665-4430-81ed-3c61cf08b127"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 12:05:14.635084 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.635058 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3086576-e665-4430-81ed-3c61cf08b127-config-out" (OuterVolumeSpecName: "config-out") pod "d3086576-e665-4430-81ed-3c61cf08b127" (UID: "d3086576-e665-4430-81ed-3c61cf08b127"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 12:05:14.636306 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.636280 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "d3086576-e665-4430-81ed-3c61cf08b127" (UID: "d3086576-e665-4430-81ed-3c61cf08b127"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 12:05:14.638864 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.638840 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "d3086576-e665-4430-81ed-3c61cf08b127" (UID: "d3086576-e665-4430-81ed-3c61cf08b127"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 12:05:14.645289 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.645266 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-web-config" (OuterVolumeSpecName: "web-config") pod "d3086576-e665-4430-81ed-3c61cf08b127" (UID: "d3086576-e665-4430-81ed-3c61cf08b127"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 12:05:14.732447 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.732409 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wss65\" (UniqueName: \"kubernetes.io/projected/d3086576-e665-4430-81ed-3c61cf08b127-kube-api-access-wss65\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:14.732447 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.732447 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-web-config\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:14.732627 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.732458 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:14.732627 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.732468 2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-config-volume\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:14.732627 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.732477 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-secret-alertmanager-main-tls\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:14.732627 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.732485 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d3086576-e665-4430-81ed-3c61cf08b127-tls-assets\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:14.732627 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.732492 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d3086576-e665-4430-81ed-3c61cf08b127-config-out\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:14.732627 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.732500 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:14.732627 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.732509 2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-cluster-tls-config\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:14.732627 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:14.732517 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d3086576-e665-4430-81ed-3c61cf08b127-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:15.536642 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:15.536605 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 12:05:15.562069 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:15.562035 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 12:05:15.567217 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:15.567181 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 12:05:17.465991 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:17.465941 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3086576-e665-4430-81ed-3c61cf08b127" path="/var/lib/kubelet/pods/d3086576-e665-4430-81ed-3c61cf08b127/volumes" Sep 18 12:05:17.665459 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:17.665404 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 12:05:17.666086 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:17.666051 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8abab63f-e025-41d6-b087-5b54732fc49c" containerName="prometheus" containerID="cri-o://ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5" gracePeriod=600 Sep 18 12:05:17.666535 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:17.666470 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8abab63f-e025-41d6-b087-5b54732fc49c" containerName="thanos-sidecar" containerID="cri-o://00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602" gracePeriod=600 Sep 18 12:05:17.666535 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:17.666508 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8abab63f-e025-41d6-b087-5b54732fc49c" containerName="config-reloader" containerID="cri-o://8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c" gracePeriod=600 Sep 18 12:05:17.666726 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:17.666475 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8abab63f-e025-41d6-b087-5b54732fc49c" containerName="kube-rbac-proxy" containerID="cri-o://a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88" gracePeriod=600 Sep 18 12:05:17.666726 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:17.666432 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8abab63f-e025-41d6-b087-5b54732fc49c" containerName="kube-rbac-proxy-web" containerID="cri-o://4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317" gracePeriod=600 Sep 18 12:05:17.666726 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:17.666244 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8abab63f-e025-41d6-b087-5b54732fc49c" containerName="kube-rbac-proxy-thanos" containerID="cri-o://d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24" gracePeriod=600 Sep 18 12:05:17.912046 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:17.911320 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.063999 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.063916 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-configmap-metrics-client-ca\") pod \"8abab63f-e025-41d6-b087-5b54732fc49c\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " Sep 18 12:05:18.063999 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.063960 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-prometheus-k8s-rulefiles-0\") pod \"8abab63f-e025-41d6-b087-5b54732fc49c\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " Sep 18 12:05:18.063999 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.063986 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-prometheus-k8s-rulefiles-1\") pod \"8abab63f-e025-41d6-b087-5b54732fc49c\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " Sep 18 12:05:18.064287 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.064008 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-configmap-serving-certs-ca-bundle\") pod \"8abab63f-e025-41d6-b087-5b54732fc49c\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " Sep 18 12:05:18.064287 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.064031 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-prometheus-k8s-rulefiles-2\") pod \"8abab63f-e025-41d6-b087-5b54732fc49c\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " Sep 18 12:05:18.064287 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.064046 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-kube-rbac-proxy\") pod \"8abab63f-e025-41d6-b087-5b54732fc49c\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " Sep 18 12:05:18.064287 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.064072 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8abab63f-e025-41d6-b087-5b54732fc49c-config-out\") pod \"8abab63f-e025-41d6-b087-5b54732fc49c\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " Sep 18 12:05:18.064287 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.064096 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"8abab63f-e025-41d6-b087-5b54732fc49c\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " Sep 18 12:05:18.064287 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.064121 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-web-config\") pod \"8abab63f-e025-41d6-b087-5b54732fc49c\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " Sep 18 12:05:18.064287 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.064145 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-prometheus-k8s-tls\") pod \"8abab63f-e025-41d6-b087-5b54732fc49c\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " Sep 18 12:05:18.064287 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.064193 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"8abab63f-e025-41d6-b087-5b54732fc49c\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " Sep 18 12:05:18.064287 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.064245 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfm2f\" (UniqueName: \"kubernetes.io/projected/8abab63f-e025-41d6-b087-5b54732fc49c-kube-api-access-pfm2f\") pod \"8abab63f-e025-41d6-b087-5b54732fc49c\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " Sep 18 12:05:18.064287 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.064266 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-prometheus-trusted-ca-bundle\") pod \"8abab63f-e025-41d6-b087-5b54732fc49c\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " Sep 18 12:05:18.064287 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.064285 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8abab63f-e025-41d6-b087-5b54732fc49c-tls-assets\") pod \"8abab63f-e025-41d6-b087-5b54732fc49c\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " Sep 18 12:05:18.064866 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.064302 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-thanos-prometheus-http-client-file\") pod \"8abab63f-e025-41d6-b087-5b54732fc49c\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " Sep 18 12:05:18.064866 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.064326 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-configmap-kubelet-serving-ca-bundle\") pod \"8abab63f-e025-41d6-b087-5b54732fc49c\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " Sep 18 12:05:18.064866 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.064348 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-grpc-tls\") pod \"8abab63f-e025-41d6-b087-5b54732fc49c\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " Sep 18 12:05:18.064866 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.064373 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-config\") pod \"8abab63f-e025-41d6-b087-5b54732fc49c\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " Sep 18 12:05:18.064866 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.064389 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8abab63f-e025-41d6-b087-5b54732fc49c-prometheus-k8s-db\") pod \"8abab63f-e025-41d6-b087-5b54732fc49c\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " Sep 18 12:05:18.064866 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.064404 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-metrics-client-certs\") pod \"8abab63f-e025-41d6-b087-5b54732fc49c\" (UID: \"8abab63f-e025-41d6-b087-5b54732fc49c\") " Sep 18 12:05:18.064866 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.064500 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "8abab63f-e025-41d6-b087-5b54732fc49c" (UID: "8abab63f-e025-41d6-b087-5b54732fc49c"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 12:05:18.064866 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.064739 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "8abab63f-e025-41d6-b087-5b54732fc49c" (UID: "8abab63f-e025-41d6-b087-5b54732fc49c"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 12:05:18.064866 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.064798 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "8abab63f-e025-41d6-b087-5b54732fc49c" (UID: "8abab63f-e025-41d6-b087-5b54732fc49c"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 12:05:18.064866 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.064812 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-configmap-metrics-client-ca\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:18.064866 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.064838 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "8abab63f-e025-41d6-b087-5b54732fc49c" (UID: "8abab63f-e025-41d6-b087-5b54732fc49c"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 12:05:18.065597 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.064953 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "8abab63f-e025-41d6-b087-5b54732fc49c" (UID: "8abab63f-e025-41d6-b087-5b54732fc49c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 12:05:18.065597 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.065207 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "8abab63f-e025-41d6-b087-5b54732fc49c" (UID: "8abab63f-e025-41d6-b087-5b54732fc49c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 12:05:18.065597 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.065314 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "8abab63f-e025-41d6-b087-5b54732fc49c" (UID: "8abab63f-e025-41d6-b087-5b54732fc49c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 12:05:18.066667 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.066635 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8abab63f-e025-41d6-b087-5b54732fc49c-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "8abab63f-e025-41d6-b087-5b54732fc49c" (UID: "8abab63f-e025-41d6-b087-5b54732fc49c"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 12:05:18.067883 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.067851 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "8abab63f-e025-41d6-b087-5b54732fc49c" (UID: "8abab63f-e025-41d6-b087-5b54732fc49c"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 12:05:18.068398 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.068371 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "8abab63f-e025-41d6-b087-5b54732fc49c" (UID: "8abab63f-e025-41d6-b087-5b54732fc49c"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 12:05:18.068837 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.068721 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "8abab63f-e025-41d6-b087-5b54732fc49c" (UID: "8abab63f-e025-41d6-b087-5b54732fc49c"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 12:05:18.068837 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.068797 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8abab63f-e025-41d6-b087-5b54732fc49c-config-out" (OuterVolumeSpecName: "config-out") pod "8abab63f-e025-41d6-b087-5b54732fc49c" (UID: "8abab63f-e025-41d6-b087-5b54732fc49c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 12:05:18.068837 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.068764 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "8abab63f-e025-41d6-b087-5b54732fc49c" (UID: "8abab63f-e025-41d6-b087-5b54732fc49c"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 12:05:18.069044 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.068860 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "8abab63f-e025-41d6-b087-5b54732fc49c" (UID: "8abab63f-e025-41d6-b087-5b54732fc49c"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 12:05:18.069154 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.069132 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "8abab63f-e025-41d6-b087-5b54732fc49c" (UID: "8abab63f-e025-41d6-b087-5b54732fc49c"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 12:05:18.069381 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.069361 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8abab63f-e025-41d6-b087-5b54732fc49c-kube-api-access-pfm2f" (OuterVolumeSpecName: "kube-api-access-pfm2f") pod "8abab63f-e025-41d6-b087-5b54732fc49c" (UID: "8abab63f-e025-41d6-b087-5b54732fc49c"). InnerVolumeSpecName "kube-api-access-pfm2f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 12:05:18.069763 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.069745 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-config" (OuterVolumeSpecName: "config") pod "8abab63f-e025-41d6-b087-5b54732fc49c" (UID: "8abab63f-e025-41d6-b087-5b54732fc49c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 12:05:18.069975 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.069949 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8abab63f-e025-41d6-b087-5b54732fc49c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8abab63f-e025-41d6-b087-5b54732fc49c" (UID: "8abab63f-e025-41d6-b087-5b54732fc49c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 12:05:18.070163 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.070148 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "8abab63f-e025-41d6-b087-5b54732fc49c" (UID: "8abab63f-e025-41d6-b087-5b54732fc49c"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 12:05:18.078594 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.078574 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-web-config" (OuterVolumeSpecName: "web-config") pod "8abab63f-e025-41d6-b087-5b54732fc49c" (UID: "8abab63f-e025-41d6-b087-5b54732fc49c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 12:05:18.165299 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.165261 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfm2f\" (UniqueName: \"kubernetes.io/projected/8abab63f-e025-41d6-b087-5b54732fc49c-kube-api-access-pfm2f\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:18.165299 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.165292 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:18.165299 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.165306 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8abab63f-e025-41d6-b087-5b54732fc49c-tls-assets\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:18.165609 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.165319 2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:18.165609 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.165331 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:18.165609 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.165343 2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-grpc-tls\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:18.165609 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.165353 2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-config\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:18.165609 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.165363 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8abab63f-e025-41d6-b087-5b54732fc49c-prometheus-k8s-db\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:18.165609 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.165374 2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-metrics-client-certs\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:18.165609 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.165386 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:18.165609 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.165397 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:18.165609 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.165408 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:18.165609 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.165419 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8abab63f-e025-41d6-b087-5b54732fc49c-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:18.165609 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.165430 2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-kube-rbac-proxy\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:18.165609 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.165461 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8abab63f-e025-41d6-b087-5b54732fc49c-config-out\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:18.165609 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.165474 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:18.165609 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.165485 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-web-config\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:18.165609 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.165496 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:18.165609 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.165508 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8abab63f-e025-41d6-b087-5b54732fc49c-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:05:18.555862 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.555827 2578 generic.go:356] "Generic (PLEG): container finished" podID="8abab63f-e025-41d6-b087-5b54732fc49c" containerID="d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24" exitCode=0 Sep 18 12:05:18.555862 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.555854 2578 generic.go:356] "Generic (PLEG): container finished" podID="8abab63f-e025-41d6-b087-5b54732fc49c" containerID="a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88" exitCode=0 Sep 18 12:05:18.555862 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.555860 2578 generic.go:356] "Generic (PLEG): container finished" podID="8abab63f-e025-41d6-b087-5b54732fc49c" containerID="4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317" exitCode=0 Sep 18 12:05:18.555862 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.555866 2578 generic.go:356] "Generic (PLEG): container finished" podID="8abab63f-e025-41d6-b087-5b54732fc49c" containerID="00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602" exitCode=0 Sep 18 12:05:18.555862 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.555872 2578 generic.go:356] "Generic (PLEG): container finished" podID="8abab63f-e025-41d6-b087-5b54732fc49c" containerID="8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c" exitCode=0 Sep 18 12:05:18.556424 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.555881 2578 generic.go:356] "Generic (PLEG): container finished" podID="8abab63f-e025-41d6-b087-5b54732fc49c" containerID="ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5" exitCode=0 Sep 18 12:05:18.556424 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.555898 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.556424 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.555902 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8abab63f-e025-41d6-b087-5b54732fc49c","Type":"ContainerDied","Data":"d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24"} Sep 18 12:05:18.556424 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.555971 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8abab63f-e025-41d6-b087-5b54732fc49c","Type":"ContainerDied","Data":"a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88"} Sep 18 12:05:18.556424 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.555999 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8abab63f-e025-41d6-b087-5b54732fc49c","Type":"ContainerDied","Data":"4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317"} Sep 18 12:05:18.556424 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.556036 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8abab63f-e025-41d6-b087-5b54732fc49c","Type":"ContainerDied","Data":"00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602"} Sep 18 12:05:18.556424 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.556067 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8abab63f-e025-41d6-b087-5b54732fc49c","Type":"ContainerDied","Data":"8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c"} Sep 18 12:05:18.556424 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.556093 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8abab63f-e025-41d6-b087-5b54732fc49c","Type":"ContainerDied","Data":"ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5"} Sep 18 12:05:18.556424 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.556039 2578 scope.go:117] "RemoveContainer" containerID="d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24" Sep 18 12:05:18.556424 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.556130 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8abab63f-e025-41d6-b087-5b54732fc49c","Type":"ContainerDied","Data":"bebe8144ef02df7db4240864d0e833d923e27452ac1567c3fceaaed26c50a363"} Sep 18 12:05:18.564909 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.564889 2578 scope.go:117] "RemoveContainer" containerID="a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88" Sep 18 12:05:18.573094 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.573075 2578 scope.go:117] "RemoveContainer" containerID="4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317" Sep 18 12:05:18.580663 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.580639 2578 scope.go:117] "RemoveContainer" containerID="00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602" Sep 18 12:05:18.588169 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.588136 2578 scope.go:117] "RemoveContainer" containerID="8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c" Sep 18 12:05:18.591621 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.591596 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 12:05:18.596383 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.596366 2578 scope.go:117] "RemoveContainer" containerID="ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5" Sep 18 12:05:18.599497 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.599473 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 12:05:18.605036 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.605016 2578 scope.go:117] "RemoveContainer" containerID="c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d" Sep 18 12:05:18.612583 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.612562 2578 scope.go:117] "RemoveContainer" containerID="d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24" Sep 18 12:05:18.612938 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:05:18.612911 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24\": container with ID starting with d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24 not found: ID does not exist" containerID="d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24" Sep 18 12:05:18.613072 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.612944 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24"} err="failed to get container status \"d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24\": rpc error: code = NotFound desc = could not find container \"d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24\": container with ID starting with d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24 not found: ID does not exist" Sep 18 12:05:18.613072 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.612963 2578 scope.go:117] "RemoveContainer" containerID="a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88" Sep 18 12:05:18.613226 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:05:18.613207 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88\": container with ID starting with a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88 not found: ID does not exist" containerID="a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88" Sep 18 12:05:18.613290 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.613234 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88"} err="failed to get container status \"a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88\": rpc error: code = NotFound desc = could not find container \"a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88\": container with ID starting with a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88 not found: ID does not exist" Sep 18 12:05:18.613290 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.613253 2578 scope.go:117] "RemoveContainer" containerID="4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317" Sep 18 12:05:18.613525 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:05:18.613507 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317\": container with ID starting with 4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317 not found: ID does not exist" containerID="4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317" Sep 18 12:05:18.613598 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.613528 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317"} err="failed to get container status \"4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317\": rpc error: code = NotFound desc = could not find container \"4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317\": container with ID starting with 4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317 not found: ID does not exist" Sep 18 12:05:18.613598 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.613541 2578 scope.go:117] "RemoveContainer" containerID="00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602" Sep 18 12:05:18.613789 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:05:18.613769 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602\": container with ID starting with 00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602 not found: ID does not exist" containerID="00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602" Sep 18 12:05:18.613868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.613791 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602"} err="failed to get container status \"00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602\": rpc error: code = NotFound desc = could not find container \"00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602\": container with ID starting with 00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602 not found: ID does not exist" Sep 18 12:05:18.613868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.613814 2578 scope.go:117] "RemoveContainer" containerID="8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c" Sep 18 12:05:18.614085 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:05:18.614068 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c\": container with ID starting with 8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c not found: ID does not exist" containerID="8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c" Sep 18 12:05:18.614131 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.614090 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c"} err="failed to get container status \"8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c\": rpc error: code = NotFound desc = could not find container \"8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c\": container with ID starting with 8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c not found: ID does not exist" Sep 18 12:05:18.614131 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.614104 2578 scope.go:117] "RemoveContainer" containerID="ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5" Sep 18 12:05:18.614398 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:05:18.614382 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5\": container with ID starting with ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5 not found: ID does not exist" containerID="ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5" Sep 18 12:05:18.614503 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.614400 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5"} err="failed to get container status \"ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5\": rpc error: code = NotFound desc = could not find container \"ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5\": container with ID starting with ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5 not found: ID does not exist" Sep 18 12:05:18.614503 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.614412 2578 scope.go:117] "RemoveContainer" containerID="c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d" Sep 18 12:05:18.614667 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:05:18.614652 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d\": container with ID starting with c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d not found: ID does not exist" containerID="c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d" Sep 18 12:05:18.614713 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.614670 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d"} err="failed to get container status \"c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d\": rpc error: code = NotFound desc = could not find container \"c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d\": container with ID starting with c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d not found: ID does not exist" Sep 18 12:05:18.614713 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.614682 2578 scope.go:117] "RemoveContainer" containerID="d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24" Sep 18 12:05:18.614925 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.614909 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24"} err="failed to get container status \"d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24\": rpc error: code = NotFound desc = could not find container \"d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24\": container with ID starting with d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24 not found: ID does not exist" Sep 18 12:05:18.614969 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.614926 2578 scope.go:117] "RemoveContainer" containerID="a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88" Sep 18 12:05:18.615163 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.615146 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88"} err="failed to get container status \"a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88\": rpc error: code = NotFound desc = could not find container \"a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88\": container with ID starting with a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88 not found: ID does not exist" Sep 18 12:05:18.615210 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.615164 2578 scope.go:117] "RemoveContainer" containerID="4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317" Sep 18 12:05:18.615401 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.615385 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317"} err="failed to get container status \"4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317\": rpc error: code = NotFound desc = could not find container \"4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317\": container with ID starting with 4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317 not found: ID does not exist" Sep 18 12:05:18.615401 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.615400 2578 scope.go:117] "RemoveContainer" containerID="00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602" Sep 18 12:05:18.615676 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.615655 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602"} err="failed to get container status \"00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602\": rpc error: code = NotFound desc = could not find container \"00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602\": container with ID starting with 00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602 not found: ID does not exist" Sep 18 12:05:18.615676 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.615674 2578 scope.go:117] "RemoveContainer" containerID="8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c" Sep 18 12:05:18.615888 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.615874 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c"} err="failed to get container status \"8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c\": rpc error: code = NotFound desc = could not find container \"8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c\": container with ID starting with 8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c not found: ID does not exist" Sep 18 12:05:18.615932 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.615888 2578 scope.go:117] "RemoveContainer" containerID="ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5" Sep 18 12:05:18.616132 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.616114 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5"} err="failed to get container status \"ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5\": rpc error: code = NotFound desc = could not find container \"ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5\": container with ID starting with ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5 not found: ID does not exist" Sep 18 12:05:18.616181 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.616134 2578 scope.go:117] "RemoveContainer" containerID="c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d" Sep 18 12:05:18.616382 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.616364 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d"} err="failed to get container status \"c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d\": rpc error: code = NotFound desc = could not find container \"c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d\": container with ID starting with c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d not found: ID does not exist" Sep 18 12:05:18.616479 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.616385 2578 scope.go:117] "RemoveContainer" containerID="d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24" Sep 18 12:05:18.616668 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.616650 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24"} err="failed to get container status \"d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24\": rpc error: code = NotFound desc = could not find container \"d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24\": container with ID starting with d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24 not found: ID does not exist" Sep 18 12:05:18.616719 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.616668 2578 scope.go:117] "RemoveContainer" containerID="a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88" Sep 18 12:05:18.616899 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.616883 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88"} err="failed to get container status \"a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88\": rpc error: code = NotFound desc = could not find container \"a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88\": container with ID starting with a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88 not found: ID does not exist" Sep 18 12:05:18.616991 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.616900 2578 scope.go:117] "RemoveContainer" containerID="4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317" Sep 18 12:05:18.617102 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.617087 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317"} err="failed to get container status \"4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317\": rpc error: code = NotFound desc = could not find container \"4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317\": container with ID starting with 4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317 not found: ID does not exist" Sep 18 12:05:18.617145 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.617102 2578 scope.go:117] "RemoveContainer" containerID="00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602" Sep 18 12:05:18.617322 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.617305 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602"} err="failed to get container status \"00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602\": rpc error: code = NotFound desc = could not find container \"00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602\": container with ID starting with 00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602 not found: ID does not exist" Sep 18 12:05:18.617390 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.617324 2578 scope.go:117] "RemoveContainer" containerID="8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c" Sep 18 12:05:18.617646 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.617628 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c"} err="failed to get container status \"8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c\": rpc error: code = NotFound desc = could not find container \"8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c\": container with ID starting with 8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c not found: ID does not exist" Sep 18 12:05:18.617723 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.617646 2578 scope.go:117] "RemoveContainer" containerID="ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5" Sep 18 12:05:18.617883 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.617867 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5"} err="failed to get container status \"ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5\": rpc error: code = NotFound desc = could not find container \"ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5\": container with ID starting with ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5 not found: ID does not exist" Sep 18 12:05:18.617883 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.617881 2578 scope.go:117] "RemoveContainer" containerID="c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d" Sep 18 12:05:18.618112 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.618092 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d"} err="failed to get container status \"c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d\": rpc error: code = NotFound desc = could not find container \"c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d\": container with ID starting with c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d not found: ID does not exist" Sep 18 12:05:18.618158 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.618113 2578 scope.go:117] "RemoveContainer" containerID="d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24" Sep 18 12:05:18.618325 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.618308 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24"} err="failed to get container status \"d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24\": rpc error: code = NotFound desc = could not find container \"d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24\": container with ID starting with d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24 not found: ID does not exist" Sep 18 12:05:18.618325 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.618325 2578 scope.go:117] "RemoveContainer" containerID="a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88" Sep 18 12:05:18.618579 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.618559 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88"} err="failed to get container status \"a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88\": rpc error: code = NotFound desc = could not find container \"a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88\": container with ID starting with a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88 not found: ID does not exist" Sep 18 12:05:18.618579 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.618580 2578 scope.go:117] "RemoveContainer" containerID="4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317" Sep 18 12:05:18.618828 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.618811 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317"} err="failed to get container status \"4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317\": rpc error: code = NotFound desc = could not find container \"4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317\": container with ID starting with 4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317 not found: ID does not exist" Sep 18 12:05:18.618878 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.618829 2578 scope.go:117] "RemoveContainer" containerID="00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602" Sep 18 12:05:18.619042 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.619026 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602"} err="failed to get container status \"00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602\": rpc error: code = NotFound desc = could not find container \"00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602\": container with ID starting with 00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602 not found: ID does not exist" Sep 18 12:05:18.619086 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.619042 2578 scope.go:117] "RemoveContainer" containerID="8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c" Sep 18 12:05:18.619282 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.619265 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c"} err="failed to get container status \"8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c\": rpc error: code = NotFound desc = could not find container \"8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c\": container with ID starting with 8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c not found: ID does not exist" Sep 18 12:05:18.619282 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.619281 2578 scope.go:117] "RemoveContainer" containerID="ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5" Sep 18 12:05:18.619502 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.619486 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5"} err="failed to get container status \"ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5\": rpc error: code = NotFound desc = could not find container \"ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5\": container with ID starting with ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5 not found: ID does not exist" Sep 18 12:05:18.619502 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.619501 2578 scope.go:117] "RemoveContainer" containerID="c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d" Sep 18 12:05:18.619700 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.619685 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d"} err="failed to get container status \"c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d\": rpc error: code = NotFound desc = could not find container \"c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d\": container with ID starting with c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d not found: ID does not exist" Sep 18 12:05:18.619743 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.619700 2578 scope.go:117] "RemoveContainer" containerID="d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24" Sep 18 12:05:18.619900 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.619883 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24"} err="failed to get container status \"d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24\": rpc error: code = NotFound desc = could not find container \"d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24\": container with ID starting with d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24 not found: ID does not exist" Sep 18 12:05:18.619900 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.619899 2578 scope.go:117] "RemoveContainer" containerID="a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88" Sep 18 12:05:18.620075 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.620057 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88"} err="failed to get container status \"a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88\": rpc error: code = NotFound desc = could not find container \"a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88\": container with ID starting with a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88 not found: ID does not exist" Sep 18 12:05:18.620075 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.620074 2578 scope.go:117] "RemoveContainer" containerID="4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317" Sep 18 12:05:18.620261 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.620246 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317"} err="failed to get container status \"4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317\": rpc error: code = NotFound desc = could not find container \"4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317\": container with ID starting with 4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317 not found: ID does not exist" Sep 18 12:05:18.620302 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.620261 2578 scope.go:117] "RemoveContainer" containerID="00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602" Sep 18 12:05:18.620461 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.620427 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602"} err="failed to get container status \"00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602\": rpc error: code = NotFound desc = could not find container \"00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602\": container with ID starting with 00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602 not found: ID does not exist" Sep 18 12:05:18.620510 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.620461 2578 scope.go:117] "RemoveContainer" containerID="8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c" Sep 18 12:05:18.620679 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.620658 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c"} err="failed to get container status \"8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c\": rpc error: code = NotFound desc = could not find container \"8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c\": container with ID starting with 8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c not found: ID does not exist" Sep 18 12:05:18.620679 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.620678 2578 scope.go:117] "RemoveContainer" containerID="ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5" Sep 18 12:05:18.620897 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.620880 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5"} err="failed to get container status \"ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5\": rpc error: code = NotFound desc = could not find container \"ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5\": container with ID starting with ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5 not found: ID does not exist" Sep 18 12:05:18.620968 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.620898 2578 scope.go:117] "RemoveContainer" containerID="c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d" Sep 18 12:05:18.621133 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.621117 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d"} err="failed to get container status \"c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d\": rpc error: code = NotFound desc = could not find container \"c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d\": container with ID starting with c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d not found: ID does not exist" Sep 18 12:05:18.621179 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.621135 2578 scope.go:117] "RemoveContainer" containerID="d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24" Sep 18 12:05:18.621347 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.621329 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24"} err="failed to get container status \"d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24\": rpc error: code = NotFound desc = could not find container \"d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24\": container with ID starting with d53a5383e64d4fb025ce0c1149eb241aed6025e1fe19e16aca268bcb4560ab24 not found: ID does not exist" Sep 18 12:05:18.621414 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.621347 2578 scope.go:117] "RemoveContainer" containerID="a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88" Sep 18 12:05:18.621618 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.621600 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88"} err="failed to get container status \"a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88\": rpc error: code = NotFound desc = could not find container \"a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88\": container with ID starting with a7cee985a7c8ac79cf2188e7094d1e2e97fb3a156236790af6a6abf03381df88 not found: ID does not exist" Sep 18 12:05:18.621672 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.621619 2578 scope.go:117] "RemoveContainer" containerID="4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317" Sep 18 12:05:18.621855 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.621833 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317"} err="failed to get container status \"4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317\": rpc error: code = NotFound desc = could not find container \"4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317\": container with ID starting with 4c36e4cdf9e5fd9c29a9c95c8c3624d2c53ac26a2fa509f036a81ddbc221a317 not found: ID does not exist" Sep 18 12:05:18.621855 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.621853 2578 scope.go:117] "RemoveContainer" containerID="00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602" Sep 18 12:05:18.622075 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.622060 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602"} err="failed to get container status \"00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602\": rpc error: code = NotFound desc = could not find container \"00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602\": container with ID starting with 00604e3912749dcd3c5a71bd84c5a63faebb549a7738c92eff4144903fa11602 not found: ID does not exist" Sep 18 12:05:18.622075 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.622075 2578 scope.go:117] "RemoveContainer" containerID="8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c" Sep 18 12:05:18.622274 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.622260 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c"} err="failed to get container status \"8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c\": rpc error: code = NotFound desc = could not find container \"8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c\": container with ID starting with 8ab0b0f935a8ba6fea69cc970914465d34c49f36b2da8cddadf7c46b7accf70c not found: ID does not exist" Sep 18 12:05:18.622274 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.622274 2578 scope.go:117] "RemoveContainer" containerID="ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5" Sep 18 12:05:18.622482 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.622467 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5"} err="failed to get container status \"ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5\": rpc error: code = NotFound desc = could not find container \"ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5\": container with ID starting with ba5e6aefe01bcbb2158b50b8d64b2bafe2382747e8b7369e575abdc31fcf6ad5 not found: ID does not exist" Sep 18 12:05:18.622537 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.622482 2578 scope.go:117] "RemoveContainer" containerID="c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d" Sep 18 12:05:18.622701 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.622686 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d"} err="failed to get container status \"c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d\": rpc error: code = NotFound desc = could not find container \"c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d\": container with ID starting with c5734b7a4938f0f57b07fbd667be06c36212d847f8eb4bbf0b2f696d360b933d not found: ID does not exist" Sep 18 12:05:18.643118 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643086 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 12:05:18.643375 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643362 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8abab63f-e025-41d6-b087-5b54732fc49c" containerName="init-config-reloader" Sep 18 12:05:18.643462 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643378 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8abab63f-e025-41d6-b087-5b54732fc49c" containerName="init-config-reloader" Sep 18 12:05:18.643462 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643390 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3086576-e665-4430-81ed-3c61cf08b127" containerName="init-config-reloader" Sep 18 12:05:18.643462 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643395 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3086576-e665-4430-81ed-3c61cf08b127" containerName="init-config-reloader" Sep 18 12:05:18.643462 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643404 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3086576-e665-4430-81ed-3c61cf08b127" containerName="kube-rbac-proxy" Sep 18 12:05:18.643462 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643410 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3086576-e665-4430-81ed-3c61cf08b127" containerName="kube-rbac-proxy" Sep 18 12:05:18.643462 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643416 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8abab63f-e025-41d6-b087-5b54732fc49c" containerName="config-reloader" Sep 18 12:05:18.643462 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643421 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8abab63f-e025-41d6-b087-5b54732fc49c" containerName="config-reloader" Sep 18 12:05:18.643462 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643428 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3086576-e665-4430-81ed-3c61cf08b127" containerName="config-reloader" Sep 18 12:05:18.643462 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643447 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3086576-e665-4430-81ed-3c61cf08b127" containerName="config-reloader" Sep 18 12:05:18.643462 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643454 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8521b30f-b709-4088-8560-d3c8a4da8318" containerName="console" Sep 18 12:05:18.643462 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643459 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8521b30f-b709-4088-8560-d3c8a4da8318" containerName="console" Sep 18 12:05:18.643462 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643465 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8abab63f-e025-41d6-b087-5b54732fc49c" containerName="kube-rbac-proxy-thanos" Sep 18 12:05:18.643462 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643470 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8abab63f-e025-41d6-b087-5b54732fc49c" containerName="kube-rbac-proxy-thanos" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643476 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8abab63f-e025-41d6-b087-5b54732fc49c" containerName="prometheus" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643482 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8abab63f-e025-41d6-b087-5b54732fc49c" containerName="prometheus" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643487 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8abab63f-e025-41d6-b087-5b54732fc49c" containerName="thanos-sidecar" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643494 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8abab63f-e025-41d6-b087-5b54732fc49c" containerName="thanos-sidecar" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643501 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3086576-e665-4430-81ed-3c61cf08b127" containerName="kube-rbac-proxy-web" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643506 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3086576-e665-4430-81ed-3c61cf08b127" containerName="kube-rbac-proxy-web" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643511 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1224ce74-74ed-47ba-b9f4-3b1c79ef5933" containerName="registry" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643516 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1224ce74-74ed-47ba-b9f4-3b1c79ef5933" containerName="registry" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643521 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3086576-e665-4430-81ed-3c61cf08b127" containerName="alertmanager" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643526 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3086576-e665-4430-81ed-3c61cf08b127" containerName="alertmanager" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643531 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3086576-e665-4430-81ed-3c61cf08b127" containerName="kube-rbac-proxy-metric" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643536 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3086576-e665-4430-81ed-3c61cf08b127" containerName="kube-rbac-proxy-metric" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643542 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f38c726d-39d9-4ff4-87a5-e23ce290d469" containerName="console" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643546 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f38c726d-39d9-4ff4-87a5-e23ce290d469" containerName="console" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643555 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8abab63f-e025-41d6-b087-5b54732fc49c" containerName="kube-rbac-proxy" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643560 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8abab63f-e025-41d6-b087-5b54732fc49c" containerName="kube-rbac-proxy" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643567 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3086576-e665-4430-81ed-3c61cf08b127" containerName="prom-label-proxy" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643571 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3086576-e665-4430-81ed-3c61cf08b127" containerName="prom-label-proxy" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643577 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8abab63f-e025-41d6-b087-5b54732fc49c" containerName="kube-rbac-proxy-web" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643582 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8abab63f-e025-41d6-b087-5b54732fc49c" containerName="kube-rbac-proxy-web" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643638 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3086576-e665-4430-81ed-3c61cf08b127" containerName="prom-label-proxy" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643646 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1224ce74-74ed-47ba-b9f4-3b1c79ef5933" containerName="registry" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643652 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8abab63f-e025-41d6-b087-5b54732fc49c" containerName="kube-rbac-proxy-web" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643658 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8abab63f-e025-41d6-b087-5b54732fc49c" containerName="kube-rbac-proxy" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643664 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8521b30f-b709-4088-8560-d3c8a4da8318" containerName="console" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643669 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3086576-e665-4430-81ed-3c61cf08b127" containerName="alertmanager" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643675 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3086576-e665-4430-81ed-3c61cf08b127" containerName="kube-rbac-proxy-web" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643681 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8abab63f-e025-41d6-b087-5b54732fc49c" containerName="thanos-sidecar" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643687 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3086576-e665-4430-81ed-3c61cf08b127" containerName="kube-rbac-proxy-metric" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643692 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3086576-e665-4430-81ed-3c61cf08b127" containerName="config-reloader" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643697 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3086576-e665-4430-81ed-3c61cf08b127" containerName="kube-rbac-proxy" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643703 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8abab63f-e025-41d6-b087-5b54732fc49c" containerName="prometheus" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643708 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8abab63f-e025-41d6-b087-5b54732fc49c" containerName="kube-rbac-proxy-thanos" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643713 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8abab63f-e025-41d6-b087-5b54732fc49c" containerName="config-reloader" Sep 18 12:05:18.643868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.643719 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f38c726d-39d9-4ff4-87a5-e23ce290d469" containerName="console" Sep 18 12:05:18.647544 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.647525 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.654484 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.654429 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 18 12:05:18.655338 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.654939 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 18 12:05:18.655338 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.654948 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 18 12:05:18.655338 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.655037 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 18 12:05:18.655338 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.655075 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 18 12:05:18.655583 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.655344 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-98g9h\"" Sep 18 12:05:18.655850 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.655835 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 18 12:05:18.658224 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.658209 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 18 12:05:18.659708 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.659687 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 18 12:05:18.659801 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.659730 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 18 12:05:18.659801 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.659742 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 18 12:05:18.659801 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.659688 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 18 12:05:18.659958 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.659734 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7geol4575n70j\"" Sep 18 12:05:18.665138 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.665117 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 18 12:05:18.667928 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.667909 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 18 12:05:18.670339 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.670316 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 18 12:05:18.673502 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.673479 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 12:05:18.770144 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.770105 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/af243ae5-a6bd-46bb-a80d-849749ba0a06-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.770144 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.770149 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/af243ae5-a6bd-46bb-a80d-849749ba0a06-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.770335 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.770178 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af243ae5-a6bd-46bb-a80d-849749ba0a06-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.770335 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.770209 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/af243ae5-a6bd-46bb-a80d-849749ba0a06-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.770335 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.770239 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/af243ae5-a6bd-46bb-a80d-849749ba0a06-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.770335 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.770255 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/af243ae5-a6bd-46bb-a80d-849749ba0a06-config\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.770335 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.770274 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af243ae5-a6bd-46bb-a80d-849749ba0a06-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.770548 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.770327 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/af243ae5-a6bd-46bb-a80d-849749ba0a06-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.770548 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.770380 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af243ae5-a6bd-46bb-a80d-849749ba0a06-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.770548 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.770400 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/af243ae5-a6bd-46bb-a80d-849749ba0a06-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.770548 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.770424 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/af243ae5-a6bd-46bb-a80d-849749ba0a06-web-config\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.770548 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.770474 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/af243ae5-a6bd-46bb-a80d-849749ba0a06-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.770548 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.770497 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/af243ae5-a6bd-46bb-a80d-849749ba0a06-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.770548 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.770521 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/af243ae5-a6bd-46bb-a80d-849749ba0a06-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.770548 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.770535 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/af243ae5-a6bd-46bb-a80d-849749ba0a06-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.770783 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.770590 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqzw5\" (UniqueName: \"kubernetes.io/projected/af243ae5-a6bd-46bb-a80d-849749ba0a06-kube-api-access-pqzw5\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.770783 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.770613 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/af243ae5-a6bd-46bb-a80d-849749ba0a06-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.770783 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.770635 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/af243ae5-a6bd-46bb-a80d-849749ba0a06-config-out\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.770783 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.770660 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/af243ae5-a6bd-46bb-a80d-849749ba0a06-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.770783 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.770679 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af243ae5-a6bd-46bb-a80d-849749ba0a06-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.871794 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.871710 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/af243ae5-a6bd-46bb-a80d-849749ba0a06-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.871794 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.871747 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/af243ae5-a6bd-46bb-a80d-849749ba0a06-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.871794 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.871766 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af243ae5-a6bd-46bb-a80d-849749ba0a06-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.872034 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.871877 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/af243ae5-a6bd-46bb-a80d-849749ba0a06-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.872034 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.871926 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/af243ae5-a6bd-46bb-a80d-849749ba0a06-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.872034 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.871950 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/af243ae5-a6bd-46bb-a80d-849749ba0a06-config\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.872034 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.871976 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af243ae5-a6bd-46bb-a80d-849749ba0a06-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.872034 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.872008 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/af243ae5-a6bd-46bb-a80d-849749ba0a06-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.872267 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.872063 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af243ae5-a6bd-46bb-a80d-849749ba0a06-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.872267 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.872089 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/af243ae5-a6bd-46bb-a80d-849749ba0a06-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.872267 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.872111 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/af243ae5-a6bd-46bb-a80d-849749ba0a06-web-config\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.872267 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.872132 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/af243ae5-a6bd-46bb-a80d-849749ba0a06-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.872267 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.872153 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/af243ae5-a6bd-46bb-a80d-849749ba0a06-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.872267 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.872191 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/af243ae5-a6bd-46bb-a80d-849749ba0a06-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.872267 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.872211 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/af243ae5-a6bd-46bb-a80d-849749ba0a06-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.872267 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.872264 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqzw5\" (UniqueName: \"kubernetes.io/projected/af243ae5-a6bd-46bb-a80d-849749ba0a06-kube-api-access-pqzw5\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.872869 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.872297 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/af243ae5-a6bd-46bb-a80d-849749ba0a06-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.872869 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.872323 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/af243ae5-a6bd-46bb-a80d-849749ba0a06-config-out\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.872869 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.872346 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/af243ae5-a6bd-46bb-a80d-849749ba0a06-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.872869 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.872375 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af243ae5-a6bd-46bb-a80d-849749ba0a06-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.872869 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.872768 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/af243ae5-a6bd-46bb-a80d-849749ba0a06-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.873109 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.873066 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/af243ae5-a6bd-46bb-a80d-849749ba0a06-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.873856 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.873825 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af243ae5-a6bd-46bb-a80d-849749ba0a06-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.873856 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.873843 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af243ae5-a6bd-46bb-a80d-849749ba0a06-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.874385 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.874358 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/af243ae5-a6bd-46bb-a80d-849749ba0a06-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.875022 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.874994 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af243ae5-a6bd-46bb-a80d-849749ba0a06-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.875218 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.875195 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/af243ae5-a6bd-46bb-a80d-849749ba0a06-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.875290 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.875207 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/af243ae5-a6bd-46bb-a80d-849749ba0a06-config\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.875290 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.875219 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/af243ae5-a6bd-46bb-a80d-849749ba0a06-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.875290 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.875254 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/af243ae5-a6bd-46bb-a80d-849749ba0a06-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.875626 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.875600 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af243ae5-a6bd-46bb-a80d-849749ba0a06-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.876945 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.876460 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/af243ae5-a6bd-46bb-a80d-849749ba0a06-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.876945 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.876898 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/af243ae5-a6bd-46bb-a80d-849749ba0a06-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.876945 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.876941 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/af243ae5-a6bd-46bb-a80d-849749ba0a06-web-config\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.877728 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.877704 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/af243ae5-a6bd-46bb-a80d-849749ba0a06-config-out\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.877940 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.877919 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/af243ae5-a6bd-46bb-a80d-849749ba0a06-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.878130 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.878110 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/af243ae5-a6bd-46bb-a80d-849749ba0a06-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.878346 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.878329 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/af243ae5-a6bd-46bb-a80d-849749ba0a06-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.878380 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.878330 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/af243ae5-a6bd-46bb-a80d-849749ba0a06-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.887052 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.887031 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqzw5\" (UniqueName: \"kubernetes.io/projected/af243ae5-a6bd-46bb-a80d-849749ba0a06-kube-api-access-pqzw5\") pod \"prometheus-k8s-0\" (UID: \"af243ae5-a6bd-46bb-a80d-849749ba0a06\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:18.958044 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:18.957995 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:19.262995 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:19.262968 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 12:05:19.263366 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:05:19.263345 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf243ae5_a6bd_46bb_a80d_849749ba0a06.slice/crio-70ac8c92ce8e3453573f8c039b65bcfbf6218ee0a7732f97f1e6fd084873afc1 WatchSource:0}: Error finding container 70ac8c92ce8e3453573f8c039b65bcfbf6218ee0a7732f97f1e6fd084873afc1: Status 404 returned error can't find the container with id 70ac8c92ce8e3453573f8c039b65bcfbf6218ee0a7732f97f1e6fd084873afc1 Sep 18 12:05:19.465669 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:19.465628 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8abab63f-e025-41d6-b087-5b54732fc49c" path="/var/lib/kubelet/pods/8abab63f-e025-41d6-b087-5b54732fc49c/volumes" Sep 18 12:05:19.561376 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:19.561282 2578 generic.go:356] "Generic (PLEG): container finished" podID="af243ae5-a6bd-46bb-a80d-849749ba0a06" containerID="e31b13bd83e20c7e73be9a74479985fdc302312886a45b44df190a460708cfd1" exitCode=0 Sep 18 12:05:19.561808 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:19.561377 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af243ae5-a6bd-46bb-a80d-849749ba0a06","Type":"ContainerDied","Data":"e31b13bd83e20c7e73be9a74479985fdc302312886a45b44df190a460708cfd1"} Sep 18 12:05:19.561808 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:19.561470 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af243ae5-a6bd-46bb-a80d-849749ba0a06","Type":"ContainerStarted","Data":"70ac8c92ce8e3453573f8c039b65bcfbf6218ee0a7732f97f1e6fd084873afc1"} Sep 18 12:05:20.571340 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:20.571311 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af243ae5-a6bd-46bb-a80d-849749ba0a06","Type":"ContainerStarted","Data":"127f8255788d730c056917c2b61a7ff26aac6b7429ec87a654aa5a8192f1c3d4"} Sep 18 12:05:20.571741 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:20.571370 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af243ae5-a6bd-46bb-a80d-849749ba0a06","Type":"ContainerStarted","Data":"109a3e1f3c98705c22ca853d86e158824afd7a89c98ed252b898e738b551a224"} Sep 18 12:05:20.571741 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:20.571396 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af243ae5-a6bd-46bb-a80d-849749ba0a06","Type":"ContainerStarted","Data":"00a2e29c86f3b5b2766a4bad7f51a6ec2956ffd301dedd78563d64601913255f"} Sep 18 12:05:20.571741 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:20.571421 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af243ae5-a6bd-46bb-a80d-849749ba0a06","Type":"ContainerStarted","Data":"3b18d8f457969b10431cef5423586d96a826d3b1f1713873ec8203bc2d4ac463"} Sep 18 12:05:20.571741 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:20.571473 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af243ae5-a6bd-46bb-a80d-849749ba0a06","Type":"ContainerStarted","Data":"59ed146c64c0cc23b0597ad039fff3a289c2e476d4816a9a04a51d5ef1aae96d"} Sep 18 12:05:20.571741 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:20.571508 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"af243ae5-a6bd-46bb-a80d-849749ba0a06","Type":"ContainerStarted","Data":"ad82f5432ab29c5ad13563c1c61b183a79984f2e83cabbd1ef060ef0088afff5"} Sep 18 12:05:20.619696 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:20.619645 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.597092456 podStartE2EDuration="2.619627779s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.535323ms" isStatefulPod=false podCreationTimestamp="2026-09-18 12:05:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:05:20.614484355 +0000 UTC m=+243.619172082" watchObservedRunningTime="2026-09-18 12:05:20.619627779 +0000 UTC m=+243.624315502" Sep 18 12:05:20.842232 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:20.842147 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:05:23.959104 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:23.959061 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:05:26.319143 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:26.319109 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:05:26.466089 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:26.466060 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:05:29.252511 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:29.252473 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-metrics-certs\") pod \"network-metrics-daemon-lvx4s\" (UID: \"a7f89718-22f1-4c13-aff1-d2fa5ff92c55\") " pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:05:29.255011 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:29.254990 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7f89718-22f1-4c13-aff1-d2fa5ff92c55-metrics-certs\") pod \"network-metrics-daemon-lvx4s\" (UID: \"a7f89718-22f1-4c13-aff1-d2fa5ff92c55\") " pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:05:29.264817 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:29.264797 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dg4h6\"" Sep 18 12:05:29.272821 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:29.272805 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lvx4s" Sep 18 12:05:29.545514 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:29.545490 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lvx4s"] Sep 18 12:05:29.547766 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:05:29.547739 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7f89718_22f1_4c13_aff1_d2fa5ff92c55.slice/crio-cb6582e7961abda33e9aeaae3447928dce898a216bed2a614d3fcc9c6706e4f5 WatchSource:0}: Error finding container cb6582e7961abda33e9aeaae3447928dce898a216bed2a614d3fcc9c6706e4f5: Status 404 returned error can't find the container with id cb6582e7961abda33e9aeaae3447928dce898a216bed2a614d3fcc9c6706e4f5 Sep 18 12:05:29.610840 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:29.610815 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lvx4s" event={"ID":"a7f89718-22f1-4c13-aff1-d2fa5ff92c55","Type":"ContainerStarted","Data":"cb6582e7961abda33e9aeaae3447928dce898a216bed2a614d3fcc9c6706e4f5"} Sep 18 12:05:31.622036 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:31.622006 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lvx4s" event={"ID":"a7f89718-22f1-4c13-aff1-d2fa5ff92c55","Type":"ContainerStarted","Data":"67c386a2b8580f11460d5eaac6a6c2fc2f2da7bc406ef66866cf3445eb7844ab"} Sep 18 12:05:31.622469 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:31.622064 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lvx4s" event={"ID":"a7f89718-22f1-4c13-aff1-d2fa5ff92c55","Type":"ContainerStarted","Data":"291eb51f65241f829b3c847d2b3ded405ffd0a0c9dc37b5249bb9d3b3dc107c3"} Sep 18 12:05:31.646056 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:31.646011 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lvx4s" podStartSLOduration=252.672993865 podStartE2EDuration="4m13.645996072s" totalImagesPullingTime="973.002207ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 12:01:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:05:31.644629988 +0000 UTC m=+254.649317714" watchObservedRunningTime="2026-09-18 12:05:31.645996072 +0000 UTC m=+254.650683794" Sep 18 12:05:31.824844 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:31.824809 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:05:31.926184 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:05:31.926155 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:06:06.406995 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:06:06.406960 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:06:06.534200 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:06:06.534164 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:06:17.361641 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:06:17.361614 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-fc7vn_a6629efd-ffee-4ff0-bb6c-530f4ac96793/console-operator/1.log" Sep 18 12:06:17.367534 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:06:17.367506 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-fc7vn_a6629efd-ffee-4ff0-bb6c-530f4ac96793/console-operator/1.log" Sep 18 12:06:17.373546 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:06:17.373522 2578 kubelet.go:1648] "Image garbage collection succeeded" Sep 18 12:06:18.959251 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:06:18.959202 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:06:18.975563 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:06:18.975538 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:06:19.835781 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:06:19.835748 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 12:06:27.556539 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:06:27.556504 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:06:27.685082 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:06:27.685050 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:06:35.165480 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:06:35.165426 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:06:35.263815 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:06:35.263773 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:06:36.073367 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:06:36.073331 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:06:36.166350 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:06:36.166318 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:06:39.539776 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:06:39.539742 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:06:39.640388 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:06:39.640360 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:06:46.059757 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:06:46.059725 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:06:46.161287 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:06:46.161256 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:06:46.247002 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:06:46.246969 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:06:49.688665 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:06:49.688629 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:06:56.246145 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:06:56.246110 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:06:56.344085 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:06:56.344007 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:06:56.428805 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:06:56.428771 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:07:51.627708 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:07:51.627673 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:07:53.049677 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:07:53.049633 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:08:19.275657 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:19.275622 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:08:19.668598 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:19.668569 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:08:20.182663 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:20.182626 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:08:23.692782 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:23.692746 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:08:23.798669 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:23.798628 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:08:28.969931 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:28.969872 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:08:29.073523 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:29.073493 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:08:46.754849 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:46.754753 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:08:46.889075 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:46.889041 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:08:51.165090 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:51.165054 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:08:51.263114 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:51.263079 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:08:53.559499 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:53.559427 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:08:53.979116 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:53.979084 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:08:54.128693 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:54.128659 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-djpxq"] Sep 18 12:08:54.131902 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:54.131882 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-djpxq" Sep 18 12:08:54.134766 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:54.134748 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 18 12:08:54.135792 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:54.135775 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 18 12:08:54.135898 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:54.135776 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-4pmhp\"" Sep 18 12:08:54.144812 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:54.144792 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-djpxq"] Sep 18 12:08:54.182605 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:54.182579 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95eeac8c-aa9d-431e-bb9a-354cc4468bf2-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-djpxq\" (UID: \"95eeac8c-aa9d-431e-bb9a-354cc4468bf2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-djpxq" Sep 18 12:08:54.182727 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:54.182619 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkp2f\" (UniqueName: \"kubernetes.io/projected/95eeac8c-aa9d-431e-bb9a-354cc4468bf2-kube-api-access-pkp2f\") pod \"cert-manager-webhook-6486ffd997-djpxq\" (UID: \"95eeac8c-aa9d-431e-bb9a-354cc4468bf2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-djpxq" Sep 18 12:08:54.283388 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:54.283304 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkp2f\" (UniqueName: \"kubernetes.io/projected/95eeac8c-aa9d-431e-bb9a-354cc4468bf2-kube-api-access-pkp2f\") pod \"cert-manager-webhook-6486ffd997-djpxq\" (UID: \"95eeac8c-aa9d-431e-bb9a-354cc4468bf2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-djpxq" Sep 18 12:08:54.283388 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:54.283382 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95eeac8c-aa9d-431e-bb9a-354cc4468bf2-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-djpxq\" (UID: \"95eeac8c-aa9d-431e-bb9a-354cc4468bf2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-djpxq" Sep 18 12:08:54.294073 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:54.294047 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkp2f\" (UniqueName: \"kubernetes.io/projected/95eeac8c-aa9d-431e-bb9a-354cc4468bf2-kube-api-access-pkp2f\") pod \"cert-manager-webhook-6486ffd997-djpxq\" (UID: \"95eeac8c-aa9d-431e-bb9a-354cc4468bf2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-djpxq" Sep 18 12:08:54.295119 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:54.295103 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95eeac8c-aa9d-431e-bb9a-354cc4468bf2-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-djpxq\" (UID: \"95eeac8c-aa9d-431e-bb9a-354cc4468bf2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-djpxq" Sep 18 12:08:54.448988 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:54.448958 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-djpxq" Sep 18 12:08:54.743290 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:54.743259 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-djpxq"] Sep 18 12:08:54.746822 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:08:54.746797 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95eeac8c_aa9d_431e_bb9a_354cc4468bf2.slice/crio-5404701ad9e0bc24eca0a12fef7334a2db4ca4b88d6ce6912c8773e69f048448 WatchSource:0}: Error finding container 5404701ad9e0bc24eca0a12fef7334a2db4ca4b88d6ce6912c8773e69f048448: Status 404 returned error can't find the container with id 5404701ad9e0bc24eca0a12fef7334a2db4ca4b88d6ce6912c8773e69f048448 Sep 18 12:08:54.748753 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:54.748729 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 12:08:55.431191 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:55.431159 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-djpxq" event={"ID":"95eeac8c-aa9d-431e-bb9a-354cc4468bf2","Type":"ContainerStarted","Data":"5404701ad9e0bc24eca0a12fef7334a2db4ca4b88d6ce6912c8773e69f048448"} Sep 18 12:08:57.701327 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:57.701287 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:08:57.801300 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:57.801266 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:08:57.872499 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:57.872468 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:08:58.446266 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:58.446233 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-djpxq" event={"ID":"95eeac8c-aa9d-431e-bb9a-354cc4468bf2","Type":"ContainerStarted","Data":"a1221c2479394b0b89a9bdcc09b42c1342b7d02d3aa6186ad2d1d00aeb7a85af"} Sep 18 12:08:58.446432 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:58.446304 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-djpxq" Sep 18 12:08:58.468051 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:08:58.468008 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-djpxq" podStartSLOduration=1.268926171 podStartE2EDuration="4.467993615s" totalImagesPullingTime="3.199067444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 12:08:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:08:58.467243583 +0000 UTC m=+461.471931310" watchObservedRunningTime="2026-09-18 12:08:58.467993615 +0000 UTC m=+461.472681338" Sep 18 12:09:00.498915 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:00.498883 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:09:00.597900 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:00.597845 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:09:01.161566 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:01.161536 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:09:04.452774 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:04.452744 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-djpxq" Sep 18 12:09:04.701771 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:04.701735 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:09:04.803681 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:04.803597 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:09:15.102462 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:15.102384 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:09:15.197034 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:15.196998 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:09:25.485720 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:25.485686 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:09:27.475548 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:27.475514 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:09:28.760999 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:28.760955 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:09:28.841942 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:28.841910 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:09:34.890702 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:34.890664 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:09:34.990656 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:34.990624 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:09:50.804971 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:50.804935 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:09:51.000963 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:51.000930 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:09:54.218987 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:54.218953 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7fb44f7864-lll5t"] Sep 18 12:09:54.222153 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:54.222137 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7fb44f7864-lll5t" Sep 18 12:09:54.224794 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:54.224771 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 18 12:09:54.224926 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:54.224871 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Sep 18 12:09:54.225812 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:54.225793 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 18 12:09:54.225864 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:54.225846 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-x25zp\"" Sep 18 12:09:54.225864 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:54.225853 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Sep 18 12:09:54.236921 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:54.236902 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7fb44f7864-lll5t"] Sep 18 12:09:54.268121 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:54.268094 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:09:54.278355 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:54.278332 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/b270e464-697d-4e7c-974c-7cea6419b733-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7fb44f7864-lll5t\" (UID: \"b270e464-697d-4e7c-974c-7cea6419b733\") " pod="opendatahub/kubeflow-trainer-controller-manager-7fb44f7864-lll5t" Sep 18 12:09:54.278475 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:54.278392 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqjvs\" (UniqueName: \"kubernetes.io/projected/b270e464-697d-4e7c-974c-7cea6419b733-kube-api-access-bqjvs\") pod \"kubeflow-trainer-controller-manager-7fb44f7864-lll5t\" (UID: \"b270e464-697d-4e7c-974c-7cea6419b733\") " pod="opendatahub/kubeflow-trainer-controller-manager-7fb44f7864-lll5t" Sep 18 12:09:54.278475 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:54.278425 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b270e464-697d-4e7c-974c-7cea6419b733-cert\") pod \"kubeflow-trainer-controller-manager-7fb44f7864-lll5t\" (UID: \"b270e464-697d-4e7c-974c-7cea6419b733\") " pod="opendatahub/kubeflow-trainer-controller-manager-7fb44f7864-lll5t" Sep 18 12:09:54.379817 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:54.379780 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/b270e464-697d-4e7c-974c-7cea6419b733-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7fb44f7864-lll5t\" (UID: \"b270e464-697d-4e7c-974c-7cea6419b733\") " pod="opendatahub/kubeflow-trainer-controller-manager-7fb44f7864-lll5t" Sep 18 12:09:54.380002 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:54.379865 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqjvs\" (UniqueName: \"kubernetes.io/projected/b270e464-697d-4e7c-974c-7cea6419b733-kube-api-access-bqjvs\") pod \"kubeflow-trainer-controller-manager-7fb44f7864-lll5t\" (UID: \"b270e464-697d-4e7c-974c-7cea6419b733\") " pod="opendatahub/kubeflow-trainer-controller-manager-7fb44f7864-lll5t" Sep 18 12:09:54.380002 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:54.379896 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b270e464-697d-4e7c-974c-7cea6419b733-cert\") pod \"kubeflow-trainer-controller-manager-7fb44f7864-lll5t\" (UID: \"b270e464-697d-4e7c-974c-7cea6419b733\") " pod="opendatahub/kubeflow-trainer-controller-manager-7fb44f7864-lll5t" Sep 18 12:09:54.380419 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:54.380397 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/b270e464-697d-4e7c-974c-7cea6419b733-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7fb44f7864-lll5t\" (UID: \"b270e464-697d-4e7c-974c-7cea6419b733\") " pod="opendatahub/kubeflow-trainer-controller-manager-7fb44f7864-lll5t" Sep 18 12:09:54.382340 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:54.382320 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b270e464-697d-4e7c-974c-7cea6419b733-cert\") pod \"kubeflow-trainer-controller-manager-7fb44f7864-lll5t\" (UID: \"b270e464-697d-4e7c-974c-7cea6419b733\") " pod="opendatahub/kubeflow-trainer-controller-manager-7fb44f7864-lll5t" Sep 18 12:09:54.387772 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:54.387750 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqjvs\" (UniqueName: \"kubernetes.io/projected/b270e464-697d-4e7c-974c-7cea6419b733-kube-api-access-bqjvs\") pod \"kubeflow-trainer-controller-manager-7fb44f7864-lll5t\" (UID: \"b270e464-697d-4e7c-974c-7cea6419b733\") " pod="opendatahub/kubeflow-trainer-controller-manager-7fb44f7864-lll5t" Sep 18 12:09:54.452486 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:54.452461 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:09:54.531553 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:54.531484 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7fb44f7864-lll5t" Sep 18 12:09:54.805146 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:54.805122 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7fb44f7864-lll5t"] Sep 18 12:09:54.807067 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:09:54.807042 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb270e464_697d_4e7c_974c_7cea6419b733.slice/crio-0a4a93544e7283f1954fac9da20447b598eb552f7774c366051e8d972b4b7097 WatchSource:0}: Error finding container 0a4a93544e7283f1954fac9da20447b598eb552f7774c366051e8d972b4b7097: Status 404 returned error can't find the container with id 0a4a93544e7283f1954fac9da20447b598eb552f7774c366051e8d972b4b7097 Sep 18 12:09:55.682406 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:55.682366 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7fb44f7864-lll5t" event={"ID":"b270e464-697d-4e7c-974c-7cea6419b733","Type":"ContainerStarted","Data":"0a4a93544e7283f1954fac9da20447b598eb552f7774c366051e8d972b4b7097"} Sep 18 12:09:57.692595 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:57.692561 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7fb44f7864-lll5t" event={"ID":"b270e464-697d-4e7c-974c-7cea6419b733","Type":"ContainerStarted","Data":"cbe8eff01fe17256479634897243af06f5c4b3b14c36529ebaca413d3694a5dd"} Sep 18 12:09:57.693009 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:57.692628 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-7fb44f7864-lll5t" Sep 18 12:09:57.712135 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:57.712080 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-7fb44f7864-lll5t" podStartSLOduration=1.318262641 podStartE2EDuration="3.712065665s" totalImagesPullingTime="2.393803024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 12:09:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:09:57.711727204 +0000 UTC m=+520.716414926" watchObservedRunningTime="2026-09-18 12:09:57.712065665 +0000 UTC m=+520.716753387" Sep 18 12:09:58.309914 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:58.309873 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:09:59.008991 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:59.008963 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:09:59.109889 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:09:59.109858 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:10:13.699587 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:10:13.699550 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-7fb44f7864-lll5t" podUID="b270e464-697d-4e7c-974c-7cea6419b733" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 18 12:10:17.416451 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:10:17.416387 2578 scope.go:117] "RemoveContainer" containerID="0e04b929390045246cc896077c9aff0e695911b0ec70d5e5b6f28f6be1d0b3ec" Sep 18 12:10:17.424720 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:10:17.424700 2578 scope.go:117] "RemoveContainer" containerID="e0dc4c97e78e5282df5a2b30520d3480e45e4074fed53c3d7b4a97372d7d8205" Sep 18 12:10:17.432240 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:10:17.432219 2578 scope.go:117] "RemoveContainer" containerID="e9b4e1495643666251a80613a1da5860b9104a74807eb922e17757793d943cb7" Sep 18 12:10:17.439681 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:10:17.439662 2578 scope.go:117] "RemoveContainer" containerID="0fb467ea614481bdbbc765d4132240cd256b08053e23242d024ee3acd397b775" Sep 18 12:10:17.446882 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:10:17.446860 2578 scope.go:117] "RemoveContainer" containerID="4252704c3cec22fae5681b8abac6ccf83f4fc9bf3dcb06e941fc483863c97faf" Sep 18 12:10:17.453449 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:10:17.453419 2578 scope.go:117] "RemoveContainer" containerID="eb11012bcf39409e205092b6edf18112bde08f57ad49a975f9ac435a4859f082" Sep 18 12:10:17.460290 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:10:17.460269 2578 scope.go:117] "RemoveContainer" containerID="f93c01278c4a43a1742c20713b6981517989cc430fec7a1ae8f6e151c1df05e8" Sep 18 12:10:28.699532 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:10:28.699487 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-7fb44f7864-lll5t" podUID="b270e464-697d-4e7c-974c-7cea6419b733" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 18 12:10:43.698365 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:10:43.698316 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-7fb44f7864-lll5t" podUID="b270e464-697d-4e7c-974c-7cea6419b733" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 18 12:10:58.698213 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:10:58.698161 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-7fb44f7864-lll5t" podUID="b270e464-697d-4e7c-974c-7cea6419b733" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 18 12:11:13.699212 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:11:13.699172 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-7fb44f7864-lll5t" podUID="b270e464-697d-4e7c-974c-7cea6419b733" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 18 12:11:17.390101 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:11:17.390071 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-fc7vn_a6629efd-ffee-4ff0-bb6c-530f4ac96793/console-operator/1.log" Sep 18 12:11:17.392095 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:11:17.392065 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-fc7vn_a6629efd-ffee-4ff0-bb6c-530f4ac96793/console-operator/1.log" Sep 18 12:11:17.860896 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:11:17.860808 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:11:18.461675 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:11:18.461641 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/kubeflow-trainer-controller-manager-7fb44f7864-lll5t" podUID="b270e464-697d-4e7c-974c-7cea6419b733" containerName="manager" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 18 12:11:27.346878 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:11:27.346847 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:11:33.465930 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:11:33.465901 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-7fb44f7864-lll5t" Sep 18 12:12:18.574814 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:12:18.574777 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:12:18.672475 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:12:18.672422 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:12:18.743351 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:12:18.743304 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:12:28.976450 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:12:28.976404 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:12:29.046302 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:12:29.046277 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:14:53.133927 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:14:53.133848 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:15:07.888387 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:15:07.888354 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:16:17.421412 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:16:17.421342 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-fc7vn_a6629efd-ffee-4ff0-bb6c-530f4ac96793/console-operator/1.log" Sep 18 12:16:17.421412 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:16:17.421342 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-fc7vn_a6629efd-ffee-4ff0-bb6c-530f4ac96793/console-operator/1.log" Sep 18 12:16:20.418741 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:16:20.418708 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:16:41.394049 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:16:41.394018 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:16:41.491714 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:16:41.491684 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:16:41.541158 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:16:41.541129 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-gs9q4/e2e-test-jax-node-0-0-xxhfm"] Sep 18 12:16:41.544420 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:16:41.544405 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gs9q4/e2e-test-jax-node-0-0-xxhfm" Sep 18 12:16:41.546937 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:16:41.546910 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gs9q4\"/\"openshift-service-ca.crt\"" Sep 18 12:16:41.546937 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:16:41.546933 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gs9q4\"/\"kube-root-ca.crt\"" Sep 18 12:16:41.547147 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:16:41.547034 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gs9q4\"/\"default-dockercfg-fbd5r\"" Sep 18 12:16:41.554594 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:16:41.554576 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-gs9q4/e2e-test-jax-node-0-0-xxhfm"] Sep 18 12:16:41.577122 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:16:41.577098 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:16:41.612383 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:16:41.612360 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf6mt\" (UniqueName: \"kubernetes.io/projected/80113137-6936-4f14-b06c-263bb1bb1a6e-kube-api-access-wf6mt\") pod \"e2e-test-jax-node-0-0-xxhfm\" (UID: \"80113137-6936-4f14-b06c-263bb1bb1a6e\") " pod="e2e-gs9q4/e2e-test-jax-node-0-0-xxhfm" Sep 18 12:16:41.713356 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:16:41.713289 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf6mt\" (UniqueName: \"kubernetes.io/projected/80113137-6936-4f14-b06c-263bb1bb1a6e-kube-api-access-wf6mt\") pod \"e2e-test-jax-node-0-0-xxhfm\" (UID: \"80113137-6936-4f14-b06c-263bb1bb1a6e\") " pod="e2e-gs9q4/e2e-test-jax-node-0-0-xxhfm" Sep 18 12:16:41.723115 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:16:41.723086 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf6mt\" (UniqueName: \"kubernetes.io/projected/80113137-6936-4f14-b06c-263bb1bb1a6e-kube-api-access-wf6mt\") pod \"e2e-test-jax-node-0-0-xxhfm\" (UID: \"80113137-6936-4f14-b06c-263bb1bb1a6e\") " pod="e2e-gs9q4/e2e-test-jax-node-0-0-xxhfm" Sep 18 12:16:41.854332 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:16:41.854296 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gs9q4/e2e-test-jax-node-0-0-xxhfm" Sep 18 12:16:42.124537 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:16:42.124470 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-gs9q4/e2e-test-jax-node-0-0-xxhfm"] Sep 18 12:16:42.127101 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:16:42.127073 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80113137_6936_4f14_b06c_263bb1bb1a6e.slice/crio-a485be6bee5db930b5e732d923d4c23617ecf590ac3815549949ad2791659df7 WatchSource:0}: Error finding container a485be6bee5db930b5e732d923d4c23617ecf590ac3815549949ad2791659df7: Status 404 returned error can't find the container with id a485be6bee5db930b5e732d923d4c23617ecf590ac3815549949ad2791659df7 Sep 18 12:16:42.129305 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:16:42.129289 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 12:16:42.283057 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:16:42.283022 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-gs9q4/e2e-test-jax-node-0-0-xxhfm" event={"ID":"80113137-6936-4f14-b06c-263bb1bb1a6e","Type":"ContainerStarted","Data":"a485be6bee5db930b5e732d923d4c23617ecf590ac3815549949ad2791659df7"} Sep 18 12:16:47.224624 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:16:47.224552 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:16:47.369575 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:16:47.369539 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:16:47.472424 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:16:47.471185 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:16:47.572596 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:16:47.572306 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:18:34.854430 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:34.854398 2578 generic.go:356] "Generic (PLEG): container finished" podID="80113137-6936-4f14-b06c-263bb1bb1a6e" containerID="e56780d86032e2668bf9310d86e2320aa5874c15180eeaf630d7562ada34847f" exitCode=0 Sep 18 12:18:34.854826 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:34.854476 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-gs9q4/e2e-test-jax-node-0-0-xxhfm" event={"ID":"80113137-6936-4f14-b06c-263bb1bb1a6e","Type":"ContainerDied","Data":"e56780d86032e2668bf9310d86e2320aa5874c15180eeaf630d7562ada34847f"} Sep 18 12:18:36.005245 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:36.005222 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gs9q4/e2e-test-jax-node-0-0-xxhfm" Sep 18 12:18:36.138698 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:36.138674 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wf6mt\" (UniqueName: \"kubernetes.io/projected/80113137-6936-4f14-b06c-263bb1bb1a6e-kube-api-access-wf6mt\") pod \"80113137-6936-4f14-b06c-263bb1bb1a6e\" (UID: \"80113137-6936-4f14-b06c-263bb1bb1a6e\") " Sep 18 12:18:36.141046 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:36.141021 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80113137-6936-4f14-b06c-263bb1bb1a6e-kube-api-access-wf6mt" (OuterVolumeSpecName: "kube-api-access-wf6mt") pod "80113137-6936-4f14-b06c-263bb1bb1a6e" (UID: "80113137-6936-4f14-b06c-263bb1bb1a6e"). InnerVolumeSpecName "kube-api-access-wf6mt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 12:18:36.239721 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:36.239692 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wf6mt\" (UniqueName: \"kubernetes.io/projected/80113137-6936-4f14-b06c-263bb1bb1a6e-kube-api-access-wf6mt\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:18:36.864089 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:36.864060 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gs9q4/e2e-test-jax-node-0-0-xxhfm" Sep 18 12:18:36.864089 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:36.864066 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-gs9q4/e2e-test-jax-node-0-0-xxhfm" event={"ID":"80113137-6936-4f14-b06c-263bb1bb1a6e","Type":"ContainerDied","Data":"a485be6bee5db930b5e732d923d4c23617ecf590ac3815549949ad2791659df7"} Sep 18 12:18:36.864089 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:36.864096 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a485be6bee5db930b5e732d923d4c23617ecf590ac3815549949ad2791659df7" Sep 18 12:18:37.223306 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:37.223271 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:18:37.307873 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:37.307840 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:18:37.321674 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:37.321646 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-7lz5m/e2e-test-xgboost-node-0-0-dbwlz"] Sep 18 12:18:37.321982 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:37.321971 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80113137-6936-4f14-b06c-263bb1bb1a6e" containerName="node" Sep 18 12:18:37.322027 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:37.321985 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="80113137-6936-4f14-b06c-263bb1bb1a6e" containerName="node" Sep 18 12:18:37.322067 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:37.322052 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="80113137-6936-4f14-b06c-263bb1bb1a6e" containerName="node" Sep 18 12:18:37.408169 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:37.408136 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:18:37.486801 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:37.486726 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-7lz5m/e2e-test-xgboost-node-0-0-dbwlz" Sep 18 12:18:37.489738 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:37.489715 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-7lz5m\"/\"openshift-service-ca.crt\"" Sep 18 12:18:37.489892 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:37.489716 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-7lz5m\"/\"default-dockercfg-fjdj7\"" Sep 18 12:18:37.489892 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:37.489772 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-7lz5m\"/\"kube-root-ca.crt\"" Sep 18 12:18:37.492691 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:37.492674 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-7lz5m/e2e-test-xgboost-node-0-0-dbwlz"] Sep 18 12:18:37.551540 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:37.551500 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmrm9\" (UniqueName: \"kubernetes.io/projected/d5b0db48-d2c8-452c-962a-b0de4beba3bb-kube-api-access-lmrm9\") pod \"e2e-test-xgboost-node-0-0-dbwlz\" (UID: \"d5b0db48-d2c8-452c-962a-b0de4beba3bb\") " pod="e2e-7lz5m/e2e-test-xgboost-node-0-0-dbwlz" Sep 18 12:18:37.652614 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:37.652576 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmrm9\" (UniqueName: \"kubernetes.io/projected/d5b0db48-d2c8-452c-962a-b0de4beba3bb-kube-api-access-lmrm9\") pod \"e2e-test-xgboost-node-0-0-dbwlz\" (UID: \"d5b0db48-d2c8-452c-962a-b0de4beba3bb\") " pod="e2e-7lz5m/e2e-test-xgboost-node-0-0-dbwlz" Sep 18 12:18:37.661512 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:37.661487 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmrm9\" (UniqueName: \"kubernetes.io/projected/d5b0db48-d2c8-452c-962a-b0de4beba3bb-kube-api-access-lmrm9\") pod \"e2e-test-xgboost-node-0-0-dbwlz\" (UID: \"d5b0db48-d2c8-452c-962a-b0de4beba3bb\") " pod="e2e-7lz5m/e2e-test-xgboost-node-0-0-dbwlz" Sep 18 12:18:37.801770 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:37.801670 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-7lz5m/e2e-test-xgboost-node-0-0-dbwlz" Sep 18 12:18:38.091694 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:38.091632 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-7lz5m/e2e-test-xgboost-node-0-0-dbwlz"] Sep 18 12:18:38.094256 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:18:38.094226 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd5b0db48_d2c8_452c_962a_b0de4beba3bb.slice/crio-50369c434ab5131a83e1e3a4e7820ca7b8981a494a0a9e8b3c60422c76de7528 WatchSource:0}: Error finding container 50369c434ab5131a83e1e3a4e7820ca7b8981a494a0a9e8b3c60422c76de7528: Status 404 returned error can't find the container with id 50369c434ab5131a83e1e3a4e7820ca7b8981a494a0a9e8b3c60422c76de7528 Sep 18 12:18:38.879054 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:38.878985 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-7lz5m/e2e-test-xgboost-node-0-0-dbwlz" event={"ID":"d5b0db48-d2c8-452c-962a-b0de4beba3bb","Type":"ContainerStarted","Data":"50369c434ab5131a83e1e3a4e7820ca7b8981a494a0a9e8b3c60422c76de7528"} Sep 18 12:18:42.165650 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:42.165606 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-gs9q4/e2e-test-jax-node-0-0-xxhfm"] Sep 18 12:18:42.168645 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:42.168586 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-gs9q4/e2e-test-jax-node-0-0-xxhfm"] Sep 18 12:18:42.356690 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:42.356644 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:18:42.843579 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:42.843538 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:18:42.906615 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:42.906573 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:18:43.467641 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:18:43.467600 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80113137-6936-4f14-b06c-263bb1bb1a6e" path="/var/lib/kubelet/pods/80113137-6936-4f14-b06c-263bb1bb1a6e/volumes" Sep 18 12:19:19.087366 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:19.087331 2578 generic.go:356] "Generic (PLEG): container finished" podID="d5b0db48-d2c8-452c-962a-b0de4beba3bb" containerID="fe74a05ed3b48d850d67f9301c300928fe86e488a529e1e33c6ec6090c79ae07" exitCode=0 Sep 18 12:19:19.087839 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:19.087423 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-7lz5m/e2e-test-xgboost-node-0-0-dbwlz" event={"ID":"d5b0db48-d2c8-452c-962a-b0de4beba3bb","Type":"ContainerDied","Data":"fe74a05ed3b48d850d67f9301c300928fe86e488a529e1e33c6ec6090c79ae07"} Sep 18 12:19:20.222109 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:20.222078 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-7lz5m/e2e-test-xgboost-node-0-0-dbwlz" Sep 18 12:19:20.329777 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:20.329753 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmrm9\" (UniqueName: \"kubernetes.io/projected/d5b0db48-d2c8-452c-962a-b0de4beba3bb-kube-api-access-lmrm9\") pod \"d5b0db48-d2c8-452c-962a-b0de4beba3bb\" (UID: \"d5b0db48-d2c8-452c-962a-b0de4beba3bb\") " Sep 18 12:19:20.331994 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:20.331965 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5b0db48-d2c8-452c-962a-b0de4beba3bb-kube-api-access-lmrm9" (OuterVolumeSpecName: "kube-api-access-lmrm9") pod "d5b0db48-d2c8-452c-962a-b0de4beba3bb" (UID: "d5b0db48-d2c8-452c-962a-b0de4beba3bb"). InnerVolumeSpecName "kube-api-access-lmrm9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 12:19:20.430993 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:20.430964 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmrm9\" (UniqueName: \"kubernetes.io/projected/d5b0db48-d2c8-452c-962a-b0de4beba3bb-kube-api-access-lmrm9\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:19:21.096558 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.096532 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-7lz5m/e2e-test-xgboost-node-0-0-dbwlz" Sep 18 12:19:21.096733 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.096528 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-7lz5m/e2e-test-xgboost-node-0-0-dbwlz" event={"ID":"d5b0db48-d2c8-452c-962a-b0de4beba3bb","Type":"ContainerDied","Data":"50369c434ab5131a83e1e3a4e7820ca7b8981a494a0a9e8b3c60422c76de7528"} Sep 18 12:19:21.096733 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.096650 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="50369c434ab5131a83e1e3a4e7820ca7b8981a494a0a9e8b3c60422c76de7528" Sep 18 12:19:21.354933 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.354843 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:19:21.420142 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.420096 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:19:21.448675 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.448641 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-wm9z4/e2e-test-flux-node-0-1-hpsln"] Sep 18 12:19:21.448964 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.448950 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5b0db48-d2c8-452c-962a-b0de4beba3bb" containerName="node" Sep 18 12:19:21.449050 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.448966 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5b0db48-d2c8-452c-962a-b0de4beba3bb" containerName="node" Sep 18 12:19:21.449050 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.449028 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5b0db48-d2c8-452c-962a-b0de4beba3bb" containerName="node" Sep 18 12:19:21.451164 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.451145 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-wm9z4/e2e-test-flux-node-0-1-hpsln" Sep 18 12:19:21.454100 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.454067 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-wm9z4\"/\"e2e-test-flux-flux-curve\"" Sep 18 12:19:21.454255 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.454117 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-wm9z4\"/\"openshift-service-ca.crt\"" Sep 18 12:19:21.454255 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.454144 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-wm9z4\"/\"default-dockercfg-rlnb8\"" Sep 18 12:19:21.454255 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.454162 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-wm9z4\"/\"e2e-test-flux-flux-entrypoint\"" Sep 18 12:19:21.454255 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.454164 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-wm9z4\"/\"kube-root-ca.crt\"" Sep 18 12:19:21.466035 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.466010 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-wm9z4/e2e-test-flux-node-0-1-hpsln"] Sep 18 12:19:21.488800 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.488763 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:19:21.538915 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.538874 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flux-install\" (UniqueName: \"kubernetes.io/empty-dir/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-flux-install\") pod \"e2e-test-flux-node-0-1-hpsln\" (UID: \"0cf268e9-f9ad-41f6-b3ad-64377fce9a81\") " pod="e2e-wm9z4/e2e-test-flux-node-0-1-hpsln" Sep 18 12:19:21.538915 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.538920 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spack-install\" (UniqueName: \"kubernetes.io/empty-dir/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-spack-install\") pod \"e2e-test-flux-node-0-1-hpsln\" (UID: \"0cf268e9-f9ad-41f6-b3ad-64377fce9a81\") " pod="e2e-wm9z4/e2e-test-flux-node-0-1-hpsln" Sep 18 12:19:21.539138 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.538986 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8mgd\" (UniqueName: \"kubernetes.io/projected/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-kube-api-access-v8mgd\") pod \"e2e-test-flux-node-0-1-hpsln\" (UID: \"0cf268e9-f9ad-41f6-b3ad-64377fce9a81\") " pod="e2e-wm9z4/e2e-test-flux-node-0-1-hpsln" Sep 18 12:19:21.539138 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.539060 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"e2e-test-flux-flux-entrypoint\" (UniqueName: \"kubernetes.io/configmap/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-e2e-test-flux-flux-entrypoint\") pod \"e2e-test-flux-node-0-1-hpsln\" (UID: \"0cf268e9-f9ad-41f6-b3ad-64377fce9a81\") " pod="e2e-wm9z4/e2e-test-flux-node-0-1-hpsln" Sep 18 12:19:21.539257 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.539227 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flux-curve\" (UniqueName: \"kubernetes.io/secret/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-flux-curve\") pod \"e2e-test-flux-node-0-1-hpsln\" (UID: \"0cf268e9-f9ad-41f6-b3ad-64377fce9a81\") " pod="e2e-wm9z4/e2e-test-flux-node-0-1-hpsln" Sep 18 12:19:21.539316 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.539288 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"shared-memory\" (UniqueName: \"kubernetes.io/empty-dir/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-shared-memory\") pod \"e2e-test-flux-node-0-1-hpsln\" (UID: \"0cf268e9-f9ad-41f6-b3ad-64377fce9a81\") " pod="e2e-wm9z4/e2e-test-flux-node-0-1-hpsln" Sep 18 12:19:21.639730 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.639700 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"flux-curve\" (UniqueName: \"kubernetes.io/secret/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-flux-curve\") pod \"e2e-test-flux-node-0-1-hpsln\" (UID: \"0cf268e9-f9ad-41f6-b3ad-64377fce9a81\") " pod="e2e-wm9z4/e2e-test-flux-node-0-1-hpsln" Sep 18 12:19:21.639901 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.639745 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"shared-memory\" (UniqueName: \"kubernetes.io/empty-dir/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-shared-memory\") pod \"e2e-test-flux-node-0-1-hpsln\" (UID: \"0cf268e9-f9ad-41f6-b3ad-64377fce9a81\") " pod="e2e-wm9z4/e2e-test-flux-node-0-1-hpsln" Sep 18 12:19:21.639901 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.639768 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"flux-install\" (UniqueName: \"kubernetes.io/empty-dir/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-flux-install\") pod \"e2e-test-flux-node-0-1-hpsln\" (UID: \"0cf268e9-f9ad-41f6-b3ad-64377fce9a81\") " pod="e2e-wm9z4/e2e-test-flux-node-0-1-hpsln" Sep 18 12:19:21.639901 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.639794 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"spack-install\" (UniqueName: \"kubernetes.io/empty-dir/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-spack-install\") pod \"e2e-test-flux-node-0-1-hpsln\" (UID: \"0cf268e9-f9ad-41f6-b3ad-64377fce9a81\") " pod="e2e-wm9z4/e2e-test-flux-node-0-1-hpsln" Sep 18 12:19:21.639901 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.639829 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8mgd\" (UniqueName: \"kubernetes.io/projected/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-kube-api-access-v8mgd\") pod \"e2e-test-flux-node-0-1-hpsln\" (UID: \"0cf268e9-f9ad-41f6-b3ad-64377fce9a81\") " pod="e2e-wm9z4/e2e-test-flux-node-0-1-hpsln" Sep 18 12:19:21.639901 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.639875 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"e2e-test-flux-flux-entrypoint\" (UniqueName: \"kubernetes.io/configmap/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-e2e-test-flux-flux-entrypoint\") pod \"e2e-test-flux-node-0-1-hpsln\" (UID: \"0cf268e9-f9ad-41f6-b3ad-64377fce9a81\") " pod="e2e-wm9z4/e2e-test-flux-node-0-1-hpsln" Sep 18 12:19:21.640307 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.640276 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"flux-install\" (UniqueName: \"kubernetes.io/empty-dir/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-flux-install\") pod \"e2e-test-flux-node-0-1-hpsln\" (UID: \"0cf268e9-f9ad-41f6-b3ad-64377fce9a81\") " pod="e2e-wm9z4/e2e-test-flux-node-0-1-hpsln" Sep 18 12:19:21.640470 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.640304 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"spack-install\" (UniqueName: \"kubernetes.io/empty-dir/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-spack-install\") pod \"e2e-test-flux-node-0-1-hpsln\" (UID: \"0cf268e9-f9ad-41f6-b3ad-64377fce9a81\") " pod="e2e-wm9z4/e2e-test-flux-node-0-1-hpsln" Sep 18 12:19:21.640727 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.640699 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"e2e-test-flux-flux-entrypoint\" (UniqueName: \"kubernetes.io/configmap/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-e2e-test-flux-flux-entrypoint\") pod \"e2e-test-flux-node-0-1-hpsln\" (UID: \"0cf268e9-f9ad-41f6-b3ad-64377fce9a81\") " pod="e2e-wm9z4/e2e-test-flux-node-0-1-hpsln" Sep 18 12:19:21.642232 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.642211 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"shared-memory\" (UniqueName: \"kubernetes.io/empty-dir/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-shared-memory\") pod \"e2e-test-flux-node-0-1-hpsln\" (UID: \"0cf268e9-f9ad-41f6-b3ad-64377fce9a81\") " pod="e2e-wm9z4/e2e-test-flux-node-0-1-hpsln" Sep 18 12:19:21.642316 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.642298 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"flux-curve\" (UniqueName: \"kubernetes.io/secret/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-flux-curve\") pod \"e2e-test-flux-node-0-1-hpsln\" (UID: \"0cf268e9-f9ad-41f6-b3ad-64377fce9a81\") " pod="e2e-wm9z4/e2e-test-flux-node-0-1-hpsln" Sep 18 12:19:21.648884 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.648861 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8mgd\" (UniqueName: \"kubernetes.io/projected/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-kube-api-access-v8mgd\") pod \"e2e-test-flux-node-0-1-hpsln\" (UID: \"0cf268e9-f9ad-41f6-b3ad-64377fce9a81\") " pod="e2e-wm9z4/e2e-test-flux-node-0-1-hpsln" Sep 18 12:19:21.760991 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:21.760951 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-wm9z4/e2e-test-flux-node-0-1-hpsln" Sep 18 12:19:22.033222 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:22.033197 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-wm9z4/e2e-test-flux-node-0-1-hpsln"] Sep 18 12:19:22.035169 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:19:22.035138 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0cf268e9_f9ad_41f6_b3ad_64377fce9a81.slice/crio-68e87ee40bfb50b753a1496ae0ae072db1a497947c476607f1fc2ac442aa51ef WatchSource:0}: Error finding container 68e87ee40bfb50b753a1496ae0ae072db1a497947c476607f1fc2ac442aa51ef: Status 404 returned error can't find the container with id 68e87ee40bfb50b753a1496ae0ae072db1a497947c476607f1fc2ac442aa51ef Sep 18 12:19:22.103151 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:22.103116 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-wm9z4/e2e-test-flux-node-0-1-hpsln" event={"ID":"0cf268e9-f9ad-41f6-b3ad-64377fce9a81","Type":"ContainerStarted","Data":"68e87ee40bfb50b753a1496ae0ae072db1a497947c476607f1fc2ac442aa51ef"} Sep 18 12:19:26.322003 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:26.321538 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-7lz5m/e2e-test-xgboost-node-0-0-dbwlz"] Sep 18 12:19:26.326920 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:26.326887 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-7lz5m/e2e-test-xgboost-node-0-0-dbwlz"] Sep 18 12:19:26.454126 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:26.454096 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:19:27.165956 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:27.165921 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:19:27.223065 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:27.222987 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:19:27.467762 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:27.467688 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5b0db48-d2c8-452c-962a-b0de4beba3bb" path="/var/lib/kubelet/pods/d5b0db48-d2c8-452c-962a-b0de4beba3bb/volumes" Sep 18 12:19:35.176377 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:35.176342 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-wm9z4/e2e-test-flux-node-0-1-hpsln" event={"ID":"0cf268e9-f9ad-41f6-b3ad-64377fce9a81","Type":"ContainerStarted","Data":"5e4cada05831ade945f7b3ad0bb6a87637d1060dd503ab342eae242421a36b25"} Sep 18 12:19:38.192152 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:38.192119 2578 generic.go:356] "Generic (PLEG): container finished" podID="0cf268e9-f9ad-41f6-b3ad-64377fce9a81" containerID="5e4cada05831ade945f7b3ad0bb6a87637d1060dd503ab342eae242421a36b25" exitCode=0 Sep 18 12:19:38.192561 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:38.192189 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-wm9z4/e2e-test-flux-node-0-1-hpsln" event={"ID":"0cf268e9-f9ad-41f6-b3ad-64377fce9a81","Type":"ContainerDied","Data":"5e4cada05831ade945f7b3ad0bb6a87637d1060dd503ab342eae242421a36b25"} Sep 18 12:19:40.204568 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:40.204475 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-wm9z4/e2e-test-flux-node-0-1-hpsln" event={"ID":"0cf268e9-f9ad-41f6-b3ad-64377fce9a81","Type":"ContainerStarted","Data":"83b40e771702336ae7e59afa4642bd153994e3654ee1fa2574d43ef2a706b7bd"} Sep 18 12:19:40.222901 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:40.222857 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-wm9z4/e2e-test-flux-node-0-1-hpsln" podStartSLOduration=2.508058963 podStartE2EDuration="19.222841449s" totalImagesPullingTime="13.498729882s" totalInitContainerRuntime="3.216052604s" isStatefulPod=false podCreationTimestamp="2026-09-18 12:19:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:19:40.221864091 +0000 UTC m=+1103.226551815" watchObservedRunningTime="2026-09-18 12:19:40.222841449 +0000 UTC m=+1103.227529171" Sep 18 12:19:44.225922 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:44.225889 2578 generic.go:356] "Generic (PLEG): container finished" podID="0cf268e9-f9ad-41f6-b3ad-64377fce9a81" containerID="83b40e771702336ae7e59afa4642bd153994e3654ee1fa2574d43ef2a706b7bd" exitCode=0 Sep 18 12:19:44.226326 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:44.225936 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-wm9z4/e2e-test-flux-node-0-1-hpsln" event={"ID":"0cf268e9-f9ad-41f6-b3ad-64377fce9a81","Type":"ContainerDied","Data":"83b40e771702336ae7e59afa4642bd153994e3654ee1fa2574d43ef2a706b7bd"} Sep 18 12:19:45.393560 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:45.393530 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-wm9z4/e2e-test-flux-node-0-1-hpsln" Sep 18 12:19:45.550707 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:45.550636 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"flux-install\" (UniqueName: \"kubernetes.io/empty-dir/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-flux-install\") pod \"0cf268e9-f9ad-41f6-b3ad-64377fce9a81\" (UID: \"0cf268e9-f9ad-41f6-b3ad-64377fce9a81\") " Sep 18 12:19:45.550707 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:45.550668 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"spack-install\" (UniqueName: \"kubernetes.io/empty-dir/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-spack-install\") pod \"0cf268e9-f9ad-41f6-b3ad-64377fce9a81\" (UID: \"0cf268e9-f9ad-41f6-b3ad-64377fce9a81\") " Sep 18 12:19:45.550908 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:45.550767 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"e2e-test-flux-flux-entrypoint\" (UniqueName: \"kubernetes.io/configmap/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-e2e-test-flux-flux-entrypoint\") pod \"0cf268e9-f9ad-41f6-b3ad-64377fce9a81\" (UID: \"0cf268e9-f9ad-41f6-b3ad-64377fce9a81\") " Sep 18 12:19:45.550908 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:45.550810 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"shared-memory\" (UniqueName: \"kubernetes.io/empty-dir/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-shared-memory\") pod \"0cf268e9-f9ad-41f6-b3ad-64377fce9a81\" (UID: \"0cf268e9-f9ad-41f6-b3ad-64377fce9a81\") " Sep 18 12:19:45.550908 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:45.550846 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"flux-curve\" (UniqueName: \"kubernetes.io/secret/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-flux-curve\") pod \"0cf268e9-f9ad-41f6-b3ad-64377fce9a81\" (UID: \"0cf268e9-f9ad-41f6-b3ad-64377fce9a81\") " Sep 18 12:19:45.550908 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:45.550888 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8mgd\" (UniqueName: \"kubernetes.io/projected/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-kube-api-access-v8mgd\") pod \"0cf268e9-f9ad-41f6-b3ad-64377fce9a81\" (UID: \"0cf268e9-f9ad-41f6-b3ad-64377fce9a81\") " Sep 18 12:19:45.551264 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:45.551225 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-e2e-test-flux-flux-entrypoint" (OuterVolumeSpecName: "e2e-test-flux-flux-entrypoint") pod "0cf268e9-f9ad-41f6-b3ad-64377fce9a81" (UID: "0cf268e9-f9ad-41f6-b3ad-64377fce9a81"). InnerVolumeSpecName "e2e-test-flux-flux-entrypoint". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 12:19:45.553490 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:45.553456 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-flux-curve" (OuterVolumeSpecName: "flux-curve") pod "0cf268e9-f9ad-41f6-b3ad-64377fce9a81" (UID: "0cf268e9-f9ad-41f6-b3ad-64377fce9a81"). InnerVolumeSpecName "flux-curve". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 12:19:45.553732 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:45.553699 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-shared-memory" (OuterVolumeSpecName: "shared-memory") pod "0cf268e9-f9ad-41f6-b3ad-64377fce9a81" (UID: "0cf268e9-f9ad-41f6-b3ad-64377fce9a81"). InnerVolumeSpecName "shared-memory". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 12:19:45.553732 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:45.553702 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-kube-api-access-v8mgd" (OuterVolumeSpecName: "kube-api-access-v8mgd") pod "0cf268e9-f9ad-41f6-b3ad-64377fce9a81" (UID: "0cf268e9-f9ad-41f6-b3ad-64377fce9a81"). InnerVolumeSpecName "kube-api-access-v8mgd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 12:19:45.652142 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:45.652110 2578 reconciler_common.go:299] "Volume detached for volume \"e2e-test-flux-flux-entrypoint\" (UniqueName: \"kubernetes.io/configmap/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-e2e-test-flux-flux-entrypoint\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:19:45.652142 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:45.652136 2578 reconciler_common.go:299] "Volume detached for volume \"shared-memory\" (UniqueName: \"kubernetes.io/empty-dir/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-shared-memory\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:19:45.652142 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:45.652146 2578 reconciler_common.go:299] "Volume detached for volume \"flux-curve\" (UniqueName: \"kubernetes.io/secret/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-flux-curve\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:19:45.652523 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:45.652154 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8mgd\" (UniqueName: \"kubernetes.io/projected/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-kube-api-access-v8mgd\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:19:45.854701 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:45.854617 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:19:45.954874 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:45.954835 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:19:46.054776 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:46.054745 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:19:46.237730 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:46.237683 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-wm9z4/e2e-test-flux-node-0-1-hpsln" event={"ID":"0cf268e9-f9ad-41f6-b3ad-64377fce9a81","Type":"ContainerDied","Data":"68e87ee40bfb50b753a1496ae0ae072db1a497947c476607f1fc2ac442aa51ef"} Sep 18 12:19:46.237730 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:46.237715 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-wm9z4/e2e-test-flux-node-0-1-hpsln" Sep 18 12:19:46.237730 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:46.237733 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="68e87ee40bfb50b753a1496ae0ae072db1a497947c476607f1fc2ac442aa51ef" Sep 18 12:19:46.961511 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:46.961472 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-spack-install" (OuterVolumeSpecName: "spack-install") pod "0cf268e9-f9ad-41f6-b3ad-64377fce9a81" (UID: "0cf268e9-f9ad-41f6-b3ad-64377fce9a81"). InnerVolumeSpecName "spack-install". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 12:19:46.962024 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:46.961940 2578 reconciler_common.go:299] "Volume detached for volume \"spack-install\" (UniqueName: \"kubernetes.io/empty-dir/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-spack-install\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:19:46.964429 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:46.964400 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:19:47.061284 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:47.061249 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:19:50.841567 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:50.841539 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-wm9z4/e2e-test-flux-node-0-1-hpsln"] Sep 18 12:19:50.844427 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:50.844401 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-wm9z4/e2e-test-flux-node-0-1-hpsln"] Sep 18 12:19:51.103203 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:51.103121 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-flux-install" (OuterVolumeSpecName: "flux-install") pod "0cf268e9-f9ad-41f6-b3ad-64377fce9a81" (UID: "0cf268e9-f9ad-41f6-b3ad-64377fce9a81"). InnerVolumeSpecName "flux-install". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 12:19:51.198030 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:51.198005 2578 reconciler_common.go:299] "Volume detached for volume \"flux-install\" (UniqueName: \"kubernetes.io/empty-dir/0cf268e9-f9ad-41f6-b3ad-64377fce9a81-flux-install\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:19:51.347778 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:19:51.347737 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"e2e-test-flux-node-0-1-hpsln\" is forbidden: User \"system:node:ip-10-0-136-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"e2e-wm9z4\": no relationship found between node 'ip-10-0-136-137.ec2.internal' and this object" podUID="0cf268e9-f9ad-41f6-b3ad-64377fce9a81" pod="e2e-wm9z4/e2e-test-flux-node-0-1-hpsln" Sep 18 12:19:51.425912 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:51.425884 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:19:51.465714 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:51.465687 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cf268e9-f9ad-41f6-b3ad-64377fce9a81" path="/var/lib/kubelet/pods/0cf268e9-f9ad-41f6-b3ad-64377fce9a81/volumes" Sep 18 12:19:51.885536 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:51.885506 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:19:51.986197 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:51.986140 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:19:52.087055 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:52.087014 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:19:52.318287 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:52.318205 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:19:52.738156 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:52.738115 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:19:52.789869 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:19:52.789836 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:20:02.015893 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:02.015852 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:20:03.233216 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:03.233156 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:20:07.689889 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:07.689846 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:20:07.752837 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:07.752786 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:20:11.072686 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:11.072654 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:20:11.231570 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:11.231508 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:20:11.323905 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:11.323819 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:20:11.424962 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:11.424929 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:20:11.884058 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:11.884027 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-fxltw/e2e-test-runtime-update-node-0-0-97qpv"] Sep 18 12:20:11.884351 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:11.884339 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cf268e9-f9ad-41f6-b3ad-64377fce9a81" containerName="flux-installer" Sep 18 12:20:11.884406 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:11.884354 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cf268e9-f9ad-41f6-b3ad-64377fce9a81" containerName="flux-installer" Sep 18 12:20:11.884406 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:11.884365 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cf268e9-f9ad-41f6-b3ad-64377fce9a81" containerName="node" Sep 18 12:20:11.884406 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:11.884371 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cf268e9-f9ad-41f6-b3ad-64377fce9a81" containerName="node" Sep 18 12:20:11.884527 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:11.884425 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cf268e9-f9ad-41f6-b3ad-64377fce9a81" containerName="node" Sep 18 12:20:11.910196 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:11.910171 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-fxltw/e2e-test-runtime-update-node-0-0-97qpv"] Sep 18 12:20:11.910338 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:11.910257 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-fxltw/e2e-test-runtime-update-node-0-0-97qpv" Sep 18 12:20:11.912802 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:11.912777 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-fxltw\"/\"kube-root-ca.crt\"" Sep 18 12:20:11.912924 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:11.912776 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-fxltw\"/\"openshift-service-ca.crt\"" Sep 18 12:20:11.913844 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:11.913829 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-fxltw\"/\"default-dockercfg-js25w\"" Sep 18 12:20:11.970074 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:11.970042 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk4f4\" (UniqueName: \"kubernetes.io/projected/a743503a-bc8c-49d0-a875-d3902eda804e-kube-api-access-lk4f4\") pod \"e2e-test-runtime-update-node-0-0-97qpv\" (UID: \"a743503a-bc8c-49d0-a875-d3902eda804e\") " pod="e2e-fxltw/e2e-test-runtime-update-node-0-0-97qpv" Sep 18 12:20:12.070699 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:12.070672 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk4f4\" (UniqueName: \"kubernetes.io/projected/a743503a-bc8c-49d0-a875-d3902eda804e-kube-api-access-lk4f4\") pod \"e2e-test-runtime-update-node-0-0-97qpv\" (UID: \"a743503a-bc8c-49d0-a875-d3902eda804e\") " pod="e2e-fxltw/e2e-test-runtime-update-node-0-0-97qpv" Sep 18 12:20:12.080341 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:12.080318 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk4f4\" (UniqueName: \"kubernetes.io/projected/a743503a-bc8c-49d0-a875-d3902eda804e-kube-api-access-lk4f4\") pod \"e2e-test-runtime-update-node-0-0-97qpv\" (UID: \"a743503a-bc8c-49d0-a875-d3902eda804e\") " pod="e2e-fxltw/e2e-test-runtime-update-node-0-0-97qpv" Sep 18 12:20:12.117066 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:12.117037 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-fxltw/e2e-test-runtime-update-node-0-0-97qpv"] Sep 18 12:20:12.117267 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:12.117256 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-fxltw/e2e-test-runtime-update-node-0-0-97qpv" Sep 18 12:20:12.151181 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:12.151092 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:20:12.389065 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:12.389036 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-fxltw/e2e-test-runtime-update-node-0-0-97qpv"] Sep 18 12:20:12.392489 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:20:12.392460 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda743503a_bc8c_49d0_a875_d3902eda804e.slice/crio-8db9b9ed6f159023ab4f5d61c2c0ec5afb087a71220f6b2329bff9b17c04e464 WatchSource:0}: Error finding container 8db9b9ed6f159023ab4f5d61c2c0ec5afb087a71220f6b2329bff9b17c04e464: Status 404 returned error can't find the container with id 8db9b9ed6f159023ab4f5d61c2c0ec5afb087a71220f6b2329bff9b17c04e464 Sep 18 12:20:12.409938 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:12.409871 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:20:12.475150 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:12.475099 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:20:12.478772 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:12.478748 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-89c9z/e2e-test-runtime-update-node-0-0-scdf6"] Sep 18 12:20:12.481496 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:12.481481 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-89c9z/e2e-test-runtime-update-node-0-0-scdf6" Sep 18 12:20:12.483961 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:12.483943 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-89c9z\"/\"default-dockercfg-dj22l\"" Sep 18 12:20:12.484037 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:12.483971 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-89c9z\"/\"kube-root-ca.crt\"" Sep 18 12:20:12.484037 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:12.483943 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-89c9z\"/\"openshift-service-ca.crt\"" Sep 18 12:20:12.491528 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:12.491490 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-89c9z/e2e-test-runtime-update-node-0-0-scdf6"] Sep 18 12:20:12.540301 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:12.540270 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:20:12.575189 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:12.575160 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpkdr\" (UniqueName: \"kubernetes.io/projected/fa6eabde-83c5-4c6b-a27c-90d8cd73cd15-kube-api-access-bpkdr\") pod \"e2e-test-runtime-update-node-0-0-scdf6\" (UID: \"fa6eabde-83c5-4c6b-a27c-90d8cd73cd15\") " pod="e2e-89c9z/e2e-test-runtime-update-node-0-0-scdf6" Sep 18 12:20:12.676260 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:12.676175 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpkdr\" (UniqueName: \"kubernetes.io/projected/fa6eabde-83c5-4c6b-a27c-90d8cd73cd15-kube-api-access-bpkdr\") pod \"e2e-test-runtime-update-node-0-0-scdf6\" (UID: \"fa6eabde-83c5-4c6b-a27c-90d8cd73cd15\") " pod="e2e-89c9z/e2e-test-runtime-update-node-0-0-scdf6" Sep 18 12:20:12.686822 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:12.686784 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpkdr\" (UniqueName: \"kubernetes.io/projected/fa6eabde-83c5-4c6b-a27c-90d8cd73cd15-kube-api-access-bpkdr\") pod \"e2e-test-runtime-update-node-0-0-scdf6\" (UID: \"fa6eabde-83c5-4c6b-a27c-90d8cd73cd15\") " pod="e2e-89c9z/e2e-test-runtime-update-node-0-0-scdf6" Sep 18 12:20:12.728984 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:12.728963 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-89c9z/e2e-test-runtime-update-node-0-0-scdf6"] Sep 18 12:20:12.729183 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:12.729172 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-89c9z/e2e-test-runtime-update-node-0-0-scdf6" Sep 18 12:20:13.003238 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.003215 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-89c9z/e2e-test-runtime-update-node-0-0-scdf6"] Sep 18 12:20:13.005648 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:20:13.005620 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa6eabde_83c5_4c6b_a27c_90d8cd73cd15.slice/crio-133d64a760d1293662841a29f9250fc0164ee5a164338c4b768eadccdfdde85a WatchSource:0}: Error finding container 133d64a760d1293662841a29f9250fc0164ee5a164338c4b768eadccdfdde85a: Status 404 returned error can't find the container with id 133d64a760d1293662841a29f9250fc0164ee5a164338c4b768eadccdfdde85a Sep 18 12:20:13.298738 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.298643 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:20:13.363957 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.363917 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-fxltw/e2e-test-runtime-update-node-0-0-97qpv" event={"ID":"a743503a-bc8c-49d0-a875-d3902eda804e","Type":"ContainerStarted","Data":"3bd8169677f356bbb462890f85032122337a9524018bc129d51a22cef4b6aafc"} Sep 18 12:20:13.364145 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.363966 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-fxltw/e2e-test-runtime-update-node-0-0-97qpv" event={"ID":"a743503a-bc8c-49d0-a875-d3902eda804e","Type":"ContainerStarted","Data":"8db9b9ed6f159023ab4f5d61c2c0ec5afb087a71220f6b2329bff9b17c04e464"} Sep 18 12:20:13.364145 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.363922 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-fxltw/e2e-test-runtime-update-node-0-0-97qpv" podUID="a743503a-bc8c-49d0-a875-d3902eda804e" containerName="node" containerID="cri-o://3bd8169677f356bbb462890f85032122337a9524018bc129d51a22cef4b6aafc" gracePeriod=30 Sep 18 12:20:13.365732 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.365705 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-89c9z/e2e-test-runtime-update-node-0-0-scdf6" event={"ID":"fa6eabde-83c5-4c6b-a27c-90d8cd73cd15","Type":"ContainerStarted","Data":"3bd16bacb29666558e318e71d563c9107c529e272b7782f9f3d45d0600988f50"} Sep 18 12:20:13.365836 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.365746 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-89c9z/e2e-test-runtime-update-node-0-0-scdf6" event={"ID":"fa6eabde-83c5-4c6b-a27c-90d8cd73cd15","Type":"ContainerStarted","Data":"133d64a760d1293662841a29f9250fc0164ee5a164338c4b768eadccdfdde85a"} Sep 18 12:20:13.365836 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.365805 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-89c9z/e2e-test-runtime-update-node-0-0-scdf6" podUID="fa6eabde-83c5-4c6b-a27c-90d8cd73cd15" containerName="node" containerID="cri-o://3bd16bacb29666558e318e71d563c9107c529e272b7782f9f3d45d0600988f50" gracePeriod=30 Sep 18 12:20:13.380294 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.380251 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-fxltw/e2e-test-runtime-update-node-0-0-97qpv" podStartSLOduration=2.058184912 podStartE2EDuration="2.380237163s" totalImagesPullingTime="322.052251ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 12:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:20:13.378885331 +0000 UTC m=+1136.383573054" watchObservedRunningTime="2026-09-18 12:20:13.380237163 +0000 UTC m=+1136.384924886" Sep 18 12:20:13.393544 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.393505 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-89c9z/e2e-test-runtime-update-node-0-0-scdf6" podStartSLOduration=1.393491043 podStartE2EDuration="1.393491043s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 12:20:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:20:13.392063695 +0000 UTC m=+1136.396751419" watchObservedRunningTime="2026-09-18 12:20:13.393491043 +0000 UTC m=+1136.398178765" Sep 18 12:20:13.548903 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.548838 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:20:13.616156 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.616128 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-fxltw/e2e-test-runtime-update-node-0-0-97qpv" Sep 18 12:20:13.628449 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.628409 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-89c9z/e2e-test-runtime-update-node-0-0-scdf6" Sep 18 12:20:13.636486 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.636453 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:20:13.684344 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.684312 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpkdr\" (UniqueName: \"kubernetes.io/projected/fa6eabde-83c5-4c6b-a27c-90d8cd73cd15-kube-api-access-bpkdr\") pod \"fa6eabde-83c5-4c6b-a27c-90d8cd73cd15\" (UID: \"fa6eabde-83c5-4c6b-a27c-90d8cd73cd15\") " Sep 18 12:20:13.684344 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.684343 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lk4f4\" (UniqueName: \"kubernetes.io/projected/a743503a-bc8c-49d0-a875-d3902eda804e-kube-api-access-lk4f4\") pod \"a743503a-bc8c-49d0-a875-d3902eda804e\" (UID: \"a743503a-bc8c-49d0-a875-d3902eda804e\") " Sep 18 12:20:13.686734 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.686706 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa6eabde-83c5-4c6b-a27c-90d8cd73cd15-kube-api-access-bpkdr" (OuterVolumeSpecName: "kube-api-access-bpkdr") pod "fa6eabde-83c5-4c6b-a27c-90d8cd73cd15" (UID: "fa6eabde-83c5-4c6b-a27c-90d8cd73cd15"). InnerVolumeSpecName "kube-api-access-bpkdr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 12:20:13.686835 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.686753 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a743503a-bc8c-49d0-a875-d3902eda804e-kube-api-access-lk4f4" (OuterVolumeSpecName: "kube-api-access-lk4f4") pod "a743503a-bc8c-49d0-a875-d3902eda804e" (UID: "a743503a-bc8c-49d0-a875-d3902eda804e"). InnerVolumeSpecName "kube-api-access-lk4f4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 12:20:13.696053 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.696026 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:20:13.699803 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.699781 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-fp8dg/progression-enabled-node-0-0-8w6wp"] Sep 18 12:20:13.700081 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.700070 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a743503a-bc8c-49d0-a875-d3902eda804e" containerName="node" Sep 18 12:20:13.700120 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.700083 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a743503a-bc8c-49d0-a875-d3902eda804e" containerName="node" Sep 18 12:20:13.700120 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.700090 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa6eabde-83c5-4c6b-a27c-90d8cd73cd15" containerName="node" Sep 18 12:20:13.700120 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.700096 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa6eabde-83c5-4c6b-a27c-90d8cd73cd15" containerName="node" Sep 18 12:20:13.700210 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.700157 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa6eabde-83c5-4c6b-a27c-90d8cd73cd15" containerName="node" Sep 18 12:20:13.700210 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.700166 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a743503a-bc8c-49d0-a875-d3902eda804e" containerName="node" Sep 18 12:20:13.701855 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.701838 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-fp8dg/progression-enabled-node-0-0-8w6wp" Sep 18 12:20:13.704190 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.704175 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-fp8dg\"/\"default-dockercfg-xw294\"" Sep 18 12:20:13.704422 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.704410 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-fp8dg\"/\"kube-root-ca.crt\"" Sep 18 12:20:13.704532 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.704419 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-fp8dg\"/\"openshift-service-ca.crt\"" Sep 18 12:20:13.712047 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.712028 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-fp8dg/progression-enabled-node-0-0-8w6wp"] Sep 18 12:20:13.758503 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.758466 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:20:13.785553 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.785532 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57jwf\" (UniqueName: \"kubernetes.io/projected/5452767c-da52-4c3e-9db6-c9c9b5da791e-kube-api-access-57jwf\") pod \"progression-enabled-node-0-0-8w6wp\" (UID: \"5452767c-da52-4c3e-9db6-c9c9b5da791e\") " pod="rhai-e2e-progression-fp8dg/progression-enabled-node-0-0-8w6wp" Sep 18 12:20:13.785670 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.785573 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpkdr\" (UniqueName: \"kubernetes.io/projected/fa6eabde-83c5-4c6b-a27c-90d8cd73cd15-kube-api-access-bpkdr\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:20:13.785670 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.785584 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lk4f4\" (UniqueName: \"kubernetes.io/projected/a743503a-bc8c-49d0-a875-d3902eda804e-kube-api-access-lk4f4\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:20:13.886702 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.886674 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57jwf\" (UniqueName: \"kubernetes.io/projected/5452767c-da52-4c3e-9db6-c9c9b5da791e-kube-api-access-57jwf\") pod \"progression-enabled-node-0-0-8w6wp\" (UID: \"5452767c-da52-4c3e-9db6-c9c9b5da791e\") " pod="rhai-e2e-progression-fp8dg/progression-enabled-node-0-0-8w6wp" Sep 18 12:20:13.897054 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:13.897029 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57jwf\" (UniqueName: \"kubernetes.io/projected/5452767c-da52-4c3e-9db6-c9c9b5da791e-kube-api-access-57jwf\") pod \"progression-enabled-node-0-0-8w6wp\" (UID: \"5452767c-da52-4c3e-9db6-c9c9b5da791e\") " pod="rhai-e2e-progression-fp8dg/progression-enabled-node-0-0-8w6wp" Sep 18 12:20:14.012120 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:14.012069 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-fp8dg/progression-enabled-node-0-0-8w6wp" Sep 18 12:20:14.285953 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:14.285928 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-fp8dg/progression-enabled-node-0-0-8w6wp"] Sep 18 12:20:14.288405 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:20:14.288378 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5452767c_da52_4c3e_9db6_c9c9b5da791e.slice/crio-236a284cf1513ece944515ef83b5cec06c2052acdb04190c6ab4c8aef344a252 WatchSource:0}: Error finding container 236a284cf1513ece944515ef83b5cec06c2052acdb04190c6ab4c8aef344a252: Status 404 returned error can't find the container with id 236a284cf1513ece944515ef83b5cec06c2052acdb04190c6ab4c8aef344a252 Sep 18 12:20:14.371743 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:14.371708 2578 generic.go:356] "Generic (PLEG): container finished" podID="a743503a-bc8c-49d0-a875-d3902eda804e" containerID="3bd8169677f356bbb462890f85032122337a9524018bc129d51a22cef4b6aafc" exitCode=0 Sep 18 12:20:14.372190 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:14.371748 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-fxltw/e2e-test-runtime-update-node-0-0-97qpv" Sep 18 12:20:14.372190 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:14.371777 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-fxltw/e2e-test-runtime-update-node-0-0-97qpv" event={"ID":"a743503a-bc8c-49d0-a875-d3902eda804e","Type":"ContainerDied","Data":"3bd8169677f356bbb462890f85032122337a9524018bc129d51a22cef4b6aafc"} Sep 18 12:20:14.372190 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:14.371816 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-fxltw/e2e-test-runtime-update-node-0-0-97qpv" event={"ID":"a743503a-bc8c-49d0-a875-d3902eda804e","Type":"ContainerDied","Data":"8db9b9ed6f159023ab4f5d61c2c0ec5afb087a71220f6b2329bff9b17c04e464"} Sep 18 12:20:14.372190 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:14.371840 2578 scope.go:117] "RemoveContainer" containerID="3bd8169677f356bbb462890f85032122337a9524018bc129d51a22cef4b6aafc" Sep 18 12:20:14.373385 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:14.373364 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-fp8dg/progression-enabled-node-0-0-8w6wp" event={"ID":"5452767c-da52-4c3e-9db6-c9c9b5da791e","Type":"ContainerStarted","Data":"236a284cf1513ece944515ef83b5cec06c2052acdb04190c6ab4c8aef344a252"} Sep 18 12:20:14.374896 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:14.374872 2578 generic.go:356] "Generic (PLEG): container finished" podID="fa6eabde-83c5-4c6b-a27c-90d8cd73cd15" containerID="3bd16bacb29666558e318e71d563c9107c529e272b7782f9f3d45d0600988f50" exitCode=0 Sep 18 12:20:14.375019 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:14.374914 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-89c9z/e2e-test-runtime-update-node-0-0-scdf6" Sep 18 12:20:14.375019 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:14.374922 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-89c9z/e2e-test-runtime-update-node-0-0-scdf6" event={"ID":"fa6eabde-83c5-4c6b-a27c-90d8cd73cd15","Type":"ContainerDied","Data":"3bd16bacb29666558e318e71d563c9107c529e272b7782f9f3d45d0600988f50"} Sep 18 12:20:14.375019 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:14.374949 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-89c9z/e2e-test-runtime-update-node-0-0-scdf6" event={"ID":"fa6eabde-83c5-4c6b-a27c-90d8cd73cd15","Type":"ContainerDied","Data":"133d64a760d1293662841a29f9250fc0164ee5a164338c4b768eadccdfdde85a"} Sep 18 12:20:14.381759 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:14.381603 2578 scope.go:117] "RemoveContainer" containerID="3bd8169677f356bbb462890f85032122337a9524018bc129d51a22cef4b6aafc" Sep 18 12:20:14.381960 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:20:14.381932 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bd8169677f356bbb462890f85032122337a9524018bc129d51a22cef4b6aafc\": container with ID starting with 3bd8169677f356bbb462890f85032122337a9524018bc129d51a22cef4b6aafc not found: ID does not exist" containerID="3bd8169677f356bbb462890f85032122337a9524018bc129d51a22cef4b6aafc" Sep 18 12:20:14.382057 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:14.381971 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd8169677f356bbb462890f85032122337a9524018bc129d51a22cef4b6aafc"} err="failed to get container status \"3bd8169677f356bbb462890f85032122337a9524018bc129d51a22cef4b6aafc\": rpc error: code = NotFound desc = could not find container \"3bd8169677f356bbb462890f85032122337a9524018bc129d51a22cef4b6aafc\": container with ID starting with 3bd8169677f356bbb462890f85032122337a9524018bc129d51a22cef4b6aafc not found: ID does not exist" Sep 18 12:20:14.382057 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:14.381995 2578 scope.go:117] "RemoveContainer" containerID="3bd16bacb29666558e318e71d563c9107c529e272b7782f9f3d45d0600988f50" Sep 18 12:20:14.390222 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:14.390207 2578 scope.go:117] "RemoveContainer" containerID="3bd16bacb29666558e318e71d563c9107c529e272b7782f9f3d45d0600988f50" Sep 18 12:20:14.390509 ip-10-0-136-137 kubenswrapper[2578]: E0918 12:20:14.390492 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bd16bacb29666558e318e71d563c9107c529e272b7782f9f3d45d0600988f50\": container with ID starting with 3bd16bacb29666558e318e71d563c9107c529e272b7782f9f3d45d0600988f50 not found: ID does not exist" containerID="3bd16bacb29666558e318e71d563c9107c529e272b7782f9f3d45d0600988f50" Sep 18 12:20:14.390570 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:14.390514 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd16bacb29666558e318e71d563c9107c529e272b7782f9f3d45d0600988f50"} err="failed to get container status \"3bd16bacb29666558e318e71d563c9107c529e272b7782f9f3d45d0600988f50\": rpc error: code = NotFound desc = could not find container \"3bd16bacb29666558e318e71d563c9107c529e272b7782f9f3d45d0600988f50\": container with ID starting with 3bd16bacb29666558e318e71d563c9107c529e272b7782f9f3d45d0600988f50 not found: ID does not exist" Sep 18 12:20:14.395184 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:14.395164 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-fxltw/e2e-test-runtime-update-node-0-0-97qpv"] Sep 18 12:20:14.398210 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:14.398189 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-fxltw/e2e-test-runtime-update-node-0-0-97qpv"] Sep 18 12:20:14.409011 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:14.408987 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-89c9z/e2e-test-runtime-update-node-0-0-scdf6"] Sep 18 12:20:14.414083 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:14.414061 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-89c9z/e2e-test-runtime-update-node-0-0-scdf6"] Sep 18 12:20:15.479403 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:15.478629 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a743503a-bc8c-49d0-a875-d3902eda804e" path="/var/lib/kubelet/pods/a743503a-bc8c-49d0-a875-d3902eda804e/volumes" Sep 18 12:20:15.479403 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:15.479065 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa6eabde-83c5-4c6b-a27c-90d8cd73cd15" path="/var/lib/kubelet/pods/fa6eabde-83c5-4c6b-a27c-90d8cd73cd15/volumes" Sep 18 12:20:16.299100 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:16.299043 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:20:16.940429 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:16.940233 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:20:16.997605 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:16.997554 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:20:18.020196 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:18.020146 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:20:18.075346 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:18.075314 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:20:19.589339 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:19.589301 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:20:19.689162 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:19.689126 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:20:34.304857 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:34.304818 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:20:53.799707 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:20:53.799669 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:21:17.479898 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:21:17.479870 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-fc7vn_a6629efd-ffee-4ff0-bb6c-530f4ac96793/console-operator/1.log" Sep 18 12:21:17.480432 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:21:17.479871 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-fc7vn_a6629efd-ffee-4ff0-bb6c-530f4ac96793/console-operator/1.log" Sep 18 12:21:18.758507 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:21:18.758466 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-fp8dg/progression-enabled-node-0-0-8w6wp" event={"ID":"5452767c-da52-4c3e-9db6-c9c9b5da791e","Type":"ContainerStarted","Data":"0854a4054d74da31f877e2eb94e5a2f33e3ee972d55aa1c9cc7c7cf0a1e80ef7"} Sep 18 12:21:18.775358 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:21:18.775307 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-fp8dg/progression-enabled-node-0-0-8w6wp" podStartSLOduration=2.144099236 podStartE2EDuration="1m5.775291606s" totalImagesPullingTime="1m3.63119237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 12:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:21:18.773882321 +0000 UTC m=+1201.778570058" watchObservedRunningTime="2026-09-18 12:21:18.775291606 +0000 UTC m=+1201.779979328" Sep 18 12:21:39.851342 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:21:39.851305 2578 generic.go:356] "Generic (PLEG): container finished" podID="5452767c-da52-4c3e-9db6-c9c9b5da791e" containerID="0854a4054d74da31f877e2eb94e5a2f33e3ee972d55aa1c9cc7c7cf0a1e80ef7" exitCode=0 Sep 18 12:21:39.851781 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:21:39.851354 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-fp8dg/progression-enabled-node-0-0-8w6wp" event={"ID":"5452767c-da52-4c3e-9db6-c9c9b5da791e","Type":"ContainerDied","Data":"0854a4054d74da31f877e2eb94e5a2f33e3ee972d55aa1c9cc7c7cf0a1e80ef7"} Sep 18 12:21:41.031562 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:21:41.031536 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-fp8dg/progression-enabled-node-0-0-8w6wp" Sep 18 12:21:41.075799 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:21:41.075769 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57jwf\" (UniqueName: \"kubernetes.io/projected/5452767c-da52-4c3e-9db6-c9c9b5da791e-kube-api-access-57jwf\") pod \"5452767c-da52-4c3e-9db6-c9c9b5da791e\" (UID: \"5452767c-da52-4c3e-9db6-c9c9b5da791e\") " Sep 18 12:21:41.078068 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:21:41.078035 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5452767c-da52-4c3e-9db6-c9c9b5da791e-kube-api-access-57jwf" (OuterVolumeSpecName: "kube-api-access-57jwf") pod "5452767c-da52-4c3e-9db6-c9c9b5da791e" (UID: "5452767c-da52-4c3e-9db6-c9c9b5da791e"). InnerVolumeSpecName "kube-api-access-57jwf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 12:21:41.176639 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:21:41.176609 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57jwf\" (UniqueName: \"kubernetes.io/projected/5452767c-da52-4c3e-9db6-c9c9b5da791e-kube-api-access-57jwf\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:21:41.862219 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:21:41.862145 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-fp8dg/progression-enabled-node-0-0-8w6wp" Sep 18 12:21:41.862219 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:21:41.862142 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-fp8dg/progression-enabled-node-0-0-8w6wp" event={"ID":"5452767c-da52-4c3e-9db6-c9c9b5da791e","Type":"ContainerDied","Data":"236a284cf1513ece944515ef83b5cec06c2052acdb04190c6ab4c8aef344a252"} Sep 18 12:21:41.862219 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:21:41.862195 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="236a284cf1513ece944515ef83b5cec06c2052acdb04190c6ab4c8aef344a252" Sep 18 12:21:44.139990 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:21:44.139957 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:21:44.168789 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:21:44.168759 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-fp8dg/progression-disabled-node-0-0-jvwvn"] Sep 18 12:21:44.169052 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:21:44.169041 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5452767c-da52-4c3e-9db6-c9c9b5da791e" containerName="node" Sep 18 12:21:44.169095 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:21:44.169054 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5452767c-da52-4c3e-9db6-c9c9b5da791e" containerName="node" Sep 18 12:21:44.169133 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:21:44.169119 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5452767c-da52-4c3e-9db6-c9c9b5da791e" containerName="node" Sep 18 12:21:44.183421 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:21:44.183391 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-fp8dg/progression-disabled-node-0-0-jvwvn" Sep 18 12:21:44.183594 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:21:44.183459 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-fp8dg/progression-disabled-node-0-0-jvwvn"] Sep 18 12:21:44.186051 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:21:44.186026 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-fp8dg\"/\"openshift-service-ca.crt\"" Sep 18 12:21:44.186388 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:21:44.186352 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-fp8dg\"/\"kube-root-ca.crt\"" Sep 18 12:21:44.186388 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:21:44.186375 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-fp8dg\"/\"default-dockercfg-xw294\"" Sep 18 12:21:44.197451 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:21:44.197411 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkmtl\" (UniqueName: \"kubernetes.io/projected/3375fcda-bc44-4e91-81da-82a5644f3298-kube-api-access-dkmtl\") pod \"progression-disabled-node-0-0-jvwvn\" (UID: \"3375fcda-bc44-4e91-81da-82a5644f3298\") " pod="rhai-e2e-progression-fp8dg/progression-disabled-node-0-0-jvwvn" Sep 18 12:21:44.298625 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:21:44.298593 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkmtl\" (UniqueName: \"kubernetes.io/projected/3375fcda-bc44-4e91-81da-82a5644f3298-kube-api-access-dkmtl\") pod \"progression-disabled-node-0-0-jvwvn\" (UID: \"3375fcda-bc44-4e91-81da-82a5644f3298\") " pod="rhai-e2e-progression-fp8dg/progression-disabled-node-0-0-jvwvn" Sep 18 12:21:44.307352 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:21:44.307330 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkmtl\" (UniqueName: \"kubernetes.io/projected/3375fcda-bc44-4e91-81da-82a5644f3298-kube-api-access-dkmtl\") pod \"progression-disabled-node-0-0-jvwvn\" (UID: \"3375fcda-bc44-4e91-81da-82a5644f3298\") " pod="rhai-e2e-progression-fp8dg/progression-disabled-node-0-0-jvwvn" Sep 18 12:21:44.493665 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:21:44.493575 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-fp8dg/progression-disabled-node-0-0-jvwvn" Sep 18 12:21:44.833290 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:21:44.833265 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-fp8dg/progression-disabled-node-0-0-jvwvn"] Sep 18 12:21:44.835515 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:21:44.835486 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3375fcda_bc44_4e91_81da_82a5644f3298.slice/crio-8006404f20417dd1cfaa152606a1ffb38559a18cbb60fd0f5b520c798d451a2f WatchSource:0}: Error finding container 8006404f20417dd1cfaa152606a1ffb38559a18cbb60fd0f5b520c798d451a2f: Status 404 returned error can't find the container with id 8006404f20417dd1cfaa152606a1ffb38559a18cbb60fd0f5b520c798d451a2f Sep 18 12:21:44.878836 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:21:44.878810 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-fp8dg/progression-disabled-node-0-0-jvwvn" event={"ID":"3375fcda-bc44-4e91-81da-82a5644f3298","Type":"ContainerStarted","Data":"8006404f20417dd1cfaa152606a1ffb38559a18cbb60fd0f5b520c798d451a2f"} Sep 18 12:21:45.884647 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:21:45.884609 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-fp8dg/progression-disabled-node-0-0-jvwvn" event={"ID":"3375fcda-bc44-4e91-81da-82a5644f3298","Type":"ContainerStarted","Data":"d1b45d9e2112eb94118c4a752cc6001db2da9ab161e06e2a153c807e8fbeebb5"} Sep 18 12:21:45.903137 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:21:45.903086 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-fp8dg/progression-disabled-node-0-0-jvwvn" podStartSLOduration=1.903070372 podStartE2EDuration="1.903070372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 12:21:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:21:45.901729374 +0000 UTC m=+1228.906417096" watchObservedRunningTime="2026-09-18 12:21:45.903070372 +0000 UTC m=+1228.907758094" Sep 18 12:22:06.983419 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:06.983383 2578 generic.go:356] "Generic (PLEG): container finished" podID="3375fcda-bc44-4e91-81da-82a5644f3298" containerID="d1b45d9e2112eb94118c4a752cc6001db2da9ab161e06e2a153c807e8fbeebb5" exitCode=0 Sep 18 12:22:06.983846 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:06.983480 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-fp8dg/progression-disabled-node-0-0-jvwvn" event={"ID":"3375fcda-bc44-4e91-81da-82a5644f3298","Type":"ContainerDied","Data":"d1b45d9e2112eb94118c4a752cc6001db2da9ab161e06e2a153c807e8fbeebb5"} Sep 18 12:22:08.116844 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:08.116820 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-fp8dg/progression-disabled-node-0-0-jvwvn" Sep 18 12:22:08.200056 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:08.200020 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkmtl\" (UniqueName: \"kubernetes.io/projected/3375fcda-bc44-4e91-81da-82a5644f3298-kube-api-access-dkmtl\") pod \"3375fcda-bc44-4e91-81da-82a5644f3298\" (UID: \"3375fcda-bc44-4e91-81da-82a5644f3298\") " Sep 18 12:22:08.202363 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:08.202343 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3375fcda-bc44-4e91-81da-82a5644f3298-kube-api-access-dkmtl" (OuterVolumeSpecName: "kube-api-access-dkmtl") pod "3375fcda-bc44-4e91-81da-82a5644f3298" (UID: "3375fcda-bc44-4e91-81da-82a5644f3298"). InnerVolumeSpecName "kube-api-access-dkmtl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 12:22:08.301300 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:08.301208 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkmtl\" (UniqueName: \"kubernetes.io/projected/3375fcda-bc44-4e91-81da-82a5644f3298-kube-api-access-dkmtl\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:22:08.994673 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:08.994639 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-fp8dg/progression-disabled-node-0-0-jvwvn" event={"ID":"3375fcda-bc44-4e91-81da-82a5644f3298","Type":"ContainerDied","Data":"8006404f20417dd1cfaa152606a1ffb38559a18cbb60fd0f5b520c798d451a2f"} Sep 18 12:22:08.994673 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:08.994676 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-fp8dg/progression-disabled-node-0-0-jvwvn" Sep 18 12:22:08.994921 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:08.994680 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8006404f20417dd1cfaa152606a1ffb38559a18cbb60fd0f5b520c798d451a2f" Sep 18 12:22:19.174302 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:19.174260 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:22:19.177567 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:19.177540 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-fp8dg/progression-invalid-node-0-0-pv7gb"] Sep 18 12:22:19.177899 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:19.177883 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3375fcda-bc44-4e91-81da-82a5644f3298" containerName="node" Sep 18 12:22:19.177978 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:19.177902 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3375fcda-bc44-4e91-81da-82a5644f3298" containerName="node" Sep 18 12:22:19.178043 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:19.177996 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3375fcda-bc44-4e91-81da-82a5644f3298" containerName="node" Sep 18 12:22:19.179939 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:19.179920 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-fp8dg/progression-invalid-node-0-0-pv7gb" Sep 18 12:22:19.182415 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:19.182395 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-fp8dg\"/\"openshift-service-ca.crt\"" Sep 18 12:22:19.182550 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:19.182533 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-fp8dg\"/\"kube-root-ca.crt\"" Sep 18 12:22:19.182650 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:19.182637 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-fp8dg\"/\"default-dockercfg-xw294\"" Sep 18 12:22:19.193619 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:19.193599 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-fp8dg/progression-invalid-node-0-0-pv7gb"] Sep 18 12:22:19.296295 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:19.296257 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hxvm\" (UniqueName: \"kubernetes.io/projected/35b03c0d-4d29-4196-b18e-785e9c61a360-kube-api-access-9hxvm\") pod \"progression-invalid-node-0-0-pv7gb\" (UID: \"35b03c0d-4d29-4196-b18e-785e9c61a360\") " pod="rhai-e2e-progression-fp8dg/progression-invalid-node-0-0-pv7gb" Sep 18 12:22:19.397673 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:19.397643 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hxvm\" (UniqueName: \"kubernetes.io/projected/35b03c0d-4d29-4196-b18e-785e9c61a360-kube-api-access-9hxvm\") pod \"progression-invalid-node-0-0-pv7gb\" (UID: \"35b03c0d-4d29-4196-b18e-785e9c61a360\") " pod="rhai-e2e-progression-fp8dg/progression-invalid-node-0-0-pv7gb" Sep 18 12:22:19.407335 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:19.407315 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hxvm\" (UniqueName: \"kubernetes.io/projected/35b03c0d-4d29-4196-b18e-785e9c61a360-kube-api-access-9hxvm\") pod \"progression-invalid-node-0-0-pv7gb\" (UID: \"35b03c0d-4d29-4196-b18e-785e9c61a360\") " pod="rhai-e2e-progression-fp8dg/progression-invalid-node-0-0-pv7gb" Sep 18 12:22:19.489132 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:19.489064 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-fp8dg/progression-invalid-node-0-0-pv7gb" Sep 18 12:22:19.763112 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:19.763088 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-fp8dg/progression-invalid-node-0-0-pv7gb"] Sep 18 12:22:19.765852 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:22:19.765826 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35b03c0d_4d29_4196_b18e_785e9c61a360.slice/crio-8a7b965d55acb7fbf56af646edbb60f86181a662fa32ec36c61574cac660d799 WatchSource:0}: Error finding container 8a7b965d55acb7fbf56af646edbb60f86181a662fa32ec36c61574cac660d799: Status 404 returned error can't find the container with id 8a7b965d55acb7fbf56af646edbb60f86181a662fa32ec36c61574cac660d799 Sep 18 12:22:20.044963 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:20.044880 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-fp8dg/progression-invalid-node-0-0-pv7gb" event={"ID":"35b03c0d-4d29-4196-b18e-785e9c61a360","Type":"ContainerStarted","Data":"979b80ddb6890606c34c133be4ce68a0914f2b6c47db3e42f227ad8033f4fe1b"} Sep 18 12:22:20.044963 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:20.044927 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-fp8dg/progression-invalid-node-0-0-pv7gb" event={"ID":"35b03c0d-4d29-4196-b18e-785e9c61a360","Type":"ContainerStarted","Data":"8a7b965d55acb7fbf56af646edbb60f86181a662fa32ec36c61574cac660d799"} Sep 18 12:22:20.063624 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:20.063581 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-fp8dg/progression-invalid-node-0-0-pv7gb" podStartSLOduration=1.063565312 podStartE2EDuration="1.063565312s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 12:22:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:22:20.062135203 +0000 UTC m=+1263.066822927" watchObservedRunningTime="2026-09-18 12:22:20.063565312 +0000 UTC m=+1263.068253036" Sep 18 12:22:34.210483 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:34.210425 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-fp8dg/progression-custom-config-node-0-0-bczvm"] Sep 18 12:22:34.212861 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:34.212844 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-fp8dg/progression-custom-config-node-0-0-bczvm" Sep 18 12:22:34.215245 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:34.215225 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j5nj\" (UniqueName: \"kubernetes.io/projected/e118952f-f111-4a2e-bdab-cf3a0cff5cb3-kube-api-access-7j5nj\") pod \"progression-custom-config-node-0-0-bczvm\" (UID: \"e118952f-f111-4a2e-bdab-cf3a0cff5cb3\") " pod="rhai-e2e-progression-fp8dg/progression-custom-config-node-0-0-bczvm" Sep 18 12:22:34.216533 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:34.216509 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:22:34.223002 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:34.222977 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-fp8dg/progression-custom-config-node-0-0-bczvm"] Sep 18 12:22:34.316426 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:34.316393 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j5nj\" (UniqueName: \"kubernetes.io/projected/e118952f-f111-4a2e-bdab-cf3a0cff5cb3-kube-api-access-7j5nj\") pod \"progression-custom-config-node-0-0-bczvm\" (UID: \"e118952f-f111-4a2e-bdab-cf3a0cff5cb3\") " pod="rhai-e2e-progression-fp8dg/progression-custom-config-node-0-0-bczvm" Sep 18 12:22:34.324889 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:34.324861 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j5nj\" (UniqueName: \"kubernetes.io/projected/e118952f-f111-4a2e-bdab-cf3a0cff5cb3-kube-api-access-7j5nj\") pod \"progression-custom-config-node-0-0-bczvm\" (UID: \"e118952f-f111-4a2e-bdab-cf3a0cff5cb3\") " pod="rhai-e2e-progression-fp8dg/progression-custom-config-node-0-0-bczvm" Sep 18 12:22:34.522745 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:34.522648 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-fp8dg/progression-custom-config-node-0-0-bczvm" Sep 18 12:22:34.794218 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:34.794190 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-fp8dg/progression-custom-config-node-0-0-bczvm"] Sep 18 12:22:34.796209 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:22:34.796184 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode118952f_f111_4a2e_bdab_cf3a0cff5cb3.slice/crio-8486dd4b338391ad7bd7d8f42a3f5cd323d9561884964e8b75119b487fea8433 WatchSource:0}: Error finding container 8486dd4b338391ad7bd7d8f42a3f5cd323d9561884964e8b75119b487fea8433: Status 404 returned error can't find the container with id 8486dd4b338391ad7bd7d8f42a3f5cd323d9561884964e8b75119b487fea8433 Sep 18 12:22:35.118981 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:35.118888 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-fp8dg/progression-custom-config-node-0-0-bczvm" event={"ID":"e118952f-f111-4a2e-bdab-cf3a0cff5cb3","Type":"ContainerStarted","Data":"5995867a24c530719fcfda0196587a066e8b1fcf30d984ac879299f3844ee4ab"} Sep 18 12:22:35.118981 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:35.118964 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-fp8dg/progression-custom-config-node-0-0-bczvm" event={"ID":"e118952f-f111-4a2e-bdab-cf3a0cff5cb3","Type":"ContainerStarted","Data":"8486dd4b338391ad7bd7d8f42a3f5cd323d9561884964e8b75119b487fea8433"} Sep 18 12:22:35.136308 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:35.136258 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-fp8dg/progression-custom-config-node-0-0-bczvm" podStartSLOduration=1.136244187 podStartE2EDuration="1.136244187s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 12:22:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:22:35.133872373 +0000 UTC m=+1278.138560096" watchObservedRunningTime="2026-09-18 12:22:35.136244187 +0000 UTC m=+1278.140931909" Sep 18 12:22:36.248244 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:36.248208 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-fp8dg/progression-min-interval-node-0-0-l6pd9"] Sep 18 12:22:36.250734 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:36.250708 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-fp8dg/progression-min-interval-node-0-0-l6pd9" Sep 18 12:22:36.250932 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:36.250754 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:22:36.261088 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:36.261064 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-fp8dg/progression-min-interval-node-0-0-l6pd9"] Sep 18 12:22:36.329941 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:36.329908 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nhhz\" (UniqueName: \"kubernetes.io/projected/a461be0e-da78-489e-ac92-53192612e42a-kube-api-access-8nhhz\") pod \"progression-min-interval-node-0-0-l6pd9\" (UID: \"a461be0e-da78-489e-ac92-53192612e42a\") " pod="rhai-e2e-progression-fp8dg/progression-min-interval-node-0-0-l6pd9" Sep 18 12:22:36.430721 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:36.430690 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nhhz\" (UniqueName: \"kubernetes.io/projected/a461be0e-da78-489e-ac92-53192612e42a-kube-api-access-8nhhz\") pod \"progression-min-interval-node-0-0-l6pd9\" (UID: \"a461be0e-da78-489e-ac92-53192612e42a\") " pod="rhai-e2e-progression-fp8dg/progression-min-interval-node-0-0-l6pd9" Sep 18 12:22:36.438887 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:36.438865 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nhhz\" (UniqueName: \"kubernetes.io/projected/a461be0e-da78-489e-ac92-53192612e42a-kube-api-access-8nhhz\") pod \"progression-min-interval-node-0-0-l6pd9\" (UID: \"a461be0e-da78-489e-ac92-53192612e42a\") " pod="rhai-e2e-progression-fp8dg/progression-min-interval-node-0-0-l6pd9" Sep 18 12:22:36.560396 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:36.560314 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-fp8dg/progression-min-interval-node-0-0-l6pd9" Sep 18 12:22:36.744914 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:36.744868 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:22:36.832509 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:36.832487 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-fp8dg/progression-min-interval-node-0-0-l6pd9"] Sep 18 12:22:36.834850 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:22:36.834813 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda461be0e_da78_489e_ac92_53192612e42a.slice/crio-4bf8f3837c928f22001d4bea3d660075ac04d111304ca3748d47264626c34bde WatchSource:0}: Error finding container 4bf8f3837c928f22001d4bea3d660075ac04d111304ca3748d47264626c34bde: Status 404 returned error can't find the container with id 4bf8f3837c928f22001d4bea3d660075ac04d111304ca3748d47264626c34bde Sep 18 12:22:37.130175 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:37.130146 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-fp8dg/progression-min-interval-node-0-0-l6pd9" event={"ID":"a461be0e-da78-489e-ac92-53192612e42a","Type":"ContainerStarted","Data":"14a4b76435bcc4c24eda6d6bdc0b5a0086586a4a4c5ad19761e779d13f3893c4"} Sep 18 12:22:37.130333 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:37.130189 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-fp8dg/progression-min-interval-node-0-0-l6pd9" event={"ID":"a461be0e-da78-489e-ac92-53192612e42a","Type":"ContainerStarted","Data":"4bf8f3837c928f22001d4bea3d660075ac04d111304ca3748d47264626c34bde"} Sep 18 12:22:37.147910 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:37.147863 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-fp8dg/progression-min-interval-node-0-0-l6pd9" podStartSLOduration=1.1478465660000001 podStartE2EDuration="1.147846566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 12:22:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:22:37.146460778 +0000 UTC m=+1280.151148503" watchObservedRunningTime="2026-09-18 12:22:37.147846566 +0000 UTC m=+1280.152534288" Sep 18 12:22:41.151373 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:41.151336 2578 generic.go:356] "Generic (PLEG): container finished" podID="35b03c0d-4d29-4196-b18e-785e9c61a360" containerID="979b80ddb6890606c34c133be4ce68a0914f2b6c47db3e42f227ad8033f4fe1b" exitCode=0 Sep 18 12:22:41.151812 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:41.151378 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-fp8dg/progression-invalid-node-0-0-pv7gb" event={"ID":"35b03c0d-4d29-4196-b18e-785e9c61a360","Type":"ContainerDied","Data":"979b80ddb6890606c34c133be4ce68a0914f2b6c47db3e42f227ad8033f4fe1b"} Sep 18 12:22:42.280259 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:42.280235 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-fp8dg/progression-invalid-node-0-0-pv7gb" Sep 18 12:22:42.375808 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:42.375775 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hxvm\" (UniqueName: \"kubernetes.io/projected/35b03c0d-4d29-4196-b18e-785e9c61a360-kube-api-access-9hxvm\") pod \"35b03c0d-4d29-4196-b18e-785e9c61a360\" (UID: \"35b03c0d-4d29-4196-b18e-785e9c61a360\") " Sep 18 12:22:42.377969 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:42.377942 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35b03c0d-4d29-4196-b18e-785e9c61a360-kube-api-access-9hxvm" (OuterVolumeSpecName: "kube-api-access-9hxvm") pod "35b03c0d-4d29-4196-b18e-785e9c61a360" (UID: "35b03c0d-4d29-4196-b18e-785e9c61a360"). InnerVolumeSpecName "kube-api-access-9hxvm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 12:22:42.476883 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:42.476793 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hxvm\" (UniqueName: \"kubernetes.io/projected/35b03c0d-4d29-4196-b18e-785e9c61a360-kube-api-access-9hxvm\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:22:43.162880 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:43.162847 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-fp8dg/progression-invalid-node-0-0-pv7gb" event={"ID":"35b03c0d-4d29-4196-b18e-785e9c61a360","Type":"ContainerDied","Data":"8a7b965d55acb7fbf56af646edbb60f86181a662fa32ec36c61574cac660d799"} Sep 18 12:22:43.163054 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:43.162893 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a7b965d55acb7fbf56af646edbb60f86181a662fa32ec36c61574cac660d799" Sep 18 12:22:43.163054 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:43.162860 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-fp8dg/progression-invalid-node-0-0-pv7gb" Sep 18 12:22:56.225193 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:56.225156 2578 generic.go:356] "Generic (PLEG): container finished" podID="e118952f-f111-4a2e-bdab-cf3a0cff5cb3" containerID="5995867a24c530719fcfda0196587a066e8b1fcf30d984ac879299f3844ee4ab" exitCode=0 Sep 18 12:22:56.225549 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:56.225232 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-fp8dg/progression-custom-config-node-0-0-bczvm" event={"ID":"e118952f-f111-4a2e-bdab-cf3a0cff5cb3","Type":"ContainerDied","Data":"5995867a24c530719fcfda0196587a066e8b1fcf30d984ac879299f3844ee4ab"} Sep 18 12:22:57.352161 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:57.352139 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-fp8dg/progression-custom-config-node-0-0-bczvm" Sep 18 12:22:57.395127 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:57.395094 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7j5nj\" (UniqueName: \"kubernetes.io/projected/e118952f-f111-4a2e-bdab-cf3a0cff5cb3-kube-api-access-7j5nj\") pod \"e118952f-f111-4a2e-bdab-cf3a0cff5cb3\" (UID: \"e118952f-f111-4a2e-bdab-cf3a0cff5cb3\") " Sep 18 12:22:57.397280 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:57.397257 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e118952f-f111-4a2e-bdab-cf3a0cff5cb3-kube-api-access-7j5nj" (OuterVolumeSpecName: "kube-api-access-7j5nj") pod "e118952f-f111-4a2e-bdab-cf3a0cff5cb3" (UID: "e118952f-f111-4a2e-bdab-cf3a0cff5cb3"). InnerVolumeSpecName "kube-api-access-7j5nj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 12:22:57.495957 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:57.495883 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7j5nj\" (UniqueName: \"kubernetes.io/projected/e118952f-f111-4a2e-bdab-cf3a0cff5cb3-kube-api-access-7j5nj\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:22:58.236456 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:58.236398 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-fp8dg/progression-custom-config-node-0-0-bczvm" Sep 18 12:22:58.236456 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:58.236421 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-fp8dg/progression-custom-config-node-0-0-bczvm" event={"ID":"e118952f-f111-4a2e-bdab-cf3a0cff5cb3","Type":"ContainerDied","Data":"8486dd4b338391ad7bd7d8f42a3f5cd323d9561884964e8b75119b487fea8433"} Sep 18 12:22:58.236674 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:58.236483 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8486dd4b338391ad7bd7d8f42a3f5cd323d9561884964e8b75119b487fea8433" Sep 18 12:22:58.238181 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:58.238158 2578 generic.go:356] "Generic (PLEG): container finished" podID="a461be0e-da78-489e-ac92-53192612e42a" containerID="14a4b76435bcc4c24eda6d6bdc0b5a0086586a4a4c5ad19761e779d13f3893c4" exitCode=0 Sep 18 12:22:58.238322 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:58.238241 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-fp8dg/progression-min-interval-node-0-0-l6pd9" event={"ID":"a461be0e-da78-489e-ac92-53192612e42a","Type":"ContainerDied","Data":"14a4b76435bcc4c24eda6d6bdc0b5a0086586a4a4c5ad19761e779d13f3893c4"} Sep 18 12:22:59.372088 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:59.372064 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-fp8dg/progression-min-interval-node-0-0-l6pd9" Sep 18 12:22:59.411186 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:59.411162 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8nhhz\" (UniqueName: \"kubernetes.io/projected/a461be0e-da78-489e-ac92-53192612e42a-kube-api-access-8nhhz\") pod \"a461be0e-da78-489e-ac92-53192612e42a\" (UID: \"a461be0e-da78-489e-ac92-53192612e42a\") " Sep 18 12:22:59.413416 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:59.413388 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a461be0e-da78-489e-ac92-53192612e42a-kube-api-access-8nhhz" (OuterVolumeSpecName: "kube-api-access-8nhhz") pod "a461be0e-da78-489e-ac92-53192612e42a" (UID: "a461be0e-da78-489e-ac92-53192612e42a"). InnerVolumeSpecName "kube-api-access-8nhhz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 12:22:59.512794 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:22:59.512714 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nhhz\" (UniqueName: \"kubernetes.io/projected/a461be0e-da78-489e-ac92-53192612e42a-kube-api-access-8nhhz\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:23:00.249276 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:00.249246 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-fp8dg/progression-min-interval-node-0-0-l6pd9" Sep 18 12:23:00.249496 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:00.249292 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-fp8dg/progression-min-interval-node-0-0-l6pd9" event={"ID":"a461be0e-da78-489e-ac92-53192612e42a","Type":"ContainerDied","Data":"4bf8f3837c928f22001d4bea3d660075ac04d111304ca3748d47264626c34bde"} Sep 18 12:23:00.249496 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:00.249343 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4bf8f3837c928f22001d4bea3d660075ac04d111304ca3748d47264626c34bde" Sep 18 12:23:46.632810 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:46.632734 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-fp8dg/progression-no-metrics-node-0-0-d9qfw"] Sep 18 12:23:46.633258 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:46.633035 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35b03c0d-4d29-4196-b18e-785e9c61a360" containerName="node" Sep 18 12:23:46.633258 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:46.633046 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="35b03c0d-4d29-4196-b18e-785e9c61a360" containerName="node" Sep 18 12:23:46.633258 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:46.633055 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e118952f-f111-4a2e-bdab-cf3a0cff5cb3" containerName="node" Sep 18 12:23:46.633258 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:46.633060 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e118952f-f111-4a2e-bdab-cf3a0cff5cb3" containerName="node" Sep 18 12:23:46.633258 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:46.633076 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a461be0e-da78-489e-ac92-53192612e42a" containerName="node" Sep 18 12:23:46.633258 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:46.633081 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a461be0e-da78-489e-ac92-53192612e42a" containerName="node" Sep 18 12:23:46.633258 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:46.633124 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="35b03c0d-4d29-4196-b18e-785e9c61a360" containerName="node" Sep 18 12:23:46.633258 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:46.633134 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a461be0e-da78-489e-ac92-53192612e42a" containerName="node" Sep 18 12:23:46.633258 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:46.633141 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e118952f-f111-4a2e-bdab-cf3a0cff5cb3" containerName="node" Sep 18 12:23:46.635146 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:46.635125 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-fp8dg/progression-no-metrics-node-0-0-d9qfw" Sep 18 12:23:46.637880 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:46.637858 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-fp8dg\"/\"kube-root-ca.crt\"" Sep 18 12:23:46.638003 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:46.637882 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-fp8dg\"/\"default-dockercfg-xw294\"" Sep 18 12:23:46.638003 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:46.637883 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-fp8dg\"/\"openshift-service-ca.crt\"" Sep 18 12:23:46.638128 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:46.638071 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:23:46.644832 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:46.644810 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-fp8dg/progression-no-metrics-node-0-0-d9qfw"] Sep 18 12:23:46.695783 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:46.695756 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5dwm\" (UniqueName: \"kubernetes.io/projected/6f181163-64e6-43d5-a148-b7062b45d8a1-kube-api-access-x5dwm\") pod \"progression-no-metrics-node-0-0-d9qfw\" (UID: \"6f181163-64e6-43d5-a148-b7062b45d8a1\") " pod="rhai-e2e-progression-fp8dg/progression-no-metrics-node-0-0-d9qfw" Sep 18 12:23:46.796195 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:46.796161 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5dwm\" (UniqueName: \"kubernetes.io/projected/6f181163-64e6-43d5-a148-b7062b45d8a1-kube-api-access-x5dwm\") pod \"progression-no-metrics-node-0-0-d9qfw\" (UID: \"6f181163-64e6-43d5-a148-b7062b45d8a1\") " pod="rhai-e2e-progression-fp8dg/progression-no-metrics-node-0-0-d9qfw" Sep 18 12:23:46.805043 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:46.805019 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5dwm\" (UniqueName: \"kubernetes.io/projected/6f181163-64e6-43d5-a148-b7062b45d8a1-kube-api-access-x5dwm\") pod \"progression-no-metrics-node-0-0-d9qfw\" (UID: \"6f181163-64e6-43d5-a148-b7062b45d8a1\") " pod="rhai-e2e-progression-fp8dg/progression-no-metrics-node-0-0-d9qfw" Sep 18 12:23:46.944516 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:46.944398 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-fp8dg/progression-no-metrics-node-0-0-d9qfw" Sep 18 12:23:47.215550 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:47.215533 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-fp8dg/progression-no-metrics-node-0-0-d9qfw"] Sep 18 12:23:47.475300 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:47.475218 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-fp8dg/progression-no-metrics-node-0-0-d9qfw" event={"ID":"6f181163-64e6-43d5-a148-b7062b45d8a1","Type":"ContainerStarted","Data":"4bd2dc8211830a3ba5c94fbeaa0e29104a2358da9bfd5280f47a7852452f7192"} Sep 18 12:23:47.475300 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:47.475266 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-fp8dg/progression-no-metrics-node-0-0-d9qfw" event={"ID":"6f181163-64e6-43d5-a148-b7062b45d8a1","Type":"ContainerStarted","Data":"dc877cfc92c681d081afe022e985297ef6295ee37c8166f810d3eb38e64ca5d2"} Sep 18 12:23:47.491930 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:47.491875 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-fp8dg/progression-no-metrics-node-0-0-d9qfw" podStartSLOduration=1.491858662 podStartE2EDuration="1.491858662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 12:23:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:23:47.491832902 +0000 UTC m=+1350.496520638" watchObservedRunningTime="2026-09-18 12:23:47.491858662 +0000 UTC m=+1350.496546386" Sep 18 12:23:52.501593 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:52.501561 2578 generic.go:356] "Generic (PLEG): container finished" podID="6f181163-64e6-43d5-a148-b7062b45d8a1" containerID="4bd2dc8211830a3ba5c94fbeaa0e29104a2358da9bfd5280f47a7852452f7192" exitCode=0 Sep 18 12:23:52.501593 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:52.501597 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-fp8dg/progression-no-metrics-node-0-0-d9qfw" event={"ID":"6f181163-64e6-43d5-a148-b7062b45d8a1","Type":"ContainerDied","Data":"4bd2dc8211830a3ba5c94fbeaa0e29104a2358da9bfd5280f47a7852452f7192"} Sep 18 12:23:53.638804 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:53.638783 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-fp8dg/progression-no-metrics-node-0-0-d9qfw" Sep 18 12:23:53.757712 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:53.757632 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5dwm\" (UniqueName: \"kubernetes.io/projected/6f181163-64e6-43d5-a148-b7062b45d8a1-kube-api-access-x5dwm\") pod \"6f181163-64e6-43d5-a148-b7062b45d8a1\" (UID: \"6f181163-64e6-43d5-a148-b7062b45d8a1\") " Sep 18 12:23:53.759832 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:53.759810 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f181163-64e6-43d5-a148-b7062b45d8a1-kube-api-access-x5dwm" (OuterVolumeSpecName: "kube-api-access-x5dwm") pod "6f181163-64e6-43d5-a148-b7062b45d8a1" (UID: "6f181163-64e6-43d5-a148-b7062b45d8a1"). InnerVolumeSpecName "kube-api-access-x5dwm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 12:23:53.858229 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:53.858192 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5dwm\" (UniqueName: \"kubernetes.io/projected/6f181163-64e6-43d5-a148-b7062b45d8a1-kube-api-access-x5dwm\") on node \"ip-10-0-136-137.ec2.internal\" DevicePath \"\"" Sep 18 12:23:54.517904 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:54.517871 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-fp8dg/progression-no-metrics-node-0-0-d9qfw" Sep 18 12:23:54.517904 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:54.517889 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-fp8dg/progression-no-metrics-node-0-0-d9qfw" event={"ID":"6f181163-64e6-43d5-a148-b7062b45d8a1","Type":"ContainerDied","Data":"dc877cfc92c681d081afe022e985297ef6295ee37c8166f810d3eb38e64ca5d2"} Sep 18 12:23:54.518177 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:54.517949 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc877cfc92c681d081afe022e985297ef6295ee37c8166f810d3eb38e64ca5d2" Sep 18 12:23:56.729828 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:56.729788 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:23:57.295684 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:57.295648 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:23:57.392904 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:23:57.392862 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:24:01.803884 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:01.803846 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-fp8dg/progression-custom-config-node-0-0-bczvm"] Sep 18 12:24:01.807082 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:01.807061 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-fp8dg/progression-custom-config-node-0-0-bczvm"] Sep 18 12:24:01.813418 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:01.813398 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-fp8dg/progression-disabled-node-0-0-jvwvn"] Sep 18 12:24:01.816988 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:01.816967 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-fp8dg/progression-disabled-node-0-0-jvwvn"] Sep 18 12:24:01.821733 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:01.821714 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-fp8dg/progression-enabled-node-0-0-8w6wp"] Sep 18 12:24:01.824540 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:01.824520 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-fp8dg/progression-enabled-node-0-0-8w6wp"] Sep 18 12:24:01.829288 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:01.829269 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-fp8dg/progression-invalid-node-0-0-pv7gb"] Sep 18 12:24:01.833104 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:01.833084 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-fp8dg/progression-invalid-node-0-0-pv7gb"] Sep 18 12:24:01.848544 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:01.848522 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-fp8dg/progression-min-interval-node-0-0-l6pd9"] Sep 18 12:24:01.851758 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:01.851740 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-fp8dg/progression-min-interval-node-0-0-l6pd9"] Sep 18 12:24:01.857145 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:01.857122 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-fp8dg/progression-no-metrics-node-0-0-d9qfw"] Sep 18 12:24:01.859032 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:01.859012 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-fp8dg/progression-no-metrics-node-0-0-d9qfw"] Sep 18 12:24:02.074727 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:02.074636 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:24:02.175974 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:02.175934 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:24:03.036508 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:03.036459 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:24:03.137503 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:03.137473 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:24:03.466487 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:03.466429 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3375fcda-bc44-4e91-81da-82a5644f3298" path="/var/lib/kubelet/pods/3375fcda-bc44-4e91-81da-82a5644f3298/volumes" Sep 18 12:24:03.466799 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:03.466786 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35b03c0d-4d29-4196-b18e-785e9c61a360" path="/var/lib/kubelet/pods/35b03c0d-4d29-4196-b18e-785e9c61a360/volumes" Sep 18 12:24:03.467066 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:03.467055 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5452767c-da52-4c3e-9db6-c9c9b5da791e" path="/var/lib/kubelet/pods/5452767c-da52-4c3e-9db6-c9c9b5da791e/volumes" Sep 18 12:24:03.467328 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:03.467317 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f181163-64e6-43d5-a148-b7062b45d8a1" path="/var/lib/kubelet/pods/6f181163-64e6-43d5-a148-b7062b45d8a1/volumes" Sep 18 12:24:03.467968 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:03.467953 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a461be0e-da78-489e-ac92-53192612e42a" path="/var/lib/kubelet/pods/a461be0e-da78-489e-ac92-53192612e42a/volumes" Sep 18 12:24:03.468239 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:03.468227 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e118952f-f111-4a2e-bdab-cf3a0cff5cb3" path="/var/lib/kubelet/pods/e118952f-f111-4a2e-bdab-cf3a0cff5cb3/volumes" Sep 18 12:24:18.450262 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:18.450230 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:24:50.535658 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:50.535624 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:24:50.674215 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:50.674185 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ngr5f/must-gather-kmtqk"] Sep 18 12:24:50.674564 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:50.674551 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f181163-64e6-43d5-a148-b7062b45d8a1" containerName="node" Sep 18 12:24:50.674618 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:50.674566 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f181163-64e6-43d5-a148-b7062b45d8a1" containerName="node" Sep 18 12:24:50.674656 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:50.674629 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f181163-64e6-43d5-a148-b7062b45d8a1" containerName="node" Sep 18 12:24:50.676609 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:50.676590 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ngr5f/must-gather-kmtqk" Sep 18 12:24:50.678933 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:50.678912 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ngr5f\"/\"openshift-service-ca.crt\"" Sep 18 12:24:50.679202 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:50.679187 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ngr5f\"/\"kube-root-ca.crt\"" Sep 18 12:24:50.679334 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:50.679238 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ngr5f\"/\"default-dockercfg-8tb2v\"" Sep 18 12:24:50.684699 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:50.684675 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ngr5f/must-gather-kmtqk"] Sep 18 12:24:50.694583 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:50.694552 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:24:50.792952 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:50.792859 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:24:50.832158 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:50.832137 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j45c4\" (UniqueName: \"kubernetes.io/projected/8c9c1ec0-1aa0-4adf-8c17-1e5b2608a73d-kube-api-access-j45c4\") pod \"must-gather-kmtqk\" (UID: \"8c9c1ec0-1aa0-4adf-8c17-1e5b2608a73d\") " pod="openshift-must-gather-ngr5f/must-gather-kmtqk" Sep 18 12:24:50.832284 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:50.832173 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8c9c1ec0-1aa0-4adf-8c17-1e5b2608a73d-must-gather-output\") pod \"must-gather-kmtqk\" (UID: \"8c9c1ec0-1aa0-4adf-8c17-1e5b2608a73d\") " pod="openshift-must-gather-ngr5f/must-gather-kmtqk" Sep 18 12:24:50.932965 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:50.932939 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j45c4\" (UniqueName: \"kubernetes.io/projected/8c9c1ec0-1aa0-4adf-8c17-1e5b2608a73d-kube-api-access-j45c4\") pod \"must-gather-kmtqk\" (UID: \"8c9c1ec0-1aa0-4adf-8c17-1e5b2608a73d\") " pod="openshift-must-gather-ngr5f/must-gather-kmtqk" Sep 18 12:24:50.933089 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:50.932978 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8c9c1ec0-1aa0-4adf-8c17-1e5b2608a73d-must-gather-output\") pod \"must-gather-kmtqk\" (UID: \"8c9c1ec0-1aa0-4adf-8c17-1e5b2608a73d\") " pod="openshift-must-gather-ngr5f/must-gather-kmtqk" Sep 18 12:24:50.933266 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:50.933251 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8c9c1ec0-1aa0-4adf-8c17-1e5b2608a73d-must-gather-output\") pod \"must-gather-kmtqk\" (UID: \"8c9c1ec0-1aa0-4adf-8c17-1e5b2608a73d\") " pod="openshift-must-gather-ngr5f/must-gather-kmtqk" Sep 18 12:24:50.941525 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:50.941505 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j45c4\" (UniqueName: \"kubernetes.io/projected/8c9c1ec0-1aa0-4adf-8c17-1e5b2608a73d-kube-api-access-j45c4\") pod \"must-gather-kmtqk\" (UID: \"8c9c1ec0-1aa0-4adf-8c17-1e5b2608a73d\") " pod="openshift-must-gather-ngr5f/must-gather-kmtqk" Sep 18 12:24:50.986120 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:50.986088 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ngr5f/must-gather-kmtqk" Sep 18 12:24:51.263683 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:51.263656 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ngr5f/must-gather-kmtqk"] Sep 18 12:24:51.267013 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:24:51.266986 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c9c1ec0_1aa0_4adf_8c17_1e5b2608a73d.slice/crio-49a26c8472e9965a5dac3622a2b85abb8ffa5fabe639cab921f35572b1b5f5db WatchSource:0}: Error finding container 49a26c8472e9965a5dac3622a2b85abb8ffa5fabe639cab921f35572b1b5f5db: Status 404 returned error can't find the container with id 49a26c8472e9965a5dac3622a2b85abb8ffa5fabe639cab921f35572b1b5f5db Sep 18 12:24:51.269314 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:51.269296 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 12:24:51.798802 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:51.798754 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ngr5f/must-gather-kmtqk" event={"ID":"8c9c1ec0-1aa0-4adf-8c17-1e5b2608a73d","Type":"ContainerStarted","Data":"49a26c8472e9965a5dac3622a2b85abb8ffa5fabe639cab921f35572b1b5f5db"} Sep 18 12:24:52.809594 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:52.809314 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ngr5f/must-gather-kmtqk" event={"ID":"8c9c1ec0-1aa0-4adf-8c17-1e5b2608a73d","Type":"ContainerStarted","Data":"0f592398af1b641e20916e0e3fcd6d5571945c0c5e71a59e0bcb0d65b9ebbe8d"} Sep 18 12:24:52.809594 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:52.809365 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ngr5f/must-gather-kmtqk" event={"ID":"8c9c1ec0-1aa0-4adf-8c17-1e5b2608a73d","Type":"ContainerStarted","Data":"a0c50d8c97bdc8ad6222609e5ae9ee0a08b3ce946912cca995f25de02535f4c6"} Sep 18 12:24:52.828421 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:52.828366 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ngr5f/must-gather-kmtqk" podStartSLOduration=2.134930287 podStartE2EDuration="2.828349222s" totalImagesPullingTime="693.418935ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 12:24:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:24:52.827316011 +0000 UTC m=+1415.832003736" watchObservedRunningTime="2026-09-18 12:24:52.828349222 +0000 UTC m=+1415.833036945" Sep 18 12:24:53.883335 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:53.878588 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tpftw_7e518e71-5f13-44e7-aeb5-4e7c1e6d4778/global-pull-secret-syncer/0.log" Sep 18 12:24:53.933544 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:53.933509 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" Sep 18 12:24:54.049944 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:54.049912 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-137.ec2.internal_1159b62a0722daa58656ffb4cf50e6f2/haproxy/0.log" Sep 18 12:24:56.142214 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:56.142181 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:24:56.202406 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:56.202300 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj8kz_a3ece8ac-c845-4c4a-bc4a-3cb23127eb7d/konnectivity-agent/0.log" limit=1024 Sep 18 12:24:58.315001 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:58.314968 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-tqxsv_f8bbc657-9de5-4b0d-8876-abfd078f9062/kube-state-metrics/0.log" Sep 18 12:24:58.346868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:58.346792 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-tqxsv_f8bbc657-9de5-4b0d-8876-abfd078f9062/kube-rbac-proxy-main/0.log" Sep 18 12:24:58.377953 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:58.377924 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-tqxsv_f8bbc657-9de5-4b0d-8876-abfd078f9062/kube-rbac-proxy-self/0.log" Sep 18 12:24:58.416640 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:58.416614 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5df5475c48-btngp_3a0e8d85-19cc-4600-a88b-6f93f31cde7c/metrics-server/0.log" Sep 18 12:24:58.461868 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:58.461842 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-64pmv_06f17360-3b6f-4781-ab7f-c2a03ff519d9/monitoring-plugin/0.log" Sep 18 12:24:58.598076 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:58.598000 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gbwgw_b3e92bbb-d31f-4b16-a16b-76b8d8641290/node-exporter/0.log" Sep 18 12:24:58.624459 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:58.624418 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gbwgw_b3e92bbb-d31f-4b16-a16b-76b8d8641290/kube-rbac-proxy/0.log" Sep 18 12:24:58.655967 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:58.655942 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gbwgw_b3e92bbb-d31f-4b16-a16b-76b8d8641290/init-textfile/0.log" Sep 18 12:24:58.788812 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:58.788775 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-9wwlp_7129b91a-b429-4bb0-b6a4-c7b541960a03/kube-rbac-proxy-main/0.log" Sep 18 12:24:58.814971 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:58.814938 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-9wwlp_7129b91a-b429-4bb0-b6a4-c7b541960a03/kube-rbac-proxy-self/0.log" Sep 18 12:24:58.842033 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:58.841994 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-9wwlp_7129b91a-b429-4bb0-b6a4-c7b541960a03/openshift-state-metrics/0.log" Sep 18 12:24:58.885283 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:58.885247 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_af243ae5-a6bd-46bb-a80d-849749ba0a06/prometheus/0.log" Sep 18 12:24:58.914093 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:58.914067 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_af243ae5-a6bd-46bb-a80d-849749ba0a06/config-reloader/0.log" Sep 18 12:24:58.947280 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:58.947249 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_af243ae5-a6bd-46bb-a80d-849749ba0a06/thanos-sidecar/0.log" Sep 18 12:24:58.981045 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:58.981021 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_af243ae5-a6bd-46bb-a80d-849749ba0a06/kube-rbac-proxy-web/0.log" Sep 18 12:24:59.005345 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:59.005322 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_af243ae5-a6bd-46bb-a80d-849749ba0a06/kube-rbac-proxy/0.log" Sep 18 12:24:59.034321 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:59.034206 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_af243ae5-a6bd-46bb-a80d-849749ba0a06/kube-rbac-proxy-thanos/0.log" Sep 18 12:24:59.071590 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:59.071560 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_af243ae5-a6bd-46bb-a80d-849749ba0a06/init-config-reloader/0.log" Sep 18 12:24:59.110759 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:59.110733 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-tm2vd_7ed018f8-4a30-40b1-8e9a-1fc37f4893c4/prometheus-operator/0.log" Sep 18 12:24:59.151544 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:59.151458 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-tm2vd_7ed018f8-4a30-40b1-8e9a-1fc37f4893c4/kube-rbac-proxy/0.log" Sep 18 12:24:59.194808 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:24:59.194773 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-982w4_28ea6a59-c01c-471c-b7c7-74ce5f7de1a9/prometheus-operator-admission-webhook/0.log" Sep 18 12:25:01.121598 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:01.121560 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-fc7vn_a6629efd-ffee-4ff0-bb6c-530f4ac96793/console-operator/1.log" Sep 18 12:25:01.132879 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:01.132848 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-fc7vn_a6629efd-ffee-4ff0-bb6c-530f4ac96793/console-operator/2.log" Sep 18 12:25:01.407630 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:01.407599 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ngr5f/perf-node-gather-daemonset-vtr9h"] Sep 18 12:25:01.412959 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:01.412929 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ngr5f/perf-node-gather-daemonset-vtr9h" Sep 18 12:25:01.424310 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:01.424281 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ngr5f/perf-node-gather-daemonset-vtr9h"] Sep 18 12:25:01.546933 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:01.546899 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fcebdbf2-b96c-40b0-bec1-55ba7c7edf41-proc\") pod \"perf-node-gather-daemonset-vtr9h\" (UID: \"fcebdbf2-b96c-40b0-bec1-55ba7c7edf41\") " pod="openshift-must-gather-ngr5f/perf-node-gather-daemonset-vtr9h" Sep 18 12:25:01.547205 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:01.547187 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fcebdbf2-b96c-40b0-bec1-55ba7c7edf41-lib-modules\") pod \"perf-node-gather-daemonset-vtr9h\" (UID: \"fcebdbf2-b96c-40b0-bec1-55ba7c7edf41\") " pod="openshift-must-gather-ngr5f/perf-node-gather-daemonset-vtr9h" Sep 18 12:25:01.547373 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:01.547360 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fcebdbf2-b96c-40b0-bec1-55ba7c7edf41-podres\") pod \"perf-node-gather-daemonset-vtr9h\" (UID: \"fcebdbf2-b96c-40b0-bec1-55ba7c7edf41\") " pod="openshift-must-gather-ngr5f/perf-node-gather-daemonset-vtr9h" Sep 18 12:25:01.547522 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:01.547507 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2sfb\" (UniqueName: \"kubernetes.io/projected/fcebdbf2-b96c-40b0-bec1-55ba7c7edf41-kube-api-access-q2sfb\") pod \"perf-node-gather-daemonset-vtr9h\" (UID: \"fcebdbf2-b96c-40b0-bec1-55ba7c7edf41\") " pod="openshift-must-gather-ngr5f/perf-node-gather-daemonset-vtr9h" Sep 18 12:25:01.547652 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:01.547639 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcebdbf2-b96c-40b0-bec1-55ba7c7edf41-sys\") pod \"perf-node-gather-daemonset-vtr9h\" (UID: \"fcebdbf2-b96c-40b0-bec1-55ba7c7edf41\") " pod="openshift-must-gather-ngr5f/perf-node-gather-daemonset-vtr9h" Sep 18 12:25:01.649045 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:01.649012 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fcebdbf2-b96c-40b0-bec1-55ba7c7edf41-podres\") pod \"perf-node-gather-daemonset-vtr9h\" (UID: \"fcebdbf2-b96c-40b0-bec1-55ba7c7edf41\") " pod="openshift-must-gather-ngr5f/perf-node-gather-daemonset-vtr9h" Sep 18 12:25:01.649045 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:01.649055 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2sfb\" (UniqueName: \"kubernetes.io/projected/fcebdbf2-b96c-40b0-bec1-55ba7c7edf41-kube-api-access-q2sfb\") pod \"perf-node-gather-daemonset-vtr9h\" (UID: \"fcebdbf2-b96c-40b0-bec1-55ba7c7edf41\") " pod="openshift-must-gather-ngr5f/perf-node-gather-daemonset-vtr9h" Sep 18 12:25:01.649310 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:01.649105 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcebdbf2-b96c-40b0-bec1-55ba7c7edf41-sys\") pod \"perf-node-gather-daemonset-vtr9h\" (UID: \"fcebdbf2-b96c-40b0-bec1-55ba7c7edf41\") " pod="openshift-must-gather-ngr5f/perf-node-gather-daemonset-vtr9h" Sep 18 12:25:01.649310 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:01.649183 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fcebdbf2-b96c-40b0-bec1-55ba7c7edf41-proc\") pod \"perf-node-gather-daemonset-vtr9h\" (UID: \"fcebdbf2-b96c-40b0-bec1-55ba7c7edf41\") " pod="openshift-must-gather-ngr5f/perf-node-gather-daemonset-vtr9h" Sep 18 12:25:01.649310 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:01.649189 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcebdbf2-b96c-40b0-bec1-55ba7c7edf41-sys\") pod \"perf-node-gather-daemonset-vtr9h\" (UID: \"fcebdbf2-b96c-40b0-bec1-55ba7c7edf41\") " pod="openshift-must-gather-ngr5f/perf-node-gather-daemonset-vtr9h" Sep 18 12:25:01.649310 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:01.649200 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fcebdbf2-b96c-40b0-bec1-55ba7c7edf41-podres\") pod \"perf-node-gather-daemonset-vtr9h\" (UID: \"fcebdbf2-b96c-40b0-bec1-55ba7c7edf41\") " pod="openshift-must-gather-ngr5f/perf-node-gather-daemonset-vtr9h" Sep 18 12:25:01.649310 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:01.649274 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fcebdbf2-b96c-40b0-bec1-55ba7c7edf41-lib-modules\") pod \"perf-node-gather-daemonset-vtr9h\" (UID: \"fcebdbf2-b96c-40b0-bec1-55ba7c7edf41\") " pod="openshift-must-gather-ngr5f/perf-node-gather-daemonset-vtr9h" Sep 18 12:25:01.649310 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:01.649281 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fcebdbf2-b96c-40b0-bec1-55ba7c7edf41-proc\") pod \"perf-node-gather-daemonset-vtr9h\" (UID: \"fcebdbf2-b96c-40b0-bec1-55ba7c7edf41\") " pod="openshift-must-gather-ngr5f/perf-node-gather-daemonset-vtr9h" Sep 18 12:25:01.649636 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:01.649484 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fcebdbf2-b96c-40b0-bec1-55ba7c7edf41-lib-modules\") pod \"perf-node-gather-daemonset-vtr9h\" (UID: \"fcebdbf2-b96c-40b0-bec1-55ba7c7edf41\") " pod="openshift-must-gather-ngr5f/perf-node-gather-daemonset-vtr9h" Sep 18 12:25:01.659250 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:01.659182 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2sfb\" (UniqueName: \"kubernetes.io/projected/fcebdbf2-b96c-40b0-bec1-55ba7c7edf41-kube-api-access-q2sfb\") pod \"perf-node-gather-daemonset-vtr9h\" (UID: \"fcebdbf2-b96c-40b0-bec1-55ba7c7edf41\") " pod="openshift-must-gather-ngr5f/perf-node-gather-daemonset-vtr9h" Sep 18 12:25:01.726257 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:01.726224 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ngr5f/perf-node-gather-daemonset-vtr9h" Sep 18 12:25:02.006260 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:02.006229 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ngr5f/perf-node-gather-daemonset-vtr9h"] Sep 18 12:25:02.008328 ip-10-0-136-137 kubenswrapper[2578]: W0918 12:25:02.008287 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfcebdbf2_b96c_40b0_bec1_55ba7c7edf41.slice/crio-4343e6bb672d7488c8a84fcdfbcc9c0716a177ab600619f0a15a027389acbe57 WatchSource:0}: Error finding container 4343e6bb672d7488c8a84fcdfbcc9c0716a177ab600619f0a15a027389acbe57: Status 404 returned error can't find the container with id 4343e6bb672d7488c8a84fcdfbcc9c0716a177ab600619f0a15a027389acbe57 Sep 18 12:25:02.877745 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:02.877713 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ngr5f/perf-node-gather-daemonset-vtr9h" event={"ID":"fcebdbf2-b96c-40b0-bec1-55ba7c7edf41","Type":"ContainerStarted","Data":"a035a52ccab04f71b0a59cfe918fb488d831f5c6f58f6b8ce67b0cefdec71617"} Sep 18 12:25:02.878146 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:02.877763 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ngr5f/perf-node-gather-daemonset-vtr9h" event={"ID":"fcebdbf2-b96c-40b0-bec1-55ba7c7edf41","Type":"ContainerStarted","Data":"4343e6bb672d7488c8a84fcdfbcc9c0716a177ab600619f0a15a027389acbe57"} Sep 18 12:25:02.878146 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:02.877809 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ngr5f/perf-node-gather-daemonset-vtr9h" Sep 18 12:25:02.894580 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:02.894533 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ngr5f/perf-node-gather-daemonset-vtr9h" podStartSLOduration=1.894517897 podStartE2EDuration="1.894517897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 12:25:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 12:25:02.893177204 +0000 UTC m=+1425.897864938" watchObservedRunningTime="2026-09-18 12:25:02.894517897 +0000 UTC m=+1425.899205620" Sep 18 12:25:03.019984 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:03.019949 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fzjc7_234d0ce2-2eb9-4560-9208-1c28699d7263/dns/0.log" Sep 18 12:25:03.044808 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:03.044783 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fzjc7_234d0ce2-2eb9-4560-9208-1c28699d7263/kube-rbac-proxy/0.log" Sep 18 12:25:03.197213 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:03.197146 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rvwkx_e518b32c-52bd-4209-a275-735bb0a88e9f/dns-node-resolver/0.log" Sep 18 12:25:03.747155 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:03.747126 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-72hfq_dd9664b3-5cd3-4336-9a83-c1641b6801ae/node-ca/0.log" Sep 18 12:25:05.157204 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:05.157174 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7xktt_fcbeeb9d-952c-4a61-a38f-6c338e380647/serve-healthcheck-canary/0.log" Sep 18 12:25:05.603751 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:05.603674 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-992hx_d6663817-d441-4a33-82a1-c7cb1d185808/kube-rbac-proxy/0.log" Sep 18 12:25:05.629894 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:05.629869 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-992hx_d6663817-d441-4a33-82a1-c7cb1d185808/exporter/0.log" Sep 18 12:25:05.670691 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:05.670659 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-992hx_d6663817-d441-4a33-82a1-c7cb1d185808/extractor/0.log" Sep 18 12:25:08.895030 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:08.894953 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ngr5f/perf-node-gather-daemonset-vtr9h" Sep 18 12:25:11.147924 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:11.147893 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-qg6qk_ea6a79a3-3841-46e7-b434-aaeebd930356/migrator/0.log" Sep 18 12:25:11.185807 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:11.185748 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-qg6qk_ea6a79a3-3841-46e7-b434-aaeebd930356/graceful-termination/0.log" Sep 18 12:25:12.440543 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:12.440518 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5n699_9bb652de-6064-47b2-8a77-4ab4e7a7bc69/kube-multus-additional-cni-plugins/0.log" Sep 18 12:25:12.478316 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:12.478290 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5n699_9bb652de-6064-47b2-8a77-4ab4e7a7bc69/egress-router-binary-copy/0.log" Sep 18 12:25:12.509701 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:12.509672 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5n699_9bb652de-6064-47b2-8a77-4ab4e7a7bc69/cni-plugins/0.log" Sep 18 12:25:12.538406 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:12.538379 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5n699_9bb652de-6064-47b2-8a77-4ab4e7a7bc69/bond-cni-plugin/0.log" Sep 18 12:25:12.566114 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:12.566078 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5n699_9bb652de-6064-47b2-8a77-4ab4e7a7bc69/routeoverride-cni/0.log" Sep 18 12:25:12.590719 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:12.590692 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5n699_9bb652de-6064-47b2-8a77-4ab4e7a7bc69/whereabouts-cni-bincopy/0.log" Sep 18 12:25:12.615359 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:12.615331 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5n699_9bb652de-6064-47b2-8a77-4ab4e7a7bc69/whereabouts-cni/0.log" Sep 18 12:25:13.090486 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:13.090424 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-z7phr_d41ee317-2122-4ae3-b680-6b44e17f25a9/kube-multus/0.log" Sep 18 12:25:13.224764 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:13.224666 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lvx4s_a7f89718-22f1-4c13-aff1-d2fa5ff92c55/network-metrics-daemon/0.log" Sep 18 12:25:13.250363 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:13.250343 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lvx4s_a7f89718-22f1-4c13-aff1-d2fa5ff92c55/kube-rbac-proxy/0.log" Sep 18 12:25:13.994564 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:13.994514 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l7rg_e4e24df3-32d9-47d5-bab8-3b6c6ab5451e/ovn-controller/0.log" Sep 18 12:25:14.014303 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:14.014280 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l7rg_e4e24df3-32d9-47d5-bab8-3b6c6ab5451e/ovn-acl-logging/0.log" Sep 18 12:25:14.049089 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:14.049032 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l7rg_e4e24df3-32d9-47d5-bab8-3b6c6ab5451e/kube-rbac-proxy-node/0.log" Sep 18 12:25:14.075964 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:14.075941 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l7rg_e4e24df3-32d9-47d5-bab8-3b6c6ab5451e/kube-rbac-proxy-ovn-metrics/0.log" Sep 18 12:25:14.098632 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:14.098601 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l7rg_e4e24df3-32d9-47d5-bab8-3b6c6ab5451e/northd/0.log" Sep 18 12:25:14.123738 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:14.123716 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l7rg_e4e24df3-32d9-47d5-bab8-3b6c6ab5451e/nbdb/0.log" Sep 18 12:25:14.148068 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:14.148047 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l7rg_e4e24df3-32d9-47d5-bab8-3b6c6ab5451e/sbdb/0.log" Sep 18 12:25:14.212499 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:14.212475 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5l7rg_e4e24df3-32d9-47d5-bab8-3b6c6ab5451e/ovnkube-controller/0.log" Sep 18 12:25:15.921393 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:15.921364 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7cbc45fddc-2fxjh_e5aba236-fa70-4052-b440-0092f82308c0/check-endpoints/0.log" Sep 18 12:25:16.010664 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:16.010636 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-sbkdt_91599aa3-f0bc-4a4a-afa3-362851ac1783/network-check-target-container/0.log" Sep 18 12:25:17.008784 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:17.008757 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-xzqgp_fb3f8f64-6a47-42b0-a259-fd44f14570be/iptables-alerter/0.log" Sep 18 12:25:17.732808 ip-10-0-136-137 kubenswrapper[2578]: I0918 12:25:17.732777 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-4ldj5_d43cab31-d29e-4d09-9b84-b59eff1e2163/tuned/0.log"