Sep 17 16:39:52.553021 ip-10-0-142-146 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 17 16:39:52.553033 ip-10-0-142-146 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 17 16:39:52.553042 ip-10-0-142-146 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 17 16:39:52.553324 ip-10-0-142-146 systemd[1]: Failed to start Kubernetes Kubelet. Sep 17 16:40:04.146144 ip-10-0-142-146 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 17 16:40:04.146162 ip-10-0-142-146 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 9afc9f10be084c9d9792f5baba0feb6e -- Sep 17 16:41:43.698731 ip-10-0-142-146 systemd[1]: Starting Kubernetes Kubelet... Sep 17 16:41:44.095116 ip-10-0-142-146 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 16:41:44.095116 ip-10-0-142-146 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 17 16:41:44.095116 ip-10-0-142-146 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 16:41:44.095116 ip-10-0-142-146 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 17 16:41:44.095116 ip-10-0-142-146 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 16:41:44.097314 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.097166 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 17 16:41:44.100643 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100623 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 16:41:44.100643 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100639 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 16:41:44.100643 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100644 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 16:41:44.100643 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100648 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 16:41:44.100856 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100653 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 16:41:44.100856 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100656 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 16:41:44.100856 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100660 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 16:41:44.100856 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100664 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 16:41:44.100856 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100668 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 16:41:44.100856 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100672 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 16:41:44.100856 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100676 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 16:41:44.100856 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100680 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 16:41:44.100856 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100684 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 16:41:44.100856 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100687 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 16:41:44.100856 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100691 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 16:41:44.100856 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100694 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 16:41:44.100856 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100698 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 16:41:44.100856 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100707 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 16:41:44.100856 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100711 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 16:41:44.100856 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100715 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 16:41:44.100856 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100719 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 16:41:44.100856 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100722 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 16:41:44.100856 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100726 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 16:41:44.100856 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100730 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 16:41:44.101664 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100734 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 16:41:44.101664 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100737 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 16:41:44.101664 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100741 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 16:41:44.101664 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100748 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 16:41:44.101664 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100754 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 16:41:44.101664 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100760 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 16:41:44.101664 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100765 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 16:41:44.101664 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100770 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 16:41:44.101664 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100775 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 16:41:44.101664 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100779 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 16:41:44.101664 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100784 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 16:41:44.101664 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100789 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 16:41:44.101664 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100793 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 16:41:44.101664 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100798 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 16:41:44.101664 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100803 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 16:41:44.101664 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100807 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 16:41:44.101664 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100811 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 16:41:44.101664 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100816 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 16:41:44.102376 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100819 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 16:41:44.102376 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100824 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 16:41:44.102376 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100828 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 16:41:44.102376 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100832 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 16:41:44.102376 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100837 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 16:41:44.102376 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100841 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 16:41:44.102376 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100845 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 16:41:44.102376 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100849 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 16:41:44.102376 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100857 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 16:41:44.102376 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100862 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 16:41:44.102376 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100867 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 16:41:44.102376 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100871 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 16:41:44.102376 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100874 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 16:41:44.102376 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100879 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 16:41:44.102376 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100885 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 16:41:44.102376 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100891 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 17 16:41:44.102376 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100895 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 16:41:44.102376 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100899 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 16:41:44.102376 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100903 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 16:41:44.102376 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100908 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 16:41:44.103242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100912 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 16:41:44.103242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100916 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 16:41:44.103242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100920 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 16:41:44.103242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100924 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 16:41:44.103242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100928 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 16:41:44.103242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100934 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 16:41:44.103242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100938 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 16:41:44.103242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100943 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 16:41:44.103242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100947 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 16:41:44.103242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100950 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 16:41:44.103242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100954 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 16:41:44.103242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100959 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 16:41:44.103242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100963 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 16:41:44.103242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100967 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 16:41:44.103242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100972 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 16:41:44.103242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100976 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 16:41:44.103242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100980 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 16:41:44.103242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100984 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 16:41:44.103242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100988 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 16:41:44.103242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100992 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 16:41:44.104115 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.100996 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 16:41:44.104115 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.101001 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 16:41:44.104115 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.101005 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 16:41:44.104115 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.101009 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 16:41:44.104115 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.101013 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 16:41:44.104115 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.101016 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 16:41:44.104115 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.101020 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 16:41:44.104115 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.101024 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 16:41:44.104115 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.101028 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 16:41:44.104115 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.101032 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 16:41:44.104115 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.101035 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 16:41:44.104115 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.101039 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 16:41:44.104115 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.101043 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 16:41:44.104115 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.101047 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 16:41:44.104115 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.101053 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 16:41:44.104115 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.101056 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 16:41:44.104115 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.101060 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 16:41:44.104115 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102205 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 16:41:44.104115 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102216 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 17 16:41:44.104115 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102223 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 16:41:44.104971 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102228 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 16:41:44.104971 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102233 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 16:41:44.104971 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102237 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 16:41:44.104971 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102241 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 16:41:44.104971 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102246 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 16:41:44.104971 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102250 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 16:41:44.104971 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102255 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 16:41:44.104971 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102260 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 16:41:44.104971 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102264 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 16:41:44.104971 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102269 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 16:41:44.104971 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102273 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 16:41:44.104971 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102277 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 16:41:44.104971 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102282 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 16:41:44.104971 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102286 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 16:41:44.104971 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102290 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 16:41:44.104971 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102294 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 16:41:44.104971 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102298 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 16:41:44.104971 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102302 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 16:41:44.104971 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102305 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 16:41:44.104971 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102310 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 16:41:44.105700 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102314 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 16:41:44.105700 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102318 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 16:41:44.105700 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102322 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 16:41:44.105700 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102325 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 16:41:44.105700 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102329 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 16:41:44.105700 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102334 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 16:41:44.105700 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102338 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 16:41:44.105700 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102342 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 16:41:44.105700 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102346 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 16:41:44.105700 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102350 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 16:41:44.105700 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102354 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 16:41:44.105700 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102358 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 16:41:44.105700 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102362 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 16:41:44.105700 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102366 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 16:41:44.105700 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102370 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 16:41:44.105700 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102374 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 16:41:44.105700 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102378 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 16:41:44.105700 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102381 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 16:41:44.105700 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102385 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 16:41:44.105700 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102389 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 16:41:44.106239 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102393 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 16:41:44.106239 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102397 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 16:41:44.106239 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102401 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 16:41:44.106239 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102405 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 16:41:44.106239 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102409 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 16:41:44.106239 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102413 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 16:41:44.106239 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102417 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 16:41:44.106239 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102422 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 16:41:44.106239 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102426 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 16:41:44.106239 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102430 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 16:41:44.106239 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102455 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 16:41:44.106239 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102460 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 16:41:44.106239 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102464 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 16:41:44.106239 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102468 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 16:41:44.106239 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102471 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 16:41:44.106239 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102476 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 16:41:44.106239 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102484 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 16:41:44.106239 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102490 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 16:41:44.106239 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102495 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 16:41:44.106750 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102501 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 16:41:44.106750 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102505 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 16:41:44.106750 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102509 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 16:41:44.106750 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102514 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 16:41:44.106750 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102518 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 16:41:44.106750 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102522 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 16:41:44.106750 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102526 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 16:41:44.106750 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102530 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 16:41:44.106750 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102534 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 16:41:44.106750 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102539 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 16:41:44.106750 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102544 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 16:41:44.106750 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102548 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 16:41:44.106750 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102552 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 16:41:44.106750 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102556 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 16:41:44.106750 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102559 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 16:41:44.106750 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102564 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 16:41:44.106750 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102568 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 16:41:44.106750 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102572 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 16:41:44.106750 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102576 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 16:41:44.107242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102580 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 16:41:44.107242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102584 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 16:41:44.107242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102588 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 16:41:44.107242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102592 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 16:41:44.107242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102597 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 16:41:44.107242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102601 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 16:41:44.107242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102605 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 16:41:44.107242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102609 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 16:41:44.107242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102615 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 16:41:44.107242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102621 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 16:41:44.107242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102626 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 16:41:44.107242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102630 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 16:41:44.107242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102635 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 16:41:44.107242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102639 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 16:41:44.107242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102643 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 16:41:44.107242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102647 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 16:41:44.107242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102651 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 16:41:44.107242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.102655 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 16:41:44.107242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103300 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 16:41:44.107242 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103311 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 16:41:44.107940 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103317 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 16:41:44.107940 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103323 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 16:41:44.107940 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103328 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 16:41:44.107940 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103333 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 16:41:44.107940 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103337 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 16:41:44.107940 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103342 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 16:41:44.107940 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103346 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 16:41:44.107940 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103350 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 16:41:44.107940 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103354 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 16:41:44.107940 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103358 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 16:41:44.107940 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103362 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 16:41:44.107940 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103366 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 16:41:44.107940 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103370 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 16:41:44.107940 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103375 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 16:41:44.107940 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103380 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 16:41:44.107940 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103384 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 16:41:44.107940 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103389 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 16:41:44.107940 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103393 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 16:41:44.107940 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103397 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 16:41:44.107940 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103401 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 16:41:44.108459 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103405 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 16:41:44.108459 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103409 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 16:41:44.108459 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103413 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 16:41:44.108459 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103417 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 16:41:44.108459 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103421 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 16:41:44.108459 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103426 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 16:41:44.108459 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103430 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 16:41:44.108459 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103451 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 16:41:44.108459 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103459 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 16:41:44.108459 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103464 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 16:41:44.108459 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103469 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 16:41:44.108459 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103474 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 16:41:44.108459 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103480 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 16:41:44.108459 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103485 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 16:41:44.108459 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103489 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 16:41:44.108459 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103493 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 16:41:44.108459 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103498 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 16:41:44.108459 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103502 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 16:41:44.108459 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103506 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 16:41:44.108459 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103510 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 16:41:44.108929 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103514 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 16:41:44.108929 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103518 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 16:41:44.108929 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103522 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 16:41:44.108929 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103526 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 16:41:44.108929 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103531 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 16:41:44.108929 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103534 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 16:41:44.108929 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103538 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 16:41:44.108929 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103543 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 16:41:44.108929 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103547 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 16:41:44.108929 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103552 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 16:41:44.108929 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103555 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 16:41:44.108929 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103559 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 16:41:44.108929 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103563 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 16:41:44.108929 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103568 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 16:41:44.108929 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103572 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 16:41:44.108929 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103576 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 16:41:44.108929 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103580 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 16:41:44.108929 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103586 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 16:41:44.108929 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103591 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 16:41:44.109483 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103595 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 16:41:44.109483 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103600 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 16:41:44.109483 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103604 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 16:41:44.109483 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103607 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 16:41:44.109483 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103611 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 16:41:44.109483 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103615 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 16:41:44.109483 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103619 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 16:41:44.109483 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103623 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 16:41:44.109483 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103627 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 16:41:44.109483 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103631 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 16:41:44.109483 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103635 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 16:41:44.109483 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103639 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 16:41:44.109483 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103643 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 16:41:44.109483 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103647 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 16:41:44.109483 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103651 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 16:41:44.109483 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103655 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 16:41:44.109483 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103660 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 16:41:44.109483 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103664 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 16:41:44.109483 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103668 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 16:41:44.109963 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103672 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 16:41:44.109963 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103676 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 16:41:44.109963 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103681 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 16:41:44.109963 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103685 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 16:41:44.109963 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103689 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 16:41:44.109963 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103693 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 16:41:44.109963 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103697 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 16:41:44.109963 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103704 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 16:41:44.109963 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103708 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 16:41:44.109963 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103712 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 16:41:44.109963 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103716 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 16:41:44.109963 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103720 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 16:41:44.109963 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103724 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 16:41:44.109963 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103728 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 16:41:44.109963 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103732 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 16:41:44.109963 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103736 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 16:41:44.109963 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103741 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 16:41:44.109963 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103745 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 16:41:44.109963 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.103749 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 17 16:41:44.109963 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.103847 2574 flags.go:64] FLAG: --address="0.0.0.0" Sep 17 16:41:44.110418 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.103895 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 17 16:41:44.110418 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.103904 2574 flags.go:64] FLAG: --anonymous-auth="true" Sep 17 16:41:44.110418 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.103911 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 17 16:41:44.110418 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.103918 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 17 16:41:44.110418 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.103923 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 17 16:41:44.110418 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.103929 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 17 16:41:44.110418 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.103935 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 17 16:41:44.110418 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.103940 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 17 16:41:44.110418 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.103944 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 17 16:41:44.110418 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.103950 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 17 16:41:44.110418 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.103956 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 17 16:41:44.110418 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.103961 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 17 16:41:44.110418 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.103966 2574 flags.go:64] FLAG: --cgroup-root="" Sep 17 16:41:44.110418 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.103970 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 17 16:41:44.110418 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.103975 2574 flags.go:64] FLAG: --client-ca-file="" Sep 17 16:41:44.110418 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.103981 2574 flags.go:64] FLAG: --cloud-provider="external" Sep 17 16:41:44.110418 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.103985 2574 flags.go:64] FLAG: --cluster-dns="[]" Sep 17 16:41:44.110418 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104004 2574 flags.go:64] FLAG: --cluster-domain="" Sep 17 16:41:44.110418 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104008 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 17 16:41:44.110418 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104013 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 17 16:41:44.110418 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104018 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 17 16:41:44.110418 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104023 2574 flags.go:64] FLAG: --container-log-max-files="5" Sep 17 16:41:44.110418 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104029 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 17 16:41:44.110418 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104034 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 17 16:41:44.111021 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104039 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 17 16:41:44.111021 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104044 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 17 16:41:44.111021 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104049 2574 flags.go:64] FLAG: --contention-profiling="false" Sep 17 16:41:44.111021 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104054 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 17 16:41:44.111021 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104058 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 17 16:41:44.111021 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104063 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 17 16:41:44.111021 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104067 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 17 16:41:44.111021 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104073 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 17 16:41:44.111021 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104077 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 17 16:41:44.111021 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104081 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 17 16:41:44.111021 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104086 2574 flags.go:64] FLAG: --enable-load-reader="false" Sep 17 16:41:44.111021 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104091 2574 flags.go:64] FLAG: --enable-server="true" Sep 17 16:41:44.111021 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104095 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 17 16:41:44.111021 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104101 2574 flags.go:64] FLAG: --event-burst="100" Sep 17 16:41:44.111021 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104105 2574 flags.go:64] FLAG: --event-qps="50" Sep 17 16:41:44.111021 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104109 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 17 16:41:44.111021 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104114 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 17 16:41:44.111021 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104120 2574 flags.go:64] FLAG: --eviction-hard="" Sep 17 16:41:44.111021 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104126 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 17 16:41:44.111021 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104130 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 17 16:41:44.111021 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104134 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 17 16:41:44.111021 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104139 2574 flags.go:64] FLAG: --eviction-soft="" Sep 17 16:41:44.111021 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104143 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 17 16:41:44.111021 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104147 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 17 16:41:44.111021 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104153 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 17 16:41:44.111704 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104177 2574 flags.go:64] FLAG: --experimental-mounter-path="" Sep 17 16:41:44.111704 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104182 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 17 16:41:44.111704 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104188 2574 flags.go:64] FLAG: --fail-swap-on="true" Sep 17 16:41:44.111704 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104193 2574 flags.go:64] FLAG: --feature-gates="" Sep 17 16:41:44.111704 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104198 2574 flags.go:64] FLAG: --file-check-frequency="20s" Sep 17 16:41:44.111704 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104204 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 17 16:41:44.111704 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104208 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 17 16:41:44.111704 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104213 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 17 16:41:44.111704 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104218 2574 flags.go:64] FLAG: --healthz-port="10248" Sep 17 16:41:44.111704 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104222 2574 flags.go:64] FLAG: --help="false" Sep 17 16:41:44.111704 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104227 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-142-146.ec2.internal" Sep 17 16:41:44.111704 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104232 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 17 16:41:44.111704 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104237 2574 flags.go:64] FLAG: --http-check-frequency="20s" Sep 17 16:41:44.111704 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104242 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 17 16:41:44.111704 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104247 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 17 16:41:44.111704 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104253 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 17 16:41:44.111704 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104257 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 17 16:41:44.111704 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104262 2574 flags.go:64] FLAG: --image-service-endpoint="" Sep 17 16:41:44.111704 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104266 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 17 16:41:44.111704 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104270 2574 flags.go:64] FLAG: --kube-api-burst="100" Sep 17 16:41:44.111704 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104275 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 17 16:41:44.111704 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104280 2574 flags.go:64] FLAG: --kube-api-qps="50" Sep 17 16:41:44.111704 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104284 2574 flags.go:64] FLAG: --kube-reserved="" Sep 17 16:41:44.111704 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104289 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 17 16:41:44.112351 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104295 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 17 16:41:44.112351 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104300 2574 flags.go:64] FLAG: --kubelet-cgroups="" Sep 17 16:41:44.112351 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104304 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 17 16:41:44.112351 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104308 2574 flags.go:64] FLAG: --lock-file="" Sep 17 16:41:44.112351 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104313 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 17 16:41:44.112351 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104317 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 17 16:41:44.112351 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104322 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 17 16:41:44.112351 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104330 2574 flags.go:64] FLAG: --log-json-split-stream="false" Sep 17 16:41:44.112351 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104335 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 17 16:41:44.112351 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104340 2574 flags.go:64] FLAG: --log-text-split-stream="false" Sep 17 16:41:44.112351 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104344 2574 flags.go:64] FLAG: --logging-format="text" Sep 17 16:41:44.112351 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104348 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 17 16:41:44.112351 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104353 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 17 16:41:44.112351 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104358 2574 flags.go:64] FLAG: --manifest-url="" Sep 17 16:41:44.112351 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104362 2574 flags.go:64] FLAG: --manifest-url-header="" Sep 17 16:41:44.112351 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104368 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 17 16:41:44.112351 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104373 2574 flags.go:64] FLAG: --max-open-files="1000000" Sep 17 16:41:44.112351 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104379 2574 flags.go:64] FLAG: --max-pods="110" Sep 17 16:41:44.112351 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104383 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 17 16:41:44.112351 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104388 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 17 16:41:44.112351 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104392 2574 flags.go:64] FLAG: --memory-manager-policy="None" Sep 17 16:41:44.112351 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104397 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 17 16:41:44.112351 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104401 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 17 16:41:44.112351 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104406 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 17 16:41:44.112351 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104410 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 17 16:41:44.113012 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104421 2574 flags.go:64] FLAG: --node-status-max-images="50" Sep 17 16:41:44.113012 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104425 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 17 16:41:44.113012 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104429 2574 flags.go:64] FLAG: --oom-score-adj="-999" Sep 17 16:41:44.113012 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104454 2574 flags.go:64] FLAG: --pod-cidr="" Sep 17 16:41:44.113012 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104458 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 17 16:41:44.113012 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104466 2574 flags.go:64] FLAG: --pod-manifest-path="" Sep 17 16:41:44.113012 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104470 2574 flags.go:64] FLAG: --pod-max-pids="-1" Sep 17 16:41:44.113012 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104475 2574 flags.go:64] FLAG: --pods-per-core="0" Sep 17 16:41:44.113012 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104481 2574 flags.go:64] FLAG: --port="10250" Sep 17 16:41:44.113012 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104487 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 17 16:41:44.113012 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104492 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0132b27150b5d6030" Sep 17 16:41:44.113012 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104497 2574 flags.go:64] FLAG: --qos-reserved="" Sep 17 16:41:44.113012 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104501 2574 flags.go:64] FLAG: --read-only-port="10255" Sep 17 16:41:44.113012 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104506 2574 flags.go:64] FLAG: --register-node="true" Sep 17 16:41:44.113012 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104510 2574 flags.go:64] FLAG: --register-with-taints="" Sep 17 16:41:44.113012 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104516 2574 flags.go:64] FLAG: --registry-burst="10" Sep 17 16:41:44.113012 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104521 2574 flags.go:64] FLAG: --registry-qps="5" Sep 17 16:41:44.113012 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104526 2574 flags.go:64] FLAG: --reserved-cpus="" Sep 17 16:41:44.113012 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104530 2574 flags.go:64] FLAG: --reserved-memory="" Sep 17 16:41:44.113012 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104536 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 17 16:41:44.113012 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104540 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 17 16:41:44.113012 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104545 2574 flags.go:64] FLAG: --rotate-certificates="false" Sep 17 16:41:44.113012 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104549 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 17 16:41:44.113012 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104553 2574 flags.go:64] FLAG: --runonce="false" Sep 17 16:41:44.113012 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104558 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 17 16:41:44.113915 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104562 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 17 16:41:44.113915 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104567 2574 flags.go:64] FLAG: --seccomp-default="false" Sep 17 16:41:44.113915 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104572 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 17 16:41:44.113915 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104576 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 17 16:41:44.113915 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104580 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 17 16:41:44.113915 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104584 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 17 16:41:44.113915 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104589 2574 flags.go:64] FLAG: --storage-driver-password="root" Sep 17 16:41:44.113915 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104593 2574 flags.go:64] FLAG: --storage-driver-secure="false" Sep 17 16:41:44.113915 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104598 2574 flags.go:64] FLAG: --storage-driver-table="stats" Sep 17 16:41:44.113915 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104602 2574 flags.go:64] FLAG: --storage-driver-user="root" Sep 17 16:41:44.113915 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104606 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 17 16:41:44.113915 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104611 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 17 16:41:44.113915 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104615 2574 flags.go:64] FLAG: --system-cgroups="" Sep 17 16:41:44.113915 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104619 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 17 16:41:44.113915 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104628 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 17 16:41:44.113915 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104633 2574 flags.go:64] FLAG: --tls-cert-file="" Sep 17 16:41:44.113915 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104639 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 17 16:41:44.113915 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104646 2574 flags.go:64] FLAG: --tls-min-version="" Sep 17 16:41:44.113915 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104650 2574 flags.go:64] FLAG: --tls-private-key-file="" Sep 17 16:41:44.113915 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104655 2574 flags.go:64] FLAG: --topology-manager-policy="none" Sep 17 16:41:44.113915 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104659 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 17 16:41:44.113915 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104663 2574 flags.go:64] FLAG: --topology-manager-scope="container" Sep 17 16:41:44.113915 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104668 2574 flags.go:64] FLAG: --v="2" Sep 17 16:41:44.113915 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104674 2574 flags.go:64] FLAG: --version="false" Sep 17 16:41:44.113915 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104680 2574 flags.go:64] FLAG: --vmodule="" Sep 17 16:41:44.114534 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104686 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 17 16:41:44.114534 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.104691 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 17 16:41:44.114534 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104855 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 16:41:44.114534 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104863 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 16:41:44.114534 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104868 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 16:41:44.114534 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104873 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 16:41:44.114534 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104877 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 16:41:44.114534 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104882 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 16:41:44.114534 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104886 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 16:41:44.114534 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104891 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 16:41:44.114534 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104895 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 16:41:44.114534 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104899 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 16:41:44.114534 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104903 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 16:41:44.114534 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104907 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 16:41:44.114534 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104911 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 16:41:44.114534 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104915 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 16:41:44.114534 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104919 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 16:41:44.114534 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104922 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 16:41:44.114534 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104926 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 16:41:44.115029 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104930 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 16:41:44.115029 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104934 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 16:41:44.115029 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104939 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 16:41:44.115029 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104944 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 16:41:44.115029 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104950 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 16:41:44.115029 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104954 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 16:41:44.115029 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104960 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 16:41:44.115029 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104966 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 16:41:44.115029 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104970 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 16:41:44.115029 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104974 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 16:41:44.115029 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104979 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 16:41:44.115029 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104983 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 16:41:44.115029 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104987 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 16:41:44.115029 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104992 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 16:41:44.115029 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.104997 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 16:41:44.115029 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105001 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 16:41:44.115029 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105006 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 16:41:44.115029 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105010 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 16:41:44.115029 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105015 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 16:41:44.115513 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105019 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 16:41:44.115513 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105023 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 16:41:44.115513 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105027 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 16:41:44.115513 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105031 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 16:41:44.115513 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105035 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 16:41:44.115513 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105039 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 16:41:44.115513 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105043 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 16:41:44.115513 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105049 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 16:41:44.115513 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105053 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 16:41:44.115513 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105057 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 16:41:44.115513 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105061 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 16:41:44.115513 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105065 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 16:41:44.115513 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105069 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 16:41:44.115513 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105073 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 16:41:44.115513 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105077 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 16:41:44.115513 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105080 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 16:41:44.115513 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105087 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 16:41:44.115513 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105093 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 17 16:41:44.115513 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105097 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 16:41:44.115513 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105100 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 16:41:44.116003 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105104 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 16:41:44.116003 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105108 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 16:41:44.116003 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105112 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 16:41:44.116003 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105116 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 16:41:44.116003 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105120 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 16:41:44.116003 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105123 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 16:41:44.116003 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105127 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 16:41:44.116003 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105132 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 16:41:44.116003 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105136 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 16:41:44.116003 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105140 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 16:41:44.116003 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105144 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 16:41:44.116003 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105148 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 16:41:44.116003 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105152 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 16:41:44.116003 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105156 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 16:41:44.116003 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105160 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 16:41:44.116003 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105164 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 16:41:44.116003 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105168 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 16:41:44.116003 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105172 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 16:41:44.116003 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105176 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 16:41:44.116003 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105180 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 16:41:44.116496 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105184 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 16:41:44.116496 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105188 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 16:41:44.116496 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105192 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 16:41:44.116496 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105196 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 16:41:44.116496 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105200 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 16:41:44.116496 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105203 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 16:41:44.116496 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105207 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 16:41:44.116496 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105213 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 16:41:44.116496 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105218 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 16:41:44.116496 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105224 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 16:41:44.116496 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105228 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 16:41:44.116496 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105231 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 16:41:44.116496 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105235 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 16:41:44.116496 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105238 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 16:41:44.116496 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105243 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 16:41:44.116496 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105247 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 16:41:44.116496 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105250 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 16:41:44.116496 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105254 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 16:41:44.116496 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105259 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 16:41:44.116496 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105263 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 16:41:44.116962 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105267 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 16:41:44.116962 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105271 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 16:41:44.116962 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.105275 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 16:41:44.116962 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.105993 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 16:41:44.116962 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.115388 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 17 16:41:44.116962 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.115403 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 17 16:41:44.116962 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.115420 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 17 16:41:44.116962 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.115426 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 17 16:41:44.116962 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115497 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 16:41:44.116962 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115502 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 16:41:44.116962 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115505 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 16:41:44.116962 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115508 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 16:41:44.116962 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115511 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 16:41:44.116962 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115515 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 16:41:44.116962 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115518 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 16:41:44.117333 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115521 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 16:41:44.117333 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115523 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 16:41:44.117333 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115526 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 16:41:44.117333 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115529 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 16:41:44.117333 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115532 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 16:41:44.117333 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115536 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 16:41:44.117333 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115540 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 16:41:44.117333 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115543 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 16:41:44.117333 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115547 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 16:41:44.117333 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115550 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 16:41:44.117333 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115553 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 16:41:44.117333 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115556 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 16:41:44.117333 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115559 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 17 16:41:44.117333 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115562 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 16:41:44.117333 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115564 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 16:41:44.117333 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115567 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 16:41:44.117333 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115569 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 16:41:44.117333 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115572 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 16:41:44.117333 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115575 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 16:41:44.117333 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115578 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 16:41:44.117822 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115580 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 16:41:44.117822 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115583 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 16:41:44.117822 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115587 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 16:41:44.117822 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115590 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 16:41:44.117822 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115592 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 16:41:44.117822 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115595 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 16:41:44.117822 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115597 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 16:41:44.117822 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115600 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 16:41:44.117822 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115602 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 16:41:44.117822 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115604 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 16:41:44.117822 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115608 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 16:41:44.117822 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115612 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 16:41:44.117822 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115614 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 16:41:44.117822 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115617 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 16:41:44.117822 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115619 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 16:41:44.117822 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115622 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 16:41:44.117822 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115624 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 16:41:44.117822 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115627 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 16:41:44.117822 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115629 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 16:41:44.118270 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115639 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 16:41:44.118270 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115641 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 16:41:44.118270 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115644 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 16:41:44.118270 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115646 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 16:41:44.118270 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115648 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 16:41:44.118270 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115651 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 16:41:44.118270 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115653 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 16:41:44.118270 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115656 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 16:41:44.118270 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115658 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 16:41:44.118270 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115661 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 16:41:44.118270 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115663 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 16:41:44.118270 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115666 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 16:41:44.118270 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115668 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 16:41:44.118270 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115671 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 16:41:44.118270 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115673 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 16:41:44.118270 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115676 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 16:41:44.118270 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115680 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 16:41:44.118270 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115683 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 16:41:44.118270 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115686 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 16:41:44.118743 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115689 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 16:41:44.118743 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115691 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 16:41:44.118743 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115694 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 16:41:44.118743 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115697 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 16:41:44.118743 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115700 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 16:41:44.118743 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115702 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 16:41:44.118743 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115705 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 16:41:44.118743 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115708 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 16:41:44.118743 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115710 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 16:41:44.118743 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115713 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 16:41:44.118743 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115715 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 16:41:44.118743 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115718 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 16:41:44.118743 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115720 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 16:41:44.118743 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115723 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 16:41:44.118743 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115730 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 16:41:44.118743 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115732 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 16:41:44.118743 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115736 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 16:41:44.118743 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115738 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 16:41:44.118743 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115741 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 16:41:44.118743 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115743 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 16:41:44.119238 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115746 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 16:41:44.119238 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115748 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 16:41:44.119238 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115751 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 16:41:44.119238 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115754 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 16:41:44.119238 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115756 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 16:41:44.119238 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115759 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 16:41:44.119238 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115761 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 16:41:44.119238 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115764 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 16:41:44.119238 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115767 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 16:41:44.119238 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115769 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 16:41:44.119238 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115772 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 16:41:44.119238 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115775 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 16:41:44.119238 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115777 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 16:41:44.119238 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115780 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 16:41:44.119238 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.115784 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 16:41:44.119631 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115902 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 16:41:44.119631 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115907 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 16:41:44.119631 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115910 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 16:41:44.119631 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115912 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 16:41:44.119631 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115915 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 16:41:44.119631 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115918 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 16:41:44.119631 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115921 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 16:41:44.119631 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115923 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 16:41:44.119631 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115925 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 16:41:44.119631 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115928 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 17 16:41:44.119631 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115931 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 16:41:44.119631 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115933 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 16:41:44.119631 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115938 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 16:41:44.119631 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115941 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 16:41:44.119631 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115943 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 16:41:44.119631 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115946 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 16:41:44.119631 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115948 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 16:41:44.119631 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115951 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 16:41:44.119631 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115953 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 16:41:44.119631 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115956 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 16:41:44.120156 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115958 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 16:41:44.120156 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115961 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 16:41:44.120156 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115965 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 16:41:44.120156 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115969 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 16:41:44.120156 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115972 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 16:41:44.120156 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115975 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 16:41:44.120156 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115978 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 16:41:44.120156 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115980 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 16:41:44.120156 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115983 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 16:41:44.120156 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.115985 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 16:41:44.120156 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116001 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 16:41:44.120156 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116004 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 16:41:44.120156 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116006 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 16:41:44.120156 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116009 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 16:41:44.120156 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116011 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 16:41:44.120156 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116014 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 16:41:44.120156 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116016 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 16:41:44.120156 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116019 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 16:41:44.120156 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116021 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 16:41:44.120613 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116024 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 16:41:44.120613 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116026 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 16:41:44.120613 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116028 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 16:41:44.120613 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116031 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 16:41:44.120613 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116033 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 16:41:44.120613 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116035 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 16:41:44.120613 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116039 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 16:41:44.120613 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116041 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 16:41:44.120613 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116044 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 16:41:44.120613 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116047 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 16:41:44.120613 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116049 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 16:41:44.120613 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116052 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 16:41:44.120613 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116054 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 16:41:44.120613 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116056 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 16:41:44.120613 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116059 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 16:41:44.120613 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116061 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 16:41:44.120613 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116064 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 16:41:44.120613 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116067 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 16:41:44.120613 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116069 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 16:41:44.120613 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116072 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 16:41:44.120613 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116074 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 16:41:44.121118 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116076 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 16:41:44.121118 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116079 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 16:41:44.121118 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116081 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 16:41:44.121118 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116083 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 16:41:44.121118 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116086 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 16:41:44.121118 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116088 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 16:41:44.121118 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116090 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 16:41:44.121118 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116093 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 16:41:44.121118 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116095 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 16:41:44.121118 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116097 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 16:41:44.121118 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116100 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 16:41:44.121118 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116102 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 16:41:44.121118 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116104 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 16:41:44.121118 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116107 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 16:41:44.121118 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116109 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 16:41:44.121118 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116111 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 16:41:44.121118 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116115 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 16:41:44.121118 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116117 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 16:41:44.121118 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116121 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 16:41:44.121583 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116123 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 16:41:44.121583 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116125 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 16:41:44.121583 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116128 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 16:41:44.121583 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116130 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 16:41:44.121583 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116133 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 16:41:44.121583 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116135 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 16:41:44.121583 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116139 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 16:41:44.121583 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116142 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 16:41:44.121583 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116144 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 16:41:44.121583 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116147 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 16:41:44.121583 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116150 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 16:41:44.121583 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116152 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 16:41:44.121583 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116155 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 16:41:44.121583 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116158 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 16:41:44.121583 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116161 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 16:41:44.121583 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116163 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 16:41:44.121583 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116165 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 16:41:44.121583 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116168 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 16:41:44.121583 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116170 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 16:41:44.122025 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:44.116172 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 16:41:44.122025 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.116177 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 16:41:44.122025 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.116277 2574 server.go:962] "Client rotation is on, will bootstrap in background" Sep 17 16:41:44.122025 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.118624 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 17 16:41:44.122025 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.119664 2574 server.go:1019] "Starting client certificate rotation" Sep 17 16:41:44.122025 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.119761 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 16:41:44.122025 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.120537 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 16:41:44.122604 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.122590 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 16:41:44.128220 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.128204 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 16:41:44.139382 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.139360 2574 log.go:25] "Validated CRI v1 runtime API" Sep 17 16:41:44.141237 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.141223 2574 log.go:25] "Validated CRI v1 image API" Sep 17 16:41:44.142010 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.141997 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 17 16:41:44.145346 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.145327 2574 fs.go:135] Filesystem UUIDs: map[080b46d1-caf2-4cc5-8114-9d5d7a8dee36:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f5f06630-70fe-45b8-a928-5ccb04a90442:/dev/nvme0n1p4] Sep 17 16:41:44.145425 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.145346 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:30 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 17 16:41:44.152174 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.152052 2574 manager.go:216] Machine: {Timestamp:2026-09-17 16:41:44.150729513 +0000 UTC m=+0.346723652 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3116483 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a59688dddf5d7deaf42f2693a4b44 SystemUUID:ec2a5968-8ddd-f5d7-deaf-42f2693a4b44 BootID:9afc9f10-be08-4c9d-9792-f5baba0feb6e Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:30 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e4:e6:c5:4b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e4:e6:c5:4b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1e:af:f9:50:d2:5a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 17 16:41:44.152174 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.152167 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 17 16:41:44.152321 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.152244 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 17 16:41:44.152501 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.152483 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 16:41:44.153419 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.153394 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 17 16:41:44.153559 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.153421 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-146.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 17 16:41:44.154314 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.154304 2574 topology_manager.go:138] "Creating topology manager with none policy" Sep 17 16:41:44.154343 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.154318 2574 container_manager_linux.go:309] "Creating device plugin manager" Sep 17 16:41:44.154343 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.154325 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 16:41:44.155207 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.155196 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 16:41:44.157074 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.157064 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 17 16:41:44.161535 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.161523 2574 state_mem.go:36] "Initialized new in-memory state store" Sep 17 16:41:44.161644 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.161634 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 17 16:41:44.161674 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.161664 2574 kubelet.go:486] "Attempting to sync node with API server" Sep 17 16:41:44.161674 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.161673 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 17 16:41:44.161730 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.161686 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 17 16:41:44.161730 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.161698 2574 kubelet.go:398] "Adding apiserver pod source" Sep 17 16:41:44.161730 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.161709 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 17 16:41:44.162016 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.162005 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 16:41:44.162070 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.162021 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 16:41:44.164308 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.164293 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 17 16:41:44.167718 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.167704 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 17 16:41:44.167781 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.167734 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 17 16:41:44.169077 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.169066 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 17 16:41:44.169125 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.169081 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 17 16:41:44.169125 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.169087 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 17 16:41:44.169125 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.169092 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 17 16:41:44.169125 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.169101 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 17 16:41:44.169125 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.169106 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 17 16:41:44.169125 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.169120 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 17 16:41:44.169125 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.169124 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 17 16:41:44.169308 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.169130 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 17 16:41:44.169308 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.169135 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 17 16:41:44.169308 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.169147 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 17 16:41:44.169308 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.169152 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 17 16:41:44.169998 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.169988 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 17 16:41:44.169998 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.169997 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 17 16:41:44.173808 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.173789 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-146.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 17 16:41:44.173877 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:44.173838 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-146.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 17 16:41:44.173877 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.173855 2574 server.go:1268] "Started kubelet" Sep 17 16:41:44.173986 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:44.173888 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 17 16:41:44.173986 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.173903 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 17 16:41:44.173986 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.173930 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 17 16:41:44.173986 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.173986 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 17 16:41:44.174663 ip-10-0-142-146 systemd[1]: Started Kubernetes Kubelet. Sep 17 16:41:44.175699 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.175681 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 17 16:41:44.176633 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.176614 2574 server.go:310] "Adding debug handlers to kubelet server" Sep 17 16:41:44.180736 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:44.179633 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-146.ec2.internal.18d6294b08d54afc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-146.ec2.internal,UID:ip-10-0-142-146.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-146.ec2.internal,},FirstTimestamp:2026-09-17 16:41:44.173832956 +0000 UTC m=+0.369827094,LastTimestamp:2026-09-17 16:41:44.173832956 +0000 UTC m=+0.369827094,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-146.ec2.internal,}" Sep 17 16:41:44.181478 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:44.181451 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 17 16:41:44.184891 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.184871 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 17 16:41:44.185648 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.185571 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 17 16:41:44.185795 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:44.185772 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-146.ec2.internal\" not found" Sep 17 16:41:44.186344 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.186329 2574 factory.go:55] Registering systemd factory Sep 17 16:41:44.186344 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.186346 2574 factory.go:223] Registration of the systemd container factory successfully Sep 17 16:41:44.186504 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.186406 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 17 16:41:44.186504 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.186416 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 17 16:41:44.186597 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.186507 2574 reconstruct.go:97] "Volume reconstruction finished" Sep 17 16:41:44.186597 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.186514 2574 reconciler.go:29] "Reconciler: start to sync state" Sep 17 16:41:44.186597 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.186539 2574 factory.go:153] Registering CRI-O factory Sep 17 16:41:44.186597 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.186549 2574 factory.go:223] Registration of the crio container factory successfully Sep 17 16:41:44.186597 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.186587 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 17 16:41:44.186747 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.186602 2574 factory.go:103] Registering Raw factory Sep 17 16:41:44.186747 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.186616 2574 manager.go:1196] Started watching for new ooms in manager Sep 17 16:41:44.186747 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.186536 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 17 16:41:44.186971 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.186958 2574 manager.go:349] Starting recovery of all containers Sep 17 16:41:44.189562 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:44.189528 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-146.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 17 16:41:44.189655 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:44.189635 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 17 16:41:44.199274 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.199259 2574 manager.go:354] Recovery completed Sep 17 16:41:44.203487 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.203473 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 16:41:44.205665 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.205650 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasSufficientMemory" Sep 17 16:41:44.205763 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.205681 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 16:41:44.205763 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.205697 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasSufficientPID" Sep 17 16:41:44.206221 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.206205 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 17 16:41:44.206283 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.206221 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 17 16:41:44.206283 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.206236 2574 state_mem.go:36] "Initialized new in-memory state store" Sep 17 16:41:44.206364 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.206212 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 16:41:44.206984 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.206968 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasSufficientMemory" Sep 17 16:41:44.207053 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.206995 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 16:41:44.207053 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.207007 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasSufficientPID" Sep 17 16:41:44.208112 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:44.208034 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-146.ec2.internal.18d6294b0abb06c1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-146.ec2.internal,UID:ip-10-0-142-146.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-146.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-146.ec2.internal,},FirstTimestamp:2026-09-17 16:41:44.205665985 +0000 UTC m=+0.401660128,LastTimestamp:2026-09-17 16:41:44.205665985 +0000 UTC m=+0.401660128,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-146.ec2.internal,}" Sep 17 16:41:44.208470 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.208457 2574 policy_none.go:49] "None policy: Start" Sep 17 16:41:44.208538 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.208476 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 17 16:41:44.208538 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.208489 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 17 16:41:44.209860 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.209844 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-prdzs" Sep 17 16:41:44.210414 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.210391 2574 policy_none.go:47] "Start" Sep 17 16:41:44.217468 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:44.217390 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-146.ec2.internal.18d6294b0abb5f89 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-146.ec2.internal,UID:ip-10-0-142-146.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-146.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-146.ec2.internal,},FirstTimestamp:2026-09-17 16:41:44.205688713 +0000 UTC m=+0.401682853,LastTimestamp:2026-09-17 16:41:44.205688713 +0000 UTC m=+0.401682853,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-146.ec2.internal,}" Sep 17 16:41:44.218379 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.218365 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-prdzs" Sep 17 16:41:44.249196 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.249182 2574 manager.go:337] "Starting Device Plugin manager" Sep 17 16:41:44.270415 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:44.249214 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 17 16:41:44.270415 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.249223 2574 server.go:87] "Starting device plugin registration server" Sep 17 16:41:44.270415 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.249459 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 17 16:41:44.270415 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.249474 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 17 16:41:44.270415 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.249563 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 17 16:41:44.270415 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.249645 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 17 16:41:44.270415 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.249656 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 17 16:41:44.270415 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:44.250093 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 17 16:41:44.270415 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:44.250138 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-146.ec2.internal\" not found" Sep 17 16:41:44.320480 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.320428 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 17 16:41:44.321753 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.321727 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 17 16:41:44.321862 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.321784 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 17 16:41:44.321862 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.321807 2574 kubelet.go:2448] "Starting kubelet main sync loop" Sep 17 16:41:44.321945 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:44.321898 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 17 16:41:44.324382 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.324366 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 16:41:44.350453 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.350387 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 16:41:44.351317 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.351302 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasSufficientMemory" Sep 17 16:41:44.351371 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.351332 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 16:41:44.351371 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.351342 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasSufficientPID" Sep 17 16:41:44.351371 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.351366 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-146.ec2.internal" Sep 17 16:41:44.366054 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.366041 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-146.ec2.internal" Sep 17 16:41:44.366114 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:44.366061 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-146.ec2.internal\": node \"ip-10-0-142-146.ec2.internal\" not found" Sep 17 16:41:44.422595 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.422564 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-146.ec2.internal"] Sep 17 16:41:44.422699 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.422642 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 16:41:44.424074 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.424058 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasSufficientMemory" Sep 17 16:41:44.424147 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.424089 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 16:41:44.424147 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.424099 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasSufficientPID" Sep 17 16:41:44.426349 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.426337 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 16:41:44.426485 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.426470 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal" Sep 17 16:41:44.426525 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.426504 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 16:41:44.427113 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.427098 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasSufficientMemory" Sep 17 16:41:44.427178 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.427123 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 16:41:44.427178 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.427126 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasSufficientMemory" Sep 17 16:41:44.427178 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.427151 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 16:41:44.427178 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.427163 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasSufficientPID" Sep 17 16:41:44.427293 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.427134 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasSufficientPID" Sep 17 16:41:44.429423 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.429410 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-146.ec2.internal" Sep 17 16:41:44.429474 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.429450 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 16:41:44.430114 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.430100 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasSufficientMemory" Sep 17 16:41:44.430180 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.430130 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 16:41:44.430180 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.430146 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeHasSufficientPID" Sep 17 16:41:44.449456 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:44.449422 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-146.ec2.internal\" not found" node="ip-10-0-142-146.ec2.internal" Sep 17 16:41:44.465878 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:44.465588 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-146.ec2.internal\" not found" node="ip-10-0-142-146.ec2.internal" Sep 17 16:41:44.472106 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:44.472089 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-146.ec2.internal\" not found" Sep 17 16:41:44.572823 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:44.572797 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-146.ec2.internal\" not found" Sep 17 16:41:44.587300 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.587279 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fdf5e3af8557b9fa01d00337bee43c12-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal\" (UID: \"fdf5e3af8557b9fa01d00337bee43c12\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal" Sep 17 16:41:44.587366 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.587304 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fdf5e3af8557b9fa01d00337bee43c12-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal\" (UID: \"fdf5e3af8557b9fa01d00337bee43c12\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal" Sep 17 16:41:44.587366 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.587320 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d0d4a61112593ffdf8087d8d186a27c8-config\") pod \"kube-apiserver-proxy-ip-10-0-142-146.ec2.internal\" (UID: \"d0d4a61112593ffdf8087d8d186a27c8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-146.ec2.internal" Sep 17 16:41:44.672925 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:44.672866 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-146.ec2.internal\" not found" Sep 17 16:41:44.687519 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.687493 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fdf5e3af8557b9fa01d00337bee43c12-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal\" (UID: \"fdf5e3af8557b9fa01d00337bee43c12\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal" Sep 17 16:41:44.687608 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.687536 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fdf5e3af8557b9fa01d00337bee43c12-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal\" (UID: \"fdf5e3af8557b9fa01d00337bee43c12\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal" Sep 17 16:41:44.687608 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.687568 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fdf5e3af8557b9fa01d00337bee43c12-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal\" (UID: \"fdf5e3af8557b9fa01d00337bee43c12\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal" Sep 17 16:41:44.687608 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.687585 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d0d4a61112593ffdf8087d8d186a27c8-config\") pod \"kube-apiserver-proxy-ip-10-0-142-146.ec2.internal\" (UID: \"d0d4a61112593ffdf8087d8d186a27c8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-146.ec2.internal" Sep 17 16:41:44.687717 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.687616 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d0d4a61112593ffdf8087d8d186a27c8-config\") pod \"kube-apiserver-proxy-ip-10-0-142-146.ec2.internal\" (UID: \"d0d4a61112593ffdf8087d8d186a27c8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-146.ec2.internal" Sep 17 16:41:44.687717 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.687644 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fdf5e3af8557b9fa01d00337bee43c12-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal\" (UID: \"fdf5e3af8557b9fa01d00337bee43c12\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal" Sep 17 16:41:44.753585 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.753568 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal" Sep 17 16:41:44.769733 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:44.769714 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-146.ec2.internal" Sep 17 16:41:44.773726 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:44.773700 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-146.ec2.internal\" not found" Sep 17 16:41:44.874308 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:44.874283 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-146.ec2.internal\" not found" Sep 17 16:41:44.974736 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:44.974721 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-146.ec2.internal\" not found" Sep 17 16:41:45.070767 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:45.070747 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 16:41:45.075095 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:45.075079 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-146.ec2.internal\" not found" Sep 17 16:41:45.119588 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:45.119570 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 17 16:41:45.120202 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:45.119674 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 16:41:45.120202 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:45.119719 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 16:41:45.175871 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:45.175712 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-146.ec2.internal\" not found" Sep 17 16:41:45.218654 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:45.218636 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 16:41:45.224787 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:45.224741 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 16:36:44 +0000 UTC" deadline="2028-04-10 16:36:46.820948805 +0000 UTC" Sep 17 16:41:45.224787 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:45.224765 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13703h55m1.596186917s" Sep 17 16:41:45.286653 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:45.286623 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal" Sep 17 16:41:45.300732 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:45.300713 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 16:41:45.302403 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:45.302383 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-146.ec2.internal" Sep 17 16:41:45.311248 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:45.311166 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 16:41:45.400570 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:45.400548 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 16:41:45.428635 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:45.428606 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0d4a61112593ffdf8087d8d186a27c8.slice/crio-16568192ed73f1611e30489ca44e6ea4690ca998860eef817f68de99eb5ccf37 WatchSource:0}: Error finding container 16568192ed73f1611e30489ca44e6ea4690ca998860eef817f68de99eb5ccf37: Status 404 returned error can't find the container with id 16568192ed73f1611e30489ca44e6ea4690ca998860eef817f68de99eb5ccf37 Sep 17 16:41:45.429122 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:45.429101 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdf5e3af8557b9fa01d00337bee43c12.slice/crio-6a6de00f6ff9e6539e46948c1c87e401706ec375836e6a47a0bb7ee539139943 WatchSource:0}: Error finding container 6a6de00f6ff9e6539e46948c1c87e401706ec375836e6a47a0bb7ee539139943: Status 404 returned error can't find the container with id 6a6de00f6ff9e6539e46948c1c87e401706ec375836e6a47a0bb7ee539139943 Sep 17 16:41:45.433686 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:45.433612 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 16:41:46.162222 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.162142 2574 apiserver.go:52] "Watching apiserver" Sep 17 16:41:46.172261 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.172207 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 17 16:41:46.173289 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.173255 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-rqj26","openshift-multus/network-metrics-daemon-glhzf","openshift-network-diagnostics/network-check-target-fqfbx","kube-system/konnectivity-agent-9f79b","kube-system/kube-apiserver-proxy-ip-10-0-142-146.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ck84q","openshift-dns/node-resolver-spcc4","openshift-image-registry/node-ca-7xjlf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal","openshift-network-operator/iptables-alerter-tb4rk","openshift-ovn-kubernetes/ovnkube-node-k2rxg","kube-system/global-pull-secret-syncer-99gp5","openshift-cluster-node-tuning-operator/tuned-5qmf9","openshift-multus/multus-additional-cni-plugins-cjknd"] Sep 17 16:41:46.176169 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.176145 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.179769 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.179743 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:41:46.179868 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:46.179807 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glhzf" podUID="c0f01af1-e02f-4105-8edb-33a5b8acab5c" Sep 17 16:41:46.182337 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.182313 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cjknd" Sep 17 16:41:46.184802 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.184776 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7xjlf" Sep 17 16:41:46.184901 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.184851 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 17 16:41:46.185141 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.185124 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 17 16:41:46.185371 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.184782 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 17 16:41:46.185497 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.185377 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qtpqq\"" Sep 17 16:41:46.185613 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.185592 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 17 16:41:46.186031 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.186014 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 17 16:41:46.186091 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.186068 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qjwzk\"" Sep 17 16:41:46.187103 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.187061 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 17 16:41:46.187491 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.187471 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 17 16:41:46.187984 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.187967 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 17 16:41:46.188643 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.188591 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-spcc4" Sep 17 16:41:46.191379 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.191041 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ck84q" Sep 17 16:41:46.191472 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.191450 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-k5rpc\"" Sep 17 16:41:46.191721 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.191699 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 17 16:41:46.192069 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.192047 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 17 16:41:46.192349 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.192327 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 17 16:41:46.192429 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.192353 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f4w97\"" Sep 17 16:41:46.192631 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.192610 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 17 16:41:46.193691 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.193667 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9f79b" Sep 17 16:41:46.195165 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.195143 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 17 16:41:46.195792 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.195772 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-host-run-netns\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.195884 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.195806 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-host-var-lib-cni-bin\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.195884 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.195841 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-host-var-lib-cni-multus\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.195884 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.195876 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv55f\" (UniqueName: \"kubernetes.io/projected/c0f01af1-e02f-4105-8edb-33a5b8acab5c-kube-api-access-qv55f\") pod \"network-metrics-daemon-glhzf\" (UID: \"c0f01af1-e02f-4105-8edb-33a5b8acab5c\") " pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:41:46.196025 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.195908 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/804bc511-5b2f-407e-b47f-ddd4333a6064-hosts-file\") pod \"node-resolver-spcc4\" (UID: \"804bc511-5b2f-407e-b47f-ddd4333a6064\") " pod="openshift-dns/node-resolver-spcc4" Sep 17 16:41:46.196025 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.195940 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-multus-cni-dir\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.196025 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.195965 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-cnibin\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.196025 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.195995 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-multus-socket-dir-parent\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.196216 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.196079 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85a077ee-c427-421c-930d-0deeda5fb58c-cni-binary-copy\") pod \"multus-additional-cni-plugins-cjknd\" (UID: \"85a077ee-c427-421c-930d-0deeda5fb58c\") " pod="openshift-multus/multus-additional-cni-plugins-cjknd" Sep 17 16:41:46.196216 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.196111 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9zzf\" (UniqueName: \"kubernetes.io/projected/85a077ee-c427-421c-930d-0deeda5fb58c-kube-api-access-m9zzf\") pod \"multus-additional-cni-plugins-cjknd\" (UID: \"85a077ee-c427-421c-930d-0deeda5fb58c\") " pod="openshift-multus/multus-additional-cni-plugins-cjknd" Sep 17 16:41:46.196311 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.196241 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-host-run-k8s-cni-cncf-io\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.196311 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.196274 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-host-run-multus-certs\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.196311 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.196303 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rz9d\" (UniqueName: \"kubernetes.io/projected/804bc511-5b2f-407e-b47f-ddd4333a6064-kube-api-access-5rz9d\") pod \"node-resolver-spcc4\" (UID: \"804bc511-5b2f-407e-b47f-ddd4333a6064\") " pod="openshift-dns/node-resolver-spcc4" Sep 17 16:41:46.196445 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.196333 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-system-cni-dir\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.196492 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.196363 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-host-var-lib-kubelet\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.196619 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.196534 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-multus-conf-dir\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.196619 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.196563 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85a077ee-c427-421c-930d-0deeda5fb58c-system-cni-dir\") pod \"multus-additional-cni-plugins-cjknd\" (UID: \"85a077ee-c427-421c-930d-0deeda5fb58c\") " pod="openshift-multus/multus-additional-cni-plugins-cjknd" Sep 17 16:41:46.196619 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.196610 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85a077ee-c427-421c-930d-0deeda5fb58c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cjknd\" (UID: \"85a077ee-c427-421c-930d-0deeda5fb58c\") " pod="openshift-multus/multus-additional-cni-plugins-cjknd" Sep 17 16:41:46.198618 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.196642 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/85a077ee-c427-421c-930d-0deeda5fb58c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cjknd\" (UID: \"85a077ee-c427-421c-930d-0deeda5fb58c\") " pod="openshift-multus/multus-additional-cni-plugins-cjknd" Sep 17 16:41:46.198618 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.196795 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/804bc511-5b2f-407e-b47f-ddd4333a6064-tmp-dir\") pod \"node-resolver-spcc4\" (UID: \"804bc511-5b2f-407e-b47f-ddd4333a6064\") " pod="openshift-dns/node-resolver-spcc4" Sep 17 16:41:46.198618 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.196826 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-etc-kubernetes\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.198618 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.196930 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbpr9\" (UniqueName: \"kubernetes.io/projected/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-kube-api-access-zbpr9\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.198618 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.196958 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85a077ee-c427-421c-930d-0deeda5fb58c-cnibin\") pod \"multus-additional-cni-plugins-cjknd\" (UID: \"85a077ee-c427-421c-930d-0deeda5fb58c\") " pod="openshift-multus/multus-additional-cni-plugins-cjknd" Sep 17 16:41:46.198618 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.196990 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztd2b\" (UniqueName: \"kubernetes.io/projected/dcc9a981-3536-4588-a119-b7912e2fa48e-kube-api-access-ztd2b\") pod \"node-ca-7xjlf\" (UID: \"dcc9a981-3536-4588-a119-b7912e2fa48e\") " pod="openshift-image-registry/node-ca-7xjlf" Sep 17 16:41:46.198618 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.197070 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-multus-daemon-config\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.198618 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.197108 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0f01af1-e02f-4105-8edb-33a5b8acab5c-metrics-certs\") pod \"network-metrics-daemon-glhzf\" (UID: \"c0f01af1-e02f-4105-8edb-33a5b8acab5c\") " pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:41:46.198618 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.197152 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dcc9a981-3536-4588-a119-b7912e2fa48e-host\") pod \"node-ca-7xjlf\" (UID: \"dcc9a981-3536-4588-a119-b7912e2fa48e\") " pod="openshift-image-registry/node-ca-7xjlf" Sep 17 16:41:46.198618 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.197228 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/85a077ee-c427-421c-930d-0deeda5fb58c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cjknd\" (UID: \"85a077ee-c427-421c-930d-0deeda5fb58c\") " pod="openshift-multus/multus-additional-cni-plugins-cjknd" Sep 17 16:41:46.198618 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.197259 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-cni-binary-copy\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.198618 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.197324 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-hostroot\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.198618 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.197368 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dcc9a981-3536-4588-a119-b7912e2fa48e-serviceca\") pod \"node-ca-7xjlf\" (UID: \"dcc9a981-3536-4588-a119-b7912e2fa48e\") " pod="openshift-image-registry/node-ca-7xjlf" Sep 17 16:41:46.198618 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.198119 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 17 16:41:46.198618 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.198470 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 17 16:41:46.199345 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.198696 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fj9nw\"" Sep 17 16:41:46.199628 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.199589 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 17 16:41:46.200057 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.200036 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7mcfc\"" Sep 17 16:41:46.200143 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.200106 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 17 16:41:46.200441 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.200420 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tb4rk" Sep 17 16:41:46.203075 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.203051 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 16:41:46.203644 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.203624 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.207608 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.207581 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 17 16:41:46.207801 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.207783 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 17 16:41:46.208015 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.207998 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 17 16:41:46.208261 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.208241 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-v22nc\"" Sep 17 16:41:46.208461 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.208445 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 17 16:41:46.208545 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.208501 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 17 16:41:46.208689 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.208660 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kvkx2\"" Sep 17 16:41:46.210131 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.210110 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:41:46.210239 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:46.210213 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-99gp5" podUID="e8b1cfd1-164c-4442-b711-c429d1f4a719" Sep 17 16:41:46.212573 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.212553 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 17 16:41:46.212973 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.212954 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 17 16:41:46.213260 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.213240 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 17 16:41:46.213906 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.213889 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.215118 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.214973 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 17 16:41:46.216187 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.215929 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:41:46.216187 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:46.215994 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqfbx" podUID="447eed93-408e-4029-b493-f9ec83f577b4" Sep 17 16:41:46.217404 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.217376 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 17 16:41:46.217521 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.217486 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-chq5f\"" Sep 17 16:41:46.218357 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.218342 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 17 16:41:46.252734 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.252651 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5hz6f" Sep 17 16:41:46.258479 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.258299 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 16:41:46.263896 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.263878 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5hz6f" Sep 17 16:41:46.288661 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.288643 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 17 16:41:46.298537 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.298512 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/85a077ee-c427-421c-930d-0deeda5fb58c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cjknd\" (UID: \"85a077ee-c427-421c-930d-0deeda5fb58c\") " pod="openshift-multus/multus-additional-cni-plugins-cjknd" Sep 17 16:41:46.298645 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.298554 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-cni-binary-copy\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.298645 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.298585 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-etc-systemd\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.298645 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.298609 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-host-run-netns\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.298645 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.298632 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-etc-sysctl-conf\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.298858 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.298653 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-tmp\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.298858 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.298676 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-systemd-units\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.298858 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.298709 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-run-ovn\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.298858 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.298730 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-log-socket\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.298858 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.298753 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f165c12c-1f10-400e-b4f7-270a1a0e9805-ovnkube-config\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.298858 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.298779 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-host-var-lib-cni-multus\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.298858 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.298806 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f639c21b-ffa0-4516-b1b7-528597d477e4-agent-certs\") pod \"konnectivity-agent-9f79b\" (UID: \"f639c21b-ffa0-4516-b1b7-528597d477e4\") " pod="kube-system/konnectivity-agent-9f79b" Sep 17 16:41:46.298858 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.298829 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-run\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.299262 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.298852 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-lib-modules\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.299262 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.298894 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-etc-tuned\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.299262 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.298920 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-host-kubelet\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.299262 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.298942 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-node-log\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.299262 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.298967 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-multus-cni-dir\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.299262 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.298988 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-sys\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.299262 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.299017 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85a077ee-c427-421c-930d-0deeda5fb58c-cni-binary-copy\") pod \"multus-additional-cni-plugins-cjknd\" (UID: \"85a077ee-c427-421c-930d-0deeda5fb58c\") " pod="openshift-multus/multus-additional-cni-plugins-cjknd" Sep 17 16:41:46.299262 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.299051 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9zzf\" (UniqueName: \"kubernetes.io/projected/85a077ee-c427-421c-930d-0deeda5fb58c-kube-api-access-m9zzf\") pod \"multus-additional-cni-plugins-cjknd\" (UID: \"85a077ee-c427-421c-930d-0deeda5fb58c\") " pod="openshift-multus/multus-additional-cni-plugins-cjknd" Sep 17 16:41:46.299262 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.299078 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-host-run-k8s-cni-cncf-io\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.299262 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.299105 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-host-run-multus-certs\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.299262 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.299147 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-etc-modprobe-d\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.299262 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.299174 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcxnm\" (UniqueName: \"kubernetes.io/projected/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-kube-api-access-pcxnm\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.299262 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.299185 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/85a077ee-c427-421c-930d-0deeda5fb58c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cjknd\" (UID: \"85a077ee-c427-421c-930d-0deeda5fb58c\") " pod="openshift-multus/multus-additional-cni-plugins-cjknd" Sep 17 16:41:46.299262 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.299206 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rz9d\" (UniqueName: \"kubernetes.io/projected/804bc511-5b2f-407e-b47f-ddd4333a6064-kube-api-access-5rz9d\") pod \"node-resolver-spcc4\" (UID: \"804bc511-5b2f-407e-b47f-ddd4333a6064\") " pod="openshift-dns/node-resolver-spcc4" Sep 17 16:41:46.299262 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.299235 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-multus-conf-dir\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.299262 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.299257 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-host-run-netns\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.300087 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.299369 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-multus-cni-dir\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.300087 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.299793 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-cni-binary-copy\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.300087 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.299838 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-host-cni-bin\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.300087 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.299862 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85a077ee-c427-421c-930d-0deeda5fb58c-cni-binary-copy\") pod \"multus-additional-cni-plugins-cjknd\" (UID: \"85a077ee-c427-421c-930d-0deeda5fb58c\") " pod="openshift-multus/multus-additional-cni-plugins-cjknd" Sep 17 16:41:46.300087 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.299869 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.300087 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.299901 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e8b1cfd1-164c-4442-b711-c429d1f4a719-kubelet-config\") pod \"global-pull-secret-syncer-99gp5\" (UID: \"e8b1cfd1-164c-4442-b711-c429d1f4a719\") " pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:41:46.300087 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.299958 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-host-run-netns\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.300087 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.300019 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-host-var-lib-cni-multus\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.300482 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.300094 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-host-run-k8s-cni-cncf-io\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.300482 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.300180 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-host-run-multus-certs\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.300482 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.300231 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-multus-conf-dir\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.300482 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.300271 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8b1cfd1-164c-4442-b711-c429d1f4a719-original-pull-secret\") pod \"global-pull-secret-syncer-99gp5\" (UID: \"e8b1cfd1-164c-4442-b711-c429d1f4a719\") " pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:41:46.300482 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.300309 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/85a077ee-c427-421c-930d-0deeda5fb58c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cjknd\" (UID: \"85a077ee-c427-421c-930d-0deeda5fb58c\") " pod="openshift-multus/multus-additional-cni-plugins-cjknd" Sep 17 16:41:46.300482 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.300341 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-etc-kubernetes\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.300788 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.300463 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-host\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.300788 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.300519 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-etc-kubernetes\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.300788 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.300565 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-var-lib-openvswitch\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.300788 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.300595 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-multus-daemon-config\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.300788 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.300630 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0f01af1-e02f-4105-8edb-33a5b8acab5c-metrics-certs\") pod \"network-metrics-daemon-glhzf\" (UID: \"c0f01af1-e02f-4105-8edb-33a5b8acab5c\") " pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:41:46.300788 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.300673 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1ae835cf-1368-4764-bed6-52ed2b5f9f27-socket-dir\") pod \"aws-ebs-csi-driver-node-ck84q\" (UID: \"1ae835cf-1368-4764-bed6-52ed2b5f9f27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ck84q" Sep 17 16:41:46.300788 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.300705 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1ae835cf-1368-4764-bed6-52ed2b5f9f27-sys-fs\") pod \"aws-ebs-csi-driver-node-ck84q\" (UID: \"1ae835cf-1368-4764-bed6-52ed2b5f9f27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ck84q" Sep 17 16:41:46.300788 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.300732 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dcc9a981-3536-4588-a119-b7912e2fa48e-host\") pod \"node-ca-7xjlf\" (UID: \"dcc9a981-3536-4588-a119-b7912e2fa48e\") " pod="openshift-image-registry/node-ca-7xjlf" Sep 17 16:41:46.300788 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.300760 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-hostroot\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.300788 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.300790 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f639c21b-ffa0-4516-b1b7-528597d477e4-konnectivity-ca\") pod \"konnectivity-agent-9f79b\" (UID: \"f639c21b-ffa0-4516-b1b7-528597d477e4\") " pod="kube-system/konnectivity-agent-9f79b" Sep 17 16:41:46.301278 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.300817 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-hostroot\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.301278 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.300817 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vr9x\" (UniqueName: \"kubernetes.io/projected/211fa1c6-ea59-4f31-a5e8-80a5b88fef83-kube-api-access-5vr9x\") pod \"iptables-alerter-tb4rk\" (UID: \"211fa1c6-ea59-4f31-a5e8-80a5b88fef83\") " pod="openshift-network-operator/iptables-alerter-tb4rk" Sep 17 16:41:46.301278 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.300792 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dcc9a981-3536-4588-a119-b7912e2fa48e-host\") pod \"node-ca-7xjlf\" (UID: \"dcc9a981-3536-4588-a119-b7912e2fa48e\") " pod="openshift-image-registry/node-ca-7xjlf" Sep 17 16:41:46.301278 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.300848 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/85a077ee-c427-421c-930d-0deeda5fb58c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cjknd\" (UID: \"85a077ee-c427-421c-930d-0deeda5fb58c\") " pod="openshift-multus/multus-additional-cni-plugins-cjknd" Sep 17 16:41:46.301278 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:46.300844 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:41:46.301278 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.300876 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-run-systemd\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.301278 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.300922 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dcc9a981-3536-4588-a119-b7912e2fa48e-serviceca\") pod \"node-ca-7xjlf\" (UID: \"dcc9a981-3536-4588-a119-b7912e2fa48e\") " pod="openshift-image-registry/node-ca-7xjlf" Sep 17 16:41:46.301278 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.300972 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-host-var-lib-cni-bin\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.301278 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301011 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/211fa1c6-ea59-4f31-a5e8-80a5b88fef83-host-slash\") pod \"iptables-alerter-tb4rk\" (UID: \"211fa1c6-ea59-4f31-a5e8-80a5b88fef83\") " pod="openshift-network-operator/iptables-alerter-tb4rk" Sep 17 16:41:46.301278 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:46.301044 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0f01af1-e02f-4105-8edb-33a5b8acab5c-metrics-certs podName:c0f01af1-e02f-4105-8edb-33a5b8acab5c nodeName:}" failed. No retries permitted until 2026-09-17 16:41:46.801023471 +0000 UTC m=+2.997017599 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0f01af1-e02f-4105-8edb-33a5b8acab5c-metrics-certs") pod "network-metrics-daemon-glhzf" (UID: "c0f01af1-e02f-4105-8edb-33a5b8acab5c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:41:46.301278 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301058 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e8b1cfd1-164c-4442-b711-c429d1f4a719-dbus\") pod \"global-pull-secret-syncer-99gp5\" (UID: \"e8b1cfd1-164c-4442-b711-c429d1f4a719\") " pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:41:46.301278 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301079 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-host-var-lib-cni-bin\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.301278 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301086 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv55f\" (UniqueName: \"kubernetes.io/projected/c0f01af1-e02f-4105-8edb-33a5b8acab5c-kube-api-access-qv55f\") pod \"network-metrics-daemon-glhzf\" (UID: \"c0f01af1-e02f-4105-8edb-33a5b8acab5c\") " pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:41:46.301278 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301113 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whvdf\" (UniqueName: \"kubernetes.io/projected/447eed93-408e-4029-b493-f9ec83f577b4-kube-api-access-whvdf\") pod \"network-check-target-fqfbx\" (UID: \"447eed93-408e-4029-b493-f9ec83f577b4\") " pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:41:46.301278 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301139 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/804bc511-5b2f-407e-b47f-ddd4333a6064-hosts-file\") pod \"node-resolver-spcc4\" (UID: \"804bc511-5b2f-407e-b47f-ddd4333a6064\") " pod="openshift-dns/node-resolver-spcc4" Sep 17 16:41:46.301278 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301162 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-cnibin\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.301278 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301178 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-multus-daemon-config\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.302176 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301203 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-multus-socket-dir-parent\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.302176 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301270 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-multus-socket-dir-parent\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.302176 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301278 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w76r\" (UniqueName: \"kubernetes.io/projected/1ae835cf-1368-4764-bed6-52ed2b5f9f27-kube-api-access-6w76r\") pod \"aws-ebs-csi-driver-node-ck84q\" (UID: \"1ae835cf-1368-4764-bed6-52ed2b5f9f27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ck84q" Sep 17 16:41:46.302176 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301305 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/804bc511-5b2f-407e-b47f-ddd4333a6064-hosts-file\") pod \"node-resolver-spcc4\" (UID: \"804bc511-5b2f-407e-b47f-ddd4333a6064\") " pod="openshift-dns/node-resolver-spcc4" Sep 17 16:41:46.302176 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301308 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-var-lib-kubelet\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.302176 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301337 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-cnibin\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.302176 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301346 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-etc-openvswitch\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.302176 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301384 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1ae835cf-1368-4764-bed6-52ed2b5f9f27-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ck84q\" (UID: \"1ae835cf-1368-4764-bed6-52ed2b5f9f27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ck84q" Sep 17 16:41:46.302176 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301404 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dcc9a981-3536-4588-a119-b7912e2fa48e-serviceca\") pod \"node-ca-7xjlf\" (UID: \"dcc9a981-3536-4588-a119-b7912e2fa48e\") " pod="openshift-image-registry/node-ca-7xjlf" Sep 17 16:41:46.302176 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301412 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1ae835cf-1368-4764-bed6-52ed2b5f9f27-registration-dir\") pod \"aws-ebs-csi-driver-node-ck84q\" (UID: \"1ae835cf-1368-4764-bed6-52ed2b5f9f27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ck84q" Sep 17 16:41:46.302176 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301505 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-host-cni-netd\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.302176 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301537 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f165c12c-1f10-400e-b4f7-270a1a0e9805-ovn-node-metrics-cert\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.302176 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301572 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-system-cni-dir\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.302176 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301596 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-host-var-lib-kubelet\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.302176 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301612 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-etc-sysconfig\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.302176 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301629 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-host-run-ovn-kubernetes\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.302176 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301654 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trhpb\" (UniqueName: \"kubernetes.io/projected/f165c12c-1f10-400e-b4f7-270a1a0e9805-kube-api-access-trhpb\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.302808 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301679 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85a077ee-c427-421c-930d-0deeda5fb58c-system-cni-dir\") pod \"multus-additional-cni-plugins-cjknd\" (UID: \"85a077ee-c427-421c-930d-0deeda5fb58c\") " pod="openshift-multus/multus-additional-cni-plugins-cjknd" Sep 17 16:41:46.302808 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301684 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-host-var-lib-kubelet\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.302808 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301706 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85a077ee-c427-421c-930d-0deeda5fb58c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cjknd\" (UID: \"85a077ee-c427-421c-930d-0deeda5fb58c\") " pod="openshift-multus/multus-additional-cni-plugins-cjknd" Sep 17 16:41:46.302808 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301731 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/804bc511-5b2f-407e-b47f-ddd4333a6064-tmp-dir\") pod \"node-resolver-spcc4\" (UID: \"804bc511-5b2f-407e-b47f-ddd4333a6064\") " pod="openshift-dns/node-resolver-spcc4" Sep 17 16:41:46.302808 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301755 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-system-cni-dir\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.302808 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301757 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbpr9\" (UniqueName: \"kubernetes.io/projected/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-kube-api-access-zbpr9\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.302808 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301792 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1ae835cf-1368-4764-bed6-52ed2b5f9f27-device-dir\") pod \"aws-ebs-csi-driver-node-ck84q\" (UID: \"1ae835cf-1368-4764-bed6-52ed2b5f9f27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ck84q" Sep 17 16:41:46.302808 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301822 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1ae835cf-1368-4764-bed6-52ed2b5f9f27-etc-selinux\") pod \"aws-ebs-csi-driver-node-ck84q\" (UID: \"1ae835cf-1368-4764-bed6-52ed2b5f9f27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ck84q" Sep 17 16:41:46.302808 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301857 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-etc-sysctl-d\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.302808 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301896 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/211fa1c6-ea59-4f31-a5e8-80a5b88fef83-iptables-alerter-script\") pod \"iptables-alerter-tb4rk\" (UID: \"211fa1c6-ea59-4f31-a5e8-80a5b88fef83\") " pod="openshift-network-operator/iptables-alerter-tb4rk" Sep 17 16:41:46.302808 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301925 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85a077ee-c427-421c-930d-0deeda5fb58c-cnibin\") pod \"multus-additional-cni-plugins-cjknd\" (UID: \"85a077ee-c427-421c-930d-0deeda5fb58c\") " pod="openshift-multus/multus-additional-cni-plugins-cjknd" Sep 17 16:41:46.302808 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301949 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztd2b\" (UniqueName: \"kubernetes.io/projected/dcc9a981-3536-4588-a119-b7912e2fa48e-kube-api-access-ztd2b\") pod \"node-ca-7xjlf\" (UID: \"dcc9a981-3536-4588-a119-b7912e2fa48e\") " pod="openshift-image-registry/node-ca-7xjlf" Sep 17 16:41:46.302808 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301972 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-etc-kubernetes\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.302808 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.301993 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-host-slash\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.302808 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.302061 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85a077ee-c427-421c-930d-0deeda5fb58c-cnibin\") pod \"multus-additional-cni-plugins-cjknd\" (UID: \"85a077ee-c427-421c-930d-0deeda5fb58c\") " pod="openshift-multus/multus-additional-cni-plugins-cjknd" Sep 17 16:41:46.302808 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.302085 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85a077ee-c427-421c-930d-0deeda5fb58c-system-cni-dir\") pod \"multus-additional-cni-plugins-cjknd\" (UID: \"85a077ee-c427-421c-930d-0deeda5fb58c\") " pod="openshift-multus/multus-additional-cni-plugins-cjknd" Sep 17 16:41:46.302808 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.302427 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85a077ee-c427-421c-930d-0deeda5fb58c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cjknd\" (UID: \"85a077ee-c427-421c-930d-0deeda5fb58c\") " pod="openshift-multus/multus-additional-cni-plugins-cjknd" Sep 17 16:41:46.303614 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.302520 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-run-openvswitch\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.303614 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.302556 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f165c12c-1f10-400e-b4f7-270a1a0e9805-env-overrides\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.303614 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.302581 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f165c12c-1f10-400e-b4f7-270a1a0e9805-ovnkube-script-lib\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.303614 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.303128 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/804bc511-5b2f-407e-b47f-ddd4333a6064-tmp-dir\") pod \"node-resolver-spcc4\" (UID: \"804bc511-5b2f-407e-b47f-ddd4333a6064\") " pod="openshift-dns/node-resolver-spcc4" Sep 17 16:41:46.314031 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.314005 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 17 16:41:46.319667 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.319644 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztd2b\" (UniqueName: \"kubernetes.io/projected/dcc9a981-3536-4588-a119-b7912e2fa48e-kube-api-access-ztd2b\") pod \"node-ca-7xjlf\" (UID: \"dcc9a981-3536-4588-a119-b7912e2fa48e\") " pod="openshift-image-registry/node-ca-7xjlf" Sep 17 16:41:46.321080 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.321057 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rz9d\" (UniqueName: \"kubernetes.io/projected/804bc511-5b2f-407e-b47f-ddd4333a6064-kube-api-access-5rz9d\") pod \"node-resolver-spcc4\" (UID: \"804bc511-5b2f-407e-b47f-ddd4333a6064\") " pod="openshift-dns/node-resolver-spcc4" Sep 17 16:41:46.322958 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.322890 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv55f\" (UniqueName: \"kubernetes.io/projected/c0f01af1-e02f-4105-8edb-33a5b8acab5c-kube-api-access-qv55f\") pod \"network-metrics-daemon-glhzf\" (UID: \"c0f01af1-e02f-4105-8edb-33a5b8acab5c\") " pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:41:46.324425 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.324401 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbpr9\" (UniqueName: \"kubernetes.io/projected/4e9d0c9e-7030-4ef1-8d43-9f6af050bae5-kube-api-access-zbpr9\") pod \"multus-rqj26\" (UID: \"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5\") " pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.324925 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.324901 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9zzf\" (UniqueName: \"kubernetes.io/projected/85a077ee-c427-421c-930d-0deeda5fb58c-kube-api-access-m9zzf\") pod \"multus-additional-cni-plugins-cjknd\" (UID: \"85a077ee-c427-421c-930d-0deeda5fb58c\") " pod="openshift-multus/multus-additional-cni-plugins-cjknd" Sep 17 16:41:46.330338 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.330285 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal" event={"ID":"fdf5e3af8557b9fa01d00337bee43c12","Type":"ContainerStarted","Data":"6a6de00f6ff9e6539e46948c1c87e401706ec375836e6a47a0bb7ee539139943"} Sep 17 16:41:46.332328 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.332304 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-146.ec2.internal" event={"ID":"d0d4a61112593ffdf8087d8d186a27c8","Type":"ContainerStarted","Data":"16568192ed73f1611e30489ca44e6ea4690ca998860eef817f68de99eb5ccf37"} Sep 17 16:41:46.403734 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.403705 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-var-lib-openvswitch\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.403917 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.403756 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1ae835cf-1368-4764-bed6-52ed2b5f9f27-socket-dir\") pod \"aws-ebs-csi-driver-node-ck84q\" (UID: \"1ae835cf-1368-4764-bed6-52ed2b5f9f27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ck84q" Sep 17 16:41:46.403917 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.403781 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1ae835cf-1368-4764-bed6-52ed2b5f9f27-sys-fs\") pod \"aws-ebs-csi-driver-node-ck84q\" (UID: \"1ae835cf-1368-4764-bed6-52ed2b5f9f27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ck84q" Sep 17 16:41:46.403917 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.403806 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f639c21b-ffa0-4516-b1b7-528597d477e4-konnectivity-ca\") pod \"konnectivity-agent-9f79b\" (UID: \"f639c21b-ffa0-4516-b1b7-528597d477e4\") " pod="kube-system/konnectivity-agent-9f79b" Sep 17 16:41:46.403917 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.403818 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-var-lib-openvswitch\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.403917 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.403831 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vr9x\" (UniqueName: \"kubernetes.io/projected/211fa1c6-ea59-4f31-a5e8-80a5b88fef83-kube-api-access-5vr9x\") pod \"iptables-alerter-tb4rk\" (UID: \"211fa1c6-ea59-4f31-a5e8-80a5b88fef83\") " pod="openshift-network-operator/iptables-alerter-tb4rk" Sep 17 16:41:46.403917 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.403867 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-run-systemd\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.403917 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.403878 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1ae835cf-1368-4764-bed6-52ed2b5f9f27-sys-fs\") pod \"aws-ebs-csi-driver-node-ck84q\" (UID: \"1ae835cf-1368-4764-bed6-52ed2b5f9f27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ck84q" Sep 17 16:41:46.403917 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.403892 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/211fa1c6-ea59-4f31-a5e8-80a5b88fef83-host-slash\") pod \"iptables-alerter-tb4rk\" (UID: \"211fa1c6-ea59-4f31-a5e8-80a5b88fef83\") " pod="openshift-network-operator/iptables-alerter-tb4rk" Sep 17 16:41:46.403917 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.403914 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e8b1cfd1-164c-4442-b711-c429d1f4a719-dbus\") pod \"global-pull-secret-syncer-99gp5\" (UID: \"e8b1cfd1-164c-4442-b711-c429d1f4a719\") " pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:41:46.404363 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.403928 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1ae835cf-1368-4764-bed6-52ed2b5f9f27-socket-dir\") pod \"aws-ebs-csi-driver-node-ck84q\" (UID: \"1ae835cf-1368-4764-bed6-52ed2b5f9f27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ck84q" Sep 17 16:41:46.404363 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.403939 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-run-systemd\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.404363 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.403944 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whvdf\" (UniqueName: \"kubernetes.io/projected/447eed93-408e-4029-b493-f9ec83f577b4-kube-api-access-whvdf\") pod \"network-check-target-fqfbx\" (UID: \"447eed93-408e-4029-b493-f9ec83f577b4\") " pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:41:46.404363 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.403972 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/211fa1c6-ea59-4f31-a5e8-80a5b88fef83-host-slash\") pod \"iptables-alerter-tb4rk\" (UID: \"211fa1c6-ea59-4f31-a5e8-80a5b88fef83\") " pod="openshift-network-operator/iptables-alerter-tb4rk" Sep 17 16:41:46.404363 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.403990 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w76r\" (UniqueName: \"kubernetes.io/projected/1ae835cf-1368-4764-bed6-52ed2b5f9f27-kube-api-access-6w76r\") pod \"aws-ebs-csi-driver-node-ck84q\" (UID: \"1ae835cf-1368-4764-bed6-52ed2b5f9f27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ck84q" Sep 17 16:41:46.404363 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404017 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e8b1cfd1-164c-4442-b711-c429d1f4a719-dbus\") pod \"global-pull-secret-syncer-99gp5\" (UID: \"e8b1cfd1-164c-4442-b711-c429d1f4a719\") " pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:41:46.404363 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404020 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-var-lib-kubelet\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.404363 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404055 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-etc-openvswitch\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.404363 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404068 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-var-lib-kubelet\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.404363 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404097 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1ae835cf-1368-4764-bed6-52ed2b5f9f27-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ck84q\" (UID: \"1ae835cf-1368-4764-bed6-52ed2b5f9f27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ck84q" Sep 17 16:41:46.404363 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404122 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1ae835cf-1368-4764-bed6-52ed2b5f9f27-registration-dir\") pod \"aws-ebs-csi-driver-node-ck84q\" (UID: \"1ae835cf-1368-4764-bed6-52ed2b5f9f27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ck84q" Sep 17 16:41:46.404363 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404150 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-host-cni-netd\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.404363 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404174 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f165c12c-1f10-400e-b4f7-270a1a0e9805-ovn-node-metrics-cert\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.404363 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404199 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-etc-sysconfig\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.404363 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404223 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-etc-openvswitch\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.404363 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404226 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-host-run-ovn-kubernetes\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.404363 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404252 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trhpb\" (UniqueName: \"kubernetes.io/projected/f165c12c-1f10-400e-b4f7-270a1a0e9805-kube-api-access-trhpb\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.405248 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404283 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1ae835cf-1368-4764-bed6-52ed2b5f9f27-device-dir\") pod \"aws-ebs-csi-driver-node-ck84q\" (UID: \"1ae835cf-1368-4764-bed6-52ed2b5f9f27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ck84q" Sep 17 16:41:46.405248 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404306 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1ae835cf-1368-4764-bed6-52ed2b5f9f27-etc-selinux\") pod \"aws-ebs-csi-driver-node-ck84q\" (UID: \"1ae835cf-1368-4764-bed6-52ed2b5f9f27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ck84q" Sep 17 16:41:46.405248 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404329 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-etc-sysctl-d\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.405248 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404354 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/211fa1c6-ea59-4f31-a5e8-80a5b88fef83-iptables-alerter-script\") pod \"iptables-alerter-tb4rk\" (UID: \"211fa1c6-ea59-4f31-a5e8-80a5b88fef83\") " pod="openshift-network-operator/iptables-alerter-tb4rk" Sep 17 16:41:46.405248 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404385 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-etc-kubernetes\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.405248 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404400 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1ae835cf-1368-4764-bed6-52ed2b5f9f27-registration-dir\") pod \"aws-ebs-csi-driver-node-ck84q\" (UID: \"1ae835cf-1368-4764-bed6-52ed2b5f9f27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ck84q" Sep 17 16:41:46.405248 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404408 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-host-slash\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.405248 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404434 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-run-openvswitch\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.405248 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404436 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-host-cni-netd\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.405248 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404463 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-etc-sysconfig\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.405248 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404202 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1ae835cf-1368-4764-bed6-52ed2b5f9f27-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ck84q\" (UID: \"1ae835cf-1368-4764-bed6-52ed2b5f9f27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ck84q" Sep 17 16:41:46.405248 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404469 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f165c12c-1f10-400e-b4f7-270a1a0e9805-env-overrides\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.405248 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404498 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f165c12c-1f10-400e-b4f7-270a1a0e9805-ovnkube-script-lib\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.405248 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404522 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1ae835cf-1368-4764-bed6-52ed2b5f9f27-etc-selinux\") pod \"aws-ebs-csi-driver-node-ck84q\" (UID: \"1ae835cf-1368-4764-bed6-52ed2b5f9f27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ck84q" Sep 17 16:41:46.405248 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404537 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-etc-systemd\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.405248 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404569 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-etc-systemd\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.405248 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404586 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-etc-sysctl-conf\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.406017 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404652 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-host-run-ovn-kubernetes\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.406017 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404648 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-host-slash\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.406017 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404734 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-tmp\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.406017 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404737 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-etc-kubernetes\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.406017 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404772 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-etc-sysctl-conf\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.406017 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404399 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f639c21b-ffa0-4516-b1b7-528597d477e4-konnectivity-ca\") pod \"konnectivity-agent-9f79b\" (UID: \"f639c21b-ffa0-4516-b1b7-528597d477e4\") " pod="kube-system/konnectivity-agent-9f79b" Sep 17 16:41:46.406017 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404440 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1ae835cf-1368-4764-bed6-52ed2b5f9f27-device-dir\") pod \"aws-ebs-csi-driver-node-ck84q\" (UID: \"1ae835cf-1368-4764-bed6-52ed2b5f9f27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ck84q" Sep 17 16:41:46.406017 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404865 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-run-openvswitch\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.406017 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404890 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-systemd-units\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.406017 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404891 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f165c12c-1f10-400e-b4f7-270a1a0e9805-env-overrides\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.406017 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404914 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-run-ovn\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.406017 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404923 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-etc-sysctl-d\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.406017 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404939 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-log-socket\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.406017 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404948 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-systemd-units\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.406017 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404964 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-run-ovn\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.406017 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404965 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f165c12c-1f10-400e-b4f7-270a1a0e9805-ovnkube-config\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.406017 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.404988 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-log-socket\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.406017 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.405004 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f639c21b-ffa0-4516-b1b7-528597d477e4-agent-certs\") pod \"konnectivity-agent-9f79b\" (UID: \"f639c21b-ffa0-4516-b1b7-528597d477e4\") " pod="kube-system/konnectivity-agent-9f79b" Sep 17 16:41:46.406954 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.405036 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-run\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.406954 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.405057 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-lib-modules\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.406954 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.405059 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/211fa1c6-ea59-4f31-a5e8-80a5b88fef83-iptables-alerter-script\") pod \"iptables-alerter-tb4rk\" (UID: \"211fa1c6-ea59-4f31-a5e8-80a5b88fef83\") " pod="openshift-network-operator/iptables-alerter-tb4rk" Sep 17 16:41:46.406954 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.405079 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-etc-tuned\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.406954 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.405125 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-run\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.406954 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.405237 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-lib-modules\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.406954 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.405289 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-host-kubelet\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.406954 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.405305 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f165c12c-1f10-400e-b4f7-270a1a0e9805-ovnkube-script-lib\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.406954 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.405331 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-node-log\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.406954 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.405372 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-host-kubelet\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.406954 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.405374 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-node-log\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.406954 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.405403 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-sys\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.406954 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.405405 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f165c12c-1f10-400e-b4f7-270a1a0e9805-ovnkube-config\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.406954 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.405434 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-etc-modprobe-d\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.406954 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.405475 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcxnm\" (UniqueName: \"kubernetes.io/projected/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-kube-api-access-pcxnm\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.406954 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.405480 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-sys\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.406954 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.405492 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-host-run-netns\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.406954 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.405507 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-host-cni-bin\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.407888 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.405530 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.407888 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.405559 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-host-run-netns\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.407888 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.405572 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-etc-modprobe-d\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.407888 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.405578 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.407888 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.405580 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f165c12c-1f10-400e-b4f7-270a1a0e9805-host-cni-bin\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.407888 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.405603 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e8b1cfd1-164c-4442-b711-c429d1f4a719-kubelet-config\") pod \"global-pull-secret-syncer-99gp5\" (UID: \"e8b1cfd1-164c-4442-b711-c429d1f4a719\") " pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:41:46.407888 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.405638 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8b1cfd1-164c-4442-b711-c429d1f4a719-original-pull-secret\") pod \"global-pull-secret-syncer-99gp5\" (UID: \"e8b1cfd1-164c-4442-b711-c429d1f4a719\") " pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:41:46.407888 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.405693 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e8b1cfd1-164c-4442-b711-c429d1f4a719-kubelet-config\") pod \"global-pull-secret-syncer-99gp5\" (UID: \"e8b1cfd1-164c-4442-b711-c429d1f4a719\") " pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:41:46.407888 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:46.405716 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 16:41:46.407888 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.405735 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-host\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.407888 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:46.405779 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8b1cfd1-164c-4442-b711-c429d1f4a719-original-pull-secret podName:e8b1cfd1-164c-4442-b711-c429d1f4a719 nodeName:}" failed. No retries permitted until 2026-09-17 16:41:46.905761382 +0000 UTC m=+3.101755526 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8b1cfd1-164c-4442-b711-c429d1f4a719-original-pull-secret") pod "global-pull-secret-syncer-99gp5" (UID: "e8b1cfd1-164c-4442-b711-c429d1f4a719") : object "kube-system"/"original-pull-secret" not registered Sep 17 16:41:46.407888 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.405781 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-host\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.408893 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.408845 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-tmp\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.409146 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.409123 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f165c12c-1f10-400e-b4f7-270a1a0e9805-ovn-node-metrics-cert\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.409280 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.409258 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f639c21b-ffa0-4516-b1b7-528597d477e4-agent-certs\") pod \"konnectivity-agent-9f79b\" (UID: \"f639c21b-ffa0-4516-b1b7-528597d477e4\") " pod="kube-system/konnectivity-agent-9f79b" Sep 17 16:41:46.410577 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.410553 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-etc-tuned\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.412001 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:46.411980 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 16:41:46.412106 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:46.412009 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 16:41:46.412106 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:46.412025 2574 projected.go:196] Error preparing data for projected volume kube-api-access-whvdf for pod openshift-network-diagnostics/network-check-target-fqfbx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:41:46.412106 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:46.412088 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/447eed93-408e-4029-b493-f9ec83f577b4-kube-api-access-whvdf podName:447eed93-408e-4029-b493-f9ec83f577b4 nodeName:}" failed. No retries permitted until 2026-09-17 16:41:46.912071982 +0000 UTC m=+3.108066109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-whvdf" (UniqueName: "kubernetes.io/projected/447eed93-408e-4029-b493-f9ec83f577b4-kube-api-access-whvdf") pod "network-check-target-fqfbx" (UID: "447eed93-408e-4029-b493-f9ec83f577b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:41:46.422454 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.422403 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcxnm\" (UniqueName: \"kubernetes.io/projected/a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01-kube-api-access-pcxnm\") pod \"tuned-5qmf9\" (UID: \"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01\") " pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.423962 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.423937 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trhpb\" (UniqueName: \"kubernetes.io/projected/f165c12c-1f10-400e-b4f7-270a1a0e9805-kube-api-access-trhpb\") pod \"ovnkube-node-k2rxg\" (UID: \"f165c12c-1f10-400e-b4f7-270a1a0e9805\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.425972 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.425947 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w76r\" (UniqueName: \"kubernetes.io/projected/1ae835cf-1368-4764-bed6-52ed2b5f9f27-kube-api-access-6w76r\") pod \"aws-ebs-csi-driver-node-ck84q\" (UID: \"1ae835cf-1368-4764-bed6-52ed2b5f9f27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ck84q" Sep 17 16:41:46.426073 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.425961 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vr9x\" (UniqueName: \"kubernetes.io/projected/211fa1c6-ea59-4f31-a5e8-80a5b88fef83-kube-api-access-5vr9x\") pod \"iptables-alerter-tb4rk\" (UID: \"211fa1c6-ea59-4f31-a5e8-80a5b88fef83\") " pod="openshift-network-operator/iptables-alerter-tb4rk" Sep 17 16:41:46.491324 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.491293 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rqj26" Sep 17 16:41:46.512045 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.512017 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cjknd" Sep 17 16:41:46.524708 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.524687 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7xjlf" Sep 17 16:41:46.531659 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.531639 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-spcc4" Sep 17 16:41:46.542295 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.542273 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ck84q" Sep 17 16:41:46.556127 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.556102 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9f79b" Sep 17 16:41:46.565971 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.565941 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tb4rk" Sep 17 16:41:46.573941 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.573924 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:41:46.580737 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.580719 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" Sep 17 16:41:46.809835 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.809809 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0f01af1-e02f-4105-8edb-33a5b8acab5c-metrics-certs\") pod \"network-metrics-daemon-glhzf\" (UID: \"c0f01af1-e02f-4105-8edb-33a5b8acab5c\") " pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:41:46.809990 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:46.809921 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:41:46.809990 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:46.809985 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0f01af1-e02f-4105-8edb-33a5b8acab5c-metrics-certs podName:c0f01af1-e02f-4105-8edb-33a5b8acab5c nodeName:}" failed. No retries permitted until 2026-09-17 16:41:47.809964801 +0000 UTC m=+4.005958930 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0f01af1-e02f-4105-8edb-33a5b8acab5c-metrics-certs") pod "network-metrics-daemon-glhzf" (UID: "c0f01af1-e02f-4105-8edb-33a5b8acab5c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:41:46.910794 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:46.910764 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8b1cfd1-164c-4442-b711-c429d1f4a719-original-pull-secret\") pod \"global-pull-secret-syncer-99gp5\" (UID: \"e8b1cfd1-164c-4442-b711-c429d1f4a719\") " pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:41:46.910959 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:46.910877 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 16:41:46.910959 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:46.910946 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8b1cfd1-164c-4442-b711-c429d1f4a719-original-pull-secret podName:e8b1cfd1-164c-4442-b711-c429d1f4a719 nodeName:}" failed. No retries permitted until 2026-09-17 16:41:47.910922885 +0000 UTC m=+4.106917013 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8b1cfd1-164c-4442-b711-c429d1f4a719-original-pull-secret") pod "global-pull-secret-syncer-99gp5" (UID: "e8b1cfd1-164c-4442-b711-c429d1f4a719") : object "kube-system"/"original-pull-secret" not registered Sep 17 16:41:47.011838 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:47.011804 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whvdf\" (UniqueName: \"kubernetes.io/projected/447eed93-408e-4029-b493-f9ec83f577b4-kube-api-access-whvdf\") pod \"network-check-target-fqfbx\" (UID: \"447eed93-408e-4029-b493-f9ec83f577b4\") " pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:41:47.012021 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:47.011978 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 16:41:47.012021 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:47.012005 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 16:41:47.012021 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:47.012020 2574 projected.go:196] Error preparing data for projected volume kube-api-access-whvdf for pod openshift-network-diagnostics/network-check-target-fqfbx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:41:47.012190 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:47.012090 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/447eed93-408e-4029-b493-f9ec83f577b4-kube-api-access-whvdf podName:447eed93-408e-4029-b493-f9ec83f577b4 nodeName:}" failed. No retries permitted until 2026-09-17 16:41:48.012073196 +0000 UTC m=+4.208067341 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-whvdf" (UniqueName: "kubernetes.io/projected/447eed93-408e-4029-b493-f9ec83f577b4-kube-api-access-whvdf") pod "network-check-target-fqfbx" (UID: "447eed93-408e-4029-b493-f9ec83f577b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:41:47.267958 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:47.267916 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 16:36:46 +0000 UTC" deadline="2028-02-29 12:49:48.143386466 +0000 UTC" Sep 17 16:41:47.267958 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:47.267953 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12716h8m0.875438208s" Sep 17 16:41:47.323027 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:47.322993 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:41:47.323186 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:47.323118 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-99gp5" podUID="e8b1cfd1-164c-4442-b711-c429d1f4a719" Sep 17 16:41:47.446262 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:47.446235 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 16:41:47.500775 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:47.500742 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85a077ee_c427_421c_930d_0deeda5fb58c.slice/crio-3c2a5c6243571dd2c9d15af9a52aa55d7891c7c19d5d1a697f1fd911e96702bd WatchSource:0}: Error finding container 3c2a5c6243571dd2c9d15af9a52aa55d7891c7c19d5d1a697f1fd911e96702bd: Status 404 returned error can't find the container with id 3c2a5c6243571dd2c9d15af9a52aa55d7891c7c19d5d1a697f1fd911e96702bd Sep 17 16:41:47.502499 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:47.502054 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod804bc511_5b2f_407e_b47f_ddd4333a6064.slice/crio-e863ec5068d3759add6e5b8171f34b94709941c7163f465d1182281039e22b6e WatchSource:0}: Error finding container e863ec5068d3759add6e5b8171f34b94709941c7163f465d1182281039e22b6e: Status 404 returned error can't find the container with id e863ec5068d3759add6e5b8171f34b94709941c7163f465d1182281039e22b6e Sep 17 16:41:47.504186 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:47.504161 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf165c12c_1f10_400e_b4f7_270a1a0e9805.slice/crio-daa3a3910be9399a32af0994a20e0cd5ac9b84dfe19b8c310930d43b43e05d62 WatchSource:0}: Error finding container daa3a3910be9399a32af0994a20e0cd5ac9b84dfe19b8c310930d43b43e05d62: Status 404 returned error can't find the container with id daa3a3910be9399a32af0994a20e0cd5ac9b84dfe19b8c310930d43b43e05d62 Sep 17 16:41:47.508130 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:47.508095 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e9d0c9e_7030_4ef1_8d43_9f6af050bae5.slice/crio-a7d91f1abde663badebb7cdedec7e71065de5f88413e639b6959eec5db258bdf WatchSource:0}: Error finding container a7d91f1abde663badebb7cdedec7e71065de5f88413e639b6959eec5db258bdf: Status 404 returned error can't find the container with id a7d91f1abde663badebb7cdedec7e71065de5f88413e639b6959eec5db258bdf Sep 17 16:41:47.509236 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:47.509197 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ae835cf_1368_4764_bed6_52ed2b5f9f27.slice/crio-5d4a922554aea5055a76516d84465d067a5a47791e2d43204d8403d15609b051 WatchSource:0}: Error finding container 5d4a922554aea5055a76516d84465d067a5a47791e2d43204d8403d15609b051: Status 404 returned error can't find the container with id 5d4a922554aea5055a76516d84465d067a5a47791e2d43204d8403d15609b051 Sep 17 16:41:47.509893 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:47.509784 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf639c21b_ffa0_4516_b1b7_528597d477e4.slice/crio-2586780a99925aab4eb1216bbd4bf34f5aa5bd69046815b55953ab293812044d WatchSource:0}: Error finding container 2586780a99925aab4eb1216bbd4bf34f5aa5bd69046815b55953ab293812044d: Status 404 returned error can't find the container with id 2586780a99925aab4eb1216bbd4bf34f5aa5bd69046815b55953ab293812044d Sep 17 16:41:47.513037 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:41:47.513010 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod211fa1c6_ea59_4f31_a5e8_80a5b88fef83.slice/crio-156383920b7010c2ef8ed878e171dd01a80d96b4c6ad5b02224697bffe4091ef WatchSource:0}: Error finding container 156383920b7010c2ef8ed878e171dd01a80d96b4c6ad5b02224697bffe4091ef: Status 404 returned error can't find the container with id 156383920b7010c2ef8ed878e171dd01a80d96b4c6ad5b02224697bffe4091ef Sep 17 16:41:47.818688 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:47.818538 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0f01af1-e02f-4105-8edb-33a5b8acab5c-metrics-certs\") pod \"network-metrics-daemon-glhzf\" (UID: \"c0f01af1-e02f-4105-8edb-33a5b8acab5c\") " pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:41:47.818775 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:47.818686 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:41:47.818775 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:47.818751 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0f01af1-e02f-4105-8edb-33a5b8acab5c-metrics-certs podName:c0f01af1-e02f-4105-8edb-33a5b8acab5c nodeName:}" failed. No retries permitted until 2026-09-17 16:41:49.818733453 +0000 UTC m=+6.014727580 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0f01af1-e02f-4105-8edb-33a5b8acab5c-metrics-certs") pod "network-metrics-daemon-glhzf" (UID: "c0f01af1-e02f-4105-8edb-33a5b8acab5c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:41:47.919277 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:47.919247 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8b1cfd1-164c-4442-b711-c429d1f4a719-original-pull-secret\") pod \"global-pull-secret-syncer-99gp5\" (UID: \"e8b1cfd1-164c-4442-b711-c429d1f4a719\") " pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:41:47.919468 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:47.919428 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 16:41:47.919554 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:47.919526 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8b1cfd1-164c-4442-b711-c429d1f4a719-original-pull-secret podName:e8b1cfd1-164c-4442-b711-c429d1f4a719 nodeName:}" failed. No retries permitted until 2026-09-17 16:41:49.919503637 +0000 UTC m=+6.115497784 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8b1cfd1-164c-4442-b711-c429d1f4a719-original-pull-secret") pod "global-pull-secret-syncer-99gp5" (UID: "e8b1cfd1-164c-4442-b711-c429d1f4a719") : object "kube-system"/"original-pull-secret" not registered Sep 17 16:41:48.020738 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:48.020041 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whvdf\" (UniqueName: \"kubernetes.io/projected/447eed93-408e-4029-b493-f9ec83f577b4-kube-api-access-whvdf\") pod \"network-check-target-fqfbx\" (UID: \"447eed93-408e-4029-b493-f9ec83f577b4\") " pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:41:48.020738 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:48.020209 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 16:41:48.020738 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:48.020229 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 16:41:48.020738 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:48.020243 2574 projected.go:196] Error preparing data for projected volume kube-api-access-whvdf for pod openshift-network-diagnostics/network-check-target-fqfbx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:41:48.020738 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:48.020352 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/447eed93-408e-4029-b493-f9ec83f577b4-kube-api-access-whvdf podName:447eed93-408e-4029-b493-f9ec83f577b4 nodeName:}" failed. No retries permitted until 2026-09-17 16:41:50.020330275 +0000 UTC m=+6.216324420 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-whvdf" (UniqueName: "kubernetes.io/projected/447eed93-408e-4029-b493-f9ec83f577b4-kube-api-access-whvdf") pod "network-check-target-fqfbx" (UID: "447eed93-408e-4029-b493-f9ec83f577b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:41:48.268985 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:48.268923 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 16:36:46 +0000 UTC" deadline="2028-06-03 06:48:29.072788236 +0000 UTC" Sep 17 16:41:48.268985 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:48.268983 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14990h6m40.803808949s" Sep 17 16:41:48.325028 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:48.324388 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:41:48.325028 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:48.324547 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqfbx" podUID="447eed93-408e-4029-b493-f9ec83f577b4" Sep 17 16:41:48.325028 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:48.324812 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:41:48.325028 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:48.324933 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glhzf" podUID="c0f01af1-e02f-4105-8edb-33a5b8acab5c" Sep 17 16:41:48.346764 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:48.346601 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" event={"ID":"f165c12c-1f10-400e-b4f7-270a1a0e9805","Type":"ContainerStarted","Data":"daa3a3910be9399a32af0994a20e0cd5ac9b84dfe19b8c310930d43b43e05d62"} Sep 17 16:41:48.358572 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:48.358495 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-spcc4" event={"ID":"804bc511-5b2f-407e-b47f-ddd4333a6064","Type":"ContainerStarted","Data":"e863ec5068d3759add6e5b8171f34b94709941c7163f465d1182281039e22b6e"} Sep 17 16:41:48.371105 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:48.370411 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-146.ec2.internal" event={"ID":"d0d4a61112593ffdf8087d8d186a27c8","Type":"ContainerStarted","Data":"7faa4c20ab47b8889850107b302511347a4789597ea5fcfa9e366e5e17bd14aa"} Sep 17 16:41:48.374375 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:48.374304 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tb4rk" event={"ID":"211fa1c6-ea59-4f31-a5e8-80a5b88fef83","Type":"ContainerStarted","Data":"156383920b7010c2ef8ed878e171dd01a80d96b4c6ad5b02224697bffe4091ef"} Sep 17 16:41:48.383899 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:48.383873 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ck84q" event={"ID":"1ae835cf-1368-4764-bed6-52ed2b5f9f27","Type":"ContainerStarted","Data":"5d4a922554aea5055a76516d84465d067a5a47791e2d43204d8403d15609b051"} Sep 17 16:41:48.392711 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:48.392659 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-146.ec2.internal" podStartSLOduration=3.392641591 podStartE2EDuration="3.392641591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:41:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:41:48.392543248 +0000 UTC m=+4.588537403" watchObservedRunningTime="2026-09-17 16:41:48.392641591 +0000 UTC m=+4.588635737" Sep 17 16:41:48.397744 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:48.397715 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjknd" event={"ID":"85a077ee-c427-421c-930d-0deeda5fb58c","Type":"ContainerStarted","Data":"3c2a5c6243571dd2c9d15af9a52aa55d7891c7c19d5d1a697f1fd911e96702bd"} Sep 17 16:41:48.405498 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:48.405469 2574 generic.go:356] "Generic (PLEG): container finished" podID="fdf5e3af8557b9fa01d00337bee43c12" containerID="8b16c6e3e8b0544d907ab7b2f234c49b9578f8cc5b0479b1b43c97b93811f857" exitCode=0 Sep 17 16:41:48.406483 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:48.406456 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal" event={"ID":"fdf5e3af8557b9fa01d00337bee43c12","Type":"ContainerDied","Data":"8b16c6e3e8b0544d907ab7b2f234c49b9578f8cc5b0479b1b43c97b93811f857"} Sep 17 16:41:48.415254 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:48.415229 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7xjlf" event={"ID":"dcc9a981-3536-4588-a119-b7912e2fa48e","Type":"ContainerStarted","Data":"b040764031e4079f00210368a8930285c0b21f4ff37b53d0f062f60a4452cc90"} Sep 17 16:41:48.428469 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:48.428336 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" event={"ID":"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01","Type":"ContainerStarted","Data":"8863059f54b42b7b9b4604cda44cc2d1751e24d0154db74478aef67297d455c4"} Sep 17 16:41:48.439644 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:48.439544 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9f79b" event={"ID":"f639c21b-ffa0-4516-b1b7-528597d477e4","Type":"ContainerStarted","Data":"2586780a99925aab4eb1216bbd4bf34f5aa5bd69046815b55953ab293812044d"} Sep 17 16:41:48.448032 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:48.447843 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rqj26" event={"ID":"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5","Type":"ContainerStarted","Data":"a7d91f1abde663badebb7cdedec7e71065de5f88413e639b6959eec5db258bdf"} Sep 17 16:41:49.322705 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:49.322671 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:41:49.323212 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:49.322836 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-99gp5" podUID="e8b1cfd1-164c-4442-b711-c429d1f4a719" Sep 17 16:41:49.465155 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:49.465060 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal" event={"ID":"fdf5e3af8557b9fa01d00337bee43c12","Type":"ContainerStarted","Data":"f63d902fdf49e11858164cba30dc0b1734cc729ce97262c65788220ddda4b405"} Sep 17 16:41:49.841475 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:49.841434 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0f01af1-e02f-4105-8edb-33a5b8acab5c-metrics-certs\") pod \"network-metrics-daemon-glhzf\" (UID: \"c0f01af1-e02f-4105-8edb-33a5b8acab5c\") " pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:41:49.841689 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:49.841633 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:41:49.841759 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:49.841710 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0f01af1-e02f-4105-8edb-33a5b8acab5c-metrics-certs podName:c0f01af1-e02f-4105-8edb-33a5b8acab5c nodeName:}" failed. No retries permitted until 2026-09-17 16:41:53.841679837 +0000 UTC m=+10.037673968 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0f01af1-e02f-4105-8edb-33a5b8acab5c-metrics-certs") pod "network-metrics-daemon-glhzf" (UID: "c0f01af1-e02f-4105-8edb-33a5b8acab5c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:41:49.942912 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:49.942210 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8b1cfd1-164c-4442-b711-c429d1f4a719-original-pull-secret\") pod \"global-pull-secret-syncer-99gp5\" (UID: \"e8b1cfd1-164c-4442-b711-c429d1f4a719\") " pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:41:49.942912 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:49.942375 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 16:41:49.942912 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:49.942451 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8b1cfd1-164c-4442-b711-c429d1f4a719-original-pull-secret podName:e8b1cfd1-164c-4442-b711-c429d1f4a719 nodeName:}" failed. No retries permitted until 2026-09-17 16:41:53.942416509 +0000 UTC m=+10.138410637 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8b1cfd1-164c-4442-b711-c429d1f4a719-original-pull-secret") pod "global-pull-secret-syncer-99gp5" (UID: "e8b1cfd1-164c-4442-b711-c429d1f4a719") : object "kube-system"/"original-pull-secret" not registered Sep 17 16:41:50.043090 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:50.042986 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whvdf\" (UniqueName: \"kubernetes.io/projected/447eed93-408e-4029-b493-f9ec83f577b4-kube-api-access-whvdf\") pod \"network-check-target-fqfbx\" (UID: \"447eed93-408e-4029-b493-f9ec83f577b4\") " pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:41:50.043338 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:50.043320 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 16:41:50.043419 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:50.043345 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 16:41:50.043419 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:50.043358 2574 projected.go:196] Error preparing data for projected volume kube-api-access-whvdf for pod openshift-network-diagnostics/network-check-target-fqfbx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:41:50.043560 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:50.043432 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/447eed93-408e-4029-b493-f9ec83f577b4-kube-api-access-whvdf podName:447eed93-408e-4029-b493-f9ec83f577b4 nodeName:}" failed. No retries permitted until 2026-09-17 16:41:54.043398994 +0000 UTC m=+10.239393132 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-whvdf" (UniqueName: "kubernetes.io/projected/447eed93-408e-4029-b493-f9ec83f577b4-kube-api-access-whvdf") pod "network-check-target-fqfbx" (UID: "447eed93-408e-4029-b493-f9ec83f577b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:41:50.323048 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:50.323017 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:41:50.323592 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:50.323147 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqfbx" podUID="447eed93-408e-4029-b493-f9ec83f577b4" Sep 17 16:41:50.325688 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:50.322973 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:41:50.325816 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:50.325705 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glhzf" podUID="c0f01af1-e02f-4105-8edb-33a5b8acab5c" Sep 17 16:41:51.322960 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:51.322924 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:41:51.323146 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:51.323067 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-99gp5" podUID="e8b1cfd1-164c-4442-b711-c429d1f4a719" Sep 17 16:41:52.324021 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:52.323988 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:41:52.324429 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:52.324120 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqfbx" podUID="447eed93-408e-4029-b493-f9ec83f577b4" Sep 17 16:41:52.324429 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:52.324196 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:41:52.324429 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:52.324253 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glhzf" podUID="c0f01af1-e02f-4105-8edb-33a5b8acab5c" Sep 17 16:41:53.322236 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:53.322202 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:41:53.322388 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:53.322342 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-99gp5" podUID="e8b1cfd1-164c-4442-b711-c429d1f4a719" Sep 17 16:41:53.879068 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:53.878977 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0f01af1-e02f-4105-8edb-33a5b8acab5c-metrics-certs\") pod \"network-metrics-daemon-glhzf\" (UID: \"c0f01af1-e02f-4105-8edb-33a5b8acab5c\") " pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:41:53.879603 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:53.879175 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:41:53.879603 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:53.879251 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0f01af1-e02f-4105-8edb-33a5b8acab5c-metrics-certs podName:c0f01af1-e02f-4105-8edb-33a5b8acab5c nodeName:}" failed. No retries permitted until 2026-09-17 16:42:01.87922929 +0000 UTC m=+18.075223419 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0f01af1-e02f-4105-8edb-33a5b8acab5c-metrics-certs") pod "network-metrics-daemon-glhzf" (UID: "c0f01af1-e02f-4105-8edb-33a5b8acab5c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:41:53.979936 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:53.979902 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8b1cfd1-164c-4442-b711-c429d1f4a719-original-pull-secret\") pod \"global-pull-secret-syncer-99gp5\" (UID: \"e8b1cfd1-164c-4442-b711-c429d1f4a719\") " pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:41:53.980096 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:53.980074 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 16:41:53.980173 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:53.980132 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8b1cfd1-164c-4442-b711-c429d1f4a719-original-pull-secret podName:e8b1cfd1-164c-4442-b711-c429d1f4a719 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:01.980114734 +0000 UTC m=+18.176108866 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8b1cfd1-164c-4442-b711-c429d1f4a719-original-pull-secret") pod "global-pull-secret-syncer-99gp5" (UID: "e8b1cfd1-164c-4442-b711-c429d1f4a719") : object "kube-system"/"original-pull-secret" not registered Sep 17 16:41:54.080693 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:54.080657 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whvdf\" (UniqueName: \"kubernetes.io/projected/447eed93-408e-4029-b493-f9ec83f577b4-kube-api-access-whvdf\") pod \"network-check-target-fqfbx\" (UID: \"447eed93-408e-4029-b493-f9ec83f577b4\") " pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:41:54.080870 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:54.080817 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 16:41:54.080870 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:54.080836 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 16:41:54.080870 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:54.080849 2574 projected.go:196] Error preparing data for projected volume kube-api-access-whvdf for pod openshift-network-diagnostics/network-check-target-fqfbx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:41:54.081037 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:54.080908 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/447eed93-408e-4029-b493-f9ec83f577b4-kube-api-access-whvdf podName:447eed93-408e-4029-b493-f9ec83f577b4 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:02.08089364 +0000 UTC m=+18.276887766 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-whvdf" (UniqueName: "kubernetes.io/projected/447eed93-408e-4029-b493-f9ec83f577b4-kube-api-access-whvdf") pod "network-check-target-fqfbx" (UID: "447eed93-408e-4029-b493-f9ec83f577b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:41:54.323697 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:54.323667 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:41:54.323850 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:54.323793 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glhzf" podUID="c0f01af1-e02f-4105-8edb-33a5b8acab5c" Sep 17 16:41:54.323930 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:54.323893 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:41:54.324019 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:54.323996 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqfbx" podUID="447eed93-408e-4029-b493-f9ec83f577b4" Sep 17 16:41:55.322970 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:55.322935 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:41:55.323344 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:55.323066 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-99gp5" podUID="e8b1cfd1-164c-4442-b711-c429d1f4a719" Sep 17 16:41:56.326463 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:56.325881 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:41:56.326463 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:56.325992 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqfbx" podUID="447eed93-408e-4029-b493-f9ec83f577b4" Sep 17 16:41:56.326463 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:56.326063 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:41:56.326463 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:56.326142 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glhzf" podUID="c0f01af1-e02f-4105-8edb-33a5b8acab5c" Sep 17 16:41:57.322485 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:57.322454 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:41:57.322661 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:57.322569 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-99gp5" podUID="e8b1cfd1-164c-4442-b711-c429d1f4a719" Sep 17 16:41:58.322168 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:58.322140 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:41:58.322168 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:58.322154 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:41:58.322693 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:58.322232 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqfbx" podUID="447eed93-408e-4029-b493-f9ec83f577b4" Sep 17 16:41:58.322693 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:58.322344 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glhzf" podUID="c0f01af1-e02f-4105-8edb-33a5b8acab5c" Sep 17 16:41:59.322604 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:41:59.322565 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:41:59.323120 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:41:59.322696 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-99gp5" podUID="e8b1cfd1-164c-4442-b711-c429d1f4a719" Sep 17 16:42:00.322906 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:00.322868 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:42:00.323340 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:00.322920 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:42:00.323340 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:00.323013 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glhzf" podUID="c0f01af1-e02f-4105-8edb-33a5b8acab5c" Sep 17 16:42:00.323340 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:00.323137 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqfbx" podUID="447eed93-408e-4029-b493-f9ec83f577b4" Sep 17 16:42:01.322618 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:01.322586 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:42:01.322898 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:01.322699 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-99gp5" podUID="e8b1cfd1-164c-4442-b711-c429d1f4a719" Sep 17 16:42:01.940747 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:01.940709 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0f01af1-e02f-4105-8edb-33a5b8acab5c-metrics-certs\") pod \"network-metrics-daemon-glhzf\" (UID: \"c0f01af1-e02f-4105-8edb-33a5b8acab5c\") " pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:42:01.941132 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:01.940832 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:42:01.941132 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:01.940885 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0f01af1-e02f-4105-8edb-33a5b8acab5c-metrics-certs podName:c0f01af1-e02f-4105-8edb-33a5b8acab5c nodeName:}" failed. No retries permitted until 2026-09-17 16:42:17.940871354 +0000 UTC m=+34.136865480 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0f01af1-e02f-4105-8edb-33a5b8acab5c-metrics-certs") pod "network-metrics-daemon-glhzf" (UID: "c0f01af1-e02f-4105-8edb-33a5b8acab5c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:42:02.041559 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:02.041518 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8b1cfd1-164c-4442-b711-c429d1f4a719-original-pull-secret\") pod \"global-pull-secret-syncer-99gp5\" (UID: \"e8b1cfd1-164c-4442-b711-c429d1f4a719\") " pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:42:02.041729 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:02.041683 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 16:42:02.041790 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:02.041768 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8b1cfd1-164c-4442-b711-c429d1f4a719-original-pull-secret podName:e8b1cfd1-164c-4442-b711-c429d1f4a719 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:18.041746723 +0000 UTC m=+34.237740854 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8b1cfd1-164c-4442-b711-c429d1f4a719-original-pull-secret") pod "global-pull-secret-syncer-99gp5" (UID: "e8b1cfd1-164c-4442-b711-c429d1f4a719") : object "kube-system"/"original-pull-secret" not registered Sep 17 16:42:02.142815 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:02.142768 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whvdf\" (UniqueName: \"kubernetes.io/projected/447eed93-408e-4029-b493-f9ec83f577b4-kube-api-access-whvdf\") pod \"network-check-target-fqfbx\" (UID: \"447eed93-408e-4029-b493-f9ec83f577b4\") " pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:42:02.142987 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:02.142966 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 16:42:02.143052 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:02.142991 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 16:42:02.143052 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:02.143002 2574 projected.go:196] Error preparing data for projected volume kube-api-access-whvdf for pod openshift-network-diagnostics/network-check-target-fqfbx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:42:02.143140 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:02.143065 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/447eed93-408e-4029-b493-f9ec83f577b4-kube-api-access-whvdf podName:447eed93-408e-4029-b493-f9ec83f577b4 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:18.143049843 +0000 UTC m=+34.339043971 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-whvdf" (UniqueName: "kubernetes.io/projected/447eed93-408e-4029-b493-f9ec83f577b4-kube-api-access-whvdf") pod "network-check-target-fqfbx" (UID: "447eed93-408e-4029-b493-f9ec83f577b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:42:02.323073 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:02.322396 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:42:02.323073 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:02.322569 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glhzf" podUID="c0f01af1-e02f-4105-8edb-33a5b8acab5c" Sep 17 16:42:02.323073 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:02.322903 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:42:02.323073 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:02.322992 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqfbx" podUID="447eed93-408e-4029-b493-f9ec83f577b4" Sep 17 16:42:03.322634 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:03.322597 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:42:03.323115 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:03.322732 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-99gp5" podUID="e8b1cfd1-164c-4442-b711-c429d1f4a719" Sep 17 16:42:04.325718 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:04.324452 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:42:04.325718 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:04.324600 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqfbx" podUID="447eed93-408e-4029-b493-f9ec83f577b4" Sep 17 16:42:04.325718 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:04.325321 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:42:04.325718 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:04.325473 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glhzf" podUID="c0f01af1-e02f-4105-8edb-33a5b8acab5c" Sep 17 16:42:05.322955 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:05.322920 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:42:05.323134 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:05.323041 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-99gp5" podUID="e8b1cfd1-164c-4442-b711-c429d1f4a719" Sep 17 16:42:06.322958 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:06.322544 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:42:06.323393 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:06.322545 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:42:06.323393 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:06.323089 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glhzf" podUID="c0f01af1-e02f-4105-8edb-33a5b8acab5c" Sep 17 16:42:06.323393 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:06.323138 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqfbx" podUID="447eed93-408e-4029-b493-f9ec83f577b4" Sep 17 16:42:06.501368 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:06.501336 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7xjlf" event={"ID":"dcc9a981-3536-4588-a119-b7912e2fa48e","Type":"ContainerStarted","Data":"93a2b287a4df967f13539e8f9fa372baf40fd94ac4990c132384683ae8ce045b"} Sep 17 16:42:06.502994 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:06.502973 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" event={"ID":"a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01","Type":"ContainerStarted","Data":"f70313a930482398bc548a1a40d79fb4b0cd0270b12c83fe38844384105770a1"} Sep 17 16:42:06.504595 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:06.504546 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9f79b" event={"ID":"f639c21b-ffa0-4516-b1b7-528597d477e4","Type":"ContainerStarted","Data":"e8d75d2353d06a812c38d76aa7ac0e03f92a8509c6de6d9f03b7e5413e33f55a"} Sep 17 16:42:06.506301 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:06.506116 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rqj26" event={"ID":"4e9d0c9e-7030-4ef1-8d43-9f6af050bae5","Type":"ContainerStarted","Data":"09a0b57a35900ffc2ff4d7a10dc28da3d265e33b67e540d43ae5113cf03cbf81"} Sep 17 16:42:06.509452 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:06.509412 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" event={"ID":"f165c12c-1f10-400e-b4f7-270a1a0e9805","Type":"ContainerStarted","Data":"32673d57065ebebb38ea1724dd3c49c516356cec6cdb572f7654121626b49897"} Sep 17 16:42:06.509542 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:06.509514 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" event={"ID":"f165c12c-1f10-400e-b4f7-270a1a0e9805","Type":"ContainerStarted","Data":"b678155eca1b700c71db680c681bc2712b109316047df00931ae829eef085399"} Sep 17 16:42:06.509604 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:06.509564 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" event={"ID":"f165c12c-1f10-400e-b4f7-270a1a0e9805","Type":"ContainerStarted","Data":"f8ca9c8dd99adb93e9f0ec6f7a822a737af4de6a18f4e33835e97916aca1b3fe"} Sep 17 16:42:06.509662 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:06.509604 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" event={"ID":"f165c12c-1f10-400e-b4f7-270a1a0e9805","Type":"ContainerStarted","Data":"1710071d351732ee67d3f90888ebc8a38f9d37d214543c7b22b905dbe3bf891b"} Sep 17 16:42:06.509662 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:06.509644 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" event={"ID":"f165c12c-1f10-400e-b4f7-270a1a0e9805","Type":"ContainerStarted","Data":"19f58f6cd095ec0b01d6530959c1d5d88a95ee086b56f1367e0dfff11e235f84"} Sep 17 16:42:06.509768 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:06.509676 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" event={"ID":"f165c12c-1f10-400e-b4f7-270a1a0e9805","Type":"ContainerStarted","Data":"5e1ac4ceb4025ff4925d01574cecd5edb2d705a5d0f64f534a1ee5deb950fdcd"} Sep 17 16:42:06.511055 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:06.511034 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-spcc4" event={"ID":"804bc511-5b2f-407e-b47f-ddd4333a6064","Type":"ContainerStarted","Data":"b9bef73885d8132204bbfdc4d3df0148ee698498fff4012aac2f9a9e30bd9d1b"} Sep 17 16:42:06.514685 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:06.514626 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ck84q" event={"ID":"1ae835cf-1368-4764-bed6-52ed2b5f9f27","Type":"ContainerStarted","Data":"0ddbe4653f52b3fe1d4eba2218bf188b358d5f7bebc42c2727093b8b0dacd30a"} Sep 17 16:42:06.516759 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:06.516718 2574 generic.go:356] "Generic (PLEG): container finished" podID="85a077ee-c427-421c-930d-0deeda5fb58c" containerID="fb80feb79fdbf18e652e555ad08f14b88dd3b4665897a5c82ffda97fc20b5f96" exitCode=0 Sep 17 16:42:06.516864 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:06.516774 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjknd" event={"ID":"85a077ee-c427-421c-930d-0deeda5fb58c","Type":"ContainerDied","Data":"fb80feb79fdbf18e652e555ad08f14b88dd3b4665897a5c82ffda97fc20b5f96"} Sep 17 16:42:06.518598 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:06.518561 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7xjlf" podStartSLOduration=4.321867858 podStartE2EDuration="22.518549602s" totalImagesPullingTime="18.196681744s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:41:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:06.51825491 +0000 UTC m=+22.714249059" watchObservedRunningTime="2026-09-17 16:42:06.518549602 +0000 UTC m=+22.714543750" Sep 17 16:42:06.518689 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:06.518623 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-146.ec2.internal" podStartSLOduration=21.518618985 podStartE2EDuration="21.518618985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:41:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:41:49.497962252 +0000 UTC m=+5.693956403" watchObservedRunningTime="2026-09-17 16:42:06.518618985 +0000 UTC m=+22.714613135" Sep 17 16:42:06.538704 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:06.538660 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5qmf9" podStartSLOduration=3.301703101 podStartE2EDuration="21.538643143s" totalImagesPullingTime="18.236940042s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:41:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:06.538482283 +0000 UTC m=+22.734476432" watchObservedRunningTime="2026-09-17 16:42:06.538643143 +0000 UTC m=+22.734637292" Sep 17 16:42:06.557721 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:06.557678 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rqj26" podStartSLOduration=4.296997572 podStartE2EDuration="22.557663922s" totalImagesPullingTime="18.26066635s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:41:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:06.557206635 +0000 UTC m=+22.753200786" watchObservedRunningTime="2026-09-17 16:42:06.557663922 +0000 UTC m=+22.753658069" Sep 17 16:42:06.611393 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:06.611340 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-spcc4" podStartSLOduration=3.406021936 podStartE2EDuration="21.611322058s" totalImagesPullingTime="18.205300122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:41:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:06.611231081 +0000 UTC m=+22.807225228" watchObservedRunningTime="2026-09-17 16:42:06.611322058 +0000 UTC m=+22.807316208" Sep 17 16:42:06.644886 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:06.644827 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9f79b" podStartSLOduration=10.693463329 podStartE2EDuration="21.644810072s" totalImagesPullingTime="10.951346743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:41:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:06.644804265 +0000 UTC m=+22.840798413" watchObservedRunningTime="2026-09-17 16:42:06.644810072 +0000 UTC m=+22.840804228" Sep 17 16:42:07.224801 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:07.224771 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 17 16:42:07.264181 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:07.264091 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T16:42:07.224797434Z","UUID":"7e788487-8563-48d6-a18b-1d9827802fd2","Handler":null,"Name":"","Endpoint":""} Sep 17 16:42:07.265804 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:07.265782 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 17 16:42:07.265922 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:07.265838 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 17 16:42:07.322812 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:07.322780 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:42:07.322988 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:07.322908 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-99gp5" podUID="e8b1cfd1-164c-4442-b711-c429d1f4a719" Sep 17 16:42:07.520878 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:07.520841 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tb4rk" event={"ID":"211fa1c6-ea59-4f31-a5e8-80a5b88fef83","Type":"ContainerStarted","Data":"7e23794c8a31b5ae4faae4a60210956a8cc6d7ee199967dd1ef5285a6ca8c14f"} Sep 17 16:42:07.522703 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:07.522677 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ck84q" event={"ID":"1ae835cf-1368-4764-bed6-52ed2b5f9f27","Type":"ContainerStarted","Data":"5c0109ea2f22ccf792fe0c837735844010893771c173b8536761a45e2645c6c9"} Sep 17 16:42:07.537731 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:07.537686 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tb4rk" podStartSLOduration=4.340894474 podStartE2EDuration="22.537673144s" totalImagesPullingTime="18.19677867s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:41:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:07.537586416 +0000 UTC m=+23.733580563" watchObservedRunningTime="2026-09-17 16:42:07.537673144 +0000 UTC m=+23.733667292" Sep 17 16:42:08.322865 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:08.322830 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:42:08.322865 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:08.322852 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:42:08.323490 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:08.322966 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glhzf" podUID="c0f01af1-e02f-4105-8edb-33a5b8acab5c" Sep 17 16:42:08.323490 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:08.323094 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqfbx" podUID="447eed93-408e-4029-b493-f9ec83f577b4" Sep 17 16:42:08.527769 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:08.527729 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ck84q" event={"ID":"1ae835cf-1368-4764-bed6-52ed2b5f9f27","Type":"ContainerStarted","Data":"1ec958efef0554745ab52cfe80f1eadc5339e1b1b6a9dc34c6befe9d594b705e"} Sep 17 16:42:08.555315 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:08.555264 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ck84q" podStartSLOduration=3.319694878 podStartE2EDuration="23.555242462s" totalImagesPullingTime="20.235547584s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:41:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:08.554459087 +0000 UTC m=+24.750453238" watchObservedRunningTime="2026-09-17 16:42:08.555242462 +0000 UTC m=+24.751236612" Sep 17 16:42:08.975117 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:08.975083 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9f79b" Sep 17 16:42:08.976170 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:08.976141 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9f79b" Sep 17 16:42:09.323049 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:09.322978 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:42:09.323384 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:09.323072 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-99gp5" podUID="e8b1cfd1-164c-4442-b711-c429d1f4a719" Sep 17 16:42:09.534232 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:09.534200 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" event={"ID":"f165c12c-1f10-400e-b4f7-270a1a0e9805","Type":"ContainerStarted","Data":"cf17e2c591813312f4d731c545ce7f98aedbb10d6a3c9419a139cc9d17cd7202"} Sep 17 16:42:09.534471 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:09.534454 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9f79b" Sep 17 16:42:09.534936 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:09.534915 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9f79b" Sep 17 16:42:10.322057 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:10.322016 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:42:10.322238 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:10.322111 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqfbx" podUID="447eed93-408e-4029-b493-f9ec83f577b4" Sep 17 16:42:10.322238 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:10.322176 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:42:10.322355 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:10.322289 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glhzf" podUID="c0f01af1-e02f-4105-8edb-33a5b8acab5c" Sep 17 16:42:11.322514 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:11.322477 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:42:11.323030 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:11.322619 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-99gp5" podUID="e8b1cfd1-164c-4442-b711-c429d1f4a719" Sep 17 16:42:12.322088 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:12.321931 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:42:12.322178 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:12.322005 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:42:12.322218 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:12.322177 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glhzf" podUID="c0f01af1-e02f-4105-8edb-33a5b8acab5c" Sep 17 16:42:12.322292 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:12.322272 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqfbx" podUID="447eed93-408e-4029-b493-f9ec83f577b4" Sep 17 16:42:12.544657 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:12.544620 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" event={"ID":"f165c12c-1f10-400e-b4f7-270a1a0e9805","Type":"ContainerStarted","Data":"a6c2f4d46ef3ab6a06d9d205eea7cc938f61cc188245fd770e54a1c9e2ffa44e"} Sep 17 16:42:12.545045 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:12.544861 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:42:12.546646 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:12.546623 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjknd" event={"ID":"85a077ee-c427-421c-930d-0deeda5fb58c","Type":"ContainerStarted","Data":"6c18e98879245e25f4e8a1575c013a10795bd283f652641ee5df368c1d2d0a86"} Sep 17 16:42:12.561286 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:12.561234 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:42:12.578101 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:12.578066 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" podStartSLOduration=9.309688238 podStartE2EDuration="27.57805434s" totalImagesPullingTime="18.268366102s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:41:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:12.577978566 +0000 UTC m=+28.773972710" watchObservedRunningTime="2026-09-17 16:42:12.57805434 +0000 UTC m=+28.774048487" Sep 17 16:42:13.322411 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:13.322236 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:42:13.322637 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:13.322544 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-99gp5" podUID="e8b1cfd1-164c-4442-b711-c429d1f4a719" Sep 17 16:42:13.550667 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:13.550632 2574 generic.go:356] "Generic (PLEG): container finished" podID="85a077ee-c427-421c-930d-0deeda5fb58c" containerID="6c18e98879245e25f4e8a1575c013a10795bd283f652641ee5df368c1d2d0a86" exitCode=0 Sep 17 16:42:13.551047 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:13.550706 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjknd" event={"ID":"85a077ee-c427-421c-930d-0deeda5fb58c","Type":"ContainerDied","Data":"6c18e98879245e25f4e8a1575c013a10795bd283f652641ee5df368c1d2d0a86"} Sep 17 16:42:13.551162 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:13.551143 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:42:13.551231 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:13.551219 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:42:13.567247 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:13.567221 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:42:14.323232 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:14.323203 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:42:14.323385 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:14.323305 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glhzf" podUID="c0f01af1-e02f-4105-8edb-33a5b8acab5c" Sep 17 16:42:14.323424 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:14.323395 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:42:14.323515 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:14.323495 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqfbx" podUID="447eed93-408e-4029-b493-f9ec83f577b4" Sep 17 16:42:14.356691 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:14.356634 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fqfbx"] Sep 17 16:42:14.359542 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:14.359519 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-99gp5"] Sep 17 16:42:14.359691 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:14.359676 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:42:14.359777 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:14.359757 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-99gp5" podUID="e8b1cfd1-164c-4442-b711-c429d1f4a719" Sep 17 16:42:14.362997 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:14.362977 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-glhzf"] Sep 17 16:42:14.555319 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:14.555285 2574 generic.go:356] "Generic (PLEG): container finished" podID="85a077ee-c427-421c-930d-0deeda5fb58c" containerID="20570f38e30ea3cbc915098e5546b230c21f1cd693e9092b814ddc4e8e8f9b01" exitCode=0 Sep 17 16:42:14.555319 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:14.555302 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjknd" event={"ID":"85a077ee-c427-421c-930d-0deeda5fb58c","Type":"ContainerDied","Data":"20570f38e30ea3cbc915098e5546b230c21f1cd693e9092b814ddc4e8e8f9b01"} Sep 17 16:42:14.555878 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:14.555368 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:42:14.555878 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:14.555422 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:42:14.555878 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:14.555573 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glhzf" podUID="c0f01af1-e02f-4105-8edb-33a5b8acab5c" Sep 17 16:42:14.556013 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:14.555908 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqfbx" podUID="447eed93-408e-4029-b493-f9ec83f577b4" Sep 17 16:42:16.322699 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:16.322668 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:42:16.322699 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:16.322682 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:42:16.323316 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:16.322682 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:42:16.323316 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:16.322763 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-99gp5" podUID="e8b1cfd1-164c-4442-b711-c429d1f4a719" Sep 17 16:42:16.323316 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:16.322828 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glhzf" podUID="c0f01af1-e02f-4105-8edb-33a5b8acab5c" Sep 17 16:42:16.323316 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:16.322881 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqfbx" podUID="447eed93-408e-4029-b493-f9ec83f577b4" Sep 17 16:42:16.562253 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:16.562223 2574 generic.go:356] "Generic (PLEG): container finished" podID="85a077ee-c427-421c-930d-0deeda5fb58c" containerID="5408fc0cb237b0c98195798297572a65e90c9f3dca1c633f510994c5c2b9831e" exitCode=0 Sep 17 16:42:16.562416 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:16.562269 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjknd" event={"ID":"85a077ee-c427-421c-930d-0deeda5fb58c","Type":"ContainerDied","Data":"5408fc0cb237b0c98195798297572a65e90c9f3dca1c633f510994c5c2b9831e"} Sep 17 16:42:17.948804 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:17.948632 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0f01af1-e02f-4105-8edb-33a5b8acab5c-metrics-certs\") pod \"network-metrics-daemon-glhzf\" (UID: \"c0f01af1-e02f-4105-8edb-33a5b8acab5c\") " pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:42:17.949306 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:17.948783 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:42:17.949306 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:17.948903 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0f01af1-e02f-4105-8edb-33a5b8acab5c-metrics-certs podName:c0f01af1-e02f-4105-8edb-33a5b8acab5c nodeName:}" failed. No retries permitted until 2026-09-17 16:42:49.948889365 +0000 UTC m=+66.144883491 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0f01af1-e02f-4105-8edb-33a5b8acab5c-metrics-certs") pod "network-metrics-daemon-glhzf" (UID: "c0f01af1-e02f-4105-8edb-33a5b8acab5c") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:42:18.049338 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.049309 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8b1cfd1-164c-4442-b711-c429d1f4a719-original-pull-secret\") pod \"global-pull-secret-syncer-99gp5\" (UID: \"e8b1cfd1-164c-4442-b711-c429d1f4a719\") " pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:42:18.049570 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:18.049550 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 16:42:18.049641 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:18.049630 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8b1cfd1-164c-4442-b711-c429d1f4a719-original-pull-secret podName:e8b1cfd1-164c-4442-b711-c429d1f4a719 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:50.049608081 +0000 UTC m=+66.245602221 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8b1cfd1-164c-4442-b711-c429d1f4a719-original-pull-secret") pod "global-pull-secret-syncer-99gp5" (UID: "e8b1cfd1-164c-4442-b711-c429d1f4a719") : object "kube-system"/"original-pull-secret" not registered Sep 17 16:42:18.150536 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.150501 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whvdf\" (UniqueName: \"kubernetes.io/projected/447eed93-408e-4029-b493-f9ec83f577b4-kube-api-access-whvdf\") pod \"network-check-target-fqfbx\" (UID: \"447eed93-408e-4029-b493-f9ec83f577b4\") " pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:42:18.150718 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:18.150681 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 16:42:18.150718 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:18.150700 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 16:42:18.150718 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:18.150713 2574 projected.go:196] Error preparing data for projected volume kube-api-access-whvdf for pod openshift-network-diagnostics/network-check-target-fqfbx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:42:18.150820 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:18.150770 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/447eed93-408e-4029-b493-f9ec83f577b4-kube-api-access-whvdf podName:447eed93-408e-4029-b493-f9ec83f577b4 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:50.15075031 +0000 UTC m=+66.346744442 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-whvdf" (UniqueName: "kubernetes.io/projected/447eed93-408e-4029-b493-f9ec83f577b4-kube-api-access-whvdf") pod "network-check-target-fqfbx" (UID: "447eed93-408e-4029-b493-f9ec83f577b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:42:18.322760 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.322724 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:42:18.322760 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.322739 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:42:18.323034 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:18.322859 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-99gp5" podUID="e8b1cfd1-164c-4442-b711-c429d1f4a719" Sep 17 16:42:18.323034 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:18.322891 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqfbx" podUID="447eed93-408e-4029-b493-f9ec83f577b4" Sep 17 16:42:18.323034 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.322930 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:42:18.323034 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:18.323013 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-glhzf" podUID="c0f01af1-e02f-4105-8edb-33a5b8acab5c" Sep 17 16:42:18.543985 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.543910 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-146.ec2.internal" event="NodeReady" Sep 17 16:42:18.544146 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.544061 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 17 16:42:18.614993 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.614953 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b9ff76d55-b7lfl"] Sep 17 16:42:18.619374 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.619344 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:42:18.623117 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.623093 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 17 16:42:18.623305 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.623252 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 17 16:42:18.623383 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.623336 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sbjg6\"" Sep 17 16:42:18.623808 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.623785 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 17 16:42:18.631399 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.631382 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 17 16:42:18.634225 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.634204 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b9ff76d55-b7lfl"] Sep 17 16:42:18.664378 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.664352 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wlfqv"] Sep 17 16:42:18.667335 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.667317 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wlfqv" Sep 17 16:42:18.667948 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.667926 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tkgdr"] Sep 17 16:42:18.670719 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.670685 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 17 16:42:18.670818 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.670790 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rc4fv\"" Sep 17 16:42:18.670882 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.670858 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tkgdr" Sep 17 16:42:18.670936 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.670881 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 17 16:42:18.670992 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.670937 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 17 16:42:18.675006 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.674796 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 17 16:42:18.675006 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.674818 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 17 16:42:18.675006 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.674863 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bdrbl\"" Sep 17 16:42:18.693921 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.693901 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wlfqv"] Sep 17 16:42:18.698752 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.698727 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tkgdr"] Sep 17 16:42:18.755069 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.755036 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-installation-pull-secrets\") pod \"image-registry-5b9ff76d55-b7lfl\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:42:18.755243 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.755081 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk9qk\" (UniqueName: \"kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-kube-api-access-nk9qk\") pod \"image-registry-5b9ff76d55-b7lfl\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:42:18.755243 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.755121 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f724cc35-e114-45e0-ae6b-07b4d9653424-metrics-tls\") pod \"dns-default-tkgdr\" (UID: \"f724cc35-e114-45e0-ae6b-07b4d9653424\") " pod="openshift-dns/dns-default-tkgdr" Sep 17 16:42:18.755243 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.755145 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfk4f\" (UniqueName: \"kubernetes.io/projected/f724cc35-e114-45e0-ae6b-07b4d9653424-kube-api-access-zfk4f\") pod \"dns-default-tkgdr\" (UID: \"f724cc35-e114-45e0-ae6b-07b4d9653424\") " pod="openshift-dns/dns-default-tkgdr" Sep 17 16:42:18.755243 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.755164 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-certificates\") pod \"image-registry-5b9ff76d55-b7lfl\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:42:18.755243 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.755178 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-bound-sa-token\") pod \"image-registry-5b9ff76d55-b7lfl\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:42:18.755243 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.755244 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f1bf12a-2d8f-462c-aef7-499c90c24bcc-cert\") pod \"ingress-canary-wlfqv\" (UID: \"7f1bf12a-2d8f-462c-aef7-499c90c24bcc\") " pod="openshift-ingress-canary/ingress-canary-wlfqv" Sep 17 16:42:18.755578 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.755268 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94pnm\" (UniqueName: \"kubernetes.io/projected/7f1bf12a-2d8f-462c-aef7-499c90c24bcc-kube-api-access-94pnm\") pod \"ingress-canary-wlfqv\" (UID: \"7f1bf12a-2d8f-462c-aef7-499c90c24bcc\") " pod="openshift-ingress-canary/ingress-canary-wlfqv" Sep 17 16:42:18.755578 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.755290 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-ca-trust-extracted\") pod \"image-registry-5b9ff76d55-b7lfl\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:42:18.755578 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.755307 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f724cc35-e114-45e0-ae6b-07b4d9653424-config-volume\") pod \"dns-default-tkgdr\" (UID: \"f724cc35-e114-45e0-ae6b-07b4d9653424\") " pod="openshift-dns/dns-default-tkgdr" Sep 17 16:42:18.755578 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.755330 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-trusted-ca\") pod \"image-registry-5b9ff76d55-b7lfl\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:42:18.755578 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.755375 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-image-registry-private-configuration\") pod \"image-registry-5b9ff76d55-b7lfl\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:42:18.755578 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.755396 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-tls\") pod \"image-registry-5b9ff76d55-b7lfl\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:42:18.755578 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.755422 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f724cc35-e114-45e0-ae6b-07b4d9653424-tmp-dir\") pod \"dns-default-tkgdr\" (UID: \"f724cc35-e114-45e0-ae6b-07b4d9653424\") " pod="openshift-dns/dns-default-tkgdr" Sep 17 16:42:18.856479 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.856383 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f1bf12a-2d8f-462c-aef7-499c90c24bcc-cert\") pod \"ingress-canary-wlfqv\" (UID: \"7f1bf12a-2d8f-462c-aef7-499c90c24bcc\") " pod="openshift-ingress-canary/ingress-canary-wlfqv" Sep 17 16:42:18.856479 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.856427 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94pnm\" (UniqueName: \"kubernetes.io/projected/7f1bf12a-2d8f-462c-aef7-499c90c24bcc-kube-api-access-94pnm\") pod \"ingress-canary-wlfqv\" (UID: \"7f1bf12a-2d8f-462c-aef7-499c90c24bcc\") " pod="openshift-ingress-canary/ingress-canary-wlfqv" Sep 17 16:42:18.856696 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.856628 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-ca-trust-extracted\") pod \"image-registry-5b9ff76d55-b7lfl\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:42:18.856696 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.856661 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f724cc35-e114-45e0-ae6b-07b4d9653424-config-volume\") pod \"dns-default-tkgdr\" (UID: \"f724cc35-e114-45e0-ae6b-07b4d9653424\") " pod="openshift-dns/dns-default-tkgdr" Sep 17 16:42:18.856696 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.856689 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-trusted-ca\") pod \"image-registry-5b9ff76d55-b7lfl\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:42:18.856797 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.856719 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-image-registry-private-configuration\") pod \"image-registry-5b9ff76d55-b7lfl\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:42:18.856797 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.856745 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-tls\") pod \"image-registry-5b9ff76d55-b7lfl\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:42:18.856797 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.856768 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f724cc35-e114-45e0-ae6b-07b4d9653424-tmp-dir\") pod \"dns-default-tkgdr\" (UID: \"f724cc35-e114-45e0-ae6b-07b4d9653424\") " pod="openshift-dns/dns-default-tkgdr" Sep 17 16:42:18.856909 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.856816 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-installation-pull-secrets\") pod \"image-registry-5b9ff76d55-b7lfl\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:42:18.856909 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.856845 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk9qk\" (UniqueName: \"kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-kube-api-access-nk9qk\") pod \"image-registry-5b9ff76d55-b7lfl\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:42:18.856909 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.856882 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f724cc35-e114-45e0-ae6b-07b4d9653424-metrics-tls\") pod \"dns-default-tkgdr\" (UID: \"f724cc35-e114-45e0-ae6b-07b4d9653424\") " pod="openshift-dns/dns-default-tkgdr" Sep 17 16:42:18.857052 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.856907 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfk4f\" (UniqueName: \"kubernetes.io/projected/f724cc35-e114-45e0-ae6b-07b4d9653424-kube-api-access-zfk4f\") pod \"dns-default-tkgdr\" (UID: \"f724cc35-e114-45e0-ae6b-07b4d9653424\") " pod="openshift-dns/dns-default-tkgdr" Sep 17 16:42:18.857052 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.856939 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-certificates\") pod \"image-registry-5b9ff76d55-b7lfl\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:42:18.857052 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.856961 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-bound-sa-token\") pod \"image-registry-5b9ff76d55-b7lfl\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:42:18.857340 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:18.857319 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 16:42:18.857614 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:18.857401 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f724cc35-e114-45e0-ae6b-07b4d9653424-metrics-tls podName:f724cc35-e114-45e0-ae6b-07b4d9653424 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:19.35736986 +0000 UTC m=+35.553363986 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f724cc35-e114-45e0-ae6b-07b4d9653424-metrics-tls") pod "dns-default-tkgdr" (UID: "f724cc35-e114-45e0-ae6b-07b4d9653424") : secret "dns-default-metrics-tls" not found Sep 17 16:42:18.857614 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.857322 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f724cc35-e114-45e0-ae6b-07b4d9653424-config-volume\") pod \"dns-default-tkgdr\" (UID: \"f724cc35-e114-45e0-ae6b-07b4d9653424\") " pod="openshift-dns/dns-default-tkgdr" Sep 17 16:42:18.857614 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:18.857493 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 16:42:18.857614 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:18.857516 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b9ff76d55-b7lfl: secret "image-registry-tls" not found Sep 17 16:42:18.857614 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:18.857581 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-tls podName:8141abaa-13c3-40c8-8ba6-fc3bba21daf4 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:19.357562418 +0000 UTC m=+35.553556548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-tls") pod "image-registry-5b9ff76d55-b7lfl" (UID: "8141abaa-13c3-40c8-8ba6-fc3bba21daf4") : secret "image-registry-tls" not found Sep 17 16:42:18.857880 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.857697 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-ca-trust-extracted\") pod \"image-registry-5b9ff76d55-b7lfl\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:42:18.857880 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.857843 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f724cc35-e114-45e0-ae6b-07b4d9653424-tmp-dir\") pod \"dns-default-tkgdr\" (UID: \"f724cc35-e114-45e0-ae6b-07b4d9653424\") " pod="openshift-dns/dns-default-tkgdr" Sep 17 16:42:18.858318 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.858294 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-certificates\") pod \"image-registry-5b9ff76d55-b7lfl\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:42:18.858910 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.858870 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-trusted-ca\") pod \"image-registry-5b9ff76d55-b7lfl\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:42:18.861523 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.861499 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-installation-pull-secrets\") pod \"image-registry-5b9ff76d55-b7lfl\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:42:18.861625 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.861509 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-image-registry-private-configuration\") pod \"image-registry-5b9ff76d55-b7lfl\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:42:18.861625 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.861509 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f1bf12a-2d8f-462c-aef7-499c90c24bcc-cert\") pod \"ingress-canary-wlfqv\" (UID: \"7f1bf12a-2d8f-462c-aef7-499c90c24bcc\") " pod="openshift-ingress-canary/ingress-canary-wlfqv" Sep 17 16:42:18.867011 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.866985 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94pnm\" (UniqueName: \"kubernetes.io/projected/7f1bf12a-2d8f-462c-aef7-499c90c24bcc-kube-api-access-94pnm\") pod \"ingress-canary-wlfqv\" (UID: \"7f1bf12a-2d8f-462c-aef7-499c90c24bcc\") " pod="openshift-ingress-canary/ingress-canary-wlfqv" Sep 17 16:42:18.867352 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.867332 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-bound-sa-token\") pod \"image-registry-5b9ff76d55-b7lfl\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:42:18.867567 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.867543 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk9qk\" (UniqueName: \"kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-kube-api-access-nk9qk\") pod \"image-registry-5b9ff76d55-b7lfl\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:42:18.868348 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.868328 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfk4f\" (UniqueName: \"kubernetes.io/projected/f724cc35-e114-45e0-ae6b-07b4d9653424-kube-api-access-zfk4f\") pod \"dns-default-tkgdr\" (UID: \"f724cc35-e114-45e0-ae6b-07b4d9653424\") " pod="openshift-dns/dns-default-tkgdr" Sep 17 16:42:18.979465 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:18.979418 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wlfqv" Sep 17 16:42:19.267924 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:19.267893 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wlfqv"] Sep 17 16:42:19.271966 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:42:19.271941 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f1bf12a_2d8f_462c_aef7_499c90c24bcc.slice/crio-bfc7a9fb3bfc95fda12d6664fdaa5f0c3cedb445ce987d6b250d25db37fd491a WatchSource:0}: Error finding container bfc7a9fb3bfc95fda12d6664fdaa5f0c3cedb445ce987d6b250d25db37fd491a: Status 404 returned error can't find the container with id bfc7a9fb3bfc95fda12d6664fdaa5f0c3cedb445ce987d6b250d25db37fd491a Sep 17 16:42:19.360276 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:19.360236 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-tls\") pod \"image-registry-5b9ff76d55-b7lfl\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:42:19.360480 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:19.360324 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f724cc35-e114-45e0-ae6b-07b4d9653424-metrics-tls\") pod \"dns-default-tkgdr\" (UID: \"f724cc35-e114-45e0-ae6b-07b4d9653424\") " pod="openshift-dns/dns-default-tkgdr" Sep 17 16:42:19.360480 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:19.360413 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 16:42:19.360480 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:19.360453 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b9ff76d55-b7lfl: secret "image-registry-tls" not found Sep 17 16:42:19.360480 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:19.360468 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 16:42:19.360672 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:19.360530 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-tls podName:8141abaa-13c3-40c8-8ba6-fc3bba21daf4 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:20.360507161 +0000 UTC m=+36.556501287 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-tls") pod "image-registry-5b9ff76d55-b7lfl" (UID: "8141abaa-13c3-40c8-8ba6-fc3bba21daf4") : secret "image-registry-tls" not found Sep 17 16:42:19.360672 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:19.360549 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f724cc35-e114-45e0-ae6b-07b4d9653424-metrics-tls podName:f724cc35-e114-45e0-ae6b-07b4d9653424 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:20.360540125 +0000 UTC m=+36.556534255 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f724cc35-e114-45e0-ae6b-07b4d9653424-metrics-tls") pod "dns-default-tkgdr" (UID: "f724cc35-e114-45e0-ae6b-07b4d9653424") : secret "dns-default-metrics-tls" not found Sep 17 16:42:19.569703 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:19.569613 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wlfqv" event={"ID":"7f1bf12a-2d8f-462c-aef7-499c90c24bcc","Type":"ContainerStarted","Data":"bfc7a9fb3bfc95fda12d6664fdaa5f0c3cedb445ce987d6b250d25db37fd491a"} Sep 17 16:42:20.322037 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:20.322002 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:42:20.322515 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:20.322007 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:42:20.322515 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:20.322139 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:42:20.326138 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:20.326106 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 16:42:20.326138 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:20.326125 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n5btm\"" Sep 17 16:42:20.326464 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:20.326422 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 16:42:20.326633 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:20.326617 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 16:42:20.326748 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:20.326727 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 16:42:20.327305 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:20.326106 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dfgr8\"" Sep 17 16:42:20.369016 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:20.368990 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f724cc35-e114-45e0-ae6b-07b4d9653424-metrics-tls\") pod \"dns-default-tkgdr\" (UID: \"f724cc35-e114-45e0-ae6b-07b4d9653424\") " pod="openshift-dns/dns-default-tkgdr" Sep 17 16:42:20.369124 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:20.369057 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-tls\") pod \"image-registry-5b9ff76d55-b7lfl\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:42:20.369163 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:20.369140 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 16:42:20.369163 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:20.369148 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 16:42:20.369163 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:20.369160 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b9ff76d55-b7lfl: secret "image-registry-tls" not found Sep 17 16:42:20.369271 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:20.369201 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-tls podName:8141abaa-13c3-40c8-8ba6-fc3bba21daf4 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:22.369186124 +0000 UTC m=+38.565180253 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-tls") pod "image-registry-5b9ff76d55-b7lfl" (UID: "8141abaa-13c3-40c8-8ba6-fc3bba21daf4") : secret "image-registry-tls" not found Sep 17 16:42:20.369271 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:20.369213 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f724cc35-e114-45e0-ae6b-07b4d9653424-metrics-tls podName:f724cc35-e114-45e0-ae6b-07b4d9653424 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:22.369207899 +0000 UTC m=+38.565202024 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f724cc35-e114-45e0-ae6b-07b4d9653424-metrics-tls") pod "dns-default-tkgdr" (UID: "f724cc35-e114-45e0-ae6b-07b4d9653424") : secret "dns-default-metrics-tls" not found Sep 17 16:42:21.579292 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:21.579108 2574 generic.go:356] "Generic (PLEG): container finished" podID="85a077ee-c427-421c-930d-0deeda5fb58c" containerID="8b16a73790d1ee7116ca0af0876a1be6079d4284258f0553e0c3fa1ae7267627" exitCode=0 Sep 17 16:42:21.579292 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:21.579196 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjknd" event={"ID":"85a077ee-c427-421c-930d-0deeda5fb58c","Type":"ContainerDied","Data":"8b16a73790d1ee7116ca0af0876a1be6079d4284258f0553e0c3fa1ae7267627"} Sep 17 16:42:22.384369 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:22.384334 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-tls\") pod \"image-registry-5b9ff76d55-b7lfl\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:42:22.384558 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:22.384389 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f724cc35-e114-45e0-ae6b-07b4d9653424-metrics-tls\") pod \"dns-default-tkgdr\" (UID: \"f724cc35-e114-45e0-ae6b-07b4d9653424\") " pod="openshift-dns/dns-default-tkgdr" Sep 17 16:42:22.384558 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:22.384502 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 16:42:22.384558 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:22.384510 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 16:42:22.384558 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:22.384519 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b9ff76d55-b7lfl: secret "image-registry-tls" not found Sep 17 16:42:22.384685 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:22.384570 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-tls podName:8141abaa-13c3-40c8-8ba6-fc3bba21daf4 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:26.384555672 +0000 UTC m=+42.580549798 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-tls") pod "image-registry-5b9ff76d55-b7lfl" (UID: "8141abaa-13c3-40c8-8ba6-fc3bba21daf4") : secret "image-registry-tls" not found Sep 17 16:42:22.384685 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:22.384582 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f724cc35-e114-45e0-ae6b-07b4d9653424-metrics-tls podName:f724cc35-e114-45e0-ae6b-07b4d9653424 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:26.384576671 +0000 UTC m=+42.580570797 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f724cc35-e114-45e0-ae6b-07b4d9653424-metrics-tls") pod "dns-default-tkgdr" (UID: "f724cc35-e114-45e0-ae6b-07b4d9653424") : secret "dns-default-metrics-tls" not found Sep 17 16:42:22.585519 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:22.585483 2574 generic.go:356] "Generic (PLEG): container finished" podID="85a077ee-c427-421c-930d-0deeda5fb58c" containerID="7b6cde05af1d6034996c7f9726c3e220b5f4cb763026663c90114bfe7edeee4a" exitCode=0 Sep 17 16:42:22.586032 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:22.585534 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjknd" event={"ID":"85a077ee-c427-421c-930d-0deeda5fb58c","Type":"ContainerDied","Data":"7b6cde05af1d6034996c7f9726c3e220b5f4cb763026663c90114bfe7edeee4a"} Sep 17 16:42:23.303566 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:23.303535 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:23.477384 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:23.477355 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:23.591568 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:23.591529 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cjknd" event={"ID":"85a077ee-c427-421c-930d-0deeda5fb58c","Type":"ContainerStarted","Data":"f92cddd0dc2044119391069f2154bc6701d5d49126bf9beb22fbb33f2f1f6402"} Sep 17 16:42:23.621912 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:23.618723 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cjknd" podStartSLOduration=8.985573111 podStartE2EDuration="39.618700268s" totalImagesPullingTime="30.633127157s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:41:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:23.61704892 +0000 UTC m=+39.813043067" watchObservedRunningTime="2026-09-17 16:42:23.618700268 +0000 UTC m=+39.814694414" Sep 17 16:42:23.738756 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:23.738723 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:23.839216 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:23.839114 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:24.595108 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:24.595073 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wlfqv" event={"ID":"7f1bf12a-2d8f-462c-aef7-499c90c24bcc","Type":"ContainerStarted","Data":"6f9fa90c0328e4fa2f2cffec4d88b7f55edf8d112bb55d869dae25284a1a7c86"} Sep 17 16:42:24.612568 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:24.612527 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wlfqv" podStartSLOduration=2.322090952 podStartE2EDuration="6.612510197s" totalImagesPullingTime="4.290419245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:42:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:24.611806666 +0000 UTC m=+40.807800804" watchObservedRunningTime="2026-09-17 16:42:24.612510197 +0000 UTC m=+40.808504345" Sep 17 16:42:26.414959 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:26.414918 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-tls\") pod \"image-registry-5b9ff76d55-b7lfl\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:42:26.415411 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:26.414977 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f724cc35-e114-45e0-ae6b-07b4d9653424-metrics-tls\") pod \"dns-default-tkgdr\" (UID: \"f724cc35-e114-45e0-ae6b-07b4d9653424\") " pod="openshift-dns/dns-default-tkgdr" Sep 17 16:42:26.415411 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:26.415067 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 16:42:26.415411 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:26.415080 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 16:42:26.415411 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:26.415102 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b9ff76d55-b7lfl: secret "image-registry-tls" not found Sep 17 16:42:26.415411 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:26.415119 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f724cc35-e114-45e0-ae6b-07b4d9653424-metrics-tls podName:f724cc35-e114-45e0-ae6b-07b4d9653424 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:34.415106496 +0000 UTC m=+50.611100622 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f724cc35-e114-45e0-ae6b-07b4d9653424-metrics-tls") pod "dns-default-tkgdr" (UID: "f724cc35-e114-45e0-ae6b-07b4d9653424") : secret "dns-default-metrics-tls" not found Sep 17 16:42:26.415411 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:26.415159 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-tls podName:8141abaa-13c3-40c8-8ba6-fc3bba21daf4 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:34.41513978 +0000 UTC m=+50.611133925 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-tls") pod "image-registry-5b9ff76d55-b7lfl" (UID: "8141abaa-13c3-40c8-8ba6-fc3bba21daf4") : secret "image-registry-tls" not found Sep 17 16:42:27.569612 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:27.569576 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:27.636302 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:27.636272 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:27.774385 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:27.774355 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:27.870806 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:27.870715 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:34.471533 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:34.471495 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f724cc35-e114-45e0-ae6b-07b4d9653424-metrics-tls\") pod \"dns-default-tkgdr\" (UID: \"f724cc35-e114-45e0-ae6b-07b4d9653424\") " pod="openshift-dns/dns-default-tkgdr" Sep 17 16:42:34.471985 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:34.471578 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-tls\") pod \"image-registry-5b9ff76d55-b7lfl\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:42:34.471985 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:34.471659 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 16:42:34.471985 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:34.471680 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 16:42:34.471985 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:34.471690 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b9ff76d55-b7lfl: secret "image-registry-tls" not found Sep 17 16:42:34.471985 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:34.471731 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f724cc35-e114-45e0-ae6b-07b4d9653424-metrics-tls podName:f724cc35-e114-45e0-ae6b-07b4d9653424 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:50.471711176 +0000 UTC m=+66.667705371 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f724cc35-e114-45e0-ae6b-07b4d9653424-metrics-tls") pod "dns-default-tkgdr" (UID: "f724cc35-e114-45e0-ae6b-07b4d9653424") : secret "dns-default-metrics-tls" not found Sep 17 16:42:34.471985 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:34.471746 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-tls podName:8141abaa-13c3-40c8-8ba6-fc3bba21daf4 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:50.471740233 +0000 UTC m=+66.667734359 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-tls") pod "image-registry-5b9ff76d55-b7lfl" (UID: "8141abaa-13c3-40c8-8ba6-fc3bba21daf4") : secret "image-registry-tls" not found Sep 17 16:42:34.505290 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:34.505262 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:34.605129 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:34.605098 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:45.568751 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:45.568722 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k2rxg" Sep 17 16:42:45.722724 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:45.722683 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:45.822480 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:45.822372 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:49.748196 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:49.748159 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:49.848792 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:49.848768 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:49.981240 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:49.981205 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0f01af1-e02f-4105-8edb-33a5b8acab5c-metrics-certs\") pod \"network-metrics-daemon-glhzf\" (UID: \"c0f01af1-e02f-4105-8edb-33a5b8acab5c\") " pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:42:49.984134 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:49.984115 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 16:42:49.991731 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:49.991710 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 17 16:42:49.991875 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:49.991785 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0f01af1-e02f-4105-8edb-33a5b8acab5c-metrics-certs podName:c0f01af1-e02f-4105-8edb-33a5b8acab5c nodeName:}" failed. No retries permitted until 2026-09-17 16:43:53.991768115 +0000 UTC m=+130.187762240 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c0f01af1-e02f-4105-8edb-33a5b8acab5c-metrics-certs") pod "network-metrics-daemon-glhzf" (UID: "c0f01af1-e02f-4105-8edb-33a5b8acab5c") : secret "metrics-daemon-secret" not found Sep 17 16:42:50.081868 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:50.081803 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8b1cfd1-164c-4442-b711-c429d1f4a719-original-pull-secret\") pod \"global-pull-secret-syncer-99gp5\" (UID: \"e8b1cfd1-164c-4442-b711-c429d1f4a719\") " pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:42:50.087844 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:50.087826 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 16:42:50.095974 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:50.095954 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8b1cfd1-164c-4442-b711-c429d1f4a719-original-pull-secret\") pod \"global-pull-secret-syncer-99gp5\" (UID: \"e8b1cfd1-164c-4442-b711-c429d1f4a719\") " pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:42:50.182511 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:50.182477 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whvdf\" (UniqueName: \"kubernetes.io/projected/447eed93-408e-4029-b493-f9ec83f577b4-kube-api-access-whvdf\") pod \"network-check-target-fqfbx\" (UID: \"447eed93-408e-4029-b493-f9ec83f577b4\") " pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:42:50.185353 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:50.185335 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 16:42:50.196249 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:50.196231 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 16:42:50.206121 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:50.206090 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whvdf\" (UniqueName: \"kubernetes.io/projected/447eed93-408e-4029-b493-f9ec83f577b4-kube-api-access-whvdf\") pod \"network-check-target-fqfbx\" (UID: \"447eed93-408e-4029-b493-f9ec83f577b4\") " pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:42:50.347790 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:50.347708 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dfgr8\"" Sep 17 16:42:50.351102 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:50.351086 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-99gp5" Sep 17 16:42:50.355533 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:50.355517 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:42:50.484096 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:50.484055 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-tls\") pod \"image-registry-5b9ff76d55-b7lfl\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:42:50.484290 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:50.484123 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f724cc35-e114-45e0-ae6b-07b4d9653424-metrics-tls\") pod \"dns-default-tkgdr\" (UID: \"f724cc35-e114-45e0-ae6b-07b4d9653424\") " pod="openshift-dns/dns-default-tkgdr" Sep 17 16:42:50.484290 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:50.484201 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 16:42:50.484290 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:50.484223 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b9ff76d55-b7lfl: secret "image-registry-tls" not found Sep 17 16:42:50.484290 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:50.484250 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 16:42:50.484290 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:50.484278 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-tls podName:8141abaa-13c3-40c8-8ba6-fc3bba21daf4 nodeName:}" failed. No retries permitted until 2026-09-17 16:43:22.484262243 +0000 UTC m=+98.680256374 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-tls") pod "image-registry-5b9ff76d55-b7lfl" (UID: "8141abaa-13c3-40c8-8ba6-fc3bba21daf4") : secret "image-registry-tls" not found Sep 17 16:42:50.484517 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:50.484298 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f724cc35-e114-45e0-ae6b-07b4d9653424-metrics-tls podName:f724cc35-e114-45e0-ae6b-07b4d9653424 nodeName:}" failed. No retries permitted until 2026-09-17 16:43:22.484283587 +0000 UTC m=+98.680277713 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f724cc35-e114-45e0-ae6b-07b4d9653424-metrics-tls") pod "dns-default-tkgdr" (UID: "f724cc35-e114-45e0-ae6b-07b4d9653424") : secret "dns-default-metrics-tls" not found Sep 17 16:42:50.623994 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:50.623908 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-99gp5"] Sep 17 16:42:50.627302 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:42:50.627204 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8b1cfd1_164c_4442_b711_c429d1f4a719.slice/crio-e8fa700860f193528055856deed26275481aee897e0c46a8e6d41ecb6106f59f WatchSource:0}: Error finding container e8fa700860f193528055856deed26275481aee897e0c46a8e6d41ecb6106f59f: Status 404 returned error can't find the container with id e8fa700860f193528055856deed26275481aee897e0c46a8e6d41ecb6106f59f Sep 17 16:42:50.628196 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:50.628170 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fqfbx"] Sep 17 16:42:50.631536 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:42:50.631515 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod447eed93_408e_4029_b493_f9ec83f577b4.slice/crio-c1dd16898c59b4d467d4b1de04dbcd2d4e2ef8c5afa930d174e0668fa8d2bdcb WatchSource:0}: Error finding container c1dd16898c59b4d467d4b1de04dbcd2d4e2ef8c5afa930d174e0668fa8d2bdcb: Status 404 returned error can't find the container with id c1dd16898c59b4d467d4b1de04dbcd2d4e2ef8c5afa930d174e0668fa8d2bdcb Sep 17 16:42:50.656970 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:50.656932 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-99gp5" event={"ID":"e8b1cfd1-164c-4442-b711-c429d1f4a719","Type":"ContainerStarted","Data":"e8fa700860f193528055856deed26275481aee897e0c46a8e6d41ecb6106f59f"} Sep 17 16:42:50.658021 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:50.657998 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fqfbx" event={"ID":"447eed93-408e-4029-b493-f9ec83f577b4","Type":"ContainerStarted","Data":"c1dd16898c59b4d467d4b1de04dbcd2d4e2ef8c5afa930d174e0668fa8d2bdcb"} Sep 17 16:42:55.674899 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.674859 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-99gp5" event={"ID":"e8b1cfd1-164c-4442-b711-c429d1f4a719","Type":"ContainerStarted","Data":"86efb005f31ec85047de6d59518db4aaabf5796146c4a3899df09b560f7d18b1"} Sep 17 16:42:55.676359 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.676335 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fqfbx" event={"ID":"447eed93-408e-4029-b493-f9ec83f577b4","Type":"ContainerStarted","Data":"ecfaf3ab11488c763e1df0795bcd9eac6c497ae5937ad8feae4a868825a4e5b7"} Sep 17 16:42:55.676492 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.676480 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:42:55.691359 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.691309 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-99gp5" podStartSLOduration=65.838639346 podStartE2EDuration="1m10.691294587s" totalImagesPullingTime="4.852655241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:41:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:55.690734008 +0000 UTC m=+71.886728158" watchObservedRunningTime="2026-09-17 16:42:55.691294587 +0000 UTC m=+71.887288734" Sep 17 16:42:55.695049 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.695021 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-6zz8j"] Sep 17 16:42:55.710324 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.710266 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fqfbx" podStartSLOduration=65.872487467 podStartE2EDuration="1m10.710249098s" totalImagesPullingTime="4.837761631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:41:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:55.709411553 +0000 UTC m=+71.905405701" watchObservedRunningTime="2026-09-17 16:42:55.710249098 +0000 UTC m=+71.906243244" Sep 17 16:42:55.716638 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.716573 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5dc4c55b4-tls6x"] Sep 17 16:42:55.716767 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.716686 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-6zz8j" Sep 17 16:42:55.719402 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.719372 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 17 16:42:55.719554 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.719508 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 17 16:42:55.719624 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.719580 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 17 16:42:55.719749 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.719731 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rgnns\"" Sep 17 16:42:55.720903 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.720886 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 17 16:42:55.738683 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.738657 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-6zz8j"] Sep 17 16:42:55.738683 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.738694 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5dc4c55b4-tls6x"] Sep 17 16:42:55.738867 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.738800 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:42:55.741681 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.741657 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 17 16:42:55.741864 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.741839 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 17 16:42:55.741982 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.741962 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 17 16:42:55.742038 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.741993 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 17 16:42:55.742103 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.742082 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 17 16:42:55.742359 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.742337 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tzxz9\"" Sep 17 16:42:55.742359 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.742347 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 17 16:42:55.817743 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.817708 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a19b7131-de33-4c65-924f-b582e08a1eb2-stats-auth\") pod \"router-default-5dc4c55b4-tls6x\" (UID: \"a19b7131-de33-4c65-924f-b582e08a1eb2\") " pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:42:55.817743 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.817744 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19b7131-de33-4c65-924f-b582e08a1eb2-metrics-certs\") pod \"router-default-5dc4c55b4-tls6x\" (UID: \"a19b7131-de33-4c65-924f-b582e08a1eb2\") " pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:42:55.817982 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.817790 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a19b7131-de33-4c65-924f-b582e08a1eb2-default-certificate\") pod \"router-default-5dc4c55b4-tls6x\" (UID: \"a19b7131-de33-4c65-924f-b582e08a1eb2\") " pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:42:55.817982 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.817811 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0d51f98-f18d-426d-a626-e068dc133c6d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-6zz8j\" (UID: \"e0d51f98-f18d-426d-a626-e068dc133c6d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-6zz8j" Sep 17 16:42:55.817982 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.817828 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rlkl\" (UniqueName: \"kubernetes.io/projected/e0d51f98-f18d-426d-a626-e068dc133c6d-kube-api-access-7rlkl\") pod \"cluster-monitoring-operator-847b8bd8d7-6zz8j\" (UID: \"e0d51f98-f18d-426d-a626-e068dc133c6d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-6zz8j" Sep 17 16:42:55.817982 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.817849 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a19b7131-de33-4c65-924f-b582e08a1eb2-service-ca-bundle\") pod \"router-default-5dc4c55b4-tls6x\" (UID: \"a19b7131-de33-4c65-924f-b582e08a1eb2\") " pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:42:55.817982 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.817879 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpwhg\" (UniqueName: \"kubernetes.io/projected/a19b7131-de33-4c65-924f-b582e08a1eb2-kube-api-access-qpwhg\") pod \"router-default-5dc4c55b4-tls6x\" (UID: \"a19b7131-de33-4c65-924f-b582e08a1eb2\") " pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:42:55.817982 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.817895 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e0d51f98-f18d-426d-a626-e068dc133c6d-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-6zz8j\" (UID: \"e0d51f98-f18d-426d-a626-e068dc133c6d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-6zz8j" Sep 17 16:42:55.836488 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.836431 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:55.912825 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.912795 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:55.918566 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.918545 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a19b7131-de33-4c65-924f-b582e08a1eb2-service-ca-bundle\") pod \"router-default-5dc4c55b4-tls6x\" (UID: \"a19b7131-de33-4c65-924f-b582e08a1eb2\") " pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:42:55.918639 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.918589 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpwhg\" (UniqueName: \"kubernetes.io/projected/a19b7131-de33-4c65-924f-b582e08a1eb2-kube-api-access-qpwhg\") pod \"router-default-5dc4c55b4-tls6x\" (UID: \"a19b7131-de33-4c65-924f-b582e08a1eb2\") " pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:42:55.918639 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.918607 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e0d51f98-f18d-426d-a626-e068dc133c6d-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-6zz8j\" (UID: \"e0d51f98-f18d-426d-a626-e068dc133c6d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-6zz8j" Sep 17 16:42:55.918639 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.918631 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a19b7131-de33-4c65-924f-b582e08a1eb2-stats-auth\") pod \"router-default-5dc4c55b4-tls6x\" (UID: \"a19b7131-de33-4c65-924f-b582e08a1eb2\") " pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:42:55.918795 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.918648 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19b7131-de33-4c65-924f-b582e08a1eb2-metrics-certs\") pod \"router-default-5dc4c55b4-tls6x\" (UID: \"a19b7131-de33-4c65-924f-b582e08a1eb2\") " pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:42:55.918795 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:55.918715 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a19b7131-de33-4c65-924f-b582e08a1eb2-service-ca-bundle podName:a19b7131-de33-4c65-924f-b582e08a1eb2 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:56.418698029 +0000 UTC m=+72.614692156 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a19b7131-de33-4c65-924f-b582e08a1eb2-service-ca-bundle") pod "router-default-5dc4c55b4-tls6x" (UID: "a19b7131-de33-4c65-924f-b582e08a1eb2") : configmap references non-existent config key: service-ca.crt Sep 17 16:42:55.918795 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:55.918754 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 16:42:55.918795 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.918757 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a19b7131-de33-4c65-924f-b582e08a1eb2-default-certificate\") pod \"router-default-5dc4c55b4-tls6x\" (UID: \"a19b7131-de33-4c65-924f-b582e08a1eb2\") " pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:42:55.918795 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.918784 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0d51f98-f18d-426d-a626-e068dc133c6d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-6zz8j\" (UID: \"e0d51f98-f18d-426d-a626-e068dc133c6d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-6zz8j" Sep 17 16:42:55.919032 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.918808 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rlkl\" (UniqueName: \"kubernetes.io/projected/e0d51f98-f18d-426d-a626-e068dc133c6d-kube-api-access-7rlkl\") pod \"cluster-monitoring-operator-847b8bd8d7-6zz8j\" (UID: \"e0d51f98-f18d-426d-a626-e068dc133c6d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-6zz8j" Sep 17 16:42:55.919032 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:55.918847 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 16:42:55.919032 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:55.918873 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19b7131-de33-4c65-924f-b582e08a1eb2-metrics-certs podName:a19b7131-de33-4c65-924f-b582e08a1eb2 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:56.41885764 +0000 UTC m=+72.614851785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a19b7131-de33-4c65-924f-b582e08a1eb2-metrics-certs") pod "router-default-5dc4c55b4-tls6x" (UID: "a19b7131-de33-4c65-924f-b582e08a1eb2") : secret "router-metrics-certs-default" not found Sep 17 16:42:55.919032 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:55.918900 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0d51f98-f18d-426d-a626-e068dc133c6d-cluster-monitoring-operator-tls podName:e0d51f98-f18d-426d-a626-e068dc133c6d nodeName:}" failed. No retries permitted until 2026-09-17 16:42:56.418884827 +0000 UTC m=+72.614878955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e0d51f98-f18d-426d-a626-e068dc133c6d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-6zz8j" (UID: "e0d51f98-f18d-426d-a626-e068dc133c6d") : secret "cluster-monitoring-operator-tls" not found Sep 17 16:42:55.919400 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.919375 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e0d51f98-f18d-426d-a626-e068dc133c6d-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-6zz8j\" (UID: \"e0d51f98-f18d-426d-a626-e068dc133c6d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-6zz8j" Sep 17 16:42:55.921822 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.921802 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a19b7131-de33-4c65-924f-b582e08a1eb2-default-certificate\") pod \"router-default-5dc4c55b4-tls6x\" (UID: \"a19b7131-de33-4c65-924f-b582e08a1eb2\") " pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:42:55.921932 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.921912 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a19b7131-de33-4c65-924f-b582e08a1eb2-stats-auth\") pod \"router-default-5dc4c55b4-tls6x\" (UID: \"a19b7131-de33-4c65-924f-b582e08a1eb2\") " pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:42:55.929291 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.929265 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpwhg\" (UniqueName: \"kubernetes.io/projected/a19b7131-de33-4c65-924f-b582e08a1eb2-kube-api-access-qpwhg\") pod \"router-default-5dc4c55b4-tls6x\" (UID: \"a19b7131-de33-4c65-924f-b582e08a1eb2\") " pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:42:55.929391 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:55.929277 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rlkl\" (UniqueName: \"kubernetes.io/projected/e0d51f98-f18d-426d-a626-e068dc133c6d-kube-api-access-7rlkl\") pod \"cluster-monitoring-operator-847b8bd8d7-6zz8j\" (UID: \"e0d51f98-f18d-426d-a626-e068dc133c6d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-6zz8j" Sep 17 16:42:56.421694 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:56.421656 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0d51f98-f18d-426d-a626-e068dc133c6d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-6zz8j\" (UID: \"e0d51f98-f18d-426d-a626-e068dc133c6d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-6zz8j" Sep 17 16:42:56.421694 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:56.421699 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a19b7131-de33-4c65-924f-b582e08a1eb2-service-ca-bundle\") pod \"router-default-5dc4c55b4-tls6x\" (UID: \"a19b7131-de33-4c65-924f-b582e08a1eb2\") " pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:42:56.421958 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:56.421812 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a19b7131-de33-4c65-924f-b582e08a1eb2-service-ca-bundle podName:a19b7131-de33-4c65-924f-b582e08a1eb2 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:57.421799181 +0000 UTC m=+73.617793308 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a19b7131-de33-4c65-924f-b582e08a1eb2-service-ca-bundle") pod "router-default-5dc4c55b4-tls6x" (UID: "a19b7131-de33-4c65-924f-b582e08a1eb2") : configmap references non-existent config key: service-ca.crt Sep 17 16:42:56.421958 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:56.421823 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 16:42:56.421958 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:56.421844 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19b7131-de33-4c65-924f-b582e08a1eb2-metrics-certs\") pod \"router-default-5dc4c55b4-tls6x\" (UID: \"a19b7131-de33-4c65-924f-b582e08a1eb2\") " pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:42:56.421958 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:56.421885 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0d51f98-f18d-426d-a626-e068dc133c6d-cluster-monitoring-operator-tls podName:e0d51f98-f18d-426d-a626-e068dc133c6d nodeName:}" failed. No retries permitted until 2026-09-17 16:42:57.421865969 +0000 UTC m=+73.617860100 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e0d51f98-f18d-426d-a626-e068dc133c6d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-6zz8j" (UID: "e0d51f98-f18d-426d-a626-e068dc133c6d") : secret "cluster-monitoring-operator-tls" not found Sep 17 16:42:56.421958 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:56.421922 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 16:42:56.421958 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:56.421960 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19b7131-de33-4c65-924f-b582e08a1eb2-metrics-certs podName:a19b7131-de33-4c65-924f-b582e08a1eb2 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:57.421949746 +0000 UTC m=+73.617943872 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a19b7131-de33-4c65-924f-b582e08a1eb2-metrics-certs") pod "router-default-5dc4c55b4-tls6x" (UID: "a19b7131-de33-4c65-924f-b582e08a1eb2") : secret "router-metrics-certs-default" not found Sep 17 16:42:57.430132 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:57.430088 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a19b7131-de33-4c65-924f-b582e08a1eb2-service-ca-bundle\") pod \"router-default-5dc4c55b4-tls6x\" (UID: \"a19b7131-de33-4c65-924f-b582e08a1eb2\") " pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:42:57.430611 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:57.430164 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19b7131-de33-4c65-924f-b582e08a1eb2-metrics-certs\") pod \"router-default-5dc4c55b4-tls6x\" (UID: \"a19b7131-de33-4c65-924f-b582e08a1eb2\") " pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:42:57.430611 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:57.430225 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0d51f98-f18d-426d-a626-e068dc133c6d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-6zz8j\" (UID: \"e0d51f98-f18d-426d-a626-e068dc133c6d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-6zz8j" Sep 17 16:42:57.430611 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:57.430269 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a19b7131-de33-4c65-924f-b582e08a1eb2-service-ca-bundle podName:a19b7131-de33-4c65-924f-b582e08a1eb2 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:59.430248541 +0000 UTC m=+75.626242666 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a19b7131-de33-4c65-924f-b582e08a1eb2-service-ca-bundle") pod "router-default-5dc4c55b4-tls6x" (UID: "a19b7131-de33-4c65-924f-b582e08a1eb2") : configmap references non-existent config key: service-ca.crt Sep 17 16:42:57.430611 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:57.430314 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 16:42:57.430611 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:57.430337 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 16:42:57.430611 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:57.430357 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19b7131-de33-4c65-924f-b582e08a1eb2-metrics-certs podName:a19b7131-de33-4c65-924f-b582e08a1eb2 nodeName:}" failed. No retries permitted until 2026-09-17 16:42:59.430345249 +0000 UTC m=+75.626339388 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a19b7131-de33-4c65-924f-b582e08a1eb2-metrics-certs") pod "router-default-5dc4c55b4-tls6x" (UID: "a19b7131-de33-4c65-924f-b582e08a1eb2") : secret "router-metrics-certs-default" not found Sep 17 16:42:57.430611 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:57.430390 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0d51f98-f18d-426d-a626-e068dc133c6d-cluster-monitoring-operator-tls podName:e0d51f98-f18d-426d-a626-e068dc133c6d nodeName:}" failed. No retries permitted until 2026-09-17 16:42:59.430371995 +0000 UTC m=+75.626366142 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e0d51f98-f18d-426d-a626-e068dc133c6d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-6zz8j" (UID: "e0d51f98-f18d-426d-a626-e068dc133c6d") : secret "cluster-monitoring-operator-tls" not found Sep 17 16:42:58.890125 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:58.890088 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:58.989956 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:58.989932 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:59.445779 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:59.445748 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0d51f98-f18d-426d-a626-e068dc133c6d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-6zz8j\" (UID: \"e0d51f98-f18d-426d-a626-e068dc133c6d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-6zz8j" Sep 17 16:42:59.445917 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:59.445789 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a19b7131-de33-4c65-924f-b582e08a1eb2-service-ca-bundle\") pod \"router-default-5dc4c55b4-tls6x\" (UID: \"a19b7131-de33-4c65-924f-b582e08a1eb2\") " pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:42:59.445917 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:42:59.445846 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19b7131-de33-4c65-924f-b582e08a1eb2-metrics-certs\") pod \"router-default-5dc4c55b4-tls6x\" (UID: \"a19b7131-de33-4c65-924f-b582e08a1eb2\") " pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:42:59.445917 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:59.445905 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 16:42:59.446009 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:59.445926 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 16:42:59.446009 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:59.445980 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19b7131-de33-4c65-924f-b582e08a1eb2-metrics-certs podName:a19b7131-de33-4c65-924f-b582e08a1eb2 nodeName:}" failed. No retries permitted until 2026-09-17 16:43:03.445961357 +0000 UTC m=+79.641955483 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a19b7131-de33-4c65-924f-b582e08a1eb2-metrics-certs") pod "router-default-5dc4c55b4-tls6x" (UID: "a19b7131-de33-4c65-924f-b582e08a1eb2") : secret "router-metrics-certs-default" not found Sep 17 16:42:59.446009 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:59.445996 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0d51f98-f18d-426d-a626-e068dc133c6d-cluster-monitoring-operator-tls podName:e0d51f98-f18d-426d-a626-e068dc133c6d nodeName:}" failed. No retries permitted until 2026-09-17 16:43:03.445987404 +0000 UTC m=+79.641981530 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e0d51f98-f18d-426d-a626-e068dc133c6d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-6zz8j" (UID: "e0d51f98-f18d-426d-a626-e068dc133c6d") : secret "cluster-monitoring-operator-tls" not found Sep 17 16:42:59.446009 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:42:59.446008 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a19b7131-de33-4c65-924f-b582e08a1eb2-service-ca-bundle podName:a19b7131-de33-4c65-924f-b582e08a1eb2 nodeName:}" failed. No retries permitted until 2026-09-17 16:43:03.446001462 +0000 UTC m=+79.641995592 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a19b7131-de33-4c65-924f-b582e08a1eb2-service-ca-bundle") pod "router-default-5dc4c55b4-tls6x" (UID: "a19b7131-de33-4c65-924f-b582e08a1eb2") : configmap references non-existent config key: service-ca.crt Sep 17 16:43:01.885577 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:01.885546 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cj4n5"] Sep 17 16:43:01.888127 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:01.888107 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cj4n5" Sep 17 16:43:01.892059 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:01.892033 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 17 16:43:01.893098 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:01.893078 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 17 16:43:01.893209 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:01.893126 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 17 16:43:01.893209 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:01.893161 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jqstw\"" Sep 17 16:43:01.893209 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:01.893169 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 17 16:43:01.893696 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:01.893670 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:01.903524 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:01.903494 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cj4n5"] Sep 17 16:43:01.963989 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:01.963968 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnhn5\" (UniqueName: \"kubernetes.io/projected/b159f372-3935-4843-bc51-50f8d456496b-kube-api-access-rnhn5\") pod \"insights-runtime-extractor-cj4n5\" (UID: \"b159f372-3935-4843-bc51-50f8d456496b\") " pod="openshift-insights/insights-runtime-extractor-cj4n5" Sep 17 16:43:01.964118 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:01.964011 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b159f372-3935-4843-bc51-50f8d456496b-data-volume\") pod \"insights-runtime-extractor-cj4n5\" (UID: \"b159f372-3935-4843-bc51-50f8d456496b\") " pod="openshift-insights/insights-runtime-extractor-cj4n5" Sep 17 16:43:01.964118 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:01.964075 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b159f372-3935-4843-bc51-50f8d456496b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cj4n5\" (UID: \"b159f372-3935-4843-bc51-50f8d456496b\") " pod="openshift-insights/insights-runtime-extractor-cj4n5" Sep 17 16:43:01.964118 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:01.964105 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b159f372-3935-4843-bc51-50f8d456496b-crio-socket\") pod \"insights-runtime-extractor-cj4n5\" (UID: \"b159f372-3935-4843-bc51-50f8d456496b\") " pod="openshift-insights/insights-runtime-extractor-cj4n5" Sep 17 16:43:01.964233 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:01.964125 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b159f372-3935-4843-bc51-50f8d456496b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cj4n5\" (UID: \"b159f372-3935-4843-bc51-50f8d456496b\") " pod="openshift-insights/insights-runtime-extractor-cj4n5" Sep 17 16:43:01.981251 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:01.981214 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:02.065422 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:02.065399 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b159f372-3935-4843-bc51-50f8d456496b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cj4n5\" (UID: \"b159f372-3935-4843-bc51-50f8d456496b\") " pod="openshift-insights/insights-runtime-extractor-cj4n5" Sep 17 16:43:02.065505 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:02.065426 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b159f372-3935-4843-bc51-50f8d456496b-crio-socket\") pod \"insights-runtime-extractor-cj4n5\" (UID: \"b159f372-3935-4843-bc51-50f8d456496b\") " pod="openshift-insights/insights-runtime-extractor-cj4n5" Sep 17 16:43:02.065505 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:02.065468 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b159f372-3935-4843-bc51-50f8d456496b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cj4n5\" (UID: \"b159f372-3935-4843-bc51-50f8d456496b\") " pod="openshift-insights/insights-runtime-extractor-cj4n5" Sep 17 16:43:02.065571 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:02.065530 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b159f372-3935-4843-bc51-50f8d456496b-crio-socket\") pod \"insights-runtime-extractor-cj4n5\" (UID: \"b159f372-3935-4843-bc51-50f8d456496b\") " pod="openshift-insights/insights-runtime-extractor-cj4n5" Sep 17 16:43:02.065571 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:02.065534 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 16:43:02.065571 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:02.065554 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 16:43:02.065657 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:02.065593 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b159f372-3935-4843-bc51-50f8d456496b-insights-runtime-extractor-tls podName:b159f372-3935-4843-bc51-50f8d456496b nodeName:}" failed. No retries permitted until 2026-09-17 16:43:02.565575881 +0000 UTC m=+78.761570007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b159f372-3935-4843-bc51-50f8d456496b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cj4n5" (UID: "b159f372-3935-4843-bc51-50f8d456496b") : secret "insights-runtime-extractor-tls" not found Sep 17 16:43:02.065657 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:02.065612 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b159f372-3935-4843-bc51-50f8d456496b-kube-rbac-proxy-cm podName:b159f372-3935-4843-bc51-50f8d456496b nodeName:}" failed. No retries permitted until 2026-09-17 16:43:02.565602367 +0000 UTC m=+78.761596492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b159f372-3935-4843-bc51-50f8d456496b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cj4n5" (UID: "b159f372-3935-4843-bc51-50f8d456496b") : configmap "kube-rbac-proxy" not found Sep 17 16:43:02.065657 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:02.065650 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnhn5\" (UniqueName: \"kubernetes.io/projected/b159f372-3935-4843-bc51-50f8d456496b-kube-api-access-rnhn5\") pod \"insights-runtime-extractor-cj4n5\" (UID: \"b159f372-3935-4843-bc51-50f8d456496b\") " pod="openshift-insights/insights-runtime-extractor-cj4n5" Sep 17 16:43:02.065754 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:02.065705 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b159f372-3935-4843-bc51-50f8d456496b-data-volume\") pod \"insights-runtime-extractor-cj4n5\" (UID: \"b159f372-3935-4843-bc51-50f8d456496b\") " pod="openshift-insights/insights-runtime-extractor-cj4n5" Sep 17 16:43:02.065992 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:02.065976 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b159f372-3935-4843-bc51-50f8d456496b-data-volume\") pod \"insights-runtime-extractor-cj4n5\" (UID: \"b159f372-3935-4843-bc51-50f8d456496b\") " pod="openshift-insights/insights-runtime-extractor-cj4n5" Sep 17 16:43:02.082705 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:02.082680 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnhn5\" (UniqueName: \"kubernetes.io/projected/b159f372-3935-4843-bc51-50f8d456496b-kube-api-access-rnhn5\") pod \"insights-runtime-extractor-cj4n5\" (UID: \"b159f372-3935-4843-bc51-50f8d456496b\") " pod="openshift-insights/insights-runtime-extractor-cj4n5" Sep 17 16:43:02.567604 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:02.567570 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b159f372-3935-4843-bc51-50f8d456496b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cj4n5\" (UID: \"b159f372-3935-4843-bc51-50f8d456496b\") " pod="openshift-insights/insights-runtime-extractor-cj4n5" Sep 17 16:43:02.567776 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:02.567610 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b159f372-3935-4843-bc51-50f8d456496b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cj4n5\" (UID: \"b159f372-3935-4843-bc51-50f8d456496b\") " pod="openshift-insights/insights-runtime-extractor-cj4n5" Sep 17 16:43:02.567776 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:02.567680 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 16:43:02.567776 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:02.567761 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b159f372-3935-4843-bc51-50f8d456496b-kube-rbac-proxy-cm podName:b159f372-3935-4843-bc51-50f8d456496b nodeName:}" failed. No retries permitted until 2026-09-17 16:43:03.567742563 +0000 UTC m=+79.763736704 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b159f372-3935-4843-bc51-50f8d456496b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cj4n5" (UID: "b159f372-3935-4843-bc51-50f8d456496b") : configmap "kube-rbac-proxy" not found Sep 17 16:43:02.567776 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:02.567767 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 16:43:02.567936 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:02.567805 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b159f372-3935-4843-bc51-50f8d456496b-insights-runtime-extractor-tls podName:b159f372-3935-4843-bc51-50f8d456496b nodeName:}" failed. No retries permitted until 2026-09-17 16:43:03.567793243 +0000 UTC m=+79.763787391 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b159f372-3935-4843-bc51-50f8d456496b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cj4n5" (UID: "b159f372-3935-4843-bc51-50f8d456496b") : secret "insights-runtime-extractor-tls" not found Sep 17 16:43:03.231335 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:03.231307 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-spcc4_804bc511-5b2f-407e-b47f-ddd4333a6064/dns-node-resolver/0.log" Sep 17 16:43:03.476109 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:03.476077 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0d51f98-f18d-426d-a626-e068dc133c6d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-6zz8j\" (UID: \"e0d51f98-f18d-426d-a626-e068dc133c6d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-6zz8j" Sep 17 16:43:03.476279 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:03.476114 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a19b7131-de33-4c65-924f-b582e08a1eb2-service-ca-bundle\") pod \"router-default-5dc4c55b4-tls6x\" (UID: \"a19b7131-de33-4c65-924f-b582e08a1eb2\") " pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:43:03.476279 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:03.476164 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19b7131-de33-4c65-924f-b582e08a1eb2-metrics-certs\") pod \"router-default-5dc4c55b4-tls6x\" (UID: \"a19b7131-de33-4c65-924f-b582e08a1eb2\") " pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:43:03.476279 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:03.476244 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 16:43:03.476527 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:03.476248 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 16:43:03.476527 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:03.476305 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a19b7131-de33-4c65-924f-b582e08a1eb2-service-ca-bundle podName:a19b7131-de33-4c65-924f-b582e08a1eb2 nodeName:}" failed. No retries permitted until 2026-09-17 16:43:11.476289379 +0000 UTC m=+87.672283506 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a19b7131-de33-4c65-924f-b582e08a1eb2-service-ca-bundle") pod "router-default-5dc4c55b4-tls6x" (UID: "a19b7131-de33-4c65-924f-b582e08a1eb2") : configmap references non-existent config key: service-ca.crt Sep 17 16:43:03.476527 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:03.476325 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0d51f98-f18d-426d-a626-e068dc133c6d-cluster-monitoring-operator-tls podName:e0d51f98-f18d-426d-a626-e068dc133c6d nodeName:}" failed. No retries permitted until 2026-09-17 16:43:11.476318811 +0000 UTC m=+87.672312937 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e0d51f98-f18d-426d-a626-e068dc133c6d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-6zz8j" (UID: "e0d51f98-f18d-426d-a626-e068dc133c6d") : secret "cluster-monitoring-operator-tls" not found Sep 17 16:43:03.476527 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:03.476337 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19b7131-de33-4c65-924f-b582e08a1eb2-metrics-certs podName:a19b7131-de33-4c65-924f-b582e08a1eb2 nodeName:}" failed. No retries permitted until 2026-09-17 16:43:11.476329873 +0000 UTC m=+87.672323998 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a19b7131-de33-4c65-924f-b582e08a1eb2-metrics-certs") pod "router-default-5dc4c55b4-tls6x" (UID: "a19b7131-de33-4c65-924f-b582e08a1eb2") : secret "router-metrics-certs-default" not found Sep 17 16:43:03.577380 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:03.577301 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b159f372-3935-4843-bc51-50f8d456496b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cj4n5\" (UID: \"b159f372-3935-4843-bc51-50f8d456496b\") " pod="openshift-insights/insights-runtime-extractor-cj4n5" Sep 17 16:43:03.577551 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:03.577457 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b159f372-3935-4843-bc51-50f8d456496b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cj4n5\" (UID: \"b159f372-3935-4843-bc51-50f8d456496b\") " pod="openshift-insights/insights-runtime-extractor-cj4n5" Sep 17 16:43:03.577551 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:03.577463 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 16:43:03.577551 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:03.577492 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 16:43:03.577671 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:03.577556 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b159f372-3935-4843-bc51-50f8d456496b-insights-runtime-extractor-tls podName:b159f372-3935-4843-bc51-50f8d456496b nodeName:}" failed. No retries permitted until 2026-09-17 16:43:05.577537788 +0000 UTC m=+81.773531915 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b159f372-3935-4843-bc51-50f8d456496b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cj4n5" (UID: "b159f372-3935-4843-bc51-50f8d456496b") : secret "insights-runtime-extractor-tls" not found Sep 17 16:43:03.577671 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:03.577577 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b159f372-3935-4843-bc51-50f8d456496b-kube-rbac-proxy-cm podName:b159f372-3935-4843-bc51-50f8d456496b nodeName:}" failed. No retries permitted until 2026-09-17 16:43:05.577568349 +0000 UTC m=+81.773562475 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b159f372-3935-4843-bc51-50f8d456496b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cj4n5" (UID: "b159f372-3935-4843-bc51-50f8d456496b") : configmap "kube-rbac-proxy" not found Sep 17 16:43:04.231184 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:04.231156 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7xjlf_dcc9a981-3536-4588-a119-b7912e2fa48e/node-ca/0.log" Sep 17 16:43:04.831855 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:04.831833 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wlfqv_7f1bf12a-2d8f-462c-aef7-499c90c24bcc/serve-healthcheck-canary/0.log" Sep 17 16:43:05.588938 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:05.588813 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b159f372-3935-4843-bc51-50f8d456496b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cj4n5\" (UID: \"b159f372-3935-4843-bc51-50f8d456496b\") " pod="openshift-insights/insights-runtime-extractor-cj4n5" Sep 17 16:43:05.588938 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:05.588872 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b159f372-3935-4843-bc51-50f8d456496b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cj4n5\" (UID: \"b159f372-3935-4843-bc51-50f8d456496b\") " pod="openshift-insights/insights-runtime-extractor-cj4n5" Sep 17 16:43:05.589199 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:05.588947 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 16:43:05.589199 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:05.588998 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 16:43:05.589199 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:05.589019 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b159f372-3935-4843-bc51-50f8d456496b-kube-rbac-proxy-cm podName:b159f372-3935-4843-bc51-50f8d456496b nodeName:}" failed. No retries permitted until 2026-09-17 16:43:09.588999547 +0000 UTC m=+85.784993692 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b159f372-3935-4843-bc51-50f8d456496b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cj4n5" (UID: "b159f372-3935-4843-bc51-50f8d456496b") : configmap "kube-rbac-proxy" not found Sep 17 16:43:05.589199 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:05.589038 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b159f372-3935-4843-bc51-50f8d456496b-insights-runtime-extractor-tls podName:b159f372-3935-4843-bc51-50f8d456496b nodeName:}" failed. No retries permitted until 2026-09-17 16:43:09.589026342 +0000 UTC m=+85.785020470 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b159f372-3935-4843-bc51-50f8d456496b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cj4n5" (UID: "b159f372-3935-4843-bc51-50f8d456496b") : secret "insights-runtime-extractor-tls" not found Sep 17 16:43:05.829641 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:05.829609 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-rg4nf"] Sep 17 16:43:05.832096 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:05.832082 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rg4nf" Sep 17 16:43:05.835625 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:05.835594 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 17 16:43:05.835741 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:05.835725 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-b9rpz\"" Sep 17 16:43:05.836832 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:05.836802 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 17 16:43:05.836948 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:05.836883 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 17 16:43:05.836948 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:05.836889 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 17 16:43:05.855550 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:05.855496 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-rg4nf"] Sep 17 16:43:05.890883 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:05.890858 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/63e99ccc-a56a-4e27-94d4-e4284762bf7c-config\") pod \"service-ca-operator-57cdc4b768-rg4nf\" (UID: \"63e99ccc-a56a-4e27-94d4-e4284762bf7c\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rg4nf" Sep 17 16:43:05.890991 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:05.890896 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63e99ccc-a56a-4e27-94d4-e4284762bf7c-serving-cert\") pod \"service-ca-operator-57cdc4b768-rg4nf\" (UID: \"63e99ccc-a56a-4e27-94d4-e4284762bf7c\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rg4nf" Sep 17 16:43:05.890991 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:05.890914 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxc4w\" (UniqueName: \"kubernetes.io/projected/63e99ccc-a56a-4e27-94d4-e4284762bf7c-kube-api-access-cxc4w\") pod \"service-ca-operator-57cdc4b768-rg4nf\" (UID: \"63e99ccc-a56a-4e27-94d4-e4284762bf7c\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rg4nf" Sep 17 16:43:05.991918 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:05.991877 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/63e99ccc-a56a-4e27-94d4-e4284762bf7c-config\") pod \"service-ca-operator-57cdc4b768-rg4nf\" (UID: \"63e99ccc-a56a-4e27-94d4-e4284762bf7c\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rg4nf" Sep 17 16:43:05.992096 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:05.991937 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63e99ccc-a56a-4e27-94d4-e4284762bf7c-serving-cert\") pod \"service-ca-operator-57cdc4b768-rg4nf\" (UID: \"63e99ccc-a56a-4e27-94d4-e4284762bf7c\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rg4nf" Sep 17 16:43:05.992096 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:05.991971 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxc4w\" (UniqueName: \"kubernetes.io/projected/63e99ccc-a56a-4e27-94d4-e4284762bf7c-kube-api-access-cxc4w\") pod \"service-ca-operator-57cdc4b768-rg4nf\" (UID: \"63e99ccc-a56a-4e27-94d4-e4284762bf7c\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rg4nf" Sep 17 16:43:05.992530 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:05.992505 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/63e99ccc-a56a-4e27-94d4-e4284762bf7c-config\") pod \"service-ca-operator-57cdc4b768-rg4nf\" (UID: \"63e99ccc-a56a-4e27-94d4-e4284762bf7c\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rg4nf" Sep 17 16:43:05.994261 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:05.994238 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63e99ccc-a56a-4e27-94d4-e4284762bf7c-serving-cert\") pod \"service-ca-operator-57cdc4b768-rg4nf\" (UID: \"63e99ccc-a56a-4e27-94d4-e4284762bf7c\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rg4nf" Sep 17 16:43:06.003892 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:06.003861 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxc4w\" (UniqueName: \"kubernetes.io/projected/63e99ccc-a56a-4e27-94d4-e4284762bf7c-kube-api-access-cxc4w\") pod \"service-ca-operator-57cdc4b768-rg4nf\" (UID: \"63e99ccc-a56a-4e27-94d4-e4284762bf7c\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rg4nf" Sep 17 16:43:06.140977 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:06.140910 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rg4nf" Sep 17 16:43:06.420061 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:06.419991 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-rg4nf"] Sep 17 16:43:06.423029 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:43:06.423002 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63e99ccc_a56a_4e27_94d4_e4284762bf7c.slice/crio-30bec6b8b8aa690a4973dd0a7d83cef59cdb6ceab1324520e67e3a877de63ede WatchSource:0}: Error finding container 30bec6b8b8aa690a4973dd0a7d83cef59cdb6ceab1324520e67e3a877de63ede: Status 404 returned error can't find the container with id 30bec6b8b8aa690a4973dd0a7d83cef59cdb6ceab1324520e67e3a877de63ede Sep 17 16:43:06.708938 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:06.708905 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rg4nf" event={"ID":"63e99ccc-a56a-4e27-94d4-e4284762bf7c","Type":"ContainerStarted","Data":"30bec6b8b8aa690a4973dd0a7d83cef59cdb6ceab1324520e67e3a877de63ede"} Sep 17 16:43:07.858313 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:07.858275 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:07.921375 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:07.921336 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:08.715306 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:08.715270 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rg4nf" event={"ID":"63e99ccc-a56a-4e27-94d4-e4284762bf7c","Type":"ContainerStarted","Data":"e840629e0e67650e0c4e42a9f3abca1fafc210de8b7850f3b81cb72161f01402"} Sep 17 16:43:08.740706 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:08.740662 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rg4nf" podStartSLOduration=1.817759311 podStartE2EDuration="3.740645756s" totalImagesPullingTime="1.922886445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:43:08.739581281 +0000 UTC m=+84.935575428" watchObservedRunningTime="2026-09-17 16:43:08.740645756 +0000 UTC m=+84.936639906" Sep 17 16:43:09.080055 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:09.079973 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:09.190871 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:09.190840 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:09.292679 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:09.292648 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:09.418718 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:09.418636 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:09.624708 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:09.624666 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b159f372-3935-4843-bc51-50f8d456496b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cj4n5\" (UID: \"b159f372-3935-4843-bc51-50f8d456496b\") " pod="openshift-insights/insights-runtime-extractor-cj4n5" Sep 17 16:43:09.624908 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:09.624766 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b159f372-3935-4843-bc51-50f8d456496b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cj4n5\" (UID: \"b159f372-3935-4843-bc51-50f8d456496b\") " pod="openshift-insights/insights-runtime-extractor-cj4n5" Sep 17 16:43:09.624908 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:09.624821 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 16:43:09.624908 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:09.624853 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 16:43:09.624908 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:09.624886 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b159f372-3935-4843-bc51-50f8d456496b-insights-runtime-extractor-tls podName:b159f372-3935-4843-bc51-50f8d456496b nodeName:}" failed. No retries permitted until 2026-09-17 16:43:17.624870226 +0000 UTC m=+93.820864352 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b159f372-3935-4843-bc51-50f8d456496b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cj4n5" (UID: "b159f372-3935-4843-bc51-50f8d456496b") : secret "insights-runtime-extractor-tls" not found Sep 17 16:43:09.624908 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:09.624908 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b159f372-3935-4843-bc51-50f8d456496b-kube-rbac-proxy-cm podName:b159f372-3935-4843-bc51-50f8d456496b nodeName:}" failed. No retries permitted until 2026-09-17 16:43:17.624893385 +0000 UTC m=+93.820887516 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b159f372-3935-4843-bc51-50f8d456496b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cj4n5" (UID: "b159f372-3935-4843-bc51-50f8d456496b") : configmap "kube-rbac-proxy" not found Sep 17 16:43:09.779621 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:09.779586 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:09.933388 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:09.933351 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:10.339379 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:10.339347 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:10.355966 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:10.355940 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-89kjv"] Sep 17 16:43:10.358888 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:10.358873 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-89kjv" Sep 17 16:43:10.363745 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:10.363720 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 17 16:43:10.365270 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:10.365251 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-5vp77\"" Sep 17 16:43:10.365610 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:10.365595 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 17 16:43:10.381488 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:10.381467 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-89kjv"] Sep 17 16:43:10.430052 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:10.430026 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25ght\" (UniqueName: \"kubernetes.io/projected/135ba22b-5655-469a-aa63-e28de41a34dd-kube-api-access-25ght\") pod \"migrator-76794cbd6c-89kjv\" (UID: \"135ba22b-5655-469a-aa63-e28de41a34dd\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-89kjv" Sep 17 16:43:10.476628 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:10.476587 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:10.530881 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:10.530843 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25ght\" (UniqueName: \"kubernetes.io/projected/135ba22b-5655-469a-aa63-e28de41a34dd-kube-api-access-25ght\") pod \"migrator-76794cbd6c-89kjv\" (UID: \"135ba22b-5655-469a-aa63-e28de41a34dd\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-89kjv" Sep 17 16:43:10.540539 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:10.540517 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25ght\" (UniqueName: \"kubernetes.io/projected/135ba22b-5655-469a-aa63-e28de41a34dd-kube-api-access-25ght\") pod \"migrator-76794cbd6c-89kjv\" (UID: \"135ba22b-5655-469a-aa63-e28de41a34dd\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-89kjv" Sep 17 16:43:10.583056 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:10.583026 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:10.667933 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:10.667849 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-89kjv" Sep 17 16:43:10.938286 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:10.938258 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-89kjv"] Sep 17 16:43:10.941278 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:43:10.941255 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod135ba22b_5655_469a_aa63_e28de41a34dd.slice/crio-3bd7182e7feb865d98d99e215ed97ee1965c2c2cc666fea97e23972489971a7d WatchSource:0}: Error finding container 3bd7182e7feb865d98d99e215ed97ee1965c2c2cc666fea97e23972489971a7d: Status 404 returned error can't find the container with id 3bd7182e7feb865d98d99e215ed97ee1965c2c2cc666fea97e23972489971a7d Sep 17 16:43:11.482500 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:11.482466 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:11.541732 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:11.541693 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0d51f98-f18d-426d-a626-e068dc133c6d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-6zz8j\" (UID: \"e0d51f98-f18d-426d-a626-e068dc133c6d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-6zz8j" Sep 17 16:43:11.541911 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:11.541761 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a19b7131-de33-4c65-924f-b582e08a1eb2-service-ca-bundle\") pod \"router-default-5dc4c55b4-tls6x\" (UID: \"a19b7131-de33-4c65-924f-b582e08a1eb2\") " pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:43:11.541911 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:11.541817 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19b7131-de33-4c65-924f-b582e08a1eb2-metrics-certs\") pod \"router-default-5dc4c55b4-tls6x\" (UID: \"a19b7131-de33-4c65-924f-b582e08a1eb2\") " pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:43:11.541911 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:11.541844 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 17 16:43:11.542040 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:11.541920 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0d51f98-f18d-426d-a626-e068dc133c6d-cluster-monitoring-operator-tls podName:e0d51f98-f18d-426d-a626-e068dc133c6d nodeName:}" failed. No retries permitted until 2026-09-17 16:43:27.541901955 +0000 UTC m=+103.737896104 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e0d51f98-f18d-426d-a626-e068dc133c6d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-6zz8j" (UID: "e0d51f98-f18d-426d-a626-e068dc133c6d") : secret "cluster-monitoring-operator-tls" not found Sep 17 16:43:11.542040 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:11.541946 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 17 16:43:11.542040 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:11.542015 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19b7131-de33-4c65-924f-b582e08a1eb2-metrics-certs podName:a19b7131-de33-4c65-924f-b582e08a1eb2 nodeName:}" failed. No retries permitted until 2026-09-17 16:43:27.54199826 +0000 UTC m=+103.737992406 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a19b7131-de33-4c65-924f-b582e08a1eb2-metrics-certs") pod "router-default-5dc4c55b4-tls6x" (UID: "a19b7131-de33-4c65-924f-b582e08a1eb2") : secret "router-metrics-certs-default" not found Sep 17 16:43:11.542170 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:11.542098 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a19b7131-de33-4c65-924f-b582e08a1eb2-service-ca-bundle podName:a19b7131-de33-4c65-924f-b582e08a1eb2 nodeName:}" failed. No retries permitted until 2026-09-17 16:43:27.542084053 +0000 UTC m=+103.738078188 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a19b7131-de33-4c65-924f-b582e08a1eb2-service-ca-bundle") pod "router-default-5dc4c55b4-tls6x" (UID: "a19b7131-de33-4c65-924f-b582e08a1eb2") : configmap references non-existent config key: service-ca.crt Sep 17 16:43:11.602043 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:11.602006 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:11.724478 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:11.724423 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-89kjv" event={"ID":"135ba22b-5655-469a-aa63-e28de41a34dd","Type":"ContainerStarted","Data":"3bd7182e7feb865d98d99e215ed97ee1965c2c2cc666fea97e23972489971a7d"} Sep 17 16:43:12.729028 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:12.728988 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-89kjv" event={"ID":"135ba22b-5655-469a-aa63-e28de41a34dd","Type":"ContainerStarted","Data":"6c37d6d97acd6a4babfa8501356f733d2448b931645fbe6688f4de6b816e5b6a"} Sep 17 16:43:12.729387 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:12.729053 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-89kjv" event={"ID":"135ba22b-5655-469a-aa63-e28de41a34dd","Type":"ContainerStarted","Data":"11cc48a1919256a0f1489cba0d0c8e7806b0da8095c497e8c19d48308b8c71a2"} Sep 17 16:43:12.769048 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:12.769003 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-89kjv" podStartSLOduration=1.741167635 podStartE2EDuration="2.768988598s" totalImagesPullingTime="1.027820963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:43:12.767665857 +0000 UTC m=+88.963660005" watchObservedRunningTime="2026-09-17 16:43:12.768988598 +0000 UTC m=+88.964982746" Sep 17 16:43:12.914064 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:12.914016 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:15.093243 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:15.093212 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:15.356893 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:15.356807 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:15.479931 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:15.479892 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:15.597472 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:15.597405 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:15.767648 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:15.767618 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:16.014197 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:16.014166 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:17.194994 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:17.194955 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:17.485236 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:17.485143 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:17.653629 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:17.653598 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:17.691646 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:17.691617 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b159f372-3935-4843-bc51-50f8d456496b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cj4n5\" (UID: \"b159f372-3935-4843-bc51-50f8d456496b\") " pod="openshift-insights/insights-runtime-extractor-cj4n5" Sep 17 16:43:17.691780 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:17.691700 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b159f372-3935-4843-bc51-50f8d456496b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cj4n5\" (UID: \"b159f372-3935-4843-bc51-50f8d456496b\") " pod="openshift-insights/insights-runtime-extractor-cj4n5" Sep 17 16:43:17.691828 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:17.691817 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 16:43:17.691878 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:17.691869 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b159f372-3935-4843-bc51-50f8d456496b-insights-runtime-extractor-tls podName:b159f372-3935-4843-bc51-50f8d456496b nodeName:}" failed. No retries permitted until 2026-09-17 16:43:33.691855438 +0000 UTC m=+109.887849564 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b159f372-3935-4843-bc51-50f8d456496b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cj4n5" (UID: "b159f372-3935-4843-bc51-50f8d456496b") : secret "insights-runtime-extractor-tls" not found Sep 17 16:43:17.692134 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:17.692118 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b159f372-3935-4843-bc51-50f8d456496b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cj4n5\" (UID: \"b159f372-3935-4843-bc51-50f8d456496b\") " pod="openshift-insights/insights-runtime-extractor-cj4n5" Sep 17 16:43:17.794690 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:17.794591 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:17.994115 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:17.994078 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:18.800391 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:18.800360 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:18.983670 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:18.983635 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:19.184497 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:19.184458 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:19.419972 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:19.419924 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:19.577750 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:19.577663 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:19.693768 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:19.693738 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:19.805685 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:19.805658 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:20.014017 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:20.013986 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:21.180464 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:21.180417 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:21.362783 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:21.362741 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:21.560381 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:21.560298 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:21.658853 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:21.658824 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:21.797083 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:21.797037 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:21.981086 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:21.981054 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:22.529951 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:22.529919 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-tls\") pod \"image-registry-5b9ff76d55-b7lfl\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:43:22.530313 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:22.529970 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f724cc35-e114-45e0-ae6b-07b4d9653424-metrics-tls\") pod \"dns-default-tkgdr\" (UID: \"f724cc35-e114-45e0-ae6b-07b4d9653424\") " pod="openshift-dns/dns-default-tkgdr" Sep 17 16:43:22.532360 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:22.532335 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f724cc35-e114-45e0-ae6b-07b4d9653424-metrics-tls\") pod \"dns-default-tkgdr\" (UID: \"f724cc35-e114-45e0-ae6b-07b4d9653424\") " pod="openshift-dns/dns-default-tkgdr" Sep 17 16:43:22.532545 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:22.532524 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-tls\") pod \"image-registry-5b9ff76d55-b7lfl\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:43:22.588653 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:22.588628 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bdrbl\"" Sep 17 16:43:22.596052 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:22.596032 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tkgdr" Sep 17 16:43:22.834144 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:22.834062 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-sbjg6\"" Sep 17 16:43:22.841323 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:22.841307 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:43:22.867139 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:22.867111 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tkgdr"] Sep 17 16:43:22.870041 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:43:22.870016 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf724cc35_e114_45e0_ae6b_07b4d9653424.slice/crio-3e1c679536052f5b8b2286a126f8d4367acdb33796e384e6a45e2836f434f72c WatchSource:0}: Error finding container 3e1c679536052f5b8b2286a126f8d4367acdb33796e384e6a45e2836f434f72c: Status 404 returned error can't find the container with id 3e1c679536052f5b8b2286a126f8d4367acdb33796e384e6a45e2836f434f72c Sep 17 16:43:22.959384 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:22.959353 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:23.117094 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:23.117015 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b9ff76d55-b7lfl"] Sep 17 16:43:23.119737 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:43:23.119713 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8141abaa_13c3_40c8_8ba6_fc3bba21daf4.slice/crio-e14fd40bd13772723376a3dc1a80c995f8fd8805b3538cd02d3b635cc1a3e9a7 WatchSource:0}: Error finding container e14fd40bd13772723376a3dc1a80c995f8fd8805b3538cd02d3b635cc1a3e9a7: Status 404 returned error can't find the container with id e14fd40bd13772723376a3dc1a80c995f8fd8805b3538cd02d3b635cc1a3e9a7 Sep 17 16:43:23.183162 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:23.183124 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:23.699296 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:23.699248 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:23.763051 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:23.763016 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tkgdr" event={"ID":"f724cc35-e114-45e0-ae6b-07b4d9653424","Type":"ContainerStarted","Data":"3e1c679536052f5b8b2286a126f8d4367acdb33796e384e6a45e2836f434f72c"} Sep 17 16:43:23.764788 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:23.764756 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" event={"ID":"8141abaa-13c3-40c8-8ba6-fc3bba21daf4","Type":"ContainerStarted","Data":"f246b456663c1e2d4cf498fcc43599e55ef351ff27003ef9d5b460e12c9767c2"} Sep 17 16:43:23.764915 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:23.764805 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" event={"ID":"8141abaa-13c3-40c8-8ba6-fc3bba21daf4","Type":"ContainerStarted","Data":"e14fd40bd13772723376a3dc1a80c995f8fd8805b3538cd02d3b635cc1a3e9a7"} Sep 17 16:43:23.764967 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:23.764913 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:43:23.800532 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:23.800476 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" podStartSLOduration=98.800459015 podStartE2EDuration="1m38.800459015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:41:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:43:23.798502452 +0000 UTC m=+99.994496602" watchObservedRunningTime="2026-09-17 16:43:23.800459015 +0000 UTC m=+99.996453162" Sep 17 16:43:23.816534 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:23.816508 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:24.413701 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:24.413673 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:24.768601 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:24.768564 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:25.188954 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:25.188927 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:25.620754 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:25.620667 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:25.772604 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:25.772569 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tkgdr" event={"ID":"f724cc35-e114-45e0-ae6b-07b4d9653424","Type":"ContainerStarted","Data":"f2bc02fbc56c28217049fdcd5ce212f2b9316c7d63b41ce185ac415175362a58"} Sep 17 16:43:25.773061 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:25.772625 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tkgdr" event={"ID":"f724cc35-e114-45e0-ae6b-07b4d9653424","Type":"ContainerStarted","Data":"0c54f8e65c7b6034b6e3a39c3c9e8aaaaccb0640e9f726433602e1325d918923"} Sep 17 16:43:25.773061 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:25.772687 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tkgdr" Sep 17 16:43:25.797699 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:25.797666 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:25.802552 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:25.802507 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tkgdr" podStartSLOduration=65.643701685 podStartE2EDuration="1m7.802494077s" totalImagesPullingTime="2.158792392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:42:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:43:25.801690991 +0000 UTC m=+101.997685138" watchObservedRunningTime="2026-09-17 16:43:25.802494077 +0000 UTC m=+101.998488224" Sep 17 16:43:26.015667 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:26.015619 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:26.682123 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:26.682098 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fqfbx" Sep 17 16:43:27.574146 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:27.574105 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19b7131-de33-4c65-924f-b582e08a1eb2-metrics-certs\") pod \"router-default-5dc4c55b4-tls6x\" (UID: \"a19b7131-de33-4c65-924f-b582e08a1eb2\") " pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:43:27.574713 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:27.574187 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0d51f98-f18d-426d-a626-e068dc133c6d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-6zz8j\" (UID: \"e0d51f98-f18d-426d-a626-e068dc133c6d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-6zz8j" Sep 17 16:43:27.574713 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:27.574342 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a19b7131-de33-4c65-924f-b582e08a1eb2-service-ca-bundle\") pod \"router-default-5dc4c55b4-tls6x\" (UID: \"a19b7131-de33-4c65-924f-b582e08a1eb2\") " pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:43:27.574959 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:27.574940 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a19b7131-de33-4c65-924f-b582e08a1eb2-service-ca-bundle\") pod \"router-default-5dc4c55b4-tls6x\" (UID: \"a19b7131-de33-4c65-924f-b582e08a1eb2\") " pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:43:27.576701 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:27.576676 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19b7131-de33-4c65-924f-b582e08a1eb2-metrics-certs\") pod \"router-default-5dc4c55b4-tls6x\" (UID: \"a19b7131-de33-4c65-924f-b582e08a1eb2\") " pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:43:27.576809 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:27.576751 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e0d51f98-f18d-426d-a626-e068dc133c6d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-6zz8j\" (UID: \"e0d51f98-f18d-426d-a626-e068dc133c6d\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-6zz8j" Sep 17 16:43:27.828126 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:27.828038 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-6zz8j" Sep 17 16:43:27.848851 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:27.848827 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:43:28.103788 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:28.103715 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-6zz8j"] Sep 17 16:43:28.106767 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:43:28.106741 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0d51f98_f18d_426d_a626_e068dc133c6d.slice/crio-58e422a4fb615f8b296909c90c1be2eb541047b7dd7160ed4f20501ab46ace18 WatchSource:0}: Error finding container 58e422a4fb615f8b296909c90c1be2eb541047b7dd7160ed4f20501ab46ace18: Status 404 returned error can't find the container with id 58e422a4fb615f8b296909c90c1be2eb541047b7dd7160ed4f20501ab46ace18 Sep 17 16:43:28.145056 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:28.145026 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5dc4c55b4-tls6x"] Sep 17 16:43:28.147401 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:43:28.147377 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda19b7131_de33_4c65_924f_b582e08a1eb2.slice/crio-0ab17943b3b110e7119c380ff8e319dc5b4a101e721ef79eb36db4b9e9d7826f WatchSource:0}: Error finding container 0ab17943b3b110e7119c380ff8e319dc5b4a101e721ef79eb36db4b9e9d7826f: Status 404 returned error can't find the container with id 0ab17943b3b110e7119c380ff8e319dc5b4a101e721ef79eb36db4b9e9d7826f Sep 17 16:43:28.784869 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:28.784829 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5dc4c55b4-tls6x" event={"ID":"a19b7131-de33-4c65-924f-b582e08a1eb2","Type":"ContainerStarted","Data":"dbfd2e25ea78cc28b62d53a0e74639dbd6ffdbc268ec976b3366edf8a64c4ec7"} Sep 17 16:43:28.785304 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:28.784890 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5dc4c55b4-tls6x" event={"ID":"a19b7131-de33-4c65-924f-b582e08a1eb2","Type":"ContainerStarted","Data":"0ab17943b3b110e7119c380ff8e319dc5b4a101e721ef79eb36db4b9e9d7826f"} Sep 17 16:43:28.786158 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:28.786131 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-6zz8j" event={"ID":"e0d51f98-f18d-426d-a626-e068dc133c6d","Type":"ContainerStarted","Data":"58e422a4fb615f8b296909c90c1be2eb541047b7dd7160ed4f20501ab46ace18"} Sep 17 16:43:28.820957 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:28.820898 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5dc4c55b4-tls6x" podStartSLOduration=33.82088175 podStartE2EDuration="33.82088175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:42:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:43:28.820087104 +0000 UTC m=+105.016081252" watchObservedRunningTime="2026-09-17 16:43:28.82088175 +0000 UTC m=+105.016875895" Sep 17 16:43:28.849350 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:28.849316 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:43:28.852354 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:28.852331 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:43:29.223559 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:29.223523 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:29.789146 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:29.789123 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:43:29.790334 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:29.790311 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5dc4c55b4-tls6x" Sep 17 16:43:30.169742 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:30.169655 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:30.325531 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:30.325501 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:30.668476 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:30.668430 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:30.793239 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:30.793206 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-6zz8j" event={"ID":"e0d51f98-f18d-426d-a626-e068dc133c6d","Type":"ContainerStarted","Data":"cb5ba4f6ec6ef4ec723af5c7a0aa3110ad709676b896bcdb17a870db6a7f9de8"} Sep 17 16:43:30.812618 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:30.812578 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-6zz8j" podStartSLOduration=34.140291442 podStartE2EDuration="35.812561073s" totalImagesPullingTime="1.672269631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:42:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:43:30.812421233 +0000 UTC m=+107.008415382" watchObservedRunningTime="2026-09-17 16:43:30.812561073 +0000 UTC m=+107.008555222" Sep 17 16:43:31.035938 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:31.035900 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:31.151141 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:31.151115 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:31.447724 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:31.447696 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:31.616776 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:31.616748 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:31.705816 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:31.705716 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:32.434942 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:32.434894 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:32.668226 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:32.668186 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:32.832863 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:32.832784 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:33.008407 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:33.008375 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:33.083478 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:33.083405 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:33.724352 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:33.724310 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b159f372-3935-4843-bc51-50f8d456496b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cj4n5\" (UID: \"b159f372-3935-4843-bc51-50f8d456496b\") " pod="openshift-insights/insights-runtime-extractor-cj4n5" Sep 17 16:43:33.726757 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:33.726729 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b159f372-3935-4843-bc51-50f8d456496b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cj4n5\" (UID: \"b159f372-3935-4843-bc51-50f8d456496b\") " pod="openshift-insights/insights-runtime-extractor-cj4n5" Sep 17 16:43:33.997222 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:33.997132 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cj4n5" Sep 17 16:43:34.268294 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:34.268215 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cj4n5"] Sep 17 16:43:34.272619 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:43:34.272594 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb159f372_3935_4843_bc51_50f8d456496b.slice/crio-41c562529a70cfd33760fffb953da9b24542b61da16f74b9ec7242ab3e78518e WatchSource:0}: Error finding container 41c562529a70cfd33760fffb953da9b24542b61da16f74b9ec7242ab3e78518e: Status 404 returned error can't find the container with id 41c562529a70cfd33760fffb953da9b24542b61da16f74b9ec7242ab3e78518e Sep 17 16:43:34.505028 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:34.504996 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:34.573213 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:34.573150 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:34.808474 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:34.808429 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cj4n5" event={"ID":"b159f372-3935-4843-bc51-50f8d456496b","Type":"ContainerStarted","Data":"25eb5a7d576ea3f320c27cd25c01bd497ea6affe2318e78afb71870ebce4b981"} Sep 17 16:43:34.808820 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:34.808497 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cj4n5" event={"ID":"b159f372-3935-4843-bc51-50f8d456496b","Type":"ContainerStarted","Data":"41c562529a70cfd33760fffb953da9b24542b61da16f74b9ec7242ab3e78518e"} Sep 17 16:43:35.283127 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.283102 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c9f95dfb-kvx5h"] Sep 17 16:43:35.285209 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.285192 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c9f95dfb-kvx5h" Sep 17 16:43:35.287975 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.287956 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 17 16:43:35.288931 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.288910 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 17 16:43:35.289345 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.289327 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 17 16:43:35.290108 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.290092 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-6p9jz\"" Sep 17 16:43:35.290727 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.290707 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 17 16:43:35.306612 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.306591 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c9f95dfb-kvx5h"] Sep 17 16:43:35.406291 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.406265 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-hjn8z"] Sep 17 16:43:35.408198 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.408177 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6594f4c75-9fvdm"] Sep 17 16:43:35.408344 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.408322 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-hjn8z" Sep 17 16:43:35.410651 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.410630 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vgt9j"] Sep 17 16:43:35.410788 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.410742 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-9fvdm" Sep 17 16:43:35.412427 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.412408 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-gld2l"] Sep 17 16:43:35.412609 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.412594 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vgt9j" Sep 17 16:43:35.414543 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.414527 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 17 16:43:35.414644 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.414627 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-lzxzd\"" Sep 17 16:43:35.414810 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.414795 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 17 16:43:35.415163 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.415146 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gld2l" Sep 17 16:43:35.425143 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.425126 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 17 16:43:35.425252 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.425200 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 17 16:43:35.426576 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.426553 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 17 16:43:35.426675 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.426559 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-77mlj\"" Sep 17 16:43:35.426675 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.426568 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-w7b4l\"" Sep 17 16:43:35.426675 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.426593 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-r7vdc\"" Sep 17 16:43:35.436090 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.436073 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3d010653-4d92-40f4-8f35-16e731f3d024-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-58c9f95dfb-kvx5h\" (UID: \"3d010653-4d92-40f4-8f35-16e731f3d024\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c9f95dfb-kvx5h" Sep 17 16:43:35.436166 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.436122 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8rs5\" (UniqueName: \"kubernetes.io/projected/3d010653-4d92-40f4-8f35-16e731f3d024-kube-api-access-z8rs5\") pod \"managed-serviceaccount-addon-agent-58c9f95dfb-kvx5h\" (UID: \"3d010653-4d92-40f4-8f35-16e731f3d024\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c9f95dfb-kvx5h" Sep 17 16:43:35.446493 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.446475 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-9fvdm"] Sep 17 16:43:35.447545 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.447527 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-hjn8z"] Sep 17 16:43:35.448306 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.448288 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-gld2l"] Sep 17 16:43:35.455396 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.455347 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vgt9j"] Sep 17 16:43:35.501739 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.501705 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:35.537455 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.537401 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1c761116-f06f-4a8f-a486-b38feaf57447-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-hjn8z\" (UID: \"1c761116-f06f-4a8f-a486-b38feaf57447\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-hjn8z" Sep 17 16:43:35.537603 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.537486 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1c761116-f06f-4a8f-a486-b38feaf57447-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-hjn8z\" (UID: \"1c761116-f06f-4a8f-a486-b38feaf57447\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-hjn8z" Sep 17 16:43:35.537603 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.537521 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8rs5\" (UniqueName: \"kubernetes.io/projected/3d010653-4d92-40f4-8f35-16e731f3d024-kube-api-access-z8rs5\") pod \"managed-serviceaccount-addon-agent-58c9f95dfb-kvx5h\" (UID: \"3d010653-4d92-40f4-8f35-16e731f3d024\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c9f95dfb-kvx5h" Sep 17 16:43:35.537603 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.537545 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66wwp\" (UniqueName: \"kubernetes.io/projected/4535c6ab-9627-43cf-a304-72247fafef62-kube-api-access-66wwp\") pod \"network-check-source-7cbc45fddc-gld2l\" (UID: \"4535c6ab-9627-43cf-a304-72247fafef62\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gld2l" Sep 17 16:43:35.537698 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.537636 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3d010653-4d92-40f4-8f35-16e731f3d024-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-58c9f95dfb-kvx5h\" (UID: \"3d010653-4d92-40f4-8f35-16e731f3d024\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c9f95dfb-kvx5h" Sep 17 16:43:35.537698 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.537659 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhd42\" (UniqueName: \"kubernetes.io/projected/c3d10027-2f6c-420a-9acb-7410e8d57b4c-kube-api-access-lhd42\") pod \"downloads-6594f4c75-9fvdm\" (UID: \"c3d10027-2f6c-420a-9acb-7410e8d57b4c\") " pod="openshift-console/downloads-6594f4c75-9fvdm" Sep 17 16:43:35.537698 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.537680 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/eb418122-1020-47db-9bcb-f10d09e20bb5-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-vgt9j\" (UID: \"eb418122-1020-47db-9bcb-f10d09e20bb5\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vgt9j" Sep 17 16:43:35.540404 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.540373 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3d010653-4d92-40f4-8f35-16e731f3d024-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-58c9f95dfb-kvx5h\" (UID: \"3d010653-4d92-40f4-8f35-16e731f3d024\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c9f95dfb-kvx5h" Sep 17 16:43:35.559302 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.559279 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8rs5\" (UniqueName: \"kubernetes.io/projected/3d010653-4d92-40f4-8f35-16e731f3d024-kube-api-access-z8rs5\") pod \"managed-serviceaccount-addon-agent-58c9f95dfb-kvx5h\" (UID: \"3d010653-4d92-40f4-8f35-16e731f3d024\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c9f95dfb-kvx5h" Sep 17 16:43:35.607643 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.607611 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c9f95dfb-kvx5h" Sep 17 16:43:35.622834 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.622803 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:35.638845 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.638810 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1c761116-f06f-4a8f-a486-b38feaf57447-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-hjn8z\" (UID: \"1c761116-f06f-4a8f-a486-b38feaf57447\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-hjn8z" Sep 17 16:43:35.639003 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.638976 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66wwp\" (UniqueName: \"kubernetes.io/projected/4535c6ab-9627-43cf-a304-72247fafef62-kube-api-access-66wwp\") pod \"network-check-source-7cbc45fddc-gld2l\" (UID: \"4535c6ab-9627-43cf-a304-72247fafef62\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gld2l" Sep 17 16:43:35.639085 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.639066 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhd42\" (UniqueName: \"kubernetes.io/projected/c3d10027-2f6c-420a-9acb-7410e8d57b4c-kube-api-access-lhd42\") pod \"downloads-6594f4c75-9fvdm\" (UID: \"c3d10027-2f6c-420a-9acb-7410e8d57b4c\") " pod="openshift-console/downloads-6594f4c75-9fvdm" Sep 17 16:43:35.639134 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.639109 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/eb418122-1020-47db-9bcb-f10d09e20bb5-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-vgt9j\" (UID: \"eb418122-1020-47db-9bcb-f10d09e20bb5\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vgt9j" Sep 17 16:43:35.639184 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.639155 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1c761116-f06f-4a8f-a486-b38feaf57447-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-hjn8z\" (UID: \"1c761116-f06f-4a8f-a486-b38feaf57447\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-hjn8z" Sep 17 16:43:35.639783 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.639752 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1c761116-f06f-4a8f-a486-b38feaf57447-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-hjn8z\" (UID: \"1c761116-f06f-4a8f-a486-b38feaf57447\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-hjn8z" Sep 17 16:43:35.641754 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.641725 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1c761116-f06f-4a8f-a486-b38feaf57447-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-hjn8z\" (UID: \"1c761116-f06f-4a8f-a486-b38feaf57447\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-hjn8z" Sep 17 16:43:35.642184 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.642157 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/eb418122-1020-47db-9bcb-f10d09e20bb5-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-vgt9j\" (UID: \"eb418122-1020-47db-9bcb-f10d09e20bb5\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vgt9j" Sep 17 16:43:35.651217 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.651185 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhd42\" (UniqueName: \"kubernetes.io/projected/c3d10027-2f6c-420a-9acb-7410e8d57b4c-kube-api-access-lhd42\") pod \"downloads-6594f4c75-9fvdm\" (UID: \"c3d10027-2f6c-420a-9acb-7410e8d57b4c\") " pod="openshift-console/downloads-6594f4c75-9fvdm" Sep 17 16:43:35.651370 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.651287 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66wwp\" (UniqueName: \"kubernetes.io/projected/4535c6ab-9627-43cf-a304-72247fafef62-kube-api-access-66wwp\") pod \"network-check-source-7cbc45fddc-gld2l\" (UID: \"4535c6ab-9627-43cf-a304-72247fafef62\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gld2l" Sep 17 16:43:35.718846 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.718757 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-hjn8z" Sep 17 16:43:35.723173 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.723144 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:35.724577 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.724555 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-9fvdm" Sep 17 16:43:35.730424 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.730400 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vgt9j" Sep 17 16:43:35.736388 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.736360 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gld2l" Sep 17 16:43:35.779147 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.778240 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tkgdr" Sep 17 16:43:35.825971 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.825890 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cj4n5" event={"ID":"b159f372-3935-4843-bc51-50f8d456496b","Type":"ContainerStarted","Data":"e40216513fdeb78135db5e35a0ae1082ed0fd64523656c014b588886da9d52f5"} Sep 17 16:43:35.899978 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:35.899943 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c9f95dfb-kvx5h"] Sep 17 16:43:35.903645 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:43:35.903543 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d010653_4d92_40f4_8f35_16e731f3d024.slice/crio-807349e1c8cf2f74519ead0df8116c53b0c865a30bce16cbfb84c98751e9ede5 WatchSource:0}: Error finding container 807349e1c8cf2f74519ead0df8116c53b0c865a30bce16cbfb84c98751e9ede5: Status 404 returned error can't find the container with id 807349e1c8cf2f74519ead0df8116c53b0c865a30bce16cbfb84c98751e9ede5 Sep 17 16:43:36.018223 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:36.018144 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-hjn8z"] Sep 17 16:43:36.021147 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:36.021121 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-9fvdm"] Sep 17 16:43:36.022011 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:43:36.021985 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c761116_f06f_4a8f_a486_b38feaf57447.slice/crio-3e941586c58054a279e73c1643717392aafcb2c71dfa85951849b9d2fefaeee9 WatchSource:0}: Error finding container 3e941586c58054a279e73c1643717392aafcb2c71dfa85951849b9d2fefaeee9: Status 404 returned error can't find the container with id 3e941586c58054a279e73c1643717392aafcb2c71dfa85951849b9d2fefaeee9 Sep 17 16:43:36.026151 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:43:36.026122 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3d10027_2f6c_420a_9acb_7410e8d57b4c.slice/crio-0aa0c297b1a5a4fb988578addf1a4951de7bf46fa4a3486a4f3b26f302e23b5c WatchSource:0}: Error finding container 0aa0c297b1a5a4fb988578addf1a4951de7bf46fa4a3486a4f3b26f302e23b5c: Status 404 returned error can't find the container with id 0aa0c297b1a5a4fb988578addf1a4951de7bf46fa4a3486a4f3b26f302e23b5c Sep 17 16:43:36.048273 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:36.048253 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-gld2l"] Sep 17 16:43:36.050849 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:43:36.050816 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4535c6ab_9627_43cf_a304_72247fafef62.slice/crio-0b3d81b046fa3401288ae432a45e914c64d71ce3ce448ec27f0b4982cc8134fe WatchSource:0}: Error finding container 0b3d81b046fa3401288ae432a45e914c64d71ce3ce448ec27f0b4982cc8134fe: Status 404 returned error can't find the container with id 0b3d81b046fa3401288ae432a45e914c64d71ce3ce448ec27f0b4982cc8134fe Sep 17 16:43:36.056296 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:36.055855 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vgt9j"] Sep 17 16:43:36.061713 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:43:36.061686 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb418122_1020_47db_9bcb_f10d09e20bb5.slice/crio-62f9fccdb004c6cd31633dd8b7c0665ab8bc509d4a7e6ff625e2d77c324da41e WatchSource:0}: Error finding container 62f9fccdb004c6cd31633dd8b7c0665ab8bc509d4a7e6ff625e2d77c324da41e: Status 404 returned error can't find the container with id 62f9fccdb004c6cd31633dd8b7c0665ab8bc509d4a7e6ff625e2d77c324da41e Sep 17 16:43:36.832823 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:36.832673 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-9fvdm" event={"ID":"c3d10027-2f6c-420a-9acb-7410e8d57b4c","Type":"ContainerStarted","Data":"0aa0c297b1a5a4fb988578addf1a4951de7bf46fa4a3486a4f3b26f302e23b5c"} Sep 17 16:43:36.836379 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:36.836299 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vgt9j" event={"ID":"eb418122-1020-47db-9bcb-f10d09e20bb5","Type":"ContainerStarted","Data":"62f9fccdb004c6cd31633dd8b7c0665ab8bc509d4a7e6ff625e2d77c324da41e"} Sep 17 16:43:36.842544 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:36.841678 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cj4n5" event={"ID":"b159f372-3935-4843-bc51-50f8d456496b","Type":"ContainerStarted","Data":"1391e825ce86d4f7a7cc7499607c0949bb43050cba2b6b575de6210f2c840fe6"} Sep 17 16:43:36.845130 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:36.845058 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gld2l" event={"ID":"4535c6ab-9627-43cf-a304-72247fafef62","Type":"ContainerStarted","Data":"bd7ea64cf3b782a066452c8417d6764ef4758d4712bf126e77d39fd30c3901ab"} Sep 17 16:43:36.845130 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:36.845100 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gld2l" event={"ID":"4535c6ab-9627-43cf-a304-72247fafef62","Type":"ContainerStarted","Data":"0b3d81b046fa3401288ae432a45e914c64d71ce3ce448ec27f0b4982cc8134fe"} Sep 17 16:43:36.848049 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:36.848021 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-hjn8z" event={"ID":"1c761116-f06f-4a8f-a486-b38feaf57447","Type":"ContainerStarted","Data":"3e941586c58054a279e73c1643717392aafcb2c71dfa85951849b9d2fefaeee9"} Sep 17 16:43:36.850952 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:36.850891 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c9f95dfb-kvx5h" event={"ID":"3d010653-4d92-40f4-8f35-16e731f3d024","Type":"ContainerStarted","Data":"807349e1c8cf2f74519ead0df8116c53b0c865a30bce16cbfb84c98751e9ede5"} Sep 17 16:43:36.905361 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:36.904635 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cj4n5" podStartSLOduration=33.757540484 podStartE2EDuration="35.904614475s" totalImagesPullingTime="2.147073991s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:43:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:43:36.873116007 +0000 UTC m=+113.069110157" watchObservedRunningTime="2026-09-17 16:43:36.904614475 +0000 UTC m=+113.100608624" Sep 17 16:43:36.905361 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:36.904773 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-gld2l" podStartSLOduration=1.9047651989999999 podStartE2EDuration="1.904765199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:43:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:43:36.902957934 +0000 UTC m=+113.098952083" watchObservedRunningTime="2026-09-17 16:43:36.904765199 +0000 UTC m=+113.100759347" Sep 17 16:43:39.864685 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:39.864635 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-hjn8z" event={"ID":"1c761116-f06f-4a8f-a486-b38feaf57447","Type":"ContainerStarted","Data":"6ba3f7c789ad1411b60cf2514bf7e43fd9195888ee0bbbb2695aa29d1c956022"} Sep 17 16:43:39.866257 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:39.866228 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c9f95dfb-kvx5h" event={"ID":"3d010653-4d92-40f4-8f35-16e731f3d024","Type":"ContainerStarted","Data":"a5d347f65ed917ae452a6fa8714e5b1ab176f8c3929e6628465c536f658a69c6"} Sep 17 16:43:39.867828 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:39.867800 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vgt9j" event={"ID":"eb418122-1020-47db-9bcb-f10d09e20bb5","Type":"ContainerStarted","Data":"0a89f826053cba23429cc79523681bfbfe595a47676cecb94da832fa1f709192"} Sep 17 16:43:39.867995 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:39.867976 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vgt9j" Sep 17 16:43:39.873141 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:39.873119 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vgt9j" Sep 17 16:43:39.897870 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:39.897831 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6446c8d75d-hjn8z" podStartSLOduration=1.626485745 podStartE2EDuration="4.897818431s" totalImagesPullingTime="3.271332686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:43:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:43:39.897597666 +0000 UTC m=+116.093591815" watchObservedRunningTime="2026-09-17 16:43:39.897818431 +0000 UTC m=+116.093812573" Sep 17 16:43:39.928704 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:39.928657 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58c9f95dfb-kvx5h" podStartSLOduration=1.479296527 podStartE2EDuration="4.928642932s" totalImagesPullingTime="3.449346405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:43:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:43:39.92766131 +0000 UTC m=+116.123655458" watchObservedRunningTime="2026-09-17 16:43:39.928642932 +0000 UTC m=+116.124637079" Sep 17 16:43:40.094233 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.094188 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:40.171187 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.171095 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:40.354830 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.354780 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vgt9j" podStartSLOduration=2.119553988 podStartE2EDuration="5.354762362s" totalImagesPullingTime="3.235208374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:43:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:43:39.963505827 +0000 UTC m=+116.159499976" watchObservedRunningTime="2026-09-17 16:43:40.354762362 +0000 UTC m=+116.550756511" Sep 17 16:43:40.355706 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.355677 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fc99b9cf4-5dz6x"] Sep 17 16:43:40.360260 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.360243 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fc99b9cf4-5dz6x" Sep 17 16:43:40.381309 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.381286 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 17 16:43:40.381431 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.381370 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 17 16:43:40.382511 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.382487 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 17 16:43:40.382718 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.382694 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 17 16:43:40.383326 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.383307 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 17 16:43:40.383469 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.383430 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5b6h2\"" Sep 17 16:43:40.407621 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.407596 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fc99b9cf4-5dz6x"] Sep 17 16:43:40.430722 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.430697 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:40.481357 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.481330 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f05fdaf-53cf-4545-a9f6-a83b896fb066-console-config\") pod \"console-6fc99b9cf4-5dz6x\" (UID: \"1f05fdaf-53cf-4545-a9f6-a83b896fb066\") " pod="openshift-console/console-6fc99b9cf4-5dz6x" Sep 17 16:43:40.481513 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.481368 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f05fdaf-53cf-4545-a9f6-a83b896fb066-console-serving-cert\") pod \"console-6fc99b9cf4-5dz6x\" (UID: \"1f05fdaf-53cf-4545-a9f6-a83b896fb066\") " pod="openshift-console/console-6fc99b9cf4-5dz6x" Sep 17 16:43:40.481513 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.481389 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f05fdaf-53cf-4545-a9f6-a83b896fb066-console-oauth-config\") pod \"console-6fc99b9cf4-5dz6x\" (UID: \"1f05fdaf-53cf-4545-a9f6-a83b896fb066\") " pod="openshift-console/console-6fc99b9cf4-5dz6x" Sep 17 16:43:40.481513 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.481474 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f05fdaf-53cf-4545-a9f6-a83b896fb066-oauth-serving-cert\") pod \"console-6fc99b9cf4-5dz6x\" (UID: \"1f05fdaf-53cf-4545-a9f6-a83b896fb066\") " pod="openshift-console/console-6fc99b9cf4-5dz6x" Sep 17 16:43:40.481513 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.481502 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8bdk\" (UniqueName: \"kubernetes.io/projected/1f05fdaf-53cf-4545-a9f6-a83b896fb066-kube-api-access-p8bdk\") pod \"console-6fc99b9cf4-5dz6x\" (UID: \"1f05fdaf-53cf-4545-a9f6-a83b896fb066\") " pod="openshift-console/console-6fc99b9cf4-5dz6x" Sep 17 16:43:40.481744 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.481549 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f05fdaf-53cf-4545-a9f6-a83b896fb066-service-ca\") pod \"console-6fc99b9cf4-5dz6x\" (UID: \"1f05fdaf-53cf-4545-a9f6-a83b896fb066\") " pod="openshift-console/console-6fc99b9cf4-5dz6x" Sep 17 16:43:40.490029 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.490003 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-2szks"] Sep 17 16:43:40.493267 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.493250 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2szks" Sep 17 16:43:40.496381 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.496280 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 17 16:43:40.496381 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.496329 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 17 16:43:40.496778 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.496761 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 17 16:43:40.497237 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.497217 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-8gz4s\"" Sep 17 16:43:40.530471 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.530425 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-2szks"] Sep 17 16:43:40.562725 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.562688 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:40.581905 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.581874 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f05fdaf-53cf-4545-a9f6-a83b896fb066-oauth-serving-cert\") pod \"console-6fc99b9cf4-5dz6x\" (UID: \"1f05fdaf-53cf-4545-a9f6-a83b896fb066\") " pod="openshift-console/console-6fc99b9cf4-5dz6x" Sep 17 16:43:40.582068 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.581922 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8bdk\" (UniqueName: \"kubernetes.io/projected/1f05fdaf-53cf-4545-a9f6-a83b896fb066-kube-api-access-p8bdk\") pod \"console-6fc99b9cf4-5dz6x\" (UID: \"1f05fdaf-53cf-4545-a9f6-a83b896fb066\") " pod="openshift-console/console-6fc99b9cf4-5dz6x" Sep 17 16:43:40.582068 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.581971 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03747b4e-5a9e-4e06-bc5a-57fad1591b08-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-2szks\" (UID: \"03747b4e-5a9e-4e06-bc5a-57fad1591b08\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2szks" Sep 17 16:43:40.582068 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.582002 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mfpw\" (UniqueName: \"kubernetes.io/projected/03747b4e-5a9e-4e06-bc5a-57fad1591b08-kube-api-access-6mfpw\") pod \"prometheus-operator-7bd5d56d6-2szks\" (UID: \"03747b4e-5a9e-4e06-bc5a-57fad1591b08\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2szks" Sep 17 16:43:40.582068 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.582025 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f05fdaf-53cf-4545-a9f6-a83b896fb066-service-ca\") pod \"console-6fc99b9cf4-5dz6x\" (UID: \"1f05fdaf-53cf-4545-a9f6-a83b896fb066\") " pod="openshift-console/console-6fc99b9cf4-5dz6x" Sep 17 16:43:40.582250 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.582138 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/03747b4e-5a9e-4e06-bc5a-57fad1591b08-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-2szks\" (UID: \"03747b4e-5a9e-4e06-bc5a-57fad1591b08\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2szks" Sep 17 16:43:40.582250 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.582174 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f05fdaf-53cf-4545-a9f6-a83b896fb066-console-config\") pod \"console-6fc99b9cf4-5dz6x\" (UID: \"1f05fdaf-53cf-4545-a9f6-a83b896fb066\") " pod="openshift-console/console-6fc99b9cf4-5dz6x" Sep 17 16:43:40.582250 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.582204 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f05fdaf-53cf-4545-a9f6-a83b896fb066-console-serving-cert\") pod \"console-6fc99b9cf4-5dz6x\" (UID: \"1f05fdaf-53cf-4545-a9f6-a83b896fb066\") " pod="openshift-console/console-6fc99b9cf4-5dz6x" Sep 17 16:43:40.582396 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.582250 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f05fdaf-53cf-4545-a9f6-a83b896fb066-console-oauth-config\") pod \"console-6fc99b9cf4-5dz6x\" (UID: \"1f05fdaf-53cf-4545-a9f6-a83b896fb066\") " pod="openshift-console/console-6fc99b9cf4-5dz6x" Sep 17 16:43:40.582396 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.582290 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03747b4e-5a9e-4e06-bc5a-57fad1591b08-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-2szks\" (UID: \"03747b4e-5a9e-4e06-bc5a-57fad1591b08\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2szks" Sep 17 16:43:40.582668 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.582636 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f05fdaf-53cf-4545-a9f6-a83b896fb066-oauth-serving-cert\") pod \"console-6fc99b9cf4-5dz6x\" (UID: \"1f05fdaf-53cf-4545-a9f6-a83b896fb066\") " pod="openshift-console/console-6fc99b9cf4-5dz6x" Sep 17 16:43:40.582796 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.582737 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f05fdaf-53cf-4545-a9f6-a83b896fb066-service-ca\") pod \"console-6fc99b9cf4-5dz6x\" (UID: \"1f05fdaf-53cf-4545-a9f6-a83b896fb066\") " pod="openshift-console/console-6fc99b9cf4-5dz6x" Sep 17 16:43:40.582906 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.582882 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f05fdaf-53cf-4545-a9f6-a83b896fb066-console-config\") pod \"console-6fc99b9cf4-5dz6x\" (UID: \"1f05fdaf-53cf-4545-a9f6-a83b896fb066\") " pod="openshift-console/console-6fc99b9cf4-5dz6x" Sep 17 16:43:40.585419 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.585394 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f05fdaf-53cf-4545-a9f6-a83b896fb066-console-oauth-config\") pod \"console-6fc99b9cf4-5dz6x\" (UID: \"1f05fdaf-53cf-4545-a9f6-a83b896fb066\") " pod="openshift-console/console-6fc99b9cf4-5dz6x" Sep 17 16:43:40.585542 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.585430 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f05fdaf-53cf-4545-a9f6-a83b896fb066-console-serving-cert\") pod \"console-6fc99b9cf4-5dz6x\" (UID: \"1f05fdaf-53cf-4545-a9f6-a83b896fb066\") " pod="openshift-console/console-6fc99b9cf4-5dz6x" Sep 17 16:43:40.593203 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.593183 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8bdk\" (UniqueName: \"kubernetes.io/projected/1f05fdaf-53cf-4545-a9f6-a83b896fb066-kube-api-access-p8bdk\") pod \"console-6fc99b9cf4-5dz6x\" (UID: \"1f05fdaf-53cf-4545-a9f6-a83b896fb066\") " pod="openshift-console/console-6fc99b9cf4-5dz6x" Sep 17 16:43:40.638305 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.638268 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:40.669881 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.669850 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fc99b9cf4-5dz6x" Sep 17 16:43:40.683199 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.683175 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03747b4e-5a9e-4e06-bc5a-57fad1591b08-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-2szks\" (UID: \"03747b4e-5a9e-4e06-bc5a-57fad1591b08\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2szks" Sep 17 16:43:40.683302 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.683217 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mfpw\" (UniqueName: \"kubernetes.io/projected/03747b4e-5a9e-4e06-bc5a-57fad1591b08-kube-api-access-6mfpw\") pod \"prometheus-operator-7bd5d56d6-2szks\" (UID: \"03747b4e-5a9e-4e06-bc5a-57fad1591b08\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2szks" Sep 17 16:43:40.683302 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.683268 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/03747b4e-5a9e-4e06-bc5a-57fad1591b08-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-2szks\" (UID: \"03747b4e-5a9e-4e06-bc5a-57fad1591b08\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2szks" Sep 17 16:43:40.683366 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.683318 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03747b4e-5a9e-4e06-bc5a-57fad1591b08-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-2szks\" (UID: \"03747b4e-5a9e-4e06-bc5a-57fad1591b08\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2szks" Sep 17 16:43:40.684284 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.684191 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03747b4e-5a9e-4e06-bc5a-57fad1591b08-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-2szks\" (UID: \"03747b4e-5a9e-4e06-bc5a-57fad1591b08\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2szks" Sep 17 16:43:40.686529 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.686503 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/03747b4e-5a9e-4e06-bc5a-57fad1591b08-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-2szks\" (UID: \"03747b4e-5a9e-4e06-bc5a-57fad1591b08\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2szks" Sep 17 16:43:40.686656 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.686582 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03747b4e-5a9e-4e06-bc5a-57fad1591b08-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-2szks\" (UID: \"03747b4e-5a9e-4e06-bc5a-57fad1591b08\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2szks" Sep 17 16:43:40.699034 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.699004 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mfpw\" (UniqueName: \"kubernetes.io/projected/03747b4e-5a9e-4e06-bc5a-57fad1591b08-kube-api-access-6mfpw\") pod \"prometheus-operator-7bd5d56d6-2szks\" (UID: \"03747b4e-5a9e-4e06-bc5a-57fad1591b08\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2szks" Sep 17 16:43:40.804725 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.804694 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2szks" Sep 17 16:43:40.952861 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:40.952796 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fc99b9cf4-5dz6x"] Sep 17 16:43:40.955657 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:43:40.955633 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f05fdaf_53cf_4545_a9f6_a83b896fb066.slice/crio-c8a446fc7f24892162e9da660a65ad019d6096635c95dc66282fe8bdfc6b2cc6 WatchSource:0}: Error finding container c8a446fc7f24892162e9da660a65ad019d6096635c95dc66282fe8bdfc6b2cc6: Status 404 returned error can't find the container with id c8a446fc7f24892162e9da660a65ad019d6096635c95dc66282fe8bdfc6b2cc6 Sep 17 16:43:41.088035 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:41.087637 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-2szks"] Sep 17 16:43:41.091892 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:43:41.091864 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03747b4e_5a9e_4e06_bc5a_57fad1591b08.slice/crio-bb24c56f336fa5d2b76419005ddc5390d17af8ba28c11391cdcc63d33d8a0451 WatchSource:0}: Error finding container bb24c56f336fa5d2b76419005ddc5390d17af8ba28c11391cdcc63d33d8a0451: Status 404 returned error can't find the container with id bb24c56f336fa5d2b76419005ddc5390d17af8ba28c11391cdcc63d33d8a0451 Sep 17 16:43:41.880242 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:41.880188 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2szks" event={"ID":"03747b4e-5a9e-4e06-bc5a-57fad1591b08","Type":"ContainerStarted","Data":"bb24c56f336fa5d2b76419005ddc5390d17af8ba28c11391cdcc63d33d8a0451"} Sep 17 16:43:41.883728 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:41.883662 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fc99b9cf4-5dz6x" event={"ID":"1f05fdaf-53cf-4545-a9f6-a83b896fb066","Type":"ContainerStarted","Data":"c8a446fc7f24892162e9da660a65ad019d6096635c95dc66282fe8bdfc6b2cc6"} Sep 17 16:43:42.848181 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:42.847875 2574 patch_prober.go:28] interesting pod/image-registry-5b9ff76d55-b7lfl container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 17 16:43:42.848181 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:42.847940 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" podUID="8141abaa-13c3-40c8-8ba6-fc3bba21daf4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 17 16:43:43.878869 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:43.878834 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:43.960705 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:43.960672 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:44.772905 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:44.772876 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:43:44.941091 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:44.941038 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:45.068928 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:45.068844 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:46.315843 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:46.315762 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:46.905079 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:46.905044 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fc99b9cf4-5dz6x" event={"ID":"1f05fdaf-53cf-4545-a9f6-a83b896fb066","Type":"ContainerStarted","Data":"1ab8881c021f9a1651c2e5a8c562b48e87923e788ea0d2447609ef4c95bcd6c1"} Sep 17 16:43:46.907079 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:46.907051 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2szks" event={"ID":"03747b4e-5a9e-4e06-bc5a-57fad1591b08","Type":"ContainerStarted","Data":"16eb5672879a58dbbe3b6f5922c4e18221124c403297992b320f1eec6d4d60ec"} Sep 17 16:43:46.907194 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:46.907106 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2szks" event={"ID":"03747b4e-5a9e-4e06-bc5a-57fad1591b08","Type":"ContainerStarted","Data":"16bea17b49162e98c86e3093e69ee8350bf45508a5b7fb8f8e914d1e0e68823c"} Sep 17 16:43:46.924979 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:46.924926 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fc99b9cf4-5dz6x" podStartSLOduration=1.831553872 podStartE2EDuration="6.924909371s" totalImagesPullingTime="5.093355499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:43:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:43:46.923576182 +0000 UTC m=+123.119570345" watchObservedRunningTime="2026-09-17 16:43:46.924909371 +0000 UTC m=+123.120903517" Sep 17 16:43:46.940496 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:46.940414 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-2szks" podStartSLOduration=2.03887831 podStartE2EDuration="6.940397144s" totalImagesPullingTime="4.901518834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:43:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:43:46.939496961 +0000 UTC m=+123.135491110" watchObservedRunningTime="2026-09-17 16:43:46.940397144 +0000 UTC m=+123.136391291" Sep 17 16:43:47.450462 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:47.450404 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:47.525620 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:47.525585 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:47.830202 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:47.830124 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6984cd6c7f-kfxcx"] Sep 17 16:43:47.834780 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:47.834759 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6984cd6c7f-kfxcx" Sep 17 16:43:47.843398 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:47.843375 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 17 16:43:47.844936 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:47.844914 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6984cd6c7f-kfxcx"] Sep 17 16:43:47.852051 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:47.852031 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltjnx\" (UniqueName: \"kubernetes.io/projected/8c665984-e24b-4a20-9cf7-d1aa84249b6e-kube-api-access-ltjnx\") pod \"console-6984cd6c7f-kfxcx\" (UID: \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\") " pod="openshift-console/console-6984cd6c7f-kfxcx" Sep 17 16:43:47.852174 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:47.852063 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c665984-e24b-4a20-9cf7-d1aa84249b6e-service-ca\") pod \"console-6984cd6c7f-kfxcx\" (UID: \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\") " pod="openshift-console/console-6984cd6c7f-kfxcx" Sep 17 16:43:47.852174 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:47.852081 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c665984-e24b-4a20-9cf7-d1aa84249b6e-trusted-ca-bundle\") pod \"console-6984cd6c7f-kfxcx\" (UID: \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\") " pod="openshift-console/console-6984cd6c7f-kfxcx" Sep 17 16:43:47.852174 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:47.852106 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c665984-e24b-4a20-9cf7-d1aa84249b6e-console-config\") pod \"console-6984cd6c7f-kfxcx\" (UID: \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\") " pod="openshift-console/console-6984cd6c7f-kfxcx" Sep 17 16:43:47.852174 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:47.852155 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c665984-e24b-4a20-9cf7-d1aa84249b6e-oauth-serving-cert\") pod \"console-6984cd6c7f-kfxcx\" (UID: \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\") " pod="openshift-console/console-6984cd6c7f-kfxcx" Sep 17 16:43:47.852379 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:47.852242 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c665984-e24b-4a20-9cf7-d1aa84249b6e-console-serving-cert\") pod \"console-6984cd6c7f-kfxcx\" (UID: \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\") " pod="openshift-console/console-6984cd6c7f-kfxcx" Sep 17 16:43:47.852379 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:47.852270 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c665984-e24b-4a20-9cf7-d1aa84249b6e-console-oauth-config\") pod \"console-6984cd6c7f-kfxcx\" (UID: \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\") " pod="openshift-console/console-6984cd6c7f-kfxcx" Sep 17 16:43:47.953267 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:47.953235 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c665984-e24b-4a20-9cf7-d1aa84249b6e-console-serving-cert\") pod \"console-6984cd6c7f-kfxcx\" (UID: \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\") " pod="openshift-console/console-6984cd6c7f-kfxcx" Sep 17 16:43:47.953459 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:47.953273 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c665984-e24b-4a20-9cf7-d1aa84249b6e-console-oauth-config\") pod \"console-6984cd6c7f-kfxcx\" (UID: \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\") " pod="openshift-console/console-6984cd6c7f-kfxcx" Sep 17 16:43:47.953459 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:47.953359 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltjnx\" (UniqueName: \"kubernetes.io/projected/8c665984-e24b-4a20-9cf7-d1aa84249b6e-kube-api-access-ltjnx\") pod \"console-6984cd6c7f-kfxcx\" (UID: \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\") " pod="openshift-console/console-6984cd6c7f-kfxcx" Sep 17 16:43:47.953459 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:47.953398 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c665984-e24b-4a20-9cf7-d1aa84249b6e-service-ca\") pod \"console-6984cd6c7f-kfxcx\" (UID: \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\") " pod="openshift-console/console-6984cd6c7f-kfxcx" Sep 17 16:43:47.953459 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:47.953425 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c665984-e24b-4a20-9cf7-d1aa84249b6e-trusted-ca-bundle\") pod \"console-6984cd6c7f-kfxcx\" (UID: \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\") " pod="openshift-console/console-6984cd6c7f-kfxcx" Sep 17 16:43:47.953711 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:47.953540 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c665984-e24b-4a20-9cf7-d1aa84249b6e-console-config\") pod \"console-6984cd6c7f-kfxcx\" (UID: \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\") " pod="openshift-console/console-6984cd6c7f-kfxcx" Sep 17 16:43:47.953711 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:47.953589 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c665984-e24b-4a20-9cf7-d1aa84249b6e-oauth-serving-cert\") pod \"console-6984cd6c7f-kfxcx\" (UID: \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\") " pod="openshift-console/console-6984cd6c7f-kfxcx" Sep 17 16:43:47.954142 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:47.954111 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c665984-e24b-4a20-9cf7-d1aa84249b6e-service-ca\") pod \"console-6984cd6c7f-kfxcx\" (UID: \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\") " pod="openshift-console/console-6984cd6c7f-kfxcx" Sep 17 16:43:47.954371 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:47.954345 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c665984-e24b-4a20-9cf7-d1aa84249b6e-trusted-ca-bundle\") pod \"console-6984cd6c7f-kfxcx\" (UID: \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\") " pod="openshift-console/console-6984cd6c7f-kfxcx" Sep 17 16:43:47.954476 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:47.954375 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c665984-e24b-4a20-9cf7-d1aa84249b6e-oauth-serving-cert\") pod \"console-6984cd6c7f-kfxcx\" (UID: \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\") " pod="openshift-console/console-6984cd6c7f-kfxcx" Sep 17 16:43:47.954476 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:47.954467 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c665984-e24b-4a20-9cf7-d1aa84249b6e-console-config\") pod \"console-6984cd6c7f-kfxcx\" (UID: \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\") " pod="openshift-console/console-6984cd6c7f-kfxcx" Sep 17 16:43:47.956487 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:47.956467 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c665984-e24b-4a20-9cf7-d1aa84249b6e-console-oauth-config\") pod \"console-6984cd6c7f-kfxcx\" (UID: \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\") " pod="openshift-console/console-6984cd6c7f-kfxcx" Sep 17 16:43:47.956696 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:47.956658 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c665984-e24b-4a20-9cf7-d1aa84249b6e-console-serving-cert\") pod \"console-6984cd6c7f-kfxcx\" (UID: \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\") " pod="openshift-console/console-6984cd6c7f-kfxcx" Sep 17 16:43:47.962813 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:47.962790 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltjnx\" (UniqueName: \"kubernetes.io/projected/8c665984-e24b-4a20-9cf7-d1aa84249b6e-kube-api-access-ltjnx\") pod \"console-6984cd6c7f-kfxcx\" (UID: \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\") " pod="openshift-console/console-6984cd6c7f-kfxcx" Sep 17 16:43:47.986361 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:47.986333 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:48.051475 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.051431 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:48.145930 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.145828 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6984cd6c7f-kfxcx" Sep 17 16:43:48.583535 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.583500 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:48.741702 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.741661 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:48.860916 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.860830 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:48.883615 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.883550 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-rrbx5"] Sep 17 16:43:48.887320 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.887293 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rrbx5" Sep 17 16:43:48.891398 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.891371 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 17 16:43:48.891977 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.891767 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-snzh2\"" Sep 17 16:43:48.892392 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.892370 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 17 16:43:48.896658 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.896636 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-r2lls"] Sep 17 16:43:48.900118 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.900097 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-r2lls" Sep 17 16:43:48.900793 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.900773 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-rrbx5"] Sep 17 16:43:48.903167 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.902882 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 17 16:43:48.903588 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.903565 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 17 16:43:48.903725 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.903570 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-x9nvv\"" Sep 17 16:43:48.903795 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.903776 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 17 16:43:48.912424 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.912402 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mrkmf"] Sep 17 16:43:48.923837 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.923812 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-r2lls"] Sep 17 16:43:48.923976 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.923955 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mrkmf" Sep 17 16:43:48.926762 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.926741 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 17 16:43:48.926874 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.926842 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 17 16:43:48.927116 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.927100 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-48wqc\"" Sep 17 16:43:48.927214 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.927114 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 17 16:43:48.950398 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.950366 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:48.962040 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.962016 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/47c0a509-9f12-49c2-ba40-70f94c2f5fbb-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-r2lls\" (UID: \"47c0a509-9f12-49c2-ba40-70f94c2f5fbb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-r2lls" Sep 17 16:43:48.962169 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.962044 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjqq4\" (UniqueName: \"kubernetes.io/projected/47c0a509-9f12-49c2-ba40-70f94c2f5fbb-kube-api-access-wjqq4\") pod \"kube-state-metrics-84c885658c-r2lls\" (UID: \"47c0a509-9f12-49c2-ba40-70f94c2f5fbb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-r2lls" Sep 17 16:43:48.962169 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.962072 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8b372a8d-e81e-4541-b8b6-b3d4c181cd29-node-exporter-tls\") pod \"node-exporter-mrkmf\" (UID: \"8b372a8d-e81e-4541-b8b6-b3d4c181cd29\") " pod="openshift-monitoring/node-exporter-mrkmf" Sep 17 16:43:48.962169 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.962103 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1ab5c3c-0989-46db-9bfa-c7183c759c2d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-rrbx5\" (UID: \"c1ab5c3c-0989-46db-9bfa-c7183c759c2d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rrbx5" Sep 17 16:43:48.962169 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.962122 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b372a8d-e81e-4541-b8b6-b3d4c181cd29-sys\") pod \"node-exporter-mrkmf\" (UID: \"8b372a8d-e81e-4541-b8b6-b3d4c181cd29\") " pod="openshift-monitoring/node-exporter-mrkmf" Sep 17 16:43:48.962169 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.962140 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8b372a8d-e81e-4541-b8b6-b3d4c181cd29-root\") pod \"node-exporter-mrkmf\" (UID: \"8b372a8d-e81e-4541-b8b6-b3d4c181cd29\") " pod="openshift-monitoring/node-exporter-mrkmf" Sep 17 16:43:48.962370 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.962259 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b372a8d-e81e-4541-b8b6-b3d4c181cd29-metrics-client-ca\") pod \"node-exporter-mrkmf\" (UID: \"8b372a8d-e81e-4541-b8b6-b3d4c181cd29\") " pod="openshift-monitoring/node-exporter-mrkmf" Sep 17 16:43:48.962370 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.962297 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/47c0a509-9f12-49c2-ba40-70f94c2f5fbb-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-r2lls\" (UID: \"47c0a509-9f12-49c2-ba40-70f94c2f5fbb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-r2lls" Sep 17 16:43:48.962370 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.962324 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/47c0a509-9f12-49c2-ba40-70f94c2f5fbb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-r2lls\" (UID: \"47c0a509-9f12-49c2-ba40-70f94c2f5fbb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-r2lls" Sep 17 16:43:48.962370 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.962345 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1ab5c3c-0989-46db-9bfa-c7183c759c2d-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-rrbx5\" (UID: \"c1ab5c3c-0989-46db-9bfa-c7183c759c2d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rrbx5" Sep 17 16:43:48.962370 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.962365 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47c0a509-9f12-49c2-ba40-70f94c2f5fbb-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-r2lls\" (UID: \"47c0a509-9f12-49c2-ba40-70f94c2f5fbb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-r2lls" Sep 17 16:43:48.962592 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.962391 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8b372a8d-e81e-4541-b8b6-b3d4c181cd29-node-exporter-textfile\") pod \"node-exporter-mrkmf\" (UID: \"8b372a8d-e81e-4541-b8b6-b3d4c181cd29\") " pod="openshift-monitoring/node-exporter-mrkmf" Sep 17 16:43:48.962592 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.962430 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8b372a8d-e81e-4541-b8b6-b3d4c181cd29-node-exporter-accelerators-collector-config\") pod \"node-exporter-mrkmf\" (UID: \"8b372a8d-e81e-4541-b8b6-b3d4c181cd29\") " pod="openshift-monitoring/node-exporter-mrkmf" Sep 17 16:43:48.962592 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.962504 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb276\" (UniqueName: \"kubernetes.io/projected/c1ab5c3c-0989-46db-9bfa-c7183c759c2d-kube-api-access-mb276\") pod \"openshift-state-metrics-86c5bc79d6-rrbx5\" (UID: \"c1ab5c3c-0989-46db-9bfa-c7183c759c2d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rrbx5" Sep 17 16:43:48.962592 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.962536 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1ab5c3c-0989-46db-9bfa-c7183c759c2d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-rrbx5\" (UID: \"c1ab5c3c-0989-46db-9bfa-c7183c759c2d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rrbx5" Sep 17 16:43:48.962592 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.962557 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b372a8d-e81e-4541-b8b6-b3d4c181cd29-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mrkmf\" (UID: \"8b372a8d-e81e-4541-b8b6-b3d4c181cd29\") " pod="openshift-monitoring/node-exporter-mrkmf" Sep 17 16:43:48.962592 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.962589 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/47c0a509-9f12-49c2-ba40-70f94c2f5fbb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-r2lls\" (UID: \"47c0a509-9f12-49c2-ba40-70f94c2f5fbb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-r2lls" Sep 17 16:43:48.962815 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.962629 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2k92\" (UniqueName: \"kubernetes.io/projected/8b372a8d-e81e-4541-b8b6-b3d4c181cd29-kube-api-access-h2k92\") pod \"node-exporter-mrkmf\" (UID: \"8b372a8d-e81e-4541-b8b6-b3d4c181cd29\") " pod="openshift-monitoring/node-exporter-mrkmf" Sep 17 16:43:48.962815 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:48.962660 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8b372a8d-e81e-4541-b8b6-b3d4c181cd29-node-exporter-wtmp\") pod \"node-exporter-mrkmf\" (UID: \"8b372a8d-e81e-4541-b8b6-b3d4c181cd29\") " pod="openshift-monitoring/node-exporter-mrkmf" Sep 17 16:43:49.031235 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.031193 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:49.063556 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.063514 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8b372a8d-e81e-4541-b8b6-b3d4c181cd29-node-exporter-tls\") pod \"node-exporter-mrkmf\" (UID: \"8b372a8d-e81e-4541-b8b6-b3d4c181cd29\") " pod="openshift-monitoring/node-exporter-mrkmf" Sep 17 16:43:49.063764 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.063571 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1ab5c3c-0989-46db-9bfa-c7183c759c2d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-rrbx5\" (UID: \"c1ab5c3c-0989-46db-9bfa-c7183c759c2d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rrbx5" Sep 17 16:43:49.063764 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.063589 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b372a8d-e81e-4541-b8b6-b3d4c181cd29-sys\") pod \"node-exporter-mrkmf\" (UID: \"8b372a8d-e81e-4541-b8b6-b3d4c181cd29\") " pod="openshift-monitoring/node-exporter-mrkmf" Sep 17 16:43:49.063764 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.063604 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8b372a8d-e81e-4541-b8b6-b3d4c181cd29-root\") pod \"node-exporter-mrkmf\" (UID: \"8b372a8d-e81e-4541-b8b6-b3d4c181cd29\") " pod="openshift-monitoring/node-exporter-mrkmf" Sep 17 16:43:49.063764 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.063643 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b372a8d-e81e-4541-b8b6-b3d4c181cd29-metrics-client-ca\") pod \"node-exporter-mrkmf\" (UID: \"8b372a8d-e81e-4541-b8b6-b3d4c181cd29\") " pod="openshift-monitoring/node-exporter-mrkmf" Sep 17 16:43:49.063764 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.063663 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/47c0a509-9f12-49c2-ba40-70f94c2f5fbb-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-r2lls\" (UID: \"47c0a509-9f12-49c2-ba40-70f94c2f5fbb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-r2lls" Sep 17 16:43:49.063764 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.063670 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b372a8d-e81e-4541-b8b6-b3d4c181cd29-sys\") pod \"node-exporter-mrkmf\" (UID: \"8b372a8d-e81e-4541-b8b6-b3d4c181cd29\") " pod="openshift-monitoring/node-exporter-mrkmf" Sep 17 16:43:49.063764 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:49.063682 2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 17 16:43:49.063764 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.063737 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8b372a8d-e81e-4541-b8b6-b3d4c181cd29-root\") pod \"node-exporter-mrkmf\" (UID: \"8b372a8d-e81e-4541-b8b6-b3d4c181cd29\") " pod="openshift-monitoring/node-exporter-mrkmf" Sep 17 16:43:49.063764 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:49.063762 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b372a8d-e81e-4541-b8b6-b3d4c181cd29-node-exporter-tls podName:8b372a8d-e81e-4541-b8b6-b3d4c181cd29 nodeName:}" failed. No retries permitted until 2026-09-17 16:43:49.563740319 +0000 UTC m=+125.759734463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8b372a8d-e81e-4541-b8b6-b3d4c181cd29-node-exporter-tls") pod "node-exporter-mrkmf" (UID: "8b372a8d-e81e-4541-b8b6-b3d4c181cd29") : secret "node-exporter-tls" not found Sep 17 16:43:49.063764 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:49.063766 2574 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 17 16:43:49.064170 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:49.063820 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47c0a509-9f12-49c2-ba40-70f94c2f5fbb-kube-state-metrics-tls podName:47c0a509-9f12-49c2-ba40-70f94c2f5fbb nodeName:}" failed. No retries permitted until 2026-09-17 16:43:49.563802305 +0000 UTC m=+125.759796432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/47c0a509-9f12-49c2-ba40-70f94c2f5fbb-kube-state-metrics-tls") pod "kube-state-metrics-84c885658c-r2lls" (UID: "47c0a509-9f12-49c2-ba40-70f94c2f5fbb") : secret "kube-state-metrics-tls" not found Sep 17 16:43:49.064170 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.063681 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/47c0a509-9f12-49c2-ba40-70f94c2f5fbb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-r2lls\" (UID: \"47c0a509-9f12-49c2-ba40-70f94c2f5fbb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-r2lls" Sep 17 16:43:49.064170 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.063858 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1ab5c3c-0989-46db-9bfa-c7183c759c2d-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-rrbx5\" (UID: \"c1ab5c3c-0989-46db-9bfa-c7183c759c2d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rrbx5" Sep 17 16:43:49.064170 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.063891 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47c0a509-9f12-49c2-ba40-70f94c2f5fbb-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-r2lls\" (UID: \"47c0a509-9f12-49c2-ba40-70f94c2f5fbb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-r2lls" Sep 17 16:43:49.064170 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.063909 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8b372a8d-e81e-4541-b8b6-b3d4c181cd29-node-exporter-textfile\") pod \"node-exporter-mrkmf\" (UID: \"8b372a8d-e81e-4541-b8b6-b3d4c181cd29\") " pod="openshift-monitoring/node-exporter-mrkmf" Sep 17 16:43:49.064170 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.063926 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8b372a8d-e81e-4541-b8b6-b3d4c181cd29-node-exporter-accelerators-collector-config\") pod \"node-exporter-mrkmf\" (UID: \"8b372a8d-e81e-4541-b8b6-b3d4c181cd29\") " pod="openshift-monitoring/node-exporter-mrkmf" Sep 17 16:43:49.064170 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.063972 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb276\" (UniqueName: \"kubernetes.io/projected/c1ab5c3c-0989-46db-9bfa-c7183c759c2d-kube-api-access-mb276\") pod \"openshift-state-metrics-86c5bc79d6-rrbx5\" (UID: \"c1ab5c3c-0989-46db-9bfa-c7183c759c2d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rrbx5" Sep 17 16:43:49.064170 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.064008 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1ab5c3c-0989-46db-9bfa-c7183c759c2d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-rrbx5\" (UID: \"c1ab5c3c-0989-46db-9bfa-c7183c759c2d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rrbx5" Sep 17 16:43:49.064170 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.064031 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b372a8d-e81e-4541-b8b6-b3d4c181cd29-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mrkmf\" (UID: \"8b372a8d-e81e-4541-b8b6-b3d4c181cd29\") " pod="openshift-monitoring/node-exporter-mrkmf" Sep 17 16:43:49.064170 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.064077 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/47c0a509-9f12-49c2-ba40-70f94c2f5fbb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-r2lls\" (UID: \"47c0a509-9f12-49c2-ba40-70f94c2f5fbb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-r2lls" Sep 17 16:43:49.064170 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.064102 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2k92\" (UniqueName: \"kubernetes.io/projected/8b372a8d-e81e-4541-b8b6-b3d4c181cd29-kube-api-access-h2k92\") pod \"node-exporter-mrkmf\" (UID: \"8b372a8d-e81e-4541-b8b6-b3d4c181cd29\") " pod="openshift-monitoring/node-exporter-mrkmf" Sep 17 16:43:49.064170 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.064134 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8b372a8d-e81e-4541-b8b6-b3d4c181cd29-node-exporter-wtmp\") pod \"node-exporter-mrkmf\" (UID: \"8b372a8d-e81e-4541-b8b6-b3d4c181cd29\") " pod="openshift-monitoring/node-exporter-mrkmf" Sep 17 16:43:49.064170 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.064165 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/47c0a509-9f12-49c2-ba40-70f94c2f5fbb-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-r2lls\" (UID: \"47c0a509-9f12-49c2-ba40-70f94c2f5fbb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-r2lls" Sep 17 16:43:49.064835 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.064190 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjqq4\" (UniqueName: \"kubernetes.io/projected/47c0a509-9f12-49c2-ba40-70f94c2f5fbb-kube-api-access-wjqq4\") pod \"kube-state-metrics-84c885658c-r2lls\" (UID: \"47c0a509-9f12-49c2-ba40-70f94c2f5fbb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-r2lls" Sep 17 16:43:49.064835 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.064322 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b372a8d-e81e-4541-b8b6-b3d4c181cd29-metrics-client-ca\") pod \"node-exporter-mrkmf\" (UID: \"8b372a8d-e81e-4541-b8b6-b3d4c181cd29\") " pod="openshift-monitoring/node-exporter-mrkmf" Sep 17 16:43:49.064835 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.064522 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/47c0a509-9f12-49c2-ba40-70f94c2f5fbb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-r2lls\" (UID: \"47c0a509-9f12-49c2-ba40-70f94c2f5fbb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-r2lls" Sep 17 16:43:49.064835 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.064624 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8b372a8d-e81e-4541-b8b6-b3d4c181cd29-node-exporter-wtmp\") pod \"node-exporter-mrkmf\" (UID: \"8b372a8d-e81e-4541-b8b6-b3d4c181cd29\") " pod="openshift-monitoring/node-exporter-mrkmf" Sep 17 16:43:49.064835 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.064747 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47c0a509-9f12-49c2-ba40-70f94c2f5fbb-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-r2lls\" (UID: \"47c0a509-9f12-49c2-ba40-70f94c2f5fbb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-r2lls" Sep 17 16:43:49.065137 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.064975 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1ab5c3c-0989-46db-9bfa-c7183c759c2d-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-rrbx5\" (UID: \"c1ab5c3c-0989-46db-9bfa-c7183c759c2d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rrbx5" Sep 17 16:43:49.065137 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.065006 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8b372a8d-e81e-4541-b8b6-b3d4c181cd29-node-exporter-textfile\") pod \"node-exporter-mrkmf\" (UID: \"8b372a8d-e81e-4541-b8b6-b3d4c181cd29\") " pod="openshift-monitoring/node-exporter-mrkmf" Sep 17 16:43:49.065137 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.065023 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/47c0a509-9f12-49c2-ba40-70f94c2f5fbb-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-r2lls\" (UID: \"47c0a509-9f12-49c2-ba40-70f94c2f5fbb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-r2lls" Sep 17 16:43:49.065137 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.065023 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8b372a8d-e81e-4541-b8b6-b3d4c181cd29-node-exporter-accelerators-collector-config\") pod \"node-exporter-mrkmf\" (UID: \"8b372a8d-e81e-4541-b8b6-b3d4c181cd29\") " pod="openshift-monitoring/node-exporter-mrkmf" Sep 17 16:43:49.067377 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.067334 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b372a8d-e81e-4541-b8b6-b3d4c181cd29-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mrkmf\" (UID: \"8b372a8d-e81e-4541-b8b6-b3d4c181cd29\") " pod="openshift-monitoring/node-exporter-mrkmf" Sep 17 16:43:49.067377 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.067375 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1ab5c3c-0989-46db-9bfa-c7183c759c2d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-rrbx5\" (UID: \"c1ab5c3c-0989-46db-9bfa-c7183c759c2d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rrbx5" Sep 17 16:43:49.067773 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.067750 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1ab5c3c-0989-46db-9bfa-c7183c759c2d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-rrbx5\" (UID: \"c1ab5c3c-0989-46db-9bfa-c7183c759c2d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rrbx5" Sep 17 16:43:49.067852 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.067795 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/47c0a509-9f12-49c2-ba40-70f94c2f5fbb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-r2lls\" (UID: \"47c0a509-9f12-49c2-ba40-70f94c2f5fbb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-r2lls" Sep 17 16:43:49.079869 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.079811 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2k92\" (UniqueName: \"kubernetes.io/projected/8b372a8d-e81e-4541-b8b6-b3d4c181cd29-kube-api-access-h2k92\") pod \"node-exporter-mrkmf\" (UID: \"8b372a8d-e81e-4541-b8b6-b3d4c181cd29\") " pod="openshift-monitoring/node-exporter-mrkmf" Sep 17 16:43:49.081619 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.081598 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb276\" (UniqueName: \"kubernetes.io/projected/c1ab5c3c-0989-46db-9bfa-c7183c759c2d-kube-api-access-mb276\") pod \"openshift-state-metrics-86c5bc79d6-rrbx5\" (UID: \"c1ab5c3c-0989-46db-9bfa-c7183c759c2d\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rrbx5" Sep 17 16:43:49.081737 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.081632 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjqq4\" (UniqueName: \"kubernetes.io/projected/47c0a509-9f12-49c2-ba40-70f94c2f5fbb-kube-api-access-wjqq4\") pod \"kube-state-metrics-84c885658c-r2lls\" (UID: \"47c0a509-9f12-49c2-ba40-70f94c2f5fbb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-r2lls" Sep 17 16:43:49.138183 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.138073 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:49.198887 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.198851 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rrbx5" Sep 17 16:43:49.236164 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.236129 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:49.337002 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.336968 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:49.506789 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.506752 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:49.569413 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.569377 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8b372a8d-e81e-4541-b8b6-b3d4c181cd29-node-exporter-tls\") pod \"node-exporter-mrkmf\" (UID: \"8b372a8d-e81e-4541-b8b6-b3d4c181cd29\") " pod="openshift-monitoring/node-exporter-mrkmf" Sep 17 16:43:49.569609 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.569475 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/47c0a509-9f12-49c2-ba40-70f94c2f5fbb-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-r2lls\" (UID: \"47c0a509-9f12-49c2-ba40-70f94c2f5fbb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-r2lls" Sep 17 16:43:49.572255 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.572223 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8b372a8d-e81e-4541-b8b6-b3d4c181cd29-node-exporter-tls\") pod \"node-exporter-mrkmf\" (UID: \"8b372a8d-e81e-4541-b8b6-b3d4c181cd29\") " pod="openshift-monitoring/node-exporter-mrkmf" Sep 17 16:43:49.572401 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.572300 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/47c0a509-9f12-49c2-ba40-70f94c2f5fbb-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-r2lls\" (UID: \"47c0a509-9f12-49c2-ba40-70f94c2f5fbb\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-r2lls" Sep 17 16:43:49.612081 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.612057 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:49.807123 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.807027 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:49.811400 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.811378 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-r2lls" Sep 17 16:43:49.835498 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.835462 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mrkmf" Sep 17 16:43:49.882785 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.882754 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 16:43:49.886676 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.886653 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:49.889772 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.889424 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 17 16:43:49.889772 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.889589 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 17 16:43:49.891705 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.890729 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 17 16:43:49.891705 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.890991 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 17 16:43:49.891705 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.891206 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 17 16:43:49.891705 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.891700 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 17 16:43:49.892006 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.891763 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 17 16:43:49.892006 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.891837 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 17 16:43:49.892239 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.892218 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xz84k\"" Sep 17 16:43:49.892332 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.892239 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 17 16:43:49.908607 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.908581 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 16:43:49.910156 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.910135 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:49.972657 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.972619 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-config-volume\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:49.972657 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.972666 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:49.972904 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.972715 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f49b7368-ef4c-4a61-8c8b-5154d3251d53-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:49.972904 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.972733 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jk24\" (UniqueName: \"kubernetes.io/projected/f49b7368-ef4c-4a61-8c8b-5154d3251d53-kube-api-access-4jk24\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:49.972904 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.972778 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:49.972904 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.972814 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f49b7368-ef4c-4a61-8c8b-5154d3251d53-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:49.972904 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.972833 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:49.972904 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.972854 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-web-config\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:49.972904 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.972881 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f49b7368-ef4c-4a61-8c8b-5154d3251d53-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:49.973165 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.972909 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f49b7368-ef4c-4a61-8c8b-5154d3251d53-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:49.973165 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.972928 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:49.973165 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.972953 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f49b7368-ef4c-4a61-8c8b-5154d3251d53-config-out\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:49.973165 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:49.973008 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:50.073949 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.073861 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:50.073949 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.073912 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f49b7368-ef4c-4a61-8c8b-5154d3251d53-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:50.074189 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.074081 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:50.074189 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.074120 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-web-config\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:50.074189 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.074155 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f49b7368-ef4c-4a61-8c8b-5154d3251d53-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:50.074189 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.074183 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f49b7368-ef4c-4a61-8c8b-5154d3251d53-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:50.074383 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.074213 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:50.074383 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.074246 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f49b7368-ef4c-4a61-8c8b-5154d3251d53-config-out\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:50.074383 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.074282 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:50.074383 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.074326 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f49b7368-ef4c-4a61-8c8b-5154d3251d53-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:50.074383 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.074337 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-config-volume\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:50.074383 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.074364 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:50.074667 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.074416 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f49b7368-ef4c-4a61-8c8b-5154d3251d53-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:50.074667 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.074458 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jk24\" (UniqueName: \"kubernetes.io/projected/f49b7368-ef4c-4a61-8c8b-5154d3251d53-kube-api-access-4jk24\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:50.075116 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.075061 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f49b7368-ef4c-4a61-8c8b-5154d3251d53-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:50.076119 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:50.075348 2574 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 17 16:43:50.076119 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:43:50.075430 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-secret-alertmanager-main-tls podName:f49b7368-ef4c-4a61-8c8b-5154d3251d53 nodeName:}" failed. No retries permitted until 2026-09-17 16:43:50.575404406 +0000 UTC m=+126.771398533 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "f49b7368-ef4c-4a61-8c8b-5154d3251d53") : secret "alertmanager-main-tls" not found Sep 17 16:43:50.076119 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.076081 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f49b7368-ef4c-4a61-8c8b-5154d3251d53-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:50.077661 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.077611 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:50.079273 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.079226 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:50.079789 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.079708 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-web-config\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:50.079789 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.079745 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f49b7368-ef4c-4a61-8c8b-5154d3251d53-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:50.080040 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.079992 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:50.080145 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.080122 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-config-volume\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:50.080268 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.080202 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f49b7368-ef4c-4a61-8c8b-5154d3251d53-config-out\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:50.081450 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.081410 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:50.083391 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.083370 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jk24\" (UniqueName: \"kubernetes.io/projected/f49b7368-ef4c-4a61-8c8b-5154d3251d53-kube-api-access-4jk24\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:50.210518 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.210459 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:50.579796 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.579746 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:50.582568 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.582542 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:50.671043 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.671009 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fc99b9cf4-5dz6x" Sep 17 16:43:50.671521 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.671074 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fc99b9cf4-5dz6x" Sep 17 16:43:50.677239 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.677213 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fc99b9cf4-5dz6x" Sep 17 16:43:50.800219 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.800177 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:43:50.935397 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:50.935368 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fc99b9cf4-5dz6x" Sep 17 16:43:51.798353 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:51.798317 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:51.931908 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:51.931868 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:51.933942 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:51.932956 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-d894d8899-cz27w"] Sep 17 16:43:51.936972 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:51.936951 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" Sep 17 16:43:51.939693 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:51.939671 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5r3ip7g0bmcoj\"" Sep 17 16:43:51.939819 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:51.939778 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 17 16:43:51.940179 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:51.939983 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 17 16:43:51.940179 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:51.940008 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 17 16:43:51.940179 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:51.940039 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6jn2b\"" Sep 17 16:43:51.940179 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:51.940068 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 17 16:43:51.940179 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:51.940012 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 17 16:43:51.954890 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:51.954313 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d894d8899-cz27w"] Sep 17 16:43:51.994112 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:51.994078 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3679ce8-c91f-4cf8-989a-235beaef7e4f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d894d8899-cz27w\" (UID: \"f3679ce8-c91f-4cf8-989a-235beaef7e4f\") " pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" Sep 17 16:43:51.994293 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:51.994123 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f3679ce8-c91f-4cf8-989a-235beaef7e4f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d894d8899-cz27w\" (UID: \"f3679ce8-c91f-4cf8-989a-235beaef7e4f\") " pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" Sep 17 16:43:51.994293 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:51.994140 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3679ce8-c91f-4cf8-989a-235beaef7e4f-metrics-client-ca\") pod \"thanos-querier-d894d8899-cz27w\" (UID: \"f3679ce8-c91f-4cf8-989a-235beaef7e4f\") " pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" Sep 17 16:43:51.994293 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:51.994229 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9sjn\" (UniqueName: \"kubernetes.io/projected/f3679ce8-c91f-4cf8-989a-235beaef7e4f-kube-api-access-c9sjn\") pod \"thanos-querier-d894d8899-cz27w\" (UID: \"f3679ce8-c91f-4cf8-989a-235beaef7e4f\") " pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" Sep 17 16:43:51.994489 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:51.994348 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f3679ce8-c91f-4cf8-989a-235beaef7e4f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d894d8899-cz27w\" (UID: \"f3679ce8-c91f-4cf8-989a-235beaef7e4f\") " pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" Sep 17 16:43:51.994489 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:51.994413 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f3679ce8-c91f-4cf8-989a-235beaef7e4f-secret-thanos-querier-tls\") pod \"thanos-querier-d894d8899-cz27w\" (UID: \"f3679ce8-c91f-4cf8-989a-235beaef7e4f\") " pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" Sep 17 16:43:51.994564 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:51.994534 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3679ce8-c91f-4cf8-989a-235beaef7e4f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d894d8899-cz27w\" (UID: \"f3679ce8-c91f-4cf8-989a-235beaef7e4f\") " pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" Sep 17 16:43:51.994620 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:51.994572 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3679ce8-c91f-4cf8-989a-235beaef7e4f-secret-grpc-tls\") pod \"thanos-querier-d894d8899-cz27w\" (UID: \"f3679ce8-c91f-4cf8-989a-235beaef7e4f\") " pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" Sep 17 16:43:52.095601 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:52.095516 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f3679ce8-c91f-4cf8-989a-235beaef7e4f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d894d8899-cz27w\" (UID: \"f3679ce8-c91f-4cf8-989a-235beaef7e4f\") " pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" Sep 17 16:43:52.095601 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:52.095554 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3679ce8-c91f-4cf8-989a-235beaef7e4f-metrics-client-ca\") pod \"thanos-querier-d894d8899-cz27w\" (UID: \"f3679ce8-c91f-4cf8-989a-235beaef7e4f\") " pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" Sep 17 16:43:52.095601 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:52.095584 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9sjn\" (UniqueName: \"kubernetes.io/projected/f3679ce8-c91f-4cf8-989a-235beaef7e4f-kube-api-access-c9sjn\") pod \"thanos-querier-d894d8899-cz27w\" (UID: \"f3679ce8-c91f-4cf8-989a-235beaef7e4f\") " pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" Sep 17 16:43:52.095856 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:52.095617 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f3679ce8-c91f-4cf8-989a-235beaef7e4f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d894d8899-cz27w\" (UID: \"f3679ce8-c91f-4cf8-989a-235beaef7e4f\") " pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" Sep 17 16:43:52.095856 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:52.095661 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f3679ce8-c91f-4cf8-989a-235beaef7e4f-secret-thanos-querier-tls\") pod \"thanos-querier-d894d8899-cz27w\" (UID: \"f3679ce8-c91f-4cf8-989a-235beaef7e4f\") " pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" Sep 17 16:43:52.095856 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:52.095718 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3679ce8-c91f-4cf8-989a-235beaef7e4f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d894d8899-cz27w\" (UID: \"f3679ce8-c91f-4cf8-989a-235beaef7e4f\") " pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" Sep 17 16:43:52.095856 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:52.095747 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3679ce8-c91f-4cf8-989a-235beaef7e4f-secret-grpc-tls\") pod \"thanos-querier-d894d8899-cz27w\" (UID: \"f3679ce8-c91f-4cf8-989a-235beaef7e4f\") " pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" Sep 17 16:43:52.095856 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:52.095785 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3679ce8-c91f-4cf8-989a-235beaef7e4f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d894d8899-cz27w\" (UID: \"f3679ce8-c91f-4cf8-989a-235beaef7e4f\") " pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" Sep 17 16:43:52.096757 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:52.096616 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3679ce8-c91f-4cf8-989a-235beaef7e4f-metrics-client-ca\") pod \"thanos-querier-d894d8899-cz27w\" (UID: \"f3679ce8-c91f-4cf8-989a-235beaef7e4f\") " pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" Sep 17 16:43:52.099117 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:52.099091 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f3679ce8-c91f-4cf8-989a-235beaef7e4f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d894d8899-cz27w\" (UID: \"f3679ce8-c91f-4cf8-989a-235beaef7e4f\") " pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" Sep 17 16:43:52.099208 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:52.099155 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f3679ce8-c91f-4cf8-989a-235beaef7e4f-secret-grpc-tls\") pod \"thanos-querier-d894d8899-cz27w\" (UID: \"f3679ce8-c91f-4cf8-989a-235beaef7e4f\") " pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" Sep 17 16:43:52.099262 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:52.099222 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3679ce8-c91f-4cf8-989a-235beaef7e4f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d894d8899-cz27w\" (UID: \"f3679ce8-c91f-4cf8-989a-235beaef7e4f\") " pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" Sep 17 16:43:52.099868 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:52.099847 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f3679ce8-c91f-4cf8-989a-235beaef7e4f-secret-thanos-querier-tls\") pod \"thanos-querier-d894d8899-cz27w\" (UID: \"f3679ce8-c91f-4cf8-989a-235beaef7e4f\") " pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" Sep 17 16:43:52.099964 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:52.099873 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f3679ce8-c91f-4cf8-989a-235beaef7e4f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d894d8899-cz27w\" (UID: \"f3679ce8-c91f-4cf8-989a-235beaef7e4f\") " pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" Sep 17 16:43:52.100189 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:52.100169 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3679ce8-c91f-4cf8-989a-235beaef7e4f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d894d8899-cz27w\" (UID: \"f3679ce8-c91f-4cf8-989a-235beaef7e4f\") " pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" Sep 17 16:43:52.105727 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:52.105704 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9sjn\" (UniqueName: \"kubernetes.io/projected/f3679ce8-c91f-4cf8-989a-235beaef7e4f-kube-api-access-c9sjn\") pod \"thanos-querier-d894d8899-cz27w\" (UID: \"f3679ce8-c91f-4cf8-989a-235beaef7e4f\") " pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" Sep 17 16:43:52.248336 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:52.248291 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" Sep 17 16:43:52.272479 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:52.272433 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:53.260603 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.260551 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh"] Sep 17 16:43:53.267043 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.267015 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh" Sep 17 16:43:53.270543 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.270519 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 17 16:43:53.270676 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.270574 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 17 16:43:53.270676 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.270519 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 17 16:43:53.272734 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.272098 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-hlk9f\"" Sep 17 16:43:53.272734 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.272290 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 17 16:43:53.272734 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.272510 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-deepuauk6lvbd\"" Sep 17 16:43:53.275055 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.275031 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh"] Sep 17 16:43:53.308391 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.308357 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5875730-f41c-4301-82a0-1884350931a9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5dd46dc8f7-d6jhh\" (UID: \"e5875730-f41c-4301-82a0-1884350931a9\") " pod="openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh" Sep 17 16:43:53.308565 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.308420 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e5875730-f41c-4301-82a0-1884350931a9-secret-metrics-server-client-certs\") pod \"metrics-server-5dd46dc8f7-d6jhh\" (UID: \"e5875730-f41c-4301-82a0-1884350931a9\") " pod="openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh" Sep 17 16:43:53.308565 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.308467 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e5875730-f41c-4301-82a0-1884350931a9-metrics-server-audit-profiles\") pod \"metrics-server-5dd46dc8f7-d6jhh\" (UID: \"e5875730-f41c-4301-82a0-1884350931a9\") " pod="openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh" Sep 17 16:43:53.308565 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.308492 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5875730-f41c-4301-82a0-1884350931a9-client-ca-bundle\") pod \"metrics-server-5dd46dc8f7-d6jhh\" (UID: \"e5875730-f41c-4301-82a0-1884350931a9\") " pod="openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh" Sep 17 16:43:53.308726 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.308608 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e5875730-f41c-4301-82a0-1884350931a9-secret-metrics-server-tls\") pod \"metrics-server-5dd46dc8f7-d6jhh\" (UID: \"e5875730-f41c-4301-82a0-1884350931a9\") " pod="openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh" Sep 17 16:43:53.308726 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.308659 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl9vk\" (UniqueName: \"kubernetes.io/projected/e5875730-f41c-4301-82a0-1884350931a9-kube-api-access-gl9vk\") pod \"metrics-server-5dd46dc8f7-d6jhh\" (UID: \"e5875730-f41c-4301-82a0-1884350931a9\") " pod="openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh" Sep 17 16:43:53.308810 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.308737 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e5875730-f41c-4301-82a0-1884350931a9-audit-log\") pod \"metrics-server-5dd46dc8f7-d6jhh\" (UID: \"e5875730-f41c-4301-82a0-1884350931a9\") " pod="openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh" Sep 17 16:43:53.409360 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.409315 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5875730-f41c-4301-82a0-1884350931a9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5dd46dc8f7-d6jhh\" (UID: \"e5875730-f41c-4301-82a0-1884350931a9\") " pod="openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh" Sep 17 16:43:53.409550 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.409405 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e5875730-f41c-4301-82a0-1884350931a9-secret-metrics-server-client-certs\") pod \"metrics-server-5dd46dc8f7-d6jhh\" (UID: \"e5875730-f41c-4301-82a0-1884350931a9\") " pod="openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh" Sep 17 16:43:53.409550 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.409427 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e5875730-f41c-4301-82a0-1884350931a9-metrics-server-audit-profiles\") pod \"metrics-server-5dd46dc8f7-d6jhh\" (UID: \"e5875730-f41c-4301-82a0-1884350931a9\") " pod="openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh" Sep 17 16:43:53.409550 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.409459 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5875730-f41c-4301-82a0-1884350931a9-client-ca-bundle\") pod \"metrics-server-5dd46dc8f7-d6jhh\" (UID: \"e5875730-f41c-4301-82a0-1884350931a9\") " pod="openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh" Sep 17 16:43:53.409550 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.409525 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e5875730-f41c-4301-82a0-1884350931a9-secret-metrics-server-tls\") pod \"metrics-server-5dd46dc8f7-d6jhh\" (UID: \"e5875730-f41c-4301-82a0-1884350931a9\") " pod="openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh" Sep 17 16:43:53.409550 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.409543 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl9vk\" (UniqueName: \"kubernetes.io/projected/e5875730-f41c-4301-82a0-1884350931a9-kube-api-access-gl9vk\") pod \"metrics-server-5dd46dc8f7-d6jhh\" (UID: \"e5875730-f41c-4301-82a0-1884350931a9\") " pod="openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh" Sep 17 16:43:53.409820 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.409593 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e5875730-f41c-4301-82a0-1884350931a9-audit-log\") pod \"metrics-server-5dd46dc8f7-d6jhh\" (UID: \"e5875730-f41c-4301-82a0-1884350931a9\") " pod="openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh" Sep 17 16:43:53.410028 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.410001 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e5875730-f41c-4301-82a0-1884350931a9-audit-log\") pod \"metrics-server-5dd46dc8f7-d6jhh\" (UID: \"e5875730-f41c-4301-82a0-1884350931a9\") " pod="openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh" Sep 17 16:43:53.410179 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.410143 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5875730-f41c-4301-82a0-1884350931a9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5dd46dc8f7-d6jhh\" (UID: \"e5875730-f41c-4301-82a0-1884350931a9\") " pod="openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh" Sep 17 16:43:53.410581 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.410549 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e5875730-f41c-4301-82a0-1884350931a9-metrics-server-audit-profiles\") pod \"metrics-server-5dd46dc8f7-d6jhh\" (UID: \"e5875730-f41c-4301-82a0-1884350931a9\") " pod="openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh" Sep 17 16:43:53.412521 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.412502 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e5875730-f41c-4301-82a0-1884350931a9-secret-metrics-server-tls\") pod \"metrics-server-5dd46dc8f7-d6jhh\" (UID: \"e5875730-f41c-4301-82a0-1884350931a9\") " pod="openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh" Sep 17 16:43:53.413178 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.413155 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5875730-f41c-4301-82a0-1884350931a9-client-ca-bundle\") pod \"metrics-server-5dd46dc8f7-d6jhh\" (UID: \"e5875730-f41c-4301-82a0-1884350931a9\") " pod="openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh" Sep 17 16:43:53.413276 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.413260 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e5875730-f41c-4301-82a0-1884350931a9-secret-metrics-server-client-certs\") pod \"metrics-server-5dd46dc8f7-d6jhh\" (UID: \"e5875730-f41c-4301-82a0-1884350931a9\") " pod="openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh" Sep 17 16:43:53.420477 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.420429 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl9vk\" (UniqueName: \"kubernetes.io/projected/e5875730-f41c-4301-82a0-1884350931a9-kube-api-access-gl9vk\") pod \"metrics-server-5dd46dc8f7-d6jhh\" (UID: \"e5875730-f41c-4301-82a0-1884350931a9\") " pod="openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh" Sep 17 16:43:53.580386 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.580251 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh" Sep 17 16:43:53.619984 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.619950 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:53.717299 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.717261 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:53.906776 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:53.906674 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:54.002820 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.002789 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:54.017416 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.017215 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0f01af1-e02f-4105-8edb-33a5b8acab5c-metrics-certs\") pod \"network-metrics-daemon-glhzf\" (UID: \"c0f01af1-e02f-4105-8edb-33a5b8acab5c\") " pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:43:54.021028 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.020999 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c0f01af1-e02f-4105-8edb-33a5b8acab5c-metrics-certs\") pod \"network-metrics-daemon-glhzf\" (UID: \"c0f01af1-e02f-4105-8edb-33a5b8acab5c\") " pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:43:54.130266 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.130220 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6bf5689f-mnmw4"] Sep 17 16:43:54.149661 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.149581 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6bf5689f-mnmw4"] Sep 17 16:43:54.149832 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.149807 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6bf5689f-mnmw4" Sep 17 16:43:54.153076 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.153022 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 17 16:43:54.154379 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.154100 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-sd6gl\"" Sep 17 16:43:54.155353 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.154143 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 17 16:43:54.155353 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.154194 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 17 16:43:54.155519 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.155482 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 17 16:43:54.157035 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.156849 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 17 16:43:54.159517 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.159498 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 17 16:43:54.221821 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.221793 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c268bae-d302-4d8f-82ac-febe6e14acdb-serving-certs-ca-bundle\") pod \"telemeter-client-6bf5689f-mnmw4\" (UID: \"6c268bae-d302-4d8f-82ac-febe6e14acdb\") " pod="openshift-monitoring/telemeter-client-6bf5689f-mnmw4" Sep 17 16:43:54.221936 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.221851 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6c268bae-d302-4d8f-82ac-febe6e14acdb-secret-telemeter-client\") pod \"telemeter-client-6bf5689f-mnmw4\" (UID: \"6c268bae-d302-4d8f-82ac-febe6e14acdb\") " pod="openshift-monitoring/telemeter-client-6bf5689f-mnmw4" Sep 17 16:43:54.221936 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.221919 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6c268bae-d302-4d8f-82ac-febe6e14acdb-telemeter-client-tls\") pod \"telemeter-client-6bf5689f-mnmw4\" (UID: \"6c268bae-d302-4d8f-82ac-febe6e14acdb\") " pod="openshift-monitoring/telemeter-client-6bf5689f-mnmw4" Sep 17 16:43:54.222014 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.221963 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6c268bae-d302-4d8f-82ac-febe6e14acdb-federate-client-tls\") pod \"telemeter-client-6bf5689f-mnmw4\" (UID: \"6c268bae-d302-4d8f-82ac-febe6e14acdb\") " pod="openshift-monitoring/telemeter-client-6bf5689f-mnmw4" Sep 17 16:43:54.222074 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.222055 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c268bae-d302-4d8f-82ac-febe6e14acdb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6bf5689f-mnmw4\" (UID: \"6c268bae-d302-4d8f-82ac-febe6e14acdb\") " pod="openshift-monitoring/telemeter-client-6bf5689f-mnmw4" Sep 17 16:43:54.222271 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.222110 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c268bae-d302-4d8f-82ac-febe6e14acdb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6bf5689f-mnmw4\" (UID: \"6c268bae-d302-4d8f-82ac-febe6e14acdb\") " pod="openshift-monitoring/telemeter-client-6bf5689f-mnmw4" Sep 17 16:43:54.222271 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.222135 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgqqc\" (UniqueName: \"kubernetes.io/projected/6c268bae-d302-4d8f-82ac-febe6e14acdb-kube-api-access-fgqqc\") pod \"telemeter-client-6bf5689f-mnmw4\" (UID: \"6c268bae-d302-4d8f-82ac-febe6e14acdb\") " pod="openshift-monitoring/telemeter-client-6bf5689f-mnmw4" Sep 17 16:43:54.222271 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.222164 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c268bae-d302-4d8f-82ac-febe6e14acdb-metrics-client-ca\") pod \"telemeter-client-6bf5689f-mnmw4\" (UID: \"6c268bae-d302-4d8f-82ac-febe6e14acdb\") " pod="openshift-monitoring/telemeter-client-6bf5689f-mnmw4" Sep 17 16:43:54.240315 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.240291 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n5btm\"" Sep 17 16:43:54.247984 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.247963 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-glhzf" Sep 17 16:43:54.305874 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.305806 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh"] Sep 17 16:43:54.313682 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.313656 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 16:43:54.319960 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.319240 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6984cd6c7f-kfxcx"] Sep 17 16:43:54.322890 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.322865 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c268bae-d302-4d8f-82ac-febe6e14acdb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6bf5689f-mnmw4\" (UID: \"6c268bae-d302-4d8f-82ac-febe6e14acdb\") " pod="openshift-monitoring/telemeter-client-6bf5689f-mnmw4" Sep 17 16:43:54.323079 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.323057 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c268bae-d302-4d8f-82ac-febe6e14acdb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6bf5689f-mnmw4\" (UID: \"6c268bae-d302-4d8f-82ac-febe6e14acdb\") " pod="openshift-monitoring/telemeter-client-6bf5689f-mnmw4" Sep 17 16:43:54.323385 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.323364 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgqqc\" (UniqueName: \"kubernetes.io/projected/6c268bae-d302-4d8f-82ac-febe6e14acdb-kube-api-access-fgqqc\") pod \"telemeter-client-6bf5689f-mnmw4\" (UID: \"6c268bae-d302-4d8f-82ac-febe6e14acdb\") " pod="openshift-monitoring/telemeter-client-6bf5689f-mnmw4" Sep 17 16:43:54.323542 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.323524 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c268bae-d302-4d8f-82ac-febe6e14acdb-metrics-client-ca\") pod \"telemeter-client-6bf5689f-mnmw4\" (UID: \"6c268bae-d302-4d8f-82ac-febe6e14acdb\") " pod="openshift-monitoring/telemeter-client-6bf5689f-mnmw4" Sep 17 16:43:54.323678 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.323662 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c268bae-d302-4d8f-82ac-febe6e14acdb-serving-certs-ca-bundle\") pod \"telemeter-client-6bf5689f-mnmw4\" (UID: \"6c268bae-d302-4d8f-82ac-febe6e14acdb\") " pod="openshift-monitoring/telemeter-client-6bf5689f-mnmw4" Sep 17 16:43:54.323812 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.323794 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6c268bae-d302-4d8f-82ac-febe6e14acdb-secret-telemeter-client\") pod \"telemeter-client-6bf5689f-mnmw4\" (UID: \"6c268bae-d302-4d8f-82ac-febe6e14acdb\") " pod="openshift-monitoring/telemeter-client-6bf5689f-mnmw4" Sep 17 16:43:54.323963 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.323914 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6c268bae-d302-4d8f-82ac-febe6e14acdb-telemeter-client-tls\") pod \"telemeter-client-6bf5689f-mnmw4\" (UID: \"6c268bae-d302-4d8f-82ac-febe6e14acdb\") " pod="openshift-monitoring/telemeter-client-6bf5689f-mnmw4" Sep 17 16:43:54.324076 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.323965 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6c268bae-d302-4d8f-82ac-febe6e14acdb-federate-client-tls\") pod \"telemeter-client-6bf5689f-mnmw4\" (UID: \"6c268bae-d302-4d8f-82ac-febe6e14acdb\") " pod="openshift-monitoring/telemeter-client-6bf5689f-mnmw4" Sep 17 16:43:54.324138 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.324077 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c268bae-d302-4d8f-82ac-febe6e14acdb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6bf5689f-mnmw4\" (UID: \"6c268bae-d302-4d8f-82ac-febe6e14acdb\") " pod="openshift-monitoring/telemeter-client-6bf5689f-mnmw4" Sep 17 16:43:54.324907 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.324761 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c268bae-d302-4d8f-82ac-febe6e14acdb-metrics-client-ca\") pod \"telemeter-client-6bf5689f-mnmw4\" (UID: \"6c268bae-d302-4d8f-82ac-febe6e14acdb\") " pod="openshift-monitoring/telemeter-client-6bf5689f-mnmw4" Sep 17 16:43:54.326311 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.326236 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c268bae-d302-4d8f-82ac-febe6e14acdb-serving-certs-ca-bundle\") pod \"telemeter-client-6bf5689f-mnmw4\" (UID: \"6c268bae-d302-4d8f-82ac-febe6e14acdb\") " pod="openshift-monitoring/telemeter-client-6bf5689f-mnmw4" Sep 17 16:43:54.329656 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.328242 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6c268bae-d302-4d8f-82ac-febe6e14acdb-telemeter-client-tls\") pod \"telemeter-client-6bf5689f-mnmw4\" (UID: \"6c268bae-d302-4d8f-82ac-febe6e14acdb\") " pod="openshift-monitoring/telemeter-client-6bf5689f-mnmw4" Sep 17 16:43:54.329656 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.328907 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6c268bae-d302-4d8f-82ac-febe6e14acdb-federate-client-tls\") pod \"telemeter-client-6bf5689f-mnmw4\" (UID: \"6c268bae-d302-4d8f-82ac-febe6e14acdb\") " pod="openshift-monitoring/telemeter-client-6bf5689f-mnmw4" Sep 17 16:43:54.330844 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.330800 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c268bae-d302-4d8f-82ac-febe6e14acdb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6bf5689f-mnmw4\" (UID: \"6c268bae-d302-4d8f-82ac-febe6e14acdb\") " pod="openshift-monitoring/telemeter-client-6bf5689f-mnmw4" Sep 17 16:43:54.334092 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.332481 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6c268bae-d302-4d8f-82ac-febe6e14acdb-secret-telemeter-client\") pod \"telemeter-client-6bf5689f-mnmw4\" (UID: \"6c268bae-d302-4d8f-82ac-febe6e14acdb\") " pod="openshift-monitoring/telemeter-client-6bf5689f-mnmw4" Sep 17 16:43:54.334249 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.334225 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-r2lls"] Sep 17 16:43:54.335823 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:43:54.335796 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47c0a509_9f12_49c2_ba40_70f94c2f5fbb.slice/crio-4efb3c0572d45a6eb11325a4dd365c7493c27e2d0e2015a4cd70450830a2a7f0 WatchSource:0}: Error finding container 4efb3c0572d45a6eb11325a4dd365c7493c27e2d0e2015a4cd70450830a2a7f0: Status 404 returned error can't find the container with id 4efb3c0572d45a6eb11325a4dd365c7493c27e2d0e2015a4cd70450830a2a7f0 Sep 17 16:43:54.336853 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.336828 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgqqc\" (UniqueName: \"kubernetes.io/projected/6c268bae-d302-4d8f-82ac-febe6e14acdb-kube-api-access-fgqqc\") pod \"telemeter-client-6bf5689f-mnmw4\" (UID: \"6c268bae-d302-4d8f-82ac-febe6e14acdb\") " pod="openshift-monitoring/telemeter-client-6bf5689f-mnmw4" Sep 17 16:43:54.342847 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.342820 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-rrbx5"] Sep 17 16:43:54.345891 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:43:54.345854 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1ab5c3c_0989_46db_9bfa_c7183c759c2d.slice/crio-a0234b053ca960fb2c0900a7c3f507952f6ecf76c561120bc1b8fa6b4f6ca7ea WatchSource:0}: Error finding container a0234b053ca960fb2c0900a7c3f507952f6ecf76c561120bc1b8fa6b4f6ca7ea: Status 404 returned error can't find the container with id a0234b053ca960fb2c0900a7c3f507952f6ecf76c561120bc1b8fa6b4f6ca7ea Sep 17 16:43:54.393139 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.393116 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d894d8899-cz27w"] Sep 17 16:43:54.398377 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:43:54.398343 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3679ce8_c91f_4cf8_989a_235beaef7e4f.slice/crio-e289cedfbea94b259a22285f090036c625e54afce68681ad6c4b000425c925e9 WatchSource:0}: Error finding container e289cedfbea94b259a22285f090036c625e54afce68681ad6c4b000425c925e9: Status 404 returned error can't find the container with id e289cedfbea94b259a22285f090036c625e54afce68681ad6c4b000425c925e9 Sep 17 16:43:54.460192 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.460145 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:54.464804 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.464768 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6bf5689f-mnmw4" Sep 17 16:43:54.469096 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.469070 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6984cd6c7f-kfxcx"] Sep 17 16:43:54.555590 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.552934 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-glhzf"] Sep 17 16:43:54.564907 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.564422 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:54.783057 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.782972 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6bf5689f-mnmw4"] Sep 17 16:43:54.791180 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:43:54.790913 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c268bae_d302_4d8f_82ac_febe6e14acdb.slice/crio-e91668451522390fcc951bd772be599c09ac489d31d0ccfe04c0600b8ad875aa WatchSource:0}: Error finding container e91668451522390fcc951bd772be599c09ac489d31d0ccfe04c0600b8ad875aa: Status 404 returned error can't find the container with id e91668451522390fcc951bd772be599c09ac489d31d0ccfe04c0600b8ad875aa Sep 17 16:43:54.956605 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.956504 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6bf5689f-mnmw4" event={"ID":"6c268bae-d302-4d8f-82ac-febe6e14acdb","Type":"ContainerStarted","Data":"e91668451522390fcc951bd772be599c09ac489d31d0ccfe04c0600b8ad875aa"} Sep 17 16:43:54.960239 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.960179 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f49b7368-ef4c-4a61-8c8b-5154d3251d53","Type":"ContainerStarted","Data":"84d29369e5db00cb1b8ce599b1ff6ae3af666b7d75ee6381cf1c64e1313fcf7c"} Sep 17 16:43:54.963089 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.963019 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mrkmf" event={"ID":"8b372a8d-e81e-4541-b8b6-b3d4c181cd29","Type":"ContainerStarted","Data":"f884fe916e487cfda70bdaa38f99fa71e0d7fb27a2c88f91824dc85aa3aa524e"} Sep 17 16:43:54.968334 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.966637 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh" event={"ID":"e5875730-f41c-4301-82a0-1884350931a9","Type":"ContainerStarted","Data":"2ece1f7b51c0c454c9bb58b572bc31c309e5371e32ba57db4293529ec549b232"} Sep 17 16:43:54.975016 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.974918 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rrbx5" event={"ID":"c1ab5c3c-0989-46db-9bfa-c7183c759c2d","Type":"ContainerStarted","Data":"461e14a1e5bac2b49f11c6aba8ab8c97113d74c72271e67f6be943533648d844"} Sep 17 16:43:54.975282 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.975196 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rrbx5" event={"ID":"c1ab5c3c-0989-46db-9bfa-c7183c759c2d","Type":"ContainerStarted","Data":"e57a5fd46daf105be14443a5485a0c4478c544d06cc4fbcf4a377fb0d50bf935"} Sep 17 16:43:54.975282 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.975248 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rrbx5" event={"ID":"c1ab5c3c-0989-46db-9bfa-c7183c759c2d","Type":"ContainerStarted","Data":"a0234b053ca960fb2c0900a7c3f507952f6ecf76c561120bc1b8fa6b4f6ca7ea"} Sep 17 16:43:54.982710 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.979906 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-9fvdm" event={"ID":"c3d10027-2f6c-420a-9acb-7410e8d57b4c","Type":"ContainerStarted","Data":"3d6453090a189b6b6e48c0760c5ac6b535d9f5f77be7c7b2760ba96609013e70"} Sep 17 16:43:54.982710 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.981619 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6594f4c75-9fvdm" Sep 17 16:43:54.985890 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.985844 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6594f4c75-9fvdm" Sep 17 16:43:54.994681 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.991104 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-r2lls" event={"ID":"47c0a509-9f12-49c2-ba40-70f94c2f5fbb","Type":"ContainerStarted","Data":"4efb3c0572d45a6eb11325a4dd365c7493c27e2d0e2015a4cd70450830a2a7f0"} Sep 17 16:43:55.001477 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:54.998131 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-glhzf" event={"ID":"c0f01af1-e02f-4105-8edb-33a5b8acab5c","Type":"ContainerStarted","Data":"567ff380ef8f618aaa79d702ee57c92a32220e3706fd9288791185f93535d1b9"} Sep 17 16:43:55.016865 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.016816 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" event={"ID":"f3679ce8-c91f-4cf8-989a-235beaef7e4f","Type":"ContainerStarted","Data":"e289cedfbea94b259a22285f090036c625e54afce68681ad6c4b000425c925e9"} Sep 17 16:43:55.020547 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.020482 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6594f4c75-9fvdm" podStartSLOduration=1.876056856 podStartE2EDuration="20.020462673s" totalImagesPullingTime="18.144405817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:43:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:43:55.020146982 +0000 UTC m=+131.216141129" watchObservedRunningTime="2026-09-17 16:43:55.020462673 +0000 UTC m=+131.216456821" Sep 17 16:43:55.028765 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.028197 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6984cd6c7f-kfxcx" event={"ID":"8c665984-e24b-4a20-9cf7-d1aa84249b6e","Type":"ContainerStarted","Data":"57013549828ab25f417a58e749b92e7d99720adb15cb67fac21d1430afb570f1"} Sep 17 16:43:55.028765 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.028251 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6984cd6c7f-kfxcx" event={"ID":"8c665984-e24b-4a20-9cf7-d1aa84249b6e","Type":"ContainerStarted","Data":"9392fd477408951592619fe8e3b86964ef5627ff5ecc0bbf4e67827fcdd03950"} Sep 17 16:43:55.425041 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.424695 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:55.447660 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.447584 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6984cd6c7f-kfxcx" podStartSLOduration=8.447559103 podStartE2EDuration="8.447559103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:43:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:43:55.164630044 +0000 UTC m=+131.360624195" watchObservedRunningTime="2026-09-17 16:43:55.447559103 +0000 UTC m=+131.643553260" Sep 17 16:43:55.447990 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.447966 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 16:43:55.469381 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.469349 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.481306 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.481275 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 16:43:55.511672 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.509737 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 16:43:55.511832 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.511785 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 16:43:55.512109 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.512085 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 16:43:55.512406 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.512385 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 16:43:55.517487 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.513545 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 16:43:55.517487 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.513811 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 16:43:55.517487 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.514034 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sw2js\"" Sep 17 16:43:55.517487 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.514253 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 16:43:55.517487 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.514515 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 16:43:55.517487 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.514751 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 16:43:55.521248 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.518425 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 16:43:55.521248 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.518672 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 16:43:55.521248 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.520201 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 16:43:55.521248 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.520484 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fujjb17eve9ep\"" Sep 17 16:43:55.535896 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.533489 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 16:43:55.561373 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.536599 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-web-config\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.561373 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.561064 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.561373 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.561124 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.561373 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.561165 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.561373 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.561193 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.561373 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.561218 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpj6h\" (UniqueName: \"kubernetes.io/projected/9aeaee4b-c374-4ca6-852e-b0361242985f-kube-api-access-cpj6h\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.561373 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.561247 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9aeaee4b-c374-4ca6-852e-b0361242985f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.561373 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.561269 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9aeaee4b-c374-4ca6-852e-b0361242985f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.561373 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.561300 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.561373 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.561339 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.561373 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.561372 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9aeaee4b-c374-4ca6-852e-b0361242985f-config-out\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.563194 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.561426 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.563194 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.561477 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.563194 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.561510 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.563194 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.561693 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.563194 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.561740 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.563194 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.561779 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-config\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.563194 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.561804 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.563194 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.561843 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.563194 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.561867 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.563194 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.537578 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 16:43:55.662780 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.662748 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.662964 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.662809 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.662964 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.662841 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.662964 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.662864 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.662964 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.662884 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpj6h\" (UniqueName: \"kubernetes.io/projected/9aeaee4b-c374-4ca6-852e-b0361242985f-kube-api-access-cpj6h\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.662964 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.662914 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9aeaee4b-c374-4ca6-852e-b0361242985f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.662964 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.662934 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9aeaee4b-c374-4ca6-852e-b0361242985f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.662964 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.662958 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.663319 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.662985 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.663319 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.663022 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9aeaee4b-c374-4ca6-852e-b0361242985f-config-out\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.663319 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.663074 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.663319 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.663097 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.663319 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.663128 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.663319 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.663157 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.663319 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.663183 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.663319 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.663221 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-config\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.663319 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.663245 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.663319 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.663281 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.663319 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.663305 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.663854 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.663372 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-web-config\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.665381 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.664863 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9aeaee4b-c374-4ca6-852e-b0361242985f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.665381 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.664928 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.667553 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.666145 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.667553 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.666172 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.667553 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.666979 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.667553 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.667198 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.677554 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.677263 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.679487 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.679312 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.682050 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.681984 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.721874 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.717561 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.721874 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.718333 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.721874 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.718720 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9aeaee4b-c374-4ca6-852e-b0361242985f-config-out\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.721874 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.719471 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.721874 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.719826 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9aeaee4b-c374-4ca6-852e-b0361242985f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.721874 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.720315 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.721874 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.720876 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpj6h\" (UniqueName: \"kubernetes.io/projected/9aeaee4b-c374-4ca6-852e-b0361242985f-kube-api-access-cpj6h\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.721874 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.721333 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.721874 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.721820 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.758581 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.758486 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-config\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.773989 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.773923 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-web-config\") pod \"prometheus-k8s-0\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:55.810796 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:55.810760 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:43:56.218512 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:56.218152 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 16:43:56.942792 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:43:56.942751 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aeaee4b_c374_4ca6_852e_b0361242985f.slice/crio-982576bc61edc5af33c9cb6dcf075f2afba63ad907705b978557c31e9a197138 WatchSource:0}: Error finding container 982576bc61edc5af33c9cb6dcf075f2afba63ad907705b978557c31e9a197138: Status 404 returned error can't find the container with id 982576bc61edc5af33c9cb6dcf075f2afba63ad907705b978557c31e9a197138 Sep 17 16:43:57.046067 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:57.046014 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9aeaee4b-c374-4ca6-852e-b0361242985f","Type":"ContainerStarted","Data":"982576bc61edc5af33c9cb6dcf075f2afba63ad907705b978557c31e9a197138"} Sep 17 16:43:57.071910 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:57.071842 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:57.134298 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:57.134223 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:57.509820 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:57.509766 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:57.602417 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:57.602382 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:58.146177 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:58.146143 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6984cd6c7f-kfxcx" Sep 17 16:43:58.986658 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:58.986618 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b9ff76d55-b7lfl"] Sep 17 16:43:59.108898 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:59.108856 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:59.258023 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:59.257935 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:59.387639 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:43:59.387594 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:01.247534 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:01.247502 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:01.364846 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:01.364725 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:03.086229 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:03.086189 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6bf5689f-mnmw4" event={"ID":"6c268bae-d302-4d8f-82ac-febe6e14acdb","Type":"ContainerStarted","Data":"8dd5b6451ea2d1c27f37a0bf9989f33b5133a021dcbea0941ac27114a1213e48"} Sep 17 16:44:03.086716 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:03.086269 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6bf5689f-mnmw4" event={"ID":"6c268bae-d302-4d8f-82ac-febe6e14acdb","Type":"ContainerStarted","Data":"4aec53bdc04bf41b13fd09a695e4b5115b5c31ac8b8a7106be4b4096406dc29b"} Sep 17 16:44:03.086716 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:03.086299 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6bf5689f-mnmw4" event={"ID":"6c268bae-d302-4d8f-82ac-febe6e14acdb","Type":"ContainerStarted","Data":"9b9e2abe78d06ddd5044e1e8b4478296cca2631c38301a378dd4b87b6efb8e2f"} Sep 17 16:44:03.087822 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:03.087800 2574 generic.go:356] "Generic (PLEG): container finished" podID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerID="397b16a8e90beaa52456bd8f5e1a348914b5df6b3f6599e4c271371be90c6d5b" exitCode=0 Sep 17 16:44:03.087943 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:03.087872 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f49b7368-ef4c-4a61-8c8b-5154d3251d53","Type":"ContainerDied","Data":"397b16a8e90beaa52456bd8f5e1a348914b5df6b3f6599e4c271371be90c6d5b"} Sep 17 16:44:03.089560 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:03.089537 2574 generic.go:356] "Generic (PLEG): container finished" podID="8b372a8d-e81e-4541-b8b6-b3d4c181cd29" containerID="9dc4688b2b12405290d4f33508ddb7f9e526c09a4ae196b792e74307251f1267" exitCode=0 Sep 17 16:44:03.089625 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:03.089610 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mrkmf" event={"ID":"8b372a8d-e81e-4541-b8b6-b3d4c181cd29","Type":"ContainerDied","Data":"9dc4688b2b12405290d4f33508ddb7f9e526c09a4ae196b792e74307251f1267"} Sep 17 16:44:03.091533 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:03.091511 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh" event={"ID":"e5875730-f41c-4301-82a0-1884350931a9","Type":"ContainerStarted","Data":"cacc1c741106abe946206495ef6a84719e7199f8e57aa76b769c6f7c1dd0d599"} Sep 17 16:44:03.093901 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:03.093881 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rrbx5" event={"ID":"c1ab5c3c-0989-46db-9bfa-c7183c759c2d","Type":"ContainerStarted","Data":"7b581c442d1d95c0cb78c65ae522a5cd447ce8796c118ba3f4e2955fdc9fa359"} Sep 17 16:44:03.095371 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:03.095348 2574 generic.go:356] "Generic (PLEG): container finished" podID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerID="e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6" exitCode=0 Sep 17 16:44:03.095474 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:03.095422 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9aeaee4b-c374-4ca6-852e-b0361242985f","Type":"ContainerDied","Data":"e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6"} Sep 17 16:44:03.098122 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:03.098099 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-r2lls" event={"ID":"47c0a509-9f12-49c2-ba40-70f94c2f5fbb","Type":"ContainerStarted","Data":"7a5f56a316b915f09496f742b45f7d9e2878e9d0a896474d0354b18f9e6d17cb"} Sep 17 16:44:03.098219 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:03.098148 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-r2lls" event={"ID":"47c0a509-9f12-49c2-ba40-70f94c2f5fbb","Type":"ContainerStarted","Data":"f4d3831d890fd89481fb54181efe197b43da345845790ecda4b996ffc16f1f82"} Sep 17 16:44:03.098219 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:03.098179 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-r2lls" event={"ID":"47c0a509-9f12-49c2-ba40-70f94c2f5fbb","Type":"ContainerStarted","Data":"dc6f662b989d083ddb8c596afe2d7417f93bd2cf28eb42819635550260c6ee8d"} Sep 17 16:44:03.100350 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:03.100328 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-glhzf" event={"ID":"c0f01af1-e02f-4105-8edb-33a5b8acab5c","Type":"ContainerStarted","Data":"7a1271554da63e3657d0309ef2631f8c4891651504138427a8a9d470c39361b0"} Sep 17 16:44:03.100458 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:03.100367 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-glhzf" event={"ID":"c0f01af1-e02f-4105-8edb-33a5b8acab5c","Type":"ContainerStarted","Data":"9fe08b98599423a2ce2e51dc6abefb0e3a34d3366e1e947b4cc7bd629a22fb2c"} Sep 17 16:44:03.102333 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:03.102313 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" event={"ID":"f3679ce8-c91f-4cf8-989a-235beaef7e4f","Type":"ContainerStarted","Data":"e0e34ceae0b6066bb844efd818006753f6f8099bd064196902ba991357d930e0"} Sep 17 16:44:03.102429 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:03.102374 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" event={"ID":"f3679ce8-c91f-4cf8-989a-235beaef7e4f","Type":"ContainerStarted","Data":"80603f83555758cad3ccf9f0f971e54d1dfc789322c2ff7917c691b51ee9653d"} Sep 17 16:44:03.102429 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:03.102417 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" event={"ID":"f3679ce8-c91f-4cf8-989a-235beaef7e4f","Type":"ContainerStarted","Data":"00fbbab1c9c07417b10ec158b808ca6a936056ddd7c3b1aa35db61d3be989ca3"} Sep 17 16:44:03.182389 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:03.182338 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6bf5689f-mnmw4" podStartSLOduration=1.875637812 podStartE2EDuration="9.182316274s" totalImagesPullingTime="7.306678462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:43:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:44:03.124762039 +0000 UTC m=+139.320756188" watchObservedRunningTime="2026-09-17 16:44:03.182316274 +0000 UTC m=+139.378310427" Sep 17 16:44:03.216377 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:03.216328 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh" podStartSLOduration=2.4321216469999998 podStartE2EDuration="10.216311384s" totalImagesPullingTime="7.784189737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:43:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:44:03.215930174 +0000 UTC m=+139.411924324" watchObservedRunningTime="2026-09-17 16:44:03.216311384 +0000 UTC m=+139.412305532" Sep 17 16:44:03.257076 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:03.257016 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-glhzf" podStartSLOduration=131.729803977 podStartE2EDuration="2m19.256995157s" totalImagesPullingTime="7.52719118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:41:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:44:03.255664293 +0000 UTC m=+139.451658441" watchObservedRunningTime="2026-09-17 16:44:03.256995157 +0000 UTC m=+139.452989306" Sep 17 16:44:03.291381 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:03.291303 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rrbx5" podStartSLOduration=7.731152613 podStartE2EDuration="15.291287908s" totalImagesPullingTime="7.560135295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:43:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:44:03.289644512 +0000 UTC m=+139.485638661" watchObservedRunningTime="2026-09-17 16:44:03.291287908 +0000 UTC m=+139.487282056" Sep 17 16:44:03.411430 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:03.411368 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-r2lls" podStartSLOduration=7.6496009449999995 podStartE2EDuration="15.411346705s" totalImagesPullingTime="7.76174576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:43:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:44:03.410823215 +0000 UTC m=+139.606817367" watchObservedRunningTime="2026-09-17 16:44:03.411346705 +0000 UTC m=+139.607340854" Sep 17 16:44:03.451247 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:03.451214 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:03.551815 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:03.551726 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:04.119469 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:04.117476 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mrkmf" event={"ID":"8b372a8d-e81e-4541-b8b6-b3d4c181cd29","Type":"ContainerStarted","Data":"a14352648702c632d7a26cb71cde3ad59ad4536a4dced4baf106e6dc900107b7"} Sep 17 16:44:04.119469 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:04.117570 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mrkmf" event={"ID":"8b372a8d-e81e-4541-b8b6-b3d4c181cd29","Type":"ContainerStarted","Data":"ca2d6161c7d5e4a93394aaf06c3d249517382c481b3017442b56a96676f8a44f"} Sep 17 16:44:04.142651 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:04.141711 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mrkmf" podStartSLOduration=7.91831356 podStartE2EDuration="16.141686693s" totalImagesPullingTime="7.948522362s" totalInitContainerRuntime="274.850771ms" isStatefulPod=true podCreationTimestamp="2026-09-17 16:43:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:44:04.140721118 +0000 UTC m=+140.336715266" watchObservedRunningTime="2026-09-17 16:44:04.141686693 +0000 UTC m=+140.337680842" Sep 17 16:44:04.538327 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:04.538196 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:04.637920 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:04.637806 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:04.981561 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:04.981528 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:05.082491 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:05.082429 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:05.192873 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:05.192795 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:05.290830 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:05.290802 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:05.389218 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:05.389176 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:05.489301 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:05.489160 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:05.607321 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:05.607286 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:06.130498 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:06.130461 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f49b7368-ef4c-4a61-8c8b-5154d3251d53","Type":"ContainerStarted","Data":"1999da334861ccc35a3240679fa95d959f98cbe62b5a2866464c4ae20f500eec"} Sep 17 16:44:06.133541 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:06.133507 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" event={"ID":"f3679ce8-c91f-4cf8-989a-235beaef7e4f","Type":"ContainerStarted","Data":"c71eab1a39cb00669da740d8c389acb0c209ae5985143a93b140c51eb4adcf93"} Sep 17 16:44:06.345590 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:06.345552 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:06.696983 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:06.696950 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:06.797131 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:06.797056 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:07.143591 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:07.143474 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" event={"ID":"f3679ce8-c91f-4cf8-989a-235beaef7e4f","Type":"ContainerStarted","Data":"7f4b01a8291d83f79a1b24fd983924736b92d41dc07e7be283eb87883d0d75c0"} Sep 17 16:44:07.143591 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:07.143544 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" event={"ID":"f3679ce8-c91f-4cf8-989a-235beaef7e4f","Type":"ContainerStarted","Data":"6f8efe20b9503d97cf087e92b26f71f1163fc68fe4053d717c8a1957c08f75fd"} Sep 17 16:44:07.147698 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:07.147149 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" Sep 17 16:44:07.148814 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:07.148782 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f49b7368-ef4c-4a61-8c8b-5154d3251d53","Type":"ContainerStarted","Data":"4710e06449ae957d157b2adefb80a4142b9abd22f7a6ba604daa073e33a9466d"} Sep 17 16:44:07.148922 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:07.148896 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f49b7368-ef4c-4a61-8c8b-5154d3251d53","Type":"ContainerStarted","Data":"305b705e272dc1cea14b4a1276dde71e8aa1ba2d1062071be13d82136a977f78"} Sep 17 16:44:07.148989 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:07.148941 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f49b7368-ef4c-4a61-8c8b-5154d3251d53","Type":"ContainerStarted","Data":"c68086c2bcbc024135a2840480f68bcb3797ee491920499c2c52ea823be2f2f7"} Sep 17 16:44:07.155312 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:07.155288 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9aeaee4b-c374-4ca6-852e-b0361242985f","Type":"ContainerStarted","Data":"3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3"} Sep 17 16:44:07.159177 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:07.158786 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" Sep 17 16:44:07.203112 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:07.202819 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-d894d8899-cz27w" podStartSLOduration=6.181610979 podStartE2EDuration="16.202796109s" totalImagesPullingTime="10.02118513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:43:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:44:07.200417059 +0000 UTC m=+143.396411212" watchObservedRunningTime="2026-09-17 16:44:07.202796109 +0000 UTC m=+143.398790258" Sep 17 16:44:07.812531 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:07.812498 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5dc4c55b4-tls6x_a19b7131-de33-4c65-924f-b582e08a1eb2/router/0.log" Sep 17 16:44:07.824417 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:07.824360 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wlfqv_7f1bf12a-2d8f-462c-aef7-499c90c24bcc/serve-healthcheck-canary/0.log" Sep 17 16:44:08.169213 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:08.169125 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f49b7368-ef4c-4a61-8c8b-5154d3251d53","Type":"ContainerStarted","Data":"02337c561fdedda877ca2fcf31c6d98af53f461f79096b64bbff51d05fdf3845"} Sep 17 16:44:08.169488 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:08.169236 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f49b7368-ef4c-4a61-8c8b-5154d3251d53","Type":"ContainerStarted","Data":"5a82cc02aad7749db5ed00e7d816b7e20b56dab34e99339d2ac7a0abf9c2f5fd"} Sep 17 16:44:08.172887 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:08.172859 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9aeaee4b-c374-4ca6-852e-b0361242985f","Type":"ContainerStarted","Data":"d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc"} Sep 17 16:44:08.173016 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:08.172998 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9aeaee4b-c374-4ca6-852e-b0361242985f","Type":"ContainerStarted","Data":"63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50"} Sep 17 16:44:08.173061 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:08.173050 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9aeaee4b-c374-4ca6-852e-b0361242985f","Type":"ContainerStarted","Data":"03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b"} Sep 17 16:44:08.173107 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:08.173095 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9aeaee4b-c374-4ca6-852e-b0361242985f","Type":"ContainerStarted","Data":"b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43"} Sep 17 16:44:08.173149 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:08.173138 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9aeaee4b-c374-4ca6-852e-b0361242985f","Type":"ContainerStarted","Data":"30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a"} Sep 17 16:44:08.198630 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:08.198540 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=9.177382195 podStartE2EDuration="19.198520269s" totalImagesPullingTime="9.909437503s" totalInitContainerRuntime="111.700571ms" isStatefulPod=false podCreationTimestamp="2026-09-17 16:43:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:44:08.196964041 +0000 UTC m=+144.392958226" watchObservedRunningTime="2026-09-17 16:44:08.198520269 +0000 UTC m=+144.394514417" Sep 17 16:44:08.232609 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:08.232552 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.059021316 podStartE2EDuration="13.232534939s" totalImagesPullingTime="9.121055274s" totalInitContainerRuntime="52.458349ms" isStatefulPod=false podCreationTimestamp="2026-09-17 16:43:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:44:08.229886008 +0000 UTC m=+144.425880161" watchObservedRunningTime="2026-09-17 16:44:08.232534939 +0000 UTC m=+144.428529090" Sep 17 16:44:10.811846 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:10.811815 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:44:11.869348 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:11.869311 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:11.970601 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:11.970567 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:12.036580 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:12.036544 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:13.580695 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:13.580665 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh" Sep 17 16:44:13.581067 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:13.580728 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh" Sep 17 16:44:14.140452 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:14.140411 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fc99b9cf4-5dz6x"] Sep 17 16:44:14.264799 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:14.264769 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:14.365296 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:14.365264 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:14.432706 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:14.432674 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:19.236167 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:19.236131 2574 generic.go:356] "Generic (PLEG): container finished" podID="63e99ccc-a56a-4e27-94d4-e4284762bf7c" containerID="e840629e0e67650e0c4e42a9f3abca1fafc210de8b7850f3b81cb72161f01402" exitCode=0 Sep 17 16:44:19.236694 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:19.236210 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rg4nf" event={"ID":"63e99ccc-a56a-4e27-94d4-e4284762bf7c","Type":"ContainerDied","Data":"e840629e0e67650e0c4e42a9f3abca1fafc210de8b7850f3b81cb72161f01402"} Sep 17 16:44:19.236694 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:19.236660 2574 scope.go:117] "RemoveContainer" containerID="e840629e0e67650e0c4e42a9f3abca1fafc210de8b7850f3b81cb72161f01402" Sep 17 16:44:20.247201 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:20.247148 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-rg4nf" event={"ID":"63e99ccc-a56a-4e27-94d4-e4284762bf7c","Type":"ContainerStarted","Data":"90344ee463bc150c3c44722950fb8390bbf94da806b2f9b7d3839d00d639f242"} Sep 17 16:44:21.067308 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:21.067224 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6984cd6c7f-kfxcx" podUID="8c665984-e24b-4a20-9cf7-d1aa84249b6e" containerName="console" containerID="cri-o://57013549828ab25f417a58e749b92e7d99720adb15cb67fac21d1430afb570f1" gracePeriod=15 Sep 17 16:44:21.276271 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:21.276236 2574 generic.go:356] "Generic (PLEG): container finished" podID="8c665984-e24b-4a20-9cf7-d1aa84249b6e" containerID="57013549828ab25f417a58e749b92e7d99720adb15cb67fac21d1430afb570f1" exitCode=0 Sep 17 16:44:21.276614 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:21.276346 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6984cd6c7f-kfxcx" event={"ID":"8c665984-e24b-4a20-9cf7-d1aa84249b6e","Type":"ContainerDied","Data":"57013549828ab25f417a58e749b92e7d99720adb15cb67fac21d1430afb570f1"} Sep 17 16:44:21.384610 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:21.384237 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6984cd6c7f-kfxcx" Sep 17 16:44:21.443828 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:21.443791 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c665984-e24b-4a20-9cf7-d1aa84249b6e-trusted-ca-bundle\") pod \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\" (UID: \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\") " Sep 17 16:44:21.444097 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:21.444076 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c665984-e24b-4a20-9cf7-d1aa84249b6e-oauth-serving-cert\") pod \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\" (UID: \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\") " Sep 17 16:44:21.444224 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:21.444209 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c665984-e24b-4a20-9cf7-d1aa84249b6e-console-serving-cert\") pod \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\" (UID: \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\") " Sep 17 16:44:21.444353 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:21.444338 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c665984-e24b-4a20-9cf7-d1aa84249b6e-service-ca\") pod \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\" (UID: \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\") " Sep 17 16:44:21.444519 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:21.444499 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltjnx\" (UniqueName: \"kubernetes.io/projected/8c665984-e24b-4a20-9cf7-d1aa84249b6e-kube-api-access-ltjnx\") pod \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\" (UID: \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\") " Sep 17 16:44:21.444649 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:21.444635 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c665984-e24b-4a20-9cf7-d1aa84249b6e-console-oauth-config\") pod \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\" (UID: \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\") " Sep 17 16:44:21.444791 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:21.444777 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c665984-e24b-4a20-9cf7-d1aa84249b6e-console-config\") pod \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\" (UID: \"8c665984-e24b-4a20-9cf7-d1aa84249b6e\") " Sep 17 16:44:21.445620 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:21.445595 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c665984-e24b-4a20-9cf7-d1aa84249b6e-console-config" (OuterVolumeSpecName: "console-config") pod "8c665984-e24b-4a20-9cf7-d1aa84249b6e" (UID: "8c665984-e24b-4a20-9cf7-d1aa84249b6e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:44:21.446135 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:21.446114 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c665984-e24b-4a20-9cf7-d1aa84249b6e-service-ca" (OuterVolumeSpecName: "service-ca") pod "8c665984-e24b-4a20-9cf7-d1aa84249b6e" (UID: "8c665984-e24b-4a20-9cf7-d1aa84249b6e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:44:21.448117 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:21.447789 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c665984-e24b-4a20-9cf7-d1aa84249b6e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8c665984-e24b-4a20-9cf7-d1aa84249b6e" (UID: "8c665984-e24b-4a20-9cf7-d1aa84249b6e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:44:21.448117 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:21.448053 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c665984-e24b-4a20-9cf7-d1aa84249b6e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8c665984-e24b-4a20-9cf7-d1aa84249b6e" (UID: "8c665984-e24b-4a20-9cf7-d1aa84249b6e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:44:21.465666 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:21.465638 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c665984-e24b-4a20-9cf7-d1aa84249b6e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8c665984-e24b-4a20-9cf7-d1aa84249b6e" (UID: "8c665984-e24b-4a20-9cf7-d1aa84249b6e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:44:21.465778 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:21.465712 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c665984-e24b-4a20-9cf7-d1aa84249b6e-kube-api-access-ltjnx" (OuterVolumeSpecName: "kube-api-access-ltjnx") pod "8c665984-e24b-4a20-9cf7-d1aa84249b6e" (UID: "8c665984-e24b-4a20-9cf7-d1aa84249b6e"). InnerVolumeSpecName "kube-api-access-ltjnx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 16:44:21.466011 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:21.465989 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c665984-e24b-4a20-9cf7-d1aa84249b6e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8c665984-e24b-4a20-9cf7-d1aa84249b6e" (UID: "8c665984-e24b-4a20-9cf7-d1aa84249b6e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:44:21.546703 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:21.546671 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c665984-e24b-4a20-9cf7-d1aa84249b6e-console-config\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:44:21.546703 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:21.546698 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c665984-e24b-4a20-9cf7-d1aa84249b6e-trusted-ca-bundle\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:44:21.546703 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:21.546708 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c665984-e24b-4a20-9cf7-d1aa84249b6e-oauth-serving-cert\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:44:21.546915 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:21.546716 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c665984-e24b-4a20-9cf7-d1aa84249b6e-console-serving-cert\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:44:21.546915 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:21.546725 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c665984-e24b-4a20-9cf7-d1aa84249b6e-service-ca\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:44:21.546915 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:21.546734 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltjnx\" (UniqueName: \"kubernetes.io/projected/8c665984-e24b-4a20-9cf7-d1aa84249b6e-kube-api-access-ltjnx\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:44:21.546915 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:21.546743 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c665984-e24b-4a20-9cf7-d1aa84249b6e-console-oauth-config\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:44:22.288461 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:22.284730 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6984cd6c7f-kfxcx" event={"ID":"8c665984-e24b-4a20-9cf7-d1aa84249b6e","Type":"ContainerDied","Data":"9392fd477408951592619fe8e3b86964ef5627ff5ecc0bbf4e67827fcdd03950"} Sep 17 16:44:22.288461 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:22.284803 2574 scope.go:117] "RemoveContainer" containerID="57013549828ab25f417a58e749b92e7d99720adb15cb67fac21d1430afb570f1" Sep 17 16:44:22.288461 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:22.284981 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6984cd6c7f-kfxcx" Sep 17 16:44:22.317136 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:22.317111 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6984cd6c7f-kfxcx"] Sep 17 16:44:22.320954 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:22.320929 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6984cd6c7f-kfxcx"] Sep 17 16:44:22.328043 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:22.328017 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c665984-e24b-4a20-9cf7-d1aa84249b6e" path="/var/lib/kubelet/pods/8c665984-e24b-4a20-9cf7-d1aa84249b6e/volumes" Sep 17 16:44:24.012028 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:24.011992 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" podUID="8141abaa-13c3-40c8-8ba6-fc3bba21daf4" containerName="registry" containerID="cri-o://f246b456663c1e2d4cf498fcc43599e55ef351ff27003ef9d5b460e12c9767c2" gracePeriod=30 Sep 17 16:44:24.298230 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:24.298201 2574 generic.go:356] "Generic (PLEG): container finished" podID="8141abaa-13c3-40c8-8ba6-fc3bba21daf4" containerID="f246b456663c1e2d4cf498fcc43599e55ef351ff27003ef9d5b460e12c9767c2" exitCode=0 Sep 17 16:44:24.298381 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:24.298276 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" event={"ID":"8141abaa-13c3-40c8-8ba6-fc3bba21daf4","Type":"ContainerDied","Data":"f246b456663c1e2d4cf498fcc43599e55ef351ff27003ef9d5b460e12c9767c2"} Sep 17 16:44:24.298381 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:24.298323 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" event={"ID":"8141abaa-13c3-40c8-8ba6-fc3bba21daf4","Type":"ContainerDied","Data":"e14fd40bd13772723376a3dc1a80c995f8fd8805b3538cd02d3b635cc1a3e9a7"} Sep 17 16:44:24.298381 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:24.298342 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e14fd40bd13772723376a3dc1a80c995f8fd8805b3538cd02d3b635cc1a3e9a7" Sep 17 16:44:24.305396 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:24.305372 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:44:24.373341 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:24.373313 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-installation-pull-secrets\") pod \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " Sep 17 16:44:24.373487 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:24.373368 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-tls\") pod \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " Sep 17 16:44:24.373487 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:24.373396 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-certificates\") pod \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " Sep 17 16:44:24.373487 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:24.373427 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-ca-trust-extracted\") pod \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " Sep 17 16:44:24.373487 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:24.373483 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-trusted-ca\") pod \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " Sep 17 16:44:24.373714 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:24.373515 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nk9qk\" (UniqueName: \"kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-kube-api-access-nk9qk\") pod \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " Sep 17 16:44:24.373714 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:24.373548 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-image-registry-private-configuration\") pod \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " Sep 17 16:44:24.373714 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:24.373583 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-bound-sa-token\") pod \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\" (UID: \"8141abaa-13c3-40c8-8ba6-fc3bba21daf4\") " Sep 17 16:44:24.374558 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:24.374429 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8141abaa-13c3-40c8-8ba6-fc3bba21daf4" (UID: "8141abaa-13c3-40c8-8ba6-fc3bba21daf4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:44:24.376214 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:24.376165 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8141abaa-13c3-40c8-8ba6-fc3bba21daf4" (UID: "8141abaa-13c3-40c8-8ba6-fc3bba21daf4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 16:44:24.376363 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:24.376350 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8141abaa-13c3-40c8-8ba6-fc3bba21daf4" (UID: "8141abaa-13c3-40c8-8ba6-fc3bba21daf4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:44:24.376427 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:24.376387 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8141abaa-13c3-40c8-8ba6-fc3bba21daf4" (UID: "8141abaa-13c3-40c8-8ba6-fc3bba21daf4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:44:24.376913 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:24.376885 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8141abaa-13c3-40c8-8ba6-fc3bba21daf4" (UID: "8141abaa-13c3-40c8-8ba6-fc3bba21daf4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 16:44:24.383140 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:24.383112 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-kube-api-access-nk9qk" (OuterVolumeSpecName: "kube-api-access-nk9qk") pod "8141abaa-13c3-40c8-8ba6-fc3bba21daf4" (UID: "8141abaa-13c3-40c8-8ba6-fc3bba21daf4"). InnerVolumeSpecName "kube-api-access-nk9qk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 16:44:24.383421 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:24.383390 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8141abaa-13c3-40c8-8ba6-fc3bba21daf4" (UID: "8141abaa-13c3-40c8-8ba6-fc3bba21daf4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:44:24.385970 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:24.385949 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8141abaa-13c3-40c8-8ba6-fc3bba21daf4" (UID: "8141abaa-13c3-40c8-8ba6-fc3bba21daf4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 16:44:24.476851 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:24.476829 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-trusted-ca\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:44:24.476851 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:24.476851 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nk9qk\" (UniqueName: \"kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-kube-api-access-nk9qk\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:44:24.476971 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:24.476862 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-image-registry-private-configuration\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:44:24.476971 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:24.476873 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-bound-sa-token\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:44:24.476971 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:24.476881 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-installation-pull-secrets\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:44:24.476971 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:24.476888 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-tls\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:44:24.476971 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:24.476896 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-registry-certificates\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:44:24.476971 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:24.476903 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8141abaa-13c3-40c8-8ba6-fc3bba21daf4-ca-trust-extracted\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:44:25.303359 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:25.303328 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b9ff76d55-b7lfl" Sep 17 16:44:25.339077 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:25.339046 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b9ff76d55-b7lfl"] Sep 17 16:44:25.344883 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:25.344859 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5b9ff76d55-b7lfl"] Sep 17 16:44:26.163826 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:26.163796 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:26.244634 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:26.244602 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:26.327610 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:26.327577 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8141abaa-13c3-40c8-8ba6-fc3bba21daf4" path="/var/lib/kubelet/pods/8141abaa-13c3-40c8-8ba6-fc3bba21daf4/volumes" Sep 17 16:44:26.348169 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:26.348145 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:28.165447 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:28.165416 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:28.244147 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:28.244120 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:28.313314 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:28.313288 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:33.585948 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:33.585919 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh" Sep 17 16:44:33.589771 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:33.589746 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5dd46dc8f7-d6jhh" Sep 17 16:44:34.516125 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:34.516090 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:34.620399 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:34.620366 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:35.879044 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:35.878973 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:39.160722 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:39.160680 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6fc99b9cf4-5dz6x" podUID="1f05fdaf-53cf-4545-a9f6-a83b896fb066" containerName="console" containerID="cri-o://1ab8881c021f9a1651c2e5a8c562b48e87923e788ea0d2447609ef4c95bcd6c1" gracePeriod=15 Sep 17 16:44:39.372236 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:39.372205 2574 generic.go:356] "Generic (PLEG): container finished" podID="1f05fdaf-53cf-4545-a9f6-a83b896fb066" containerID="1ab8881c021f9a1651c2e5a8c562b48e87923e788ea0d2447609ef4c95bcd6c1" exitCode=0 Sep 17 16:44:39.372376 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:39.372262 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fc99b9cf4-5dz6x" event={"ID":"1f05fdaf-53cf-4545-a9f6-a83b896fb066","Type":"ContainerDied","Data":"1ab8881c021f9a1651c2e5a8c562b48e87923e788ea0d2447609ef4c95bcd6c1"} Sep 17 16:44:39.400133 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:39.400109 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:39.435387 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:39.435368 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fc99b9cf4-5dz6x" Sep 17 16:44:39.500240 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:39.500208 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:39.513281 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:39.513256 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f05fdaf-53cf-4545-a9f6-a83b896fb066-console-config\") pod \"1f05fdaf-53cf-4545-a9f6-a83b896fb066\" (UID: \"1f05fdaf-53cf-4545-a9f6-a83b896fb066\") " Sep 17 16:44:39.513373 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:39.513323 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f05fdaf-53cf-4545-a9f6-a83b896fb066-console-oauth-config\") pod \"1f05fdaf-53cf-4545-a9f6-a83b896fb066\" (UID: \"1f05fdaf-53cf-4545-a9f6-a83b896fb066\") " Sep 17 16:44:39.513373 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:39.513339 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f05fdaf-53cf-4545-a9f6-a83b896fb066-service-ca\") pod \"1f05fdaf-53cf-4545-a9f6-a83b896fb066\" (UID: \"1f05fdaf-53cf-4545-a9f6-a83b896fb066\") " Sep 17 16:44:39.513373 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:39.513372 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f05fdaf-53cf-4545-a9f6-a83b896fb066-console-serving-cert\") pod \"1f05fdaf-53cf-4545-a9f6-a83b896fb066\" (UID: \"1f05fdaf-53cf-4545-a9f6-a83b896fb066\") " Sep 17 16:44:39.513554 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:39.513399 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f05fdaf-53cf-4545-a9f6-a83b896fb066-oauth-serving-cert\") pod \"1f05fdaf-53cf-4545-a9f6-a83b896fb066\" (UID: \"1f05fdaf-53cf-4545-a9f6-a83b896fb066\") " Sep 17 16:44:39.513554 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:39.513415 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8bdk\" (UniqueName: \"kubernetes.io/projected/1f05fdaf-53cf-4545-a9f6-a83b896fb066-kube-api-access-p8bdk\") pod \"1f05fdaf-53cf-4545-a9f6-a83b896fb066\" (UID: \"1f05fdaf-53cf-4545-a9f6-a83b896fb066\") " Sep 17 16:44:39.513745 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:39.513714 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f05fdaf-53cf-4545-a9f6-a83b896fb066-console-config" (OuterVolumeSpecName: "console-config") pod "1f05fdaf-53cf-4545-a9f6-a83b896fb066" (UID: "1f05fdaf-53cf-4545-a9f6-a83b896fb066"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:44:39.513745 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:39.513721 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f05fdaf-53cf-4545-a9f6-a83b896fb066-service-ca" (OuterVolumeSpecName: "service-ca") pod "1f05fdaf-53cf-4545-a9f6-a83b896fb066" (UID: "1f05fdaf-53cf-4545-a9f6-a83b896fb066"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:44:39.513863 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:39.513777 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f05fdaf-53cf-4545-a9f6-a83b896fb066-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1f05fdaf-53cf-4545-a9f6-a83b896fb066" (UID: "1f05fdaf-53cf-4545-a9f6-a83b896fb066"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:44:39.515626 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:39.515604 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f05fdaf-53cf-4545-a9f6-a83b896fb066-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1f05fdaf-53cf-4545-a9f6-a83b896fb066" (UID: "1f05fdaf-53cf-4545-a9f6-a83b896fb066"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:44:39.515701 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:39.515645 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f05fdaf-53cf-4545-a9f6-a83b896fb066-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1f05fdaf-53cf-4545-a9f6-a83b896fb066" (UID: "1f05fdaf-53cf-4545-a9f6-a83b896fb066"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:44:39.515773 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:39.515754 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f05fdaf-53cf-4545-a9f6-a83b896fb066-kube-api-access-p8bdk" (OuterVolumeSpecName: "kube-api-access-p8bdk") pod "1f05fdaf-53cf-4545-a9f6-a83b896fb066" (UID: "1f05fdaf-53cf-4545-a9f6-a83b896fb066"). InnerVolumeSpecName "kube-api-access-p8bdk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 16:44:39.614820 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:39.614789 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f05fdaf-53cf-4545-a9f6-a83b896fb066-console-oauth-config\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:44:39.614820 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:39.614814 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f05fdaf-53cf-4545-a9f6-a83b896fb066-service-ca\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:44:39.614820 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:39.614823 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f05fdaf-53cf-4545-a9f6-a83b896fb066-console-serving-cert\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:44:39.615003 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:39.614832 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f05fdaf-53cf-4545-a9f6-a83b896fb066-oauth-serving-cert\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:44:39.615003 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:39.614839 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8bdk\" (UniqueName: \"kubernetes.io/projected/1f05fdaf-53cf-4545-a9f6-a83b896fb066-kube-api-access-p8bdk\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:44:39.615003 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:39.614848 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f05fdaf-53cf-4545-a9f6-a83b896fb066-console-config\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:44:40.378462 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:40.378419 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fc99b9cf4-5dz6x" event={"ID":"1f05fdaf-53cf-4545-a9f6-a83b896fb066","Type":"ContainerDied","Data":"c8a446fc7f24892162e9da660a65ad019d6096635c95dc66282fe8bdfc6b2cc6"} Sep 17 16:44:40.378462 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:40.378462 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fc99b9cf4-5dz6x" Sep 17 16:44:40.378903 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:40.378476 2574 scope.go:117] "RemoveContainer" containerID="1ab8881c021f9a1651c2e5a8c562b48e87923e788ea0d2447609ef4c95bcd6c1" Sep 17 16:44:40.397668 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:40.397644 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fc99b9cf4-5dz6x"] Sep 17 16:44:40.403714 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:40.403694 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fc99b9cf4-5dz6x"] Sep 17 16:44:42.327447 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:42.327410 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f05fdaf-53cf-4545-a9f6-a83b896fb066" path="/var/lib/kubelet/pods/1f05fdaf-53cf-4545-a9f6-a83b896fb066/volumes" Sep 17 16:44:44.571379 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:44.571299 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:44.674286 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:44.674248 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:46.284736 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:46.284706 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:46.352175 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:46.352136 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:46.423111 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:46.423084 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:55.811126 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:55.811091 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:44:55.827337 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:55.827313 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:44:56.473274 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:44:56.473245 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:03.222814 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:03.222774 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:45:03.281087 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:03.281058 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:45:03.346179 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:03.346153 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:45:05.004740 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:05.004710 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:45:05.181256 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:05.181223 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:45:05.389249 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:05.389172 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:45:05.547650 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:05.547619 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:45:06.575534 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:06.575497 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:45:06.906375 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:06.906294 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:45:09.321576 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:09.321546 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 16:45:09.322098 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:09.321900 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerName="alertmanager" containerID="cri-o://1999da334861ccc35a3240679fa95d959f98cbe62b5a2866464c4ae20f500eec" gracePeriod=120 Sep 17 16:45:09.322098 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:09.321929 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerName="kube-rbac-proxy-web" containerID="cri-o://305b705e272dc1cea14b4a1276dde71e8aa1ba2d1062071be13d82136a977f78" gracePeriod=120 Sep 17 16:45:09.322098 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:09.321957 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerName="kube-rbac-proxy" containerID="cri-o://4710e06449ae957d157b2adefb80a4142b9abd22f7a6ba604daa073e33a9466d" gracePeriod=120 Sep 17 16:45:09.322098 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:09.321977 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerName="config-reloader" containerID="cri-o://c68086c2bcbc024135a2840480f68bcb3797ee491920499c2c52ea823be2f2f7" gracePeriod=120 Sep 17 16:45:09.322098 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:09.321975 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerName="prom-label-proxy" containerID="cri-o://02337c561fdedda877ca2fcf31c6d98af53f461f79096b64bbff51d05fdf3845" gracePeriod=120 Sep 17 16:45:09.322323 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:09.321929 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerName="kube-rbac-proxy-metric" containerID="cri-o://5a82cc02aad7749db5ed00e7d816b7e20b56dab34e99339d2ac7a0abf9c2f5fd" gracePeriod=120 Sep 17 16:45:09.517720 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:09.517689 2574 generic.go:356] "Generic (PLEG): container finished" podID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerID="02337c561fdedda877ca2fcf31c6d98af53f461f79096b64bbff51d05fdf3845" exitCode=0 Sep 17 16:45:09.517720 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:09.517713 2574 generic.go:356] "Generic (PLEG): container finished" podID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerID="4710e06449ae957d157b2adefb80a4142b9abd22f7a6ba604daa073e33a9466d" exitCode=0 Sep 17 16:45:09.517720 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:09.517722 2574 generic.go:356] "Generic (PLEG): container finished" podID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerID="305b705e272dc1cea14b4a1276dde71e8aa1ba2d1062071be13d82136a977f78" exitCode=0 Sep 17 16:45:09.517914 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:09.517729 2574 generic.go:356] "Generic (PLEG): container finished" podID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerID="c68086c2bcbc024135a2840480f68bcb3797ee491920499c2c52ea823be2f2f7" exitCode=0 Sep 17 16:45:09.517914 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:09.517736 2574 generic.go:356] "Generic (PLEG): container finished" podID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerID="1999da334861ccc35a3240679fa95d959f98cbe62b5a2866464c4ae20f500eec" exitCode=0 Sep 17 16:45:09.517914 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:09.517755 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f49b7368-ef4c-4a61-8c8b-5154d3251d53","Type":"ContainerDied","Data":"02337c561fdedda877ca2fcf31c6d98af53f461f79096b64bbff51d05fdf3845"} Sep 17 16:45:09.517914 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:09.517825 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f49b7368-ef4c-4a61-8c8b-5154d3251d53","Type":"ContainerDied","Data":"4710e06449ae957d157b2adefb80a4142b9abd22f7a6ba604daa073e33a9466d"} Sep 17 16:45:09.517914 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:09.517853 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f49b7368-ef4c-4a61-8c8b-5154d3251d53","Type":"ContainerDied","Data":"305b705e272dc1cea14b4a1276dde71e8aa1ba2d1062071be13d82136a977f78"} Sep 17 16:45:09.517914 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:09.517883 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f49b7368-ef4c-4a61-8c8b-5154d3251d53","Type":"ContainerDied","Data":"c68086c2bcbc024135a2840480f68bcb3797ee491920499c2c52ea823be2f2f7"} Sep 17 16:45:09.517914 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:09.517909 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f49b7368-ef4c-4a61-8c8b-5154d3251d53","Type":"ContainerDied","Data":"1999da334861ccc35a3240679fa95d959f98cbe62b5a2866464c4ae20f500eec"} Sep 17 16:45:10.526623 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.526591 2574 generic.go:356] "Generic (PLEG): container finished" podID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerID="5a82cc02aad7749db5ed00e7d816b7e20b56dab34e99339d2ac7a0abf9c2f5fd" exitCode=0 Sep 17 16:45:10.526967 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.526664 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f49b7368-ef4c-4a61-8c8b-5154d3251d53","Type":"ContainerDied","Data":"5a82cc02aad7749db5ed00e7d816b7e20b56dab34e99339d2ac7a0abf9c2f5fd"} Sep 17 16:45:10.572154 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.572132 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:45:10.668484 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.668390 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f49b7368-ef4c-4a61-8c8b-5154d3251d53-alertmanager-main-db\") pod \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " Sep 17 16:45:10.668484 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.668453 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-cluster-tls-config\") pod \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " Sep 17 16:45:10.668484 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.668482 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-secret-alertmanager-kube-rbac-proxy-metric\") pod \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " Sep 17 16:45:10.668747 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.668507 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f49b7368-ef4c-4a61-8c8b-5154d3251d53-alertmanager-trusted-ca-bundle\") pod \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " Sep 17 16:45:10.668747 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.668527 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-web-config\") pod \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " Sep 17 16:45:10.668747 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.668545 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f49b7368-ef4c-4a61-8c8b-5154d3251d53-config-out\") pod \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " Sep 17 16:45:10.668747 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.668584 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-secret-alertmanager-kube-rbac-proxy\") pod \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " Sep 17 16:45:10.668747 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.668613 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-secret-alertmanager-kube-rbac-proxy-web\") pod \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " Sep 17 16:45:10.668747 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.668641 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f49b7368-ef4c-4a61-8c8b-5154d3251d53-tls-assets\") pod \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " Sep 17 16:45:10.668747 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.668667 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f49b7368-ef4c-4a61-8c8b-5154d3251d53-metrics-client-ca\") pod \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " Sep 17 16:45:10.668747 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.668707 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-config-volume\") pod \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " Sep 17 16:45:10.668747 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.668745 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-secret-alertmanager-main-tls\") pod \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " Sep 17 16:45:10.669182 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.668770 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jk24\" (UniqueName: \"kubernetes.io/projected/f49b7368-ef4c-4a61-8c8b-5154d3251d53-kube-api-access-4jk24\") pod \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\" (UID: \"f49b7368-ef4c-4a61-8c8b-5154d3251d53\") " Sep 17 16:45:10.669182 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.668964 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f49b7368-ef4c-4a61-8c8b-5154d3251d53-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "f49b7368-ef4c-4a61-8c8b-5154d3251d53" (UID: "f49b7368-ef4c-4a61-8c8b-5154d3251d53"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:45:10.669182 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.669053 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f49b7368-ef4c-4a61-8c8b-5154d3251d53-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "f49b7368-ef4c-4a61-8c8b-5154d3251d53" (UID: "f49b7368-ef4c-4a61-8c8b-5154d3251d53"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 16:45:10.669182 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.669171 2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f49b7368-ef4c-4a61-8c8b-5154d3251d53-alertmanager-main-db\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:10.669367 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.669190 2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f49b7368-ef4c-4a61-8c8b-5154d3251d53-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:10.669746 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.669462 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f49b7368-ef4c-4a61-8c8b-5154d3251d53-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "f49b7368-ef4c-4a61-8c8b-5154d3251d53" (UID: "f49b7368-ef4c-4a61-8c8b-5154d3251d53"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:45:10.671866 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.671723 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "f49b7368-ef4c-4a61-8c8b-5154d3251d53" (UID: "f49b7368-ef4c-4a61-8c8b-5154d3251d53"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:45:10.672342 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.672045 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "f49b7368-ef4c-4a61-8c8b-5154d3251d53" (UID: "f49b7368-ef4c-4a61-8c8b-5154d3251d53"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:45:10.672342 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.672081 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f49b7368-ef4c-4a61-8c8b-5154d3251d53-config-out" (OuterVolumeSpecName: "config-out") pod "f49b7368-ef4c-4a61-8c8b-5154d3251d53" (UID: "f49b7368-ef4c-4a61-8c8b-5154d3251d53"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 16:45:10.672342 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.672249 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "f49b7368-ef4c-4a61-8c8b-5154d3251d53" (UID: "f49b7368-ef4c-4a61-8c8b-5154d3251d53"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:45:10.672902 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.672870 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f49b7368-ef4c-4a61-8c8b-5154d3251d53-kube-api-access-4jk24" (OuterVolumeSpecName: "kube-api-access-4jk24") pod "f49b7368-ef4c-4a61-8c8b-5154d3251d53" (UID: "f49b7368-ef4c-4a61-8c8b-5154d3251d53"). InnerVolumeSpecName "kube-api-access-4jk24". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 16:45:10.673489 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.673431 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f49b7368-ef4c-4a61-8c8b-5154d3251d53-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f49b7368-ef4c-4a61-8c8b-5154d3251d53" (UID: "f49b7368-ef4c-4a61-8c8b-5154d3251d53"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 16:45:10.673999 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.673979 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-config-volume" (OuterVolumeSpecName: "config-volume") pod "f49b7368-ef4c-4a61-8c8b-5154d3251d53" (UID: "f49b7368-ef4c-4a61-8c8b-5154d3251d53"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:45:10.674336 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.674317 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "f49b7368-ef4c-4a61-8c8b-5154d3251d53" (UID: "f49b7368-ef4c-4a61-8c8b-5154d3251d53"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:45:10.679072 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.679020 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "f49b7368-ef4c-4a61-8c8b-5154d3251d53" (UID: "f49b7368-ef4c-4a61-8c8b-5154d3251d53"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:45:10.686778 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.686753 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-web-config" (OuterVolumeSpecName: "web-config") pod "f49b7368-ef4c-4a61-8c8b-5154d3251d53" (UID: "f49b7368-ef4c-4a61-8c8b-5154d3251d53"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:45:10.770226 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.770199 2574 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-cluster-tls-config\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:10.770226 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.770225 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:10.770409 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.770256 2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-web-config\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:10.770409 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.770265 2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f49b7368-ef4c-4a61-8c8b-5154d3251d53-config-out\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:10.770409 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.770274 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:10.770409 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.770283 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:10.770409 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.770290 2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f49b7368-ef4c-4a61-8c8b-5154d3251d53-tls-assets\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:10.770409 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.770298 2574 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f49b7368-ef4c-4a61-8c8b-5154d3251d53-metrics-client-ca\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:10.770409 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.770305 2574 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-config-volume\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:10.770409 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.770315 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f49b7368-ef4c-4a61-8c8b-5154d3251d53-secret-alertmanager-main-tls\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:10.770409 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:10.770322 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jk24\" (UniqueName: \"kubernetes.io/projected/f49b7368-ef4c-4a61-8c8b-5154d3251d53-kube-api-access-4jk24\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:11.534758 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:11.534728 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f49b7368-ef4c-4a61-8c8b-5154d3251d53","Type":"ContainerDied","Data":"84d29369e5db00cb1b8ce599b1ff6ae3af666b7d75ee6381cf1c64e1313fcf7c"} Sep 17 16:45:11.535097 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:11.534792 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:45:11.535097 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:11.534802 2574 scope.go:117] "RemoveContainer" containerID="02337c561fdedda877ca2fcf31c6d98af53f461f79096b64bbff51d05fdf3845" Sep 17 16:45:11.542584 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:11.542565 2574 scope.go:117] "RemoveContainer" containerID="5a82cc02aad7749db5ed00e7d816b7e20b56dab34e99339d2ac7a0abf9c2f5fd" Sep 17 16:45:11.550074 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:11.550058 2574 scope.go:117] "RemoveContainer" containerID="4710e06449ae957d157b2adefb80a4142b9abd22f7a6ba604daa073e33a9466d" Sep 17 16:45:11.556925 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:11.556880 2574 scope.go:117] "RemoveContainer" containerID="305b705e272dc1cea14b4a1276dde71e8aa1ba2d1062071be13d82136a977f78" Sep 17 16:45:11.559970 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:11.559949 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 16:45:11.564722 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:11.564703 2574 scope.go:117] "RemoveContainer" containerID="c68086c2bcbc024135a2840480f68bcb3797ee491920499c2c52ea823be2f2f7" Sep 17 16:45:11.572498 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:11.572480 2574 scope.go:117] "RemoveContainer" containerID="1999da334861ccc35a3240679fa95d959f98cbe62b5a2866464c4ae20f500eec" Sep 17 16:45:11.573479 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:11.573459 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 16:45:11.579432 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:11.579415 2574 scope.go:117] "RemoveContainer" containerID="397b16a8e90beaa52456bd8f5e1a348914b5df6b3f6599e4c271371be90c6d5b" Sep 17 16:45:12.328099 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:12.328066 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" path="/var/lib/kubelet/pods/f49b7368-ef4c-4a61-8c8b-5154d3251d53/volumes" Sep 17 16:45:12.353558 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:12.353535 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:45:12.423395 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:12.423373 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:45:13.563399 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.563360 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 16:45:13.563813 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.563746 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerName="prometheus" containerID="cri-o://3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3" gracePeriod=600 Sep 17 16:45:13.563813 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.563767 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerName="kube-rbac-proxy" containerID="cri-o://63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50" gracePeriod=600 Sep 17 16:45:13.563813 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.563794 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerName="kube-rbac-proxy-web" containerID="cri-o://03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b" gracePeriod=600 Sep 17 16:45:13.563984 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.563767 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerName="thanos-sidecar" containerID="cri-o://b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43" gracePeriod=600 Sep 17 16:45:13.563984 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.563898 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerName="config-reloader" containerID="cri-o://30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a" gracePeriod=600 Sep 17 16:45:13.563984 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.563961 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerName="kube-rbac-proxy-thanos" containerID="cri-o://d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc" gracePeriod=600 Sep 17 16:45:13.807187 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.807165 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:13.897034 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.896938 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-prometheus-k8s-rulefiles-0\") pod \"9aeaee4b-c374-4ca6-852e-b0361242985f\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " Sep 17 16:45:13.897034 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.896975 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"9aeaee4b-c374-4ca6-852e-b0361242985f\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " Sep 17 16:45:13.897034 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.896998 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-prometheus-k8s-tls\") pod \"9aeaee4b-c374-4ca6-852e-b0361242985f\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " Sep 17 16:45:13.897034 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.897032 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-thanos-prometheus-http-client-file\") pod \"9aeaee4b-c374-4ca6-852e-b0361242985f\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " Sep 17 16:45:13.897330 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.897058 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-metrics-client-certs\") pod \"9aeaee4b-c374-4ca6-852e-b0361242985f\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " Sep 17 16:45:13.897330 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.897082 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-grpc-tls\") pod \"9aeaee4b-c374-4ca6-852e-b0361242985f\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " Sep 17 16:45:13.897330 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.897109 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9aeaee4b-c374-4ca6-852e-b0361242985f-config-out\") pod \"9aeaee4b-c374-4ca6-852e-b0361242985f\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " Sep 17 16:45:13.897330 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.897133 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"9aeaee4b-c374-4ca6-852e-b0361242985f\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " Sep 17 16:45:13.897330 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.897165 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-prometheus-k8s-rulefiles-2\") pod \"9aeaee4b-c374-4ca6-852e-b0361242985f\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " Sep 17 16:45:13.897330 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.897197 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-config\") pod \"9aeaee4b-c374-4ca6-852e-b0361242985f\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " Sep 17 16:45:13.897330 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.897229 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9aeaee4b-c374-4ca6-852e-b0361242985f-prometheus-k8s-db\") pod \"9aeaee4b-c374-4ca6-852e-b0361242985f\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " Sep 17 16:45:13.897330 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.897254 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-prometheus-trusted-ca-bundle\") pod \"9aeaee4b-c374-4ca6-852e-b0361242985f\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " Sep 17 16:45:13.897330 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.897278 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-configmap-metrics-client-ca\") pod \"9aeaee4b-c374-4ca6-852e-b0361242985f\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " Sep 17 16:45:13.897330 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.897305 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9aeaee4b-c374-4ca6-852e-b0361242985f-tls-assets\") pod \"9aeaee4b-c374-4ca6-852e-b0361242985f\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " Sep 17 16:45:13.897838 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.897358 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-web-config\") pod \"9aeaee4b-c374-4ca6-852e-b0361242985f\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " Sep 17 16:45:13.899287 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.898722 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "9aeaee4b-c374-4ca6-852e-b0361242985f" (UID: "9aeaee4b-c374-4ca6-852e-b0361242985f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:45:13.899538 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.899497 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "9aeaee4b-c374-4ca6-852e-b0361242985f" (UID: "9aeaee4b-c374-4ca6-852e-b0361242985f"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:45:13.899997 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.899974 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpj6h\" (UniqueName: \"kubernetes.io/projected/9aeaee4b-c374-4ca6-852e-b0361242985f-kube-api-access-cpj6h\") pod \"9aeaee4b-c374-4ca6-852e-b0361242985f\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " Sep 17 16:45:13.900118 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.900018 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-configmap-kubelet-serving-ca-bundle\") pod \"9aeaee4b-c374-4ca6-852e-b0361242985f\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " Sep 17 16:45:13.900118 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.900026 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9aeaee4b-c374-4ca6-852e-b0361242985f-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "9aeaee4b-c374-4ca6-852e-b0361242985f" (UID: "9aeaee4b-c374-4ca6-852e-b0361242985f"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 16:45:13.900118 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.900054 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-kube-rbac-proxy\") pod \"9aeaee4b-c374-4ca6-852e-b0361242985f\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " Sep 17 16:45:13.900118 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.900084 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-prometheus-k8s-rulefiles-1\") pod \"9aeaee4b-c374-4ca6-852e-b0361242985f\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " Sep 17 16:45:13.900118 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.900113 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-configmap-serving-certs-ca-bundle\") pod \"9aeaee4b-c374-4ca6-852e-b0361242985f\" (UID: \"9aeaee4b-c374-4ca6-852e-b0361242985f\") " Sep 17 16:45:13.900428 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.900386 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:13.900428 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.900404 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9aeaee4b-c374-4ca6-852e-b0361242985f-prometheus-k8s-db\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:13.900428 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.900419 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-configmap-metrics-client-ca\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:13.900646 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.900546 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "9aeaee4b-c374-4ca6-852e-b0361242985f" (UID: "9aeaee4b-c374-4ca6-852e-b0361242985f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:45:13.900864 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.900831 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "9aeaee4b-c374-4ca6-852e-b0361242985f" (UID: "9aeaee4b-c374-4ca6-852e-b0361242985f"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:45:13.900993 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.900967 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "9aeaee4b-c374-4ca6-852e-b0361242985f" (UID: "9aeaee4b-c374-4ca6-852e-b0361242985f"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:45:13.901504 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.901421 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "9aeaee4b-c374-4ca6-852e-b0361242985f" (UID: "9aeaee4b-c374-4ca6-852e-b0361242985f"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:45:13.902059 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.902037 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "9aeaee4b-c374-4ca6-852e-b0361242985f" (UID: "9aeaee4b-c374-4ca6-852e-b0361242985f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:45:13.902336 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.902303 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-config" (OuterVolumeSpecName: "config") pod "9aeaee4b-c374-4ca6-852e-b0361242985f" (UID: "9aeaee4b-c374-4ca6-852e-b0361242985f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:45:13.902594 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.902568 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9aeaee4b-c374-4ca6-852e-b0361242985f-config-out" (OuterVolumeSpecName: "config-out") pod "9aeaee4b-c374-4ca6-852e-b0361242985f" (UID: "9aeaee4b-c374-4ca6-852e-b0361242985f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 16:45:13.902749 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.902728 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "9aeaee4b-c374-4ca6-852e-b0361242985f" (UID: "9aeaee4b-c374-4ca6-852e-b0361242985f"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:45:13.902827 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.902749 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "9aeaee4b-c374-4ca6-852e-b0361242985f" (UID: "9aeaee4b-c374-4ca6-852e-b0361242985f"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:45:13.902891 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.902823 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "9aeaee4b-c374-4ca6-852e-b0361242985f" (UID: "9aeaee4b-c374-4ca6-852e-b0361242985f"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:45:13.902891 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.902835 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "9aeaee4b-c374-4ca6-852e-b0361242985f" (UID: "9aeaee4b-c374-4ca6-852e-b0361242985f"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:45:13.902969 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.902923 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "9aeaee4b-c374-4ca6-852e-b0361242985f" (UID: "9aeaee4b-c374-4ca6-852e-b0361242985f"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:45:13.903253 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.903231 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "9aeaee4b-c374-4ca6-852e-b0361242985f" (UID: "9aeaee4b-c374-4ca6-852e-b0361242985f"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:45:13.904033 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.904014 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "9aeaee4b-c374-4ca6-852e-b0361242985f" (UID: "9aeaee4b-c374-4ca6-852e-b0361242985f"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:45:13.904349 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.904325 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9aeaee4b-c374-4ca6-852e-b0361242985f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9aeaee4b-c374-4ca6-852e-b0361242985f" (UID: "9aeaee4b-c374-4ca6-852e-b0361242985f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 16:45:13.904491 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.904369 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9aeaee4b-c374-4ca6-852e-b0361242985f-kube-api-access-cpj6h" (OuterVolumeSpecName: "kube-api-access-cpj6h") pod "9aeaee4b-c374-4ca6-852e-b0361242985f" (UID: "9aeaee4b-c374-4ca6-852e-b0361242985f"). InnerVolumeSpecName "kube-api-access-cpj6h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 16:45:13.913639 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:13.913311 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-web-config" (OuterVolumeSpecName: "web-config") pod "9aeaee4b-c374-4ca6-852e-b0361242985f" (UID: "9aeaee4b-c374-4ca6-852e-b0361242985f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:45:14.001507 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.001485 2574 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:14.001507 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.001506 2574 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-metrics-client-certs\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:14.001618 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.001515 2574 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-grpc-tls\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:14.001618 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.001524 2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9aeaee4b-c374-4ca6-852e-b0361242985f-config-out\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:14.001618 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.001532 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:14.001618 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.001541 2574 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-config\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:14.001618 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.001548 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:14.001618 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.001556 2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9aeaee4b-c374-4ca6-852e-b0361242985f-tls-assets\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:14.001618 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.001564 2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-web-config\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:14.001618 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.001570 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpj6h\" (UniqueName: \"kubernetes.io/projected/9aeaee4b-c374-4ca6-852e-b0361242985f-kube-api-access-cpj6h\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:14.001618 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.001578 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:14.001618 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.001586 2574 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-kube-rbac-proxy\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:14.001618 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.001596 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:14.001618 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.001604 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:14.001618 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.001612 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9aeaee4b-c374-4ca6-852e-b0361242985f-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:14.001618 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.001621 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:14.001996 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.001629 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9aeaee4b-c374-4ca6-852e-b0361242985f-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:45:14.553707 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.553676 2574 generic.go:356] "Generic (PLEG): container finished" podID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerID="d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc" exitCode=0 Sep 17 16:45:14.553707 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.553698 2574 generic.go:356] "Generic (PLEG): container finished" podID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerID="63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50" exitCode=0 Sep 17 16:45:14.553707 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.553704 2574 generic.go:356] "Generic (PLEG): container finished" podID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerID="03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b" exitCode=0 Sep 17 16:45:14.553707 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.553709 2574 generic.go:356] "Generic (PLEG): container finished" podID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerID="b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43" exitCode=0 Sep 17 16:45:14.553707 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.553713 2574 generic.go:356] "Generic (PLEG): container finished" podID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerID="30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a" exitCode=0 Sep 17 16:45:14.553707 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.553718 2574 generic.go:356] "Generic (PLEG): container finished" podID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerID="3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3" exitCode=0 Sep 17 16:45:14.554139 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.553757 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9aeaee4b-c374-4ca6-852e-b0361242985f","Type":"ContainerDied","Data":"d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc"} Sep 17 16:45:14.554139 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.553781 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.554139 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.553829 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9aeaee4b-c374-4ca6-852e-b0361242985f","Type":"ContainerDied","Data":"63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50"} Sep 17 16:45:14.554139 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.553857 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9aeaee4b-c374-4ca6-852e-b0361242985f","Type":"ContainerDied","Data":"03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b"} Sep 17 16:45:14.554139 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.553885 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9aeaee4b-c374-4ca6-852e-b0361242985f","Type":"ContainerDied","Data":"b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43"} Sep 17 16:45:14.554139 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.553909 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9aeaee4b-c374-4ca6-852e-b0361242985f","Type":"ContainerDied","Data":"30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a"} Sep 17 16:45:14.554139 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.553937 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9aeaee4b-c374-4ca6-852e-b0361242985f","Type":"ContainerDied","Data":"3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3"} Sep 17 16:45:14.554139 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.553960 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9aeaee4b-c374-4ca6-852e-b0361242985f","Type":"ContainerDied","Data":"982576bc61edc5af33c9cb6dcf075f2afba63ad907705b978557c31e9a197138"} Sep 17 16:45:14.554139 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.553906 2574 scope.go:117] "RemoveContainer" containerID="d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc" Sep 17 16:45:14.561974 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.561957 2574 scope.go:117] "RemoveContainer" containerID="63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50" Sep 17 16:45:14.570777 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.570629 2574 scope.go:117] "RemoveContainer" containerID="03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b" Sep 17 16:45:14.577908 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.577890 2574 scope.go:117] "RemoveContainer" containerID="b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43" Sep 17 16:45:14.578975 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.578956 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 16:45:14.583689 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.583468 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 16:45:14.595745 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.595729 2574 scope.go:117] "RemoveContainer" containerID="30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a" Sep 17 16:45:14.602706 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.602690 2574 scope.go:117] "RemoveContainer" containerID="3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3" Sep 17 16:45:14.610833 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.610806 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 16:45:14.611285 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611266 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerName="thanos-sidecar" Sep 17 16:45:14.611328 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611291 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerName="thanos-sidecar" Sep 17 16:45:14.611328 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611305 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerName="kube-rbac-proxy-web" Sep 17 16:45:14.611328 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611314 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerName="kube-rbac-proxy-web" Sep 17 16:45:14.611328 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611324 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerName="kube-rbac-proxy" Sep 17 16:45:14.611496 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611332 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerName="kube-rbac-proxy" Sep 17 16:45:14.611496 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611343 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerName="kube-rbac-proxy-metric" Sep 17 16:45:14.611496 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611351 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerName="kube-rbac-proxy-metric" Sep 17 16:45:14.611496 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611361 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f05fdaf-53cf-4545-a9f6-a83b896fb066" containerName="console" Sep 17 16:45:14.611496 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611369 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f05fdaf-53cf-4545-a9f6-a83b896fb066" containerName="console" Sep 17 16:45:14.611496 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611379 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerName="prom-label-proxy" Sep 17 16:45:14.611496 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611387 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerName="prom-label-proxy" Sep 17 16:45:14.611496 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611402 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c665984-e24b-4a20-9cf7-d1aa84249b6e" containerName="console" Sep 17 16:45:14.611496 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611409 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c665984-e24b-4a20-9cf7-d1aa84249b6e" containerName="console" Sep 17 16:45:14.611496 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611418 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerName="init-config-reloader" Sep 17 16:45:14.611496 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611426 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerName="init-config-reloader" Sep 17 16:45:14.611496 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611458 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerName="config-reloader" Sep 17 16:45:14.611496 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611466 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerName="config-reloader" Sep 17 16:45:14.611496 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611476 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerName="prometheus" Sep 17 16:45:14.611496 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611485 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerName="prometheus" Sep 17 16:45:14.611496 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611497 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerName="alertmanager" Sep 17 16:45:14.611496 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611506 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerName="alertmanager" Sep 17 16:45:14.612188 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611519 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerName="init-config-reloader" Sep 17 16:45:14.612188 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611526 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerName="init-config-reloader" Sep 17 16:45:14.612188 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611538 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerName="kube-rbac-proxy" Sep 17 16:45:14.612188 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611546 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerName="kube-rbac-proxy" Sep 17 16:45:14.612188 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611556 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerName="kube-rbac-proxy-web" Sep 17 16:45:14.612188 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611562 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerName="kube-rbac-proxy-web" Sep 17 16:45:14.612188 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611569 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerName="kube-rbac-proxy-thanos" Sep 17 16:45:14.612188 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611575 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerName="kube-rbac-proxy-thanos" Sep 17 16:45:14.612188 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611583 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerName="config-reloader" Sep 17 16:45:14.612188 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611587 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerName="config-reloader" Sep 17 16:45:14.612188 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611592 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8141abaa-13c3-40c8-8ba6-fc3bba21daf4" containerName="registry" Sep 17 16:45:14.612188 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611596 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8141abaa-13c3-40c8-8ba6-fc3bba21daf4" containerName="registry" Sep 17 16:45:14.612188 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611633 2574 scope.go:117] "RemoveContainer" containerID="e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6" Sep 17 16:45:14.612188 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611683 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerName="kube-rbac-proxy-metric" Sep 17 16:45:14.612188 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611691 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerName="kube-rbac-proxy-thanos" Sep 17 16:45:14.612188 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611697 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerName="alertmanager" Sep 17 16:45:14.612188 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611706 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerName="config-reloader" Sep 17 16:45:14.612188 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611715 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerName="kube-rbac-proxy-web" Sep 17 16:45:14.612188 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611724 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c665984-e24b-4a20-9cf7-d1aa84249b6e" containerName="console" Sep 17 16:45:14.612188 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611732 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerName="kube-rbac-proxy" Sep 17 16:45:14.612188 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611737 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerName="kube-rbac-proxy-web" Sep 17 16:45:14.612188 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611742 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerName="config-reloader" Sep 17 16:45:14.612188 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611747 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f49b7368-ef4c-4a61-8c8b-5154d3251d53" containerName="prom-label-proxy" Sep 17 16:45:14.612188 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611752 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerName="kube-rbac-proxy" Sep 17 16:45:14.612188 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611765 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8141abaa-13c3-40c8-8ba6-fc3bba21daf4" containerName="registry" Sep 17 16:45:14.612188 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611774 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerName="thanos-sidecar" Sep 17 16:45:14.612188 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611780 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9aeaee4b-c374-4ca6-852e-b0361242985f" containerName="prometheus" Sep 17 16:45:14.612188 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.611788 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f05fdaf-53cf-4545-a9f6-a83b896fb066" containerName="console" Sep 17 16:45:14.614960 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.614942 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.617835 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.617814 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 16:45:14.617927 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.617866 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 16:45:14.617927 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.617823 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 16:45:14.618137 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.618119 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 16:45:14.618285 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.618268 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 16:45:14.618285 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.618282 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 16:45:14.618396 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.618349 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 16:45:14.618396 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.618363 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 16:45:14.618524 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.618485 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fujjb17eve9ep\"" Sep 17 16:45:14.618705 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.618685 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 16:45:14.618809 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.618743 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sw2js\"" Sep 17 16:45:14.618809 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.618763 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 16:45:14.618906 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.618851 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 16:45:14.618953 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.618933 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 16:45:14.621140 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.621067 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 16:45:14.621202 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.621158 2574 scope.go:117] "RemoveContainer" containerID="d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc" Sep 17 16:45:14.621481 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:45:14.621459 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc\": container with ID starting with d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc not found: ID does not exist" containerID="d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc" Sep 17 16:45:14.621556 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.621493 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc"} err="failed to get container status \"d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc\": rpc error: code = NotFound desc = could not find container \"d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc\": container with ID starting with d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc not found: ID does not exist" Sep 17 16:45:14.621556 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.621537 2574 scope.go:117] "RemoveContainer" containerID="63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50" Sep 17 16:45:14.621838 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:45:14.621822 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50\": container with ID starting with 63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50 not found: ID does not exist" containerID="63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50" Sep 17 16:45:14.621894 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.621844 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50"} err="failed to get container status \"63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50\": rpc error: code = NotFound desc = could not find container \"63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50\": container with ID starting with 63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50 not found: ID does not exist" Sep 17 16:45:14.621894 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.621864 2574 scope.go:117] "RemoveContainer" containerID="03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b" Sep 17 16:45:14.622154 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:45:14.622128 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b\": container with ID starting with 03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b not found: ID does not exist" containerID="03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b" Sep 17 16:45:14.622226 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.622164 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b"} err="failed to get container status \"03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b\": rpc error: code = NotFound desc = could not find container \"03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b\": container with ID starting with 03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b not found: ID does not exist" Sep 17 16:45:14.622226 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.622184 2574 scope.go:117] "RemoveContainer" containerID="b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43" Sep 17 16:45:14.622498 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:45:14.622478 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43\": container with ID starting with b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43 not found: ID does not exist" containerID="b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43" Sep 17 16:45:14.622571 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.622503 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43"} err="failed to get container status \"b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43\": rpc error: code = NotFound desc = could not find container \"b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43\": container with ID starting with b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43 not found: ID does not exist" Sep 17 16:45:14.622571 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.622518 2574 scope.go:117] "RemoveContainer" containerID="30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a" Sep 17 16:45:14.622908 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:45:14.622889 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a\": container with ID starting with 30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a not found: ID does not exist" containerID="30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a" Sep 17 16:45:14.622991 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.622913 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a"} err="failed to get container status \"30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a\": rpc error: code = NotFound desc = could not find container \"30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a\": container with ID starting with 30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a not found: ID does not exist" Sep 17 16:45:14.622991 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.622931 2574 scope.go:117] "RemoveContainer" containerID="3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3" Sep 17 16:45:14.623209 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:45:14.623188 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3\": container with ID starting with 3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3 not found: ID does not exist" containerID="3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3" Sep 17 16:45:14.623286 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.623218 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3"} err="failed to get container status \"3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3\": rpc error: code = NotFound desc = could not find container \"3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3\": container with ID starting with 3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3 not found: ID does not exist" Sep 17 16:45:14.623286 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.623238 2574 scope.go:117] "RemoveContainer" containerID="e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6" Sep 17 16:45:14.623593 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:45:14.623576 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6\": container with ID starting with e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6 not found: ID does not exist" containerID="e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6" Sep 17 16:45:14.623683 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.623601 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6"} err="failed to get container status \"e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6\": rpc error: code = NotFound desc = could not find container \"e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6\": container with ID starting with e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6 not found: ID does not exist" Sep 17 16:45:14.623683 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.623621 2574 scope.go:117] "RemoveContainer" containerID="d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc" Sep 17 16:45:14.624002 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.623927 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc"} err="failed to get container status \"d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc\": rpc error: code = NotFound desc = could not find container \"d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc\": container with ID starting with d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc not found: ID does not exist" Sep 17 16:45:14.624002 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.623949 2574 scope.go:117] "RemoveContainer" containerID="63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50" Sep 17 16:45:14.624317 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.624295 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50"} err="failed to get container status \"63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50\": rpc error: code = NotFound desc = could not find container \"63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50\": container with ID starting with 63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50 not found: ID does not exist" Sep 17 16:45:14.624426 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.624319 2574 scope.go:117] "RemoveContainer" containerID="03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b" Sep 17 16:45:14.624692 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.624645 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b"} err="failed to get container status \"03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b\": rpc error: code = NotFound desc = could not find container \"03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b\": container with ID starting with 03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b not found: ID does not exist" Sep 17 16:45:14.624756 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.624694 2574 scope.go:117] "RemoveContainer" containerID="b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43" Sep 17 16:45:14.624978 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.624957 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43"} err="failed to get container status \"b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43\": rpc error: code = NotFound desc = could not find container \"b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43\": container with ID starting with b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43 not found: ID does not exist" Sep 17 16:45:14.624978 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.624977 2574 scope.go:117] "RemoveContainer" containerID="30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a" Sep 17 16:45:14.625289 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.625269 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a"} err="failed to get container status \"30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a\": rpc error: code = NotFound desc = could not find container \"30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a\": container with ID starting with 30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a not found: ID does not exist" Sep 17 16:45:14.625343 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.625289 2574 scope.go:117] "RemoveContainer" containerID="3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3" Sep 17 16:45:14.625588 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.625568 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3"} err="failed to get container status \"3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3\": rpc error: code = NotFound desc = could not find container \"3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3\": container with ID starting with 3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3 not found: ID does not exist" Sep 17 16:45:14.625638 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.625589 2574 scope.go:117] "RemoveContainer" containerID="e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6" Sep 17 16:45:14.625893 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.625874 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6"} err="failed to get container status \"e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6\": rpc error: code = NotFound desc = could not find container \"e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6\": container with ID starting with e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6 not found: ID does not exist" Sep 17 16:45:14.625991 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.625893 2574 scope.go:117] "RemoveContainer" containerID="d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc" Sep 17 16:45:14.626133 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.626115 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc"} err="failed to get container status \"d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc\": rpc error: code = NotFound desc = could not find container \"d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc\": container with ID starting with d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc not found: ID does not exist" Sep 17 16:45:14.626204 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.626144 2574 scope.go:117] "RemoveContainer" containerID="63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50" Sep 17 16:45:14.626318 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.626300 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 16:45:14.626488 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.626462 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50"} err="failed to get container status \"63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50\": rpc error: code = NotFound desc = could not find container \"63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50\": container with ID starting with 63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50 not found: ID does not exist" Sep 17 16:45:14.626488 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.626488 2574 scope.go:117] "RemoveContainer" containerID="03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b" Sep 17 16:45:14.626751 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.626734 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b"} err="failed to get container status \"03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b\": rpc error: code = NotFound desc = could not find container \"03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b\": container with ID starting with 03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b not found: ID does not exist" Sep 17 16:45:14.626799 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.626752 2574 scope.go:117] "RemoveContainer" containerID="b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43" Sep 17 16:45:14.627003 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.626984 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43"} err="failed to get container status \"b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43\": rpc error: code = NotFound desc = could not find container \"b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43\": container with ID starting with b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43 not found: ID does not exist" Sep 17 16:45:14.627045 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.627006 2574 scope.go:117] "RemoveContainer" containerID="30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a" Sep 17 16:45:14.627239 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.627217 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a"} err="failed to get container status \"30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a\": rpc error: code = NotFound desc = could not find container \"30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a\": container with ID starting with 30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a not found: ID does not exist" Sep 17 16:45:14.627239 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.627237 2574 scope.go:117] "RemoveContainer" containerID="3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3" Sep 17 16:45:14.627489 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.627472 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3"} err="failed to get container status \"3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3\": rpc error: code = NotFound desc = could not find container \"3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3\": container with ID starting with 3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3 not found: ID does not exist" Sep 17 16:45:14.627529 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.627491 2574 scope.go:117] "RemoveContainer" containerID="e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6" Sep 17 16:45:14.627724 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.627706 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6"} err="failed to get container status \"e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6\": rpc error: code = NotFound desc = could not find container \"e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6\": container with ID starting with e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6 not found: ID does not exist" Sep 17 16:45:14.627774 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.627724 2574 scope.go:117] "RemoveContainer" containerID="d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc" Sep 17 16:45:14.627951 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.627933 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc"} err="failed to get container status \"d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc\": rpc error: code = NotFound desc = could not find container \"d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc\": container with ID starting with d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc not found: ID does not exist" Sep 17 16:45:14.627988 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.627953 2574 scope.go:117] "RemoveContainer" containerID="63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50" Sep 17 16:45:14.628158 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.628142 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50"} err="failed to get container status \"63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50\": rpc error: code = NotFound desc = could not find container \"63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50\": container with ID starting with 63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50 not found: ID does not exist" Sep 17 16:45:14.628190 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.628159 2574 scope.go:117] "RemoveContainer" containerID="03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b" Sep 17 16:45:14.628365 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.628350 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b"} err="failed to get container status \"03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b\": rpc error: code = NotFound desc = could not find container \"03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b\": container with ID starting with 03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b not found: ID does not exist" Sep 17 16:45:14.628398 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.628366 2574 scope.go:117] "RemoveContainer" containerID="b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43" Sep 17 16:45:14.628608 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.628587 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43"} err="failed to get container status \"b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43\": rpc error: code = NotFound desc = could not find container \"b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43\": container with ID starting with b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43 not found: ID does not exist" Sep 17 16:45:14.628670 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.628610 2574 scope.go:117] "RemoveContainer" containerID="30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a" Sep 17 16:45:14.628872 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.628847 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a"} err="failed to get container status \"30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a\": rpc error: code = NotFound desc = could not find container \"30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a\": container with ID starting with 30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a not found: ID does not exist" Sep 17 16:45:14.628872 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.628872 2574 scope.go:117] "RemoveContainer" containerID="3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3" Sep 17 16:45:14.629184 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.629143 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3"} err="failed to get container status \"3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3\": rpc error: code = NotFound desc = could not find container \"3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3\": container with ID starting with 3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3 not found: ID does not exist" Sep 17 16:45:14.629184 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.629173 2574 scope.go:117] "RemoveContainer" containerID="e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6" Sep 17 16:45:14.629537 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.629507 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6"} err="failed to get container status \"e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6\": rpc error: code = NotFound desc = could not find container \"e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6\": container with ID starting with e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6 not found: ID does not exist" Sep 17 16:45:14.629537 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.629538 2574 scope.go:117] "RemoveContainer" containerID="d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc" Sep 17 16:45:14.629812 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.629784 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc"} err="failed to get container status \"d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc\": rpc error: code = NotFound desc = could not find container \"d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc\": container with ID starting with d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc not found: ID does not exist" Sep 17 16:45:14.629812 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.629809 2574 scope.go:117] "RemoveContainer" containerID="63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50" Sep 17 16:45:14.630106 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.630080 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50"} err="failed to get container status \"63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50\": rpc error: code = NotFound desc = could not find container \"63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50\": container with ID starting with 63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50 not found: ID does not exist" Sep 17 16:45:14.630106 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.630106 2574 scope.go:117] "RemoveContainer" containerID="03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b" Sep 17 16:45:14.630813 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.630790 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b"} err="failed to get container status \"03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b\": rpc error: code = NotFound desc = could not find container \"03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b\": container with ID starting with 03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b not found: ID does not exist" Sep 17 16:45:14.630872 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.630815 2574 scope.go:117] "RemoveContainer" containerID="b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43" Sep 17 16:45:14.631079 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.631056 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43"} err="failed to get container status \"b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43\": rpc error: code = NotFound desc = could not find container \"b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43\": container with ID starting with b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43 not found: ID does not exist" Sep 17 16:45:14.631130 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.631083 2574 scope.go:117] "RemoveContainer" containerID="30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a" Sep 17 16:45:14.631342 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.631323 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a"} err="failed to get container status \"30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a\": rpc error: code = NotFound desc = could not find container \"30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a\": container with ID starting with 30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a not found: ID does not exist" Sep 17 16:45:14.631398 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.631345 2574 scope.go:117] "RemoveContainer" containerID="3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3" Sep 17 16:45:14.631655 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.631638 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3"} err="failed to get container status \"3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3\": rpc error: code = NotFound desc = could not find container \"3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3\": container with ID starting with 3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3 not found: ID does not exist" Sep 17 16:45:14.631697 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.631656 2574 scope.go:117] "RemoveContainer" containerID="e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6" Sep 17 16:45:14.631915 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.631897 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6"} err="failed to get container status \"e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6\": rpc error: code = NotFound desc = could not find container \"e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6\": container with ID starting with e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6 not found: ID does not exist" Sep 17 16:45:14.631971 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.631915 2574 scope.go:117] "RemoveContainer" containerID="d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc" Sep 17 16:45:14.632053 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.632005 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 16:45:14.632184 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.632165 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc"} err="failed to get container status \"d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc\": rpc error: code = NotFound desc = could not find container \"d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc\": container with ID starting with d8cf763055f26ff816ee8b563a5fe5b41b2451c4600b3fd80d5a3a414fb370dc not found: ID does not exist" Sep 17 16:45:14.632225 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.632188 2574 scope.go:117] "RemoveContainer" containerID="63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50" Sep 17 16:45:14.632487 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.632465 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50"} err="failed to get container status \"63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50\": rpc error: code = NotFound desc = could not find container \"63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50\": container with ID starting with 63364e17ff6b4fea052e48883cff55f9f38adc781512fd43f6bc87e950ad8f50 not found: ID does not exist" Sep 17 16:45:14.632547 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.632490 2574 scope.go:117] "RemoveContainer" containerID="03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b" Sep 17 16:45:14.632745 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.632723 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b"} err="failed to get container status \"03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b\": rpc error: code = NotFound desc = could not find container \"03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b\": container with ID starting with 03ed84d0293b4f70d0392814a780aa007b0de0cb3c3d0eb17fd24a18d5e4246b not found: ID does not exist" Sep 17 16:45:14.632802 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.632746 2574 scope.go:117] "RemoveContainer" containerID="b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43" Sep 17 16:45:14.632988 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.632965 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43"} err="failed to get container status \"b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43\": rpc error: code = NotFound desc = could not find container \"b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43\": container with ID starting with b207f981c98b3fc2aa720b1cf8e4cd4257f2a5d3e88083dd4e3d3a0f54686b43 not found: ID does not exist" Sep 17 16:45:14.633080 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.632989 2574 scope.go:117] "RemoveContainer" containerID="30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a" Sep 17 16:45:14.633353 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.633289 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a"} err="failed to get container status \"30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a\": rpc error: code = NotFound desc = could not find container \"30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a\": container with ID starting with 30d839d0cee21bcf752f5b604673edce211f8b7bbb075af38a83de4f90fdc10a not found: ID does not exist" Sep 17 16:45:14.633353 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.633337 2574 scope.go:117] "RemoveContainer" containerID="3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3" Sep 17 16:45:14.633648 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.633625 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3"} err="failed to get container status \"3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3\": rpc error: code = NotFound desc = could not find container \"3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3\": container with ID starting with 3d2319b1b2546bbef7eca3732c31897f26b904c1d23b273ff17089d32528acd3 not found: ID does not exist" Sep 17 16:45:14.633648 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.633648 2574 scope.go:117] "RemoveContainer" containerID="e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6" Sep 17 16:45:14.636114 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.633917 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6"} err="failed to get container status \"e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6\": rpc error: code = NotFound desc = could not find container \"e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6\": container with ID starting with e552f08d00f04d51701c1558108e0dea7aa10f77c06b92275c4bd00c89b1d2d6 not found: ID does not exist" Sep 17 16:45:14.705927 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.705897 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31dd95c5-1214-42f2-b124-14c43097aa18-config-out\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.705927 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.705932 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31dd95c5-1214-42f2-b124-14c43097aa18-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.706150 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.705949 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/31dd95c5-1214-42f2-b124-14c43097aa18-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.706150 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.705964 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31dd95c5-1214-42f2-b124-14c43097aa18-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.706150 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.706007 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31dd95c5-1214-42f2-b124-14c43097aa18-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.706150 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.706032 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/31dd95c5-1214-42f2-b124-14c43097aa18-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.706150 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.706063 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31dd95c5-1214-42f2-b124-14c43097aa18-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.706150 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.706134 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/31dd95c5-1214-42f2-b124-14c43097aa18-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.706372 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.706170 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31dd95c5-1214-42f2-b124-14c43097aa18-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.706372 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.706201 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/31dd95c5-1214-42f2-b124-14c43097aa18-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.706372 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.706240 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8mkz\" (UniqueName: \"kubernetes.io/projected/31dd95c5-1214-42f2-b124-14c43097aa18-kube-api-access-l8mkz\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.706372 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.706260 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/31dd95c5-1214-42f2-b124-14c43097aa18-config\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.706372 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.706289 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/31dd95c5-1214-42f2-b124-14c43097aa18-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.706372 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.706306 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/31dd95c5-1214-42f2-b124-14c43097aa18-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.706372 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.706324 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31dd95c5-1214-42f2-b124-14c43097aa18-web-config\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.706372 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.706357 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/31dd95c5-1214-42f2-b124-14c43097aa18-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.706707 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.706400 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31dd95c5-1214-42f2-b124-14c43097aa18-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.706707 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.706466 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31dd95c5-1214-42f2-b124-14c43097aa18-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.706707 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.706492 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/31dd95c5-1214-42f2-b124-14c43097aa18-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.706707 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.706522 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/31dd95c5-1214-42f2-b124-14c43097aa18-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.806856 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.806828 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31dd95c5-1214-42f2-b124-14c43097aa18-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.806856 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.806855 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/31dd95c5-1214-42f2-b124-14c43097aa18-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.807112 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.806874 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/31dd95c5-1214-42f2-b124-14c43097aa18-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.807112 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.806891 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31dd95c5-1214-42f2-b124-14c43097aa18-config-out\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.807112 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.806913 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31dd95c5-1214-42f2-b124-14c43097aa18-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.807112 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.806936 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/31dd95c5-1214-42f2-b124-14c43097aa18-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.807112 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.806962 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31dd95c5-1214-42f2-b124-14c43097aa18-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.807112 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.806986 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31dd95c5-1214-42f2-b124-14c43097aa18-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.807112 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.807014 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/31dd95c5-1214-42f2-b124-14c43097aa18-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.807112 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.807036 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31dd95c5-1214-42f2-b124-14c43097aa18-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.807112 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.807069 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/31dd95c5-1214-42f2-b124-14c43097aa18-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.807112 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.807092 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31dd95c5-1214-42f2-b124-14c43097aa18-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.807112 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.807115 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/31dd95c5-1214-42f2-b124-14c43097aa18-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.807667 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.807142 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8mkz\" (UniqueName: \"kubernetes.io/projected/31dd95c5-1214-42f2-b124-14c43097aa18-kube-api-access-l8mkz\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.807667 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.807173 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/31dd95c5-1214-42f2-b124-14c43097aa18-config\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.807667 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.807208 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/31dd95c5-1214-42f2-b124-14c43097aa18-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.807667 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.807234 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/31dd95c5-1214-42f2-b124-14c43097aa18-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.807667 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.807265 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31dd95c5-1214-42f2-b124-14c43097aa18-web-config\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.807667 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.807308 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/31dd95c5-1214-42f2-b124-14c43097aa18-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.807667 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.807342 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31dd95c5-1214-42f2-b124-14c43097aa18-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.807667 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.807476 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/31dd95c5-1214-42f2-b124-14c43097aa18-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.808216 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.807749 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/31dd95c5-1214-42f2-b124-14c43097aa18-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.808216 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.808006 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31dd95c5-1214-42f2-b124-14c43097aa18-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.808216 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.808211 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31dd95c5-1214-42f2-b124-14c43097aa18-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.810017 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.809985 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31dd95c5-1214-42f2-b124-14c43097aa18-config-out\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.810194 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.810173 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31dd95c5-1214-42f2-b124-14c43097aa18-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.810673 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.810647 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31dd95c5-1214-42f2-b124-14c43097aa18-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.811186 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.811161 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/31dd95c5-1214-42f2-b124-14c43097aa18-config\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.811349 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.811323 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/31dd95c5-1214-42f2-b124-14c43097aa18-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.811642 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.811621 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/31dd95c5-1214-42f2-b124-14c43097aa18-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.812027 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.812001 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31dd95c5-1214-42f2-b124-14c43097aa18-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.812116 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.812075 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/31dd95c5-1214-42f2-b124-14c43097aa18-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.812917 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.812888 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31dd95c5-1214-42f2-b124-14c43097aa18-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.813475 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.813127 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/31dd95c5-1214-42f2-b124-14c43097aa18-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.813475 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.813451 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/31dd95c5-1214-42f2-b124-14c43097aa18-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.813766 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.813745 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31dd95c5-1214-42f2-b124-14c43097aa18-web-config\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.814033 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.814005 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/31dd95c5-1214-42f2-b124-14c43097aa18-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.814259 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.814209 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/31dd95c5-1214-42f2-b124-14c43097aa18-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.814392 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.814375 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31dd95c5-1214-42f2-b124-14c43097aa18-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.816552 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.816526 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8mkz\" (UniqueName: \"kubernetes.io/projected/31dd95c5-1214-42f2-b124-14c43097aa18-kube-api-access-l8mkz\") pod \"prometheus-k8s-0\" (UID: \"31dd95c5-1214-42f2-b124-14c43097aa18\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:14.927522 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:14.927501 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:15.211831 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:15.211728 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 16:45:15.215482 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:45:15.215453 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31dd95c5_1214_42f2_b124_14c43097aa18.slice/crio-514bd71abd841e9c4acc4b43072bdc1bd21e4a3f3c99cd7581ea143a22fdba54 WatchSource:0}: Error finding container 514bd71abd841e9c4acc4b43072bdc1bd21e4a3f3c99cd7581ea143a22fdba54: Status 404 returned error can't find the container with id 514bd71abd841e9c4acc4b43072bdc1bd21e4a3f3c99cd7581ea143a22fdba54 Sep 17 16:45:15.561013 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:15.560919 2574 generic.go:356] "Generic (PLEG): container finished" podID="31dd95c5-1214-42f2-b124-14c43097aa18" containerID="f95b3c6ed3a93b8f0bd7cc613cbdebd165bb0311554aa7fcefdfd8f0dccad706" exitCode=0 Sep 17 16:45:15.561013 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:15.560956 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31dd95c5-1214-42f2-b124-14c43097aa18","Type":"ContainerDied","Data":"f95b3c6ed3a93b8f0bd7cc613cbdebd165bb0311554aa7fcefdfd8f0dccad706"} Sep 17 16:45:15.561220 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:15.561037 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31dd95c5-1214-42f2-b124-14c43097aa18","Type":"ContainerStarted","Data":"514bd71abd841e9c4acc4b43072bdc1bd21e4a3f3c99cd7581ea143a22fdba54"} Sep 17 16:45:16.327824 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:16.327793 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9aeaee4b-c374-4ca6-852e-b0361242985f" path="/var/lib/kubelet/pods/9aeaee4b-c374-4ca6-852e-b0361242985f/volumes" Sep 17 16:45:16.569312 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:16.569276 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31dd95c5-1214-42f2-b124-14c43097aa18","Type":"ContainerStarted","Data":"184b7ff8a5628ca249273835df930e7357f908264842576baa895b233d72c871"} Sep 17 16:45:16.569518 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:16.569350 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31dd95c5-1214-42f2-b124-14c43097aa18","Type":"ContainerStarted","Data":"334f37d90f4f47b402cceafebe9a4ba95f050c432f3a0dac82b50a84a6461917"} Sep 17 16:45:16.569518 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:16.569386 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31dd95c5-1214-42f2-b124-14c43097aa18","Type":"ContainerStarted","Data":"018d77d73fe45f5b660ecb45f229f809ec67c1357d8ab0cf63912c8affe759ea"} Sep 17 16:45:16.569518 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:16.569428 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31dd95c5-1214-42f2-b124-14c43097aa18","Type":"ContainerStarted","Data":"b897ca06e225f482ced49ff1961235e907a9010ae09e6ead7f531579f18f85e3"} Sep 17 16:45:16.569518 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:16.569483 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31dd95c5-1214-42f2-b124-14c43097aa18","Type":"ContainerStarted","Data":"fd9204c54c5481055b824ecb06e301100c458a344b613a38691b84c1b23e79f0"} Sep 17 16:45:16.569518 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:16.569518 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31dd95c5-1214-42f2-b124-14c43097aa18","Type":"ContainerStarted","Data":"c7b8e92d414b90dc2eda0a6e0b2315bee2a03eab931b3660a5a91f007815fe8b"} Sep 17 16:45:16.600940 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:16.600836 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.5842784720000003 podStartE2EDuration="2.6008156s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.537128ms" isStatefulPod=false podCreationTimestamp="2026-09-17 16:45:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:45:16.598951913 +0000 UTC m=+212.794946073" watchObservedRunningTime="2026-09-17 16:45:16.6008156 +0000 UTC m=+212.796809746" Sep 17 16:45:16.918879 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:16.918783 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:45:17.019622 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:17.019589 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:45:17.543389 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:17.543355 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:45:17.643314 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:17.643283 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:45:17.716281 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:17.716256 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:45:19.500880 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:19.500849 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:45:19.599487 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:19.599430 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:45:19.892412 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:19.892341 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:45:19.927985 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:19.927963 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:45:38.023638 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:45:38.023598 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:46:14.928660 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:46:14.928574 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:46:14.944314 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:46:14.944287 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:46:15.834823 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:46:15.834798 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:46:28.291044 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:46:28.291010 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:46:44.213253 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:46:44.213224 2574 kubelet.go:1648] "Image garbage collection succeeded" Sep 17 16:47:04.273352 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:47:04.273319 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:47:04.371002 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:47:04.370966 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:47:04.472030 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:47:04.471997 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:47:27.017005 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:47:27.016973 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:47:28.279020 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:47:28.278972 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:47:33.171445 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:47:33.171413 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:47:33.487591 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:47:33.487559 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:47:33.831117 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:47:33.831030 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:47:33.959594 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:47:33.959567 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:47:34.040957 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:47:34.040926 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:47:34.535997 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:47:34.535966 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:47:34.643488 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:47:34.643428 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:47:34.737369 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:47:34.737339 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:47:34.938336 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:47:34.938306 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:47:35.182203 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:47:35.182169 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:47:35.280710 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:47:35.280640 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:48:16.564225 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:48:16.564189 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:48:25.477102 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:48:25.477070 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:48:25.579957 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:48:25.579913 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:48:26.421133 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:48:26.421096 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:48:26.503045 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:48:26.503014 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:48:47.394228 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:48:47.394188 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:48:47.470504 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:48:47.470470 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:48:49.233271 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:48:49.233240 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:48:49.333321 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:48:49.333292 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:48:52.321068 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:48:52.321040 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:48:52.415146 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:48:52.415115 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:48:52.484358 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:48:52.484313 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:48:52.584038 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:48:52.583961 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:48:53.049100 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:48:53.049067 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:48:53.151408 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:48:53.151378 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:48:53.249626 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:48:53.249598 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:49:00.989331 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:49:00.989294 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:49:01.158912 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:49:01.158880 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:49:12.336670 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:49:12.336591 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:49:12.437611 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:49:12.437580 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:49:12.509262 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:49:12.509236 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:49:44.237693 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:49:44.237664 2574 scope.go:117] "RemoveContainer" containerID="f246b456663c1e2d4cf498fcc43599e55ef351ff27003ef9d5b460e12c9767c2" Sep 17 16:50:12.471695 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:12.471656 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:50:12.572736 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:12.572710 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:50:12.673846 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:12.673814 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:50:12.772047 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:12.771974 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:50:13.720723 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:13.720694 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:50:13.823925 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:13.823890 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:50:29.249511 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:29.249477 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-bmt22"] Sep 17 16:50:29.252903 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:29.252885 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-bmt22" Sep 17 16:50:29.255859 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:29.255837 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-qn42n\"" Sep 17 16:50:29.255963 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:29.255926 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"hf-token\"" Sep 17 16:50:29.256005 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:29.255929 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Sep 17 16:50:29.257146 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:29.257132 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Sep 17 16:50:29.257242 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:29.257224 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Sep 17 16:50:29.268924 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:29.268903 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-bmt22"] Sep 17 16:50:29.328557 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:29.328527 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:50:29.352904 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:29.352863 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a5a0494-df23-4557-a244-5fa8f14afa81-model-cache\") pod \"s3-init-bmt22\" (UID: \"7a5a0494-df23-4557-a244-5fa8f14afa81\") " pod="kserve/s3-init-bmt22" Sep 17 16:50:29.353104 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:29.352923 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl8xf\" (UniqueName: \"kubernetes.io/projected/7a5a0494-df23-4557-a244-5fa8f14afa81-kube-api-access-zl8xf\") pod \"s3-init-bmt22\" (UID: \"7a5a0494-df23-4557-a244-5fa8f14afa81\") " pod="kserve/s3-init-bmt22" Sep 17 16:50:29.454187 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:29.454145 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl8xf\" (UniqueName: \"kubernetes.io/projected/7a5a0494-df23-4557-a244-5fa8f14afa81-kube-api-access-zl8xf\") pod \"s3-init-bmt22\" (UID: \"7a5a0494-df23-4557-a244-5fa8f14afa81\") " pod="kserve/s3-init-bmt22" Sep 17 16:50:29.454387 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:29.454244 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a5a0494-df23-4557-a244-5fa8f14afa81-model-cache\") pod \"s3-init-bmt22\" (UID: \"7a5a0494-df23-4557-a244-5fa8f14afa81\") " pod="kserve/s3-init-bmt22" Sep 17 16:50:29.454668 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:29.454647 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a5a0494-df23-4557-a244-5fa8f14afa81-model-cache\") pod \"s3-init-bmt22\" (UID: \"7a5a0494-df23-4557-a244-5fa8f14afa81\") " pod="kserve/s3-init-bmt22" Sep 17 16:50:29.463200 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:29.463174 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl8xf\" (UniqueName: \"kubernetes.io/projected/7a5a0494-df23-4557-a244-5fa8f14afa81-kube-api-access-zl8xf\") pod \"s3-init-bmt22\" (UID: \"7a5a0494-df23-4557-a244-5fa8f14afa81\") " pod="kserve/s3-init-bmt22" Sep 17 16:50:29.561469 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:29.561347 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-bmt22" Sep 17 16:50:29.835666 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:29.835641 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-bmt22"] Sep 17 16:50:29.838376 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:50:29.838349 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a5a0494_df23_4557_a244_5fa8f14afa81.slice/crio-6cfd2d40a313e1c1bff128584c4c13869d4da4772b9dfe1c6af06aeec530ede7 WatchSource:0}: Error finding container 6cfd2d40a313e1c1bff128584c4c13869d4da4772b9dfe1c6af06aeec530ede7: Status 404 returned error can't find the container with id 6cfd2d40a313e1c1bff128584c4c13869d4da4772b9dfe1c6af06aeec530ede7 Sep 17 16:50:29.840908 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:29.840887 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 16:50:29.870369 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:29.870339 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-bmt22" event={"ID":"7a5a0494-df23-4557-a244-5fa8f14afa81","Type":"ContainerStarted","Data":"6cfd2d40a313e1c1bff128584c4c13869d4da4772b9dfe1c6af06aeec530ede7"} Sep 17 16:50:33.894745 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:33.894702 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-bmt22" event={"ID":"7a5a0494-df23-4557-a244-5fa8f14afa81","Type":"ContainerStarted","Data":"97ee77437ef4e02a315f148ba9742fa1671bef74eef52553e89df7a06fdca6cd"} Sep 17 16:50:35.905562 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:35.905466 2574 generic.go:356] "Generic (PLEG): container finished" podID="7a5a0494-df23-4557-a244-5fa8f14afa81" containerID="97ee77437ef4e02a315f148ba9742fa1671bef74eef52553e89df7a06fdca6cd" exitCode=0 Sep 17 16:50:35.905562 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:35.905543 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-bmt22" event={"ID":"7a5a0494-df23-4557-a244-5fa8f14afa81","Type":"ContainerDied","Data":"97ee77437ef4e02a315f148ba9742fa1671bef74eef52553e89df7a06fdca6cd"} Sep 17 16:50:40.934013 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:40.933978 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-bmt22" event={"ID":"7a5a0494-df23-4557-a244-5fa8f14afa81","Type":"ContainerStarted","Data":"341c373bc57b94a57df9d79794ebe90065a13df1663db6b027cf1d51336e546d"} Sep 17 16:50:40.951357 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:40.951303 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-bmt22" podStartSLOduration=1.7978762339999999 podStartE2EDuration="11.951286534s" totalImagesPullingTime="7.833808147s" totalInitContainerRuntime="2.319602153s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:50:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:50:40.950130589 +0000 UTC m=+537.146124738" watchObservedRunningTime="2026-09-17 16:50:40.951286534 +0000 UTC m=+537.147280703" Sep 17 16:50:53.681300 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:53.681270 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:50:53.748729 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:50:53.748671 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:51:15.997205 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:51:15.997156 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:51:45.257112 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:51:45.257066 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:51:46.204019 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:51:46.203986 2574 generic.go:356] "Generic (PLEG): container finished" podID="7a5a0494-df23-4557-a244-5fa8f14afa81" containerID="341c373bc57b94a57df9d79794ebe90065a13df1663db6b027cf1d51336e546d" exitCode=0 Sep 17 16:51:46.204019 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:51:46.204023 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-bmt22" event={"ID":"7a5a0494-df23-4557-a244-5fa8f14afa81","Type":"ContainerDied","Data":"341c373bc57b94a57df9d79794ebe90065a13df1663db6b027cf1d51336e546d"} Sep 17 16:51:47.340764 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:51:47.340732 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-bmt22" Sep 17 16:51:47.412347 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:51:47.412317 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zl8xf\" (UniqueName: \"kubernetes.io/projected/7a5a0494-df23-4557-a244-5fa8f14afa81-kube-api-access-zl8xf\") pod \"7a5a0494-df23-4557-a244-5fa8f14afa81\" (UID: \"7a5a0494-df23-4557-a244-5fa8f14afa81\") " Sep 17 16:51:47.412561 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:51:47.412413 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a5a0494-df23-4557-a244-5fa8f14afa81-model-cache\") pod \"7a5a0494-df23-4557-a244-5fa8f14afa81\" (UID: \"7a5a0494-df23-4557-a244-5fa8f14afa81\") " Sep 17 16:51:47.414691 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:51:47.414662 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a5a0494-df23-4557-a244-5fa8f14afa81-kube-api-access-zl8xf" (OuterVolumeSpecName: "kube-api-access-zl8xf") pod "7a5a0494-df23-4557-a244-5fa8f14afa81" (UID: "7a5a0494-df23-4557-a244-5fa8f14afa81"). InnerVolumeSpecName "kube-api-access-zl8xf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 16:51:47.431490 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:51:47.431462 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a5a0494-df23-4557-a244-5fa8f14afa81-model-cache" (OuterVolumeSpecName: "model-cache") pod "7a5a0494-df23-4557-a244-5fa8f14afa81" (UID: "7a5a0494-df23-4557-a244-5fa8f14afa81"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 16:51:47.513908 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:51:47.513855 2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a5a0494-df23-4557-a244-5fa8f14afa81-model-cache\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:51:47.513908 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:51:47.513876 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zl8xf\" (UniqueName: \"kubernetes.io/projected/7a5a0494-df23-4557-a244-5fa8f14afa81-kube-api-access-zl8xf\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:51:48.213657 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:51:48.213624 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-bmt22" event={"ID":"7a5a0494-df23-4557-a244-5fa8f14afa81","Type":"ContainerDied","Data":"6cfd2d40a313e1c1bff128584c4c13869d4da4772b9dfe1c6af06aeec530ede7"} Sep 17 16:51:48.213657 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:51:48.213650 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-bmt22" Sep 17 16:51:48.213657 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:51:48.213662 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6cfd2d40a313e1c1bff128584c4c13869d4da4772b9dfe1c6af06aeec530ede7" Sep 17 16:51:48.583344 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:51:48.583248 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:51:48.683977 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:51:48.683936 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:00.253362 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.253319 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:00.444856 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.444825 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:00.545229 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.545156 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:00.583152 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.583116 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs"] Sep 17 16:52:00.583545 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.583528 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a5a0494-df23-4557-a244-5fa8f14afa81" containerName="download-hf-model" Sep 17 16:52:00.583642 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.583549 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a5a0494-df23-4557-a244-5fa8f14afa81" containerName="download-hf-model" Sep 17 16:52:00.583642 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.583587 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a5a0494-df23-4557-a244-5fa8f14afa81" containerName="s3-init" Sep 17 16:52:00.583642 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.583596 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a5a0494-df23-4557-a244-5fa8f14afa81" containerName="s3-init" Sep 17 16:52:00.583808 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.583689 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a5a0494-df23-4557-a244-5fa8f14afa81" containerName="s3-init" Sep 17 16:52:00.587227 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.587206 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" Sep 17 16:52:00.590329 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.590311 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-predictor-serving-cert\"" Sep 17 16:52:00.590426 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.590360 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Sep 17 16:52:00.590426 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.590369 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-77dxf\"" Sep 17 16:52:00.590426 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.590368 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Sep 17 16:52:00.591357 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.591335 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Sep 17 16:52:00.591357 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.591350 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\"" Sep 17 16:52:00.591357 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.591357 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Sep 17 16:52:00.601368 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.601349 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs"] Sep 17 16:52:00.624410 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.624382 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:00.685287 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.685265 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:00.714306 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.714270 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/500ef483-8f7c-4c9f-a4f8-601ca66cd05e-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-st7bs\" (UID: \"500ef483-8f7c-4c9f-a4f8-601ca66cd05e\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" Sep 17 16:52:00.714500 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.714329 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9l56\" (UniqueName: \"kubernetes.io/projected/500ef483-8f7c-4c9f-a4f8-601ca66cd05e-kube-api-access-c9l56\") pod \"isvc-xgboost-graph-predictor-555fc69d56-st7bs\" (UID: \"500ef483-8f7c-4c9f-a4f8-601ca66cd05e\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" Sep 17 16:52:00.714500 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.714361 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/500ef483-8f7c-4c9f-a4f8-601ca66cd05e-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-st7bs\" (UID: \"500ef483-8f7c-4c9f-a4f8-601ca66cd05e\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" Sep 17 16:52:00.714500 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.714387 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/500ef483-8f7c-4c9f-a4f8-601ca66cd05e-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-st7bs\" (UID: \"500ef483-8f7c-4c9f-a4f8-601ca66cd05e\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" Sep 17 16:52:00.714500 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.714410 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/500ef483-8f7c-4c9f-a4f8-601ca66cd05e-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-st7bs\" (UID: \"500ef483-8f7c-4c9f-a4f8-601ca66cd05e\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" Sep 17 16:52:00.771311 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.771261 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:00.815301 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.815213 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/500ef483-8f7c-4c9f-a4f8-601ca66cd05e-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-st7bs\" (UID: \"500ef483-8f7c-4c9f-a4f8-601ca66cd05e\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" Sep 17 16:52:00.815301 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.815263 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/500ef483-8f7c-4c9f-a4f8-601ca66cd05e-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-st7bs\" (UID: \"500ef483-8f7c-4c9f-a4f8-601ca66cd05e\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" Sep 17 16:52:00.815301 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.815294 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/500ef483-8f7c-4c9f-a4f8-601ca66cd05e-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-st7bs\" (UID: \"500ef483-8f7c-4c9f-a4f8-601ca66cd05e\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" Sep 17 16:52:00.815571 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.815398 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/500ef483-8f7c-4c9f-a4f8-601ca66cd05e-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-st7bs\" (UID: \"500ef483-8f7c-4c9f-a4f8-601ca66cd05e\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" Sep 17 16:52:00.815571 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.815474 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9l56\" (UniqueName: \"kubernetes.io/projected/500ef483-8f7c-4c9f-a4f8-601ca66cd05e-kube-api-access-c9l56\") pod \"isvc-xgboost-graph-predictor-555fc69d56-st7bs\" (UID: \"500ef483-8f7c-4c9f-a4f8-601ca66cd05e\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" Sep 17 16:52:00.816078 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.816049 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/500ef483-8f7c-4c9f-a4f8-601ca66cd05e-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-st7bs\" (UID: \"500ef483-8f7c-4c9f-a4f8-601ca66cd05e\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" Sep 17 16:52:00.816210 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.816080 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/500ef483-8f7c-4c9f-a4f8-601ca66cd05e-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-st7bs\" (UID: \"500ef483-8f7c-4c9f-a4f8-601ca66cd05e\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" Sep 17 16:52:00.816210 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.816126 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/500ef483-8f7c-4c9f-a4f8-601ca66cd05e-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-st7bs\" (UID: \"500ef483-8f7c-4c9f-a4f8-601ca66cd05e\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" Sep 17 16:52:00.818263 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.818239 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/500ef483-8f7c-4c9f-a4f8-601ca66cd05e-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-st7bs\" (UID: \"500ef483-8f7c-4c9f-a4f8-601ca66cd05e\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" Sep 17 16:52:00.827261 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.827235 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9l56\" (UniqueName: \"kubernetes.io/projected/500ef483-8f7c-4c9f-a4f8-601ca66cd05e-kube-api-access-c9l56\") pod \"isvc-xgboost-graph-predictor-555fc69d56-st7bs\" (UID: \"500ef483-8f7c-4c9f-a4f8-601ca66cd05e\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" Sep 17 16:52:00.836887 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.836863 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:00.884770 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.884740 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7"] Sep 17 16:52:00.888570 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.888548 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" Sep 17 16:52:00.891255 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.891230 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-predictor-serving-cert\"" Sep 17 16:52:00.891384 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.891276 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\"" Sep 17 16:52:00.897346 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.897327 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" Sep 17 16:52:00.903970 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.903946 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7"] Sep 17 16:52:00.905666 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.905640 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:00.977756 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:00.977723 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:01.017270 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:01.017243 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f4a15c35-a180-40ac-b968-75c76e63adc1-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7\" (UID: \"f4a15c35-a180-40ac-b968-75c76e63adc1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" Sep 17 16:52:01.017407 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:01.017283 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f4a15c35-a180-40ac-b968-75c76e63adc1-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7\" (UID: \"f4a15c35-a180-40ac-b968-75c76e63adc1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" Sep 17 16:52:01.017407 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:01.017315 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f4a15c35-a180-40ac-b968-75c76e63adc1-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7\" (UID: \"f4a15c35-a180-40ac-b968-75c76e63adc1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" Sep 17 16:52:01.017407 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:01.017356 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmn9w\" (UniqueName: \"kubernetes.io/projected/f4a15c35-a180-40ac-b968-75c76e63adc1-kube-api-access-nmn9w\") pod \"isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7\" (UID: \"f4a15c35-a180-40ac-b968-75c76e63adc1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" Sep 17 16:52:01.017407 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:01.017378 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f4a15c35-a180-40ac-b968-75c76e63adc1-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7\" (UID: \"f4a15c35-a180-40ac-b968-75c76e63adc1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" Sep 17 16:52:01.076824 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:01.076747 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:01.118920 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:01.118895 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f4a15c35-a180-40ac-b968-75c76e63adc1-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7\" (UID: \"f4a15c35-a180-40ac-b968-75c76e63adc1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" Sep 17 16:52:01.119037 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:01.118934 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f4a15c35-a180-40ac-b968-75c76e63adc1-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7\" (UID: \"f4a15c35-a180-40ac-b968-75c76e63adc1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" Sep 17 16:52:01.119037 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:01.118955 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f4a15c35-a180-40ac-b968-75c76e63adc1-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7\" (UID: \"f4a15c35-a180-40ac-b968-75c76e63adc1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" Sep 17 16:52:01.119037 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:01.118980 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmn9w\" (UniqueName: \"kubernetes.io/projected/f4a15c35-a180-40ac-b968-75c76e63adc1-kube-api-access-nmn9w\") pod \"isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7\" (UID: \"f4a15c35-a180-40ac-b968-75c76e63adc1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" Sep 17 16:52:01.119037 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:01.119004 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f4a15c35-a180-40ac-b968-75c76e63adc1-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7\" (UID: \"f4a15c35-a180-40ac-b968-75c76e63adc1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" Sep 17 16:52:01.119393 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:01.119370 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f4a15c35-a180-40ac-b968-75c76e63adc1-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7\" (UID: \"f4a15c35-a180-40ac-b968-75c76e63adc1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" Sep 17 16:52:01.119647 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:01.119630 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f4a15c35-a180-40ac-b968-75c76e63adc1-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7\" (UID: \"f4a15c35-a180-40ac-b968-75c76e63adc1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" Sep 17 16:52:01.119693 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:01.119667 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f4a15c35-a180-40ac-b968-75c76e63adc1-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7\" (UID: \"f4a15c35-a180-40ac-b968-75c76e63adc1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" Sep 17 16:52:01.121603 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:01.121585 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f4a15c35-a180-40ac-b968-75c76e63adc1-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7\" (UID: \"f4a15c35-a180-40ac-b968-75c76e63adc1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" Sep 17 16:52:01.129805 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:01.129781 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmn9w\" (UniqueName: \"kubernetes.io/projected/f4a15c35-a180-40ac-b968-75c76e63adc1-kube-api-access-nmn9w\") pod \"isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7\" (UID: \"f4a15c35-a180-40ac-b968-75c76e63adc1\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" Sep 17 16:52:01.188488 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:01.188409 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs"] Sep 17 16:52:01.191194 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:52:01.191168 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod500ef483_8f7c_4c9f_a4f8_601ca66cd05e.slice/crio-6a958caf79040414066fdddd3fe6765dd2183ea90d3d5cd31c8c933a483e7927 WatchSource:0}: Error finding container 6a958caf79040414066fdddd3fe6765dd2183ea90d3d5cd31c8c933a483e7927: Status 404 returned error can't find the container with id 6a958caf79040414066fdddd3fe6765dd2183ea90d3d5cd31c8c933a483e7927 Sep 17 16:52:01.199266 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:01.199249 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" Sep 17 16:52:01.269811 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:01.269642 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" event={"ID":"500ef483-8f7c-4c9f-a4f8-601ca66cd05e","Type":"ContainerStarted","Data":"c2ad9bb1cf5f9e837dc877a084cf2e86d4648a0192576cd965a71106254da31e"} Sep 17 16:52:01.269811 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:01.269716 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" event={"ID":"500ef483-8f7c-4c9f-a4f8-601ca66cd05e","Type":"ContainerStarted","Data":"6a958caf79040414066fdddd3fe6765dd2183ea90d3d5cd31c8c933a483e7927"} Sep 17 16:52:01.478257 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:01.478205 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7"] Sep 17 16:52:01.480874 ip-10-0-142-146 kubenswrapper[2574]: W0917 16:52:01.480852 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4a15c35_a180_40ac_b968_75c76e63adc1.slice/crio-12420b86dc5d0d603ede041b2592cfd94afa6f9dc6002ad99db248998b9d8640 WatchSource:0}: Error finding container 12420b86dc5d0d603ede041b2592cfd94afa6f9dc6002ad99db248998b9d8640: Status 404 returned error can't find the container with id 12420b86dc5d0d603ede041b2592cfd94afa6f9dc6002ad99db248998b9d8640 Sep 17 16:52:02.277135 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:02.277095 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" event={"ID":"f4a15c35-a180-40ac-b968-75c76e63adc1","Type":"ContainerStarted","Data":"5953adf3f179aca62b67a07c3159f959958e9fa79c3e1cd826c05f29c2423130"} Sep 17 16:52:02.277560 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:02.277184 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" event={"ID":"f4a15c35-a180-40ac-b968-75c76e63adc1","Type":"ContainerStarted","Data":"12420b86dc5d0d603ede041b2592cfd94afa6f9dc6002ad99db248998b9d8640"} Sep 17 16:52:05.293347 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:05.293316 2574 generic.go:356] "Generic (PLEG): container finished" podID="500ef483-8f7c-4c9f-a4f8-601ca66cd05e" containerID="c2ad9bb1cf5f9e837dc877a084cf2e86d4648a0192576cd965a71106254da31e" exitCode=0 Sep 17 16:52:05.293770 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:05.293382 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" event={"ID":"500ef483-8f7c-4c9f-a4f8-601ca66cd05e","Type":"ContainerDied","Data":"c2ad9bb1cf5f9e837dc877a084cf2e86d4648a0192576cd965a71106254da31e"} Sep 17 16:52:06.300698 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:06.300656 2574 generic.go:356] "Generic (PLEG): container finished" podID="f4a15c35-a180-40ac-b968-75c76e63adc1" containerID="5953adf3f179aca62b67a07c3159f959958e9fa79c3e1cd826c05f29c2423130" exitCode=0 Sep 17 16:52:06.301098 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:06.300730 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" event={"ID":"f4a15c35-a180-40ac-b968-75c76e63adc1","Type":"ContainerDied","Data":"5953adf3f179aca62b67a07c3159f959958e9fa79c3e1cd826c05f29c2423130"} Sep 17 16:52:23.306267 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:23.306199 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:31.446110 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:31.446030 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" event={"ID":"f4a15c35-a180-40ac-b968-75c76e63adc1","Type":"ContainerStarted","Data":"ec6eb154a9b6e7b4581278574f8d89c870f4f3a9d057185ca2da404cb5bf7841"} Sep 17 16:52:32.455836 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:32.455736 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" event={"ID":"500ef483-8f7c-4c9f-a4f8-601ca66cd05e","Type":"ContainerStarted","Data":"78dc11c8f132075ae6f9c4383b2cf5b0730fc2200a771435690dcec28a9fd5e3"} Sep 17 16:52:34.466511 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:34.466467 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" event={"ID":"500ef483-8f7c-4c9f-a4f8-601ca66cd05e","Type":"ContainerStarted","Data":"22593dae4aaeebcda4759cf7020d3f07d5654eea8707644d18d7e4be2e3c37b0"} Sep 17 16:52:34.466945 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:34.466681 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" Sep 17 16:52:34.466945 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:34.466829 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" Sep 17 16:52:34.468474 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:34.468423 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" podUID="500ef483-8f7c-4c9f-a4f8-601ca66cd05e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused" Sep 17 16:52:34.468929 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:34.468908 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" event={"ID":"f4a15c35-a180-40ac-b968-75c76e63adc1","Type":"ContainerStarted","Data":"904b0372aba724c1a1a77cbfe1f7b36246feb9af00c0c455086222627ed7356d"} Sep 17 16:52:34.469039 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:34.469023 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" Sep 17 16:52:34.491493 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:34.491410 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" podStartSLOduration=2.18272343 podStartE2EDuration="34.491394109s" totalImagesPullingTime="28.323321323s" totalInitContainerRuntime="3.985349356s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:52:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:52:34.489778397 +0000 UTC m=+650.685772625" watchObservedRunningTime="2026-09-17 16:52:34.491394109 +0000 UTC m=+650.687388257" Sep 17 16:52:34.515411 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:34.515348 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" podStartSLOduration=3.271386633 podStartE2EDuration="34.515327932s" totalImagesPullingTime="27.271161223s" totalInitContainerRuntime="3.972780076s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:52:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:52:34.514870528 +0000 UTC m=+650.710864676" watchObservedRunningTime="2026-09-17 16:52:34.515327932 +0000 UTC m=+650.711322081" Sep 17 16:52:35.475295 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:35.475253 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" podUID="500ef483-8f7c-4c9f-a4f8-601ca66cd05e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused" Sep 17 16:52:35.475295 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:35.475286 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" Sep 17 16:52:35.476377 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:35.476354 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" podUID="f4a15c35-a180-40ac-b968-75c76e63adc1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused" Sep 17 16:52:36.479243 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:36.479200 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" podUID="f4a15c35-a180-40ac-b968-75c76e63adc1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused" Sep 17 16:52:40.480127 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:40.480096 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" Sep 17 16:52:40.480625 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:40.480600 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" podUID="500ef483-8f7c-4c9f-a4f8-601ca66cd05e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused" Sep 17 16:52:41.484224 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:41.484198 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" Sep 17 16:52:41.484746 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:41.484716 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" podUID="f4a15c35-a180-40ac-b968-75c76e63adc1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused" Sep 17 16:52:42.000717 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:42.000689 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:44.268767 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:44.268735 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:44.338341 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:44.338310 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:50.481548 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:50.481506 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" podUID="500ef483-8f7c-4c9f-a4f8-601ca66cd05e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused" Sep 17 16:52:51.485643 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:52:51.485604 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" podUID="f4a15c35-a180-40ac-b968-75c76e63adc1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused" Sep 17 16:53:00.480855 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:53:00.480816 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" podUID="500ef483-8f7c-4c9f-a4f8-601ca66cd05e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused" Sep 17 16:53:01.485305 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:53:01.485258 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" podUID="f4a15c35-a180-40ac-b968-75c76e63adc1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused" Sep 17 16:53:10.480555 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:53:10.480517 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" podUID="500ef483-8f7c-4c9f-a4f8-601ca66cd05e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused" Sep 17 16:53:11.484820 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:53:11.484783 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" podUID="f4a15c35-a180-40ac-b968-75c76e63adc1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused" Sep 17 16:53:20.205963 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:53:20.205930 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:20.480972 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:53:20.480886 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" podUID="500ef483-8f7c-4c9f-a4f8-601ca66cd05e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused" Sep 17 16:53:20.591598 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:53:20.591563 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:21.485076 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:53:21.485035 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" podUID="f4a15c35-a180-40ac-b968-75c76e63adc1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused" Sep 17 16:53:30.402198 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:53:30.402167 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:30.481278 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:53:30.481230 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" podUID="500ef483-8f7c-4c9f-a4f8-601ca66cd05e" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.31:8080: connect: connection refused" Sep 17 16:53:30.658963 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:53:30.658871 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:30.785177 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:53:30.785130 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:30.883461 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:53:30.883410 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:30.997142 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:53:30.997098 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:31.250360 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:53:31.250247 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:31.484793 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:53:31.484745 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" podUID="f4a15c35-a180-40ac-b968-75c76e63adc1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused" Sep 17 16:53:31.520060 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:53:31.519974 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:40.481607 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:53:40.481574 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" Sep 17 16:53:41.484768 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:53:41.484724 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" podUID="f4a15c35-a180-40ac-b968-75c76e63adc1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused" Sep 17 16:53:51.485646 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:53:51.485608 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" Sep 17 16:54:10.202030 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:10.201991 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:54:10.657129 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:10.657021 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:54:20.702596 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:20.702554 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:54:20.857466 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:20.857012 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7"] Sep 17 16:54:20.857466 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:20.857419 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" podUID="f4a15c35-a180-40ac-b968-75c76e63adc1" containerName="kserve-container" containerID="cri-o://ec6eb154a9b6e7b4581278574f8d89c870f4f3a9d057185ca2da404cb5bf7841" gracePeriod=30 Sep 17 16:54:20.857762 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:20.857711 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" podUID="f4a15c35-a180-40ac-b968-75c76e63adc1" containerName="kube-rbac-proxy" containerID="cri-o://904b0372aba724c1a1a77cbfe1f7b36246feb9af00c0c455086222627ed7356d" gracePeriod=30 Sep 17 16:54:20.930507 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:20.930479 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:54:20.931195 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:20.931164 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs"] Sep 17 16:54:20.931428 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:20.931406 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" podUID="500ef483-8f7c-4c9f-a4f8-601ca66cd05e" containerName="kserve-container" containerID="cri-o://78dc11c8f132075ae6f9c4383b2cf5b0730fc2200a771435690dcec28a9fd5e3" gracePeriod=30 Sep 17 16:54:20.931581 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:20.931516 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" podUID="500ef483-8f7c-4c9f-a4f8-601ca66cd05e" containerName="kube-rbac-proxy" containerID="cri-o://22593dae4aaeebcda4759cf7020d3f07d5654eea8707644d18d7e4be2e3c37b0" gracePeriod=30 Sep 17 16:54:21.007758 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:21.007655 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:54:21.097393 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:21.097363 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:54:21.255785 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:21.255753 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:54:21.355792 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:21.355706 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:54:21.480062 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:21.480028 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" podUID="f4a15c35-a180-40ac-b968-75c76e63adc1" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.32:8643/healthz\": dial tcp 10.132.0.32:8643: connect: connection refused" Sep 17 16:54:21.485530 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:21.485508 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" podUID="f4a15c35-a180-40ac-b968-75c76e63adc1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.32:8080: connect: connection refused" Sep 17 16:54:21.973171 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:21.973136 2574 generic.go:356] "Generic (PLEG): container finished" podID="500ef483-8f7c-4c9f-a4f8-601ca66cd05e" containerID="22593dae4aaeebcda4759cf7020d3f07d5654eea8707644d18d7e4be2e3c37b0" exitCode=2 Sep 17 16:54:21.973585 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:21.973207 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" event={"ID":"500ef483-8f7c-4c9f-a4f8-601ca66cd05e","Type":"ContainerDied","Data":"22593dae4aaeebcda4759cf7020d3f07d5654eea8707644d18d7e4be2e3c37b0"} Sep 17 16:54:21.975067 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:21.975044 2574 generic.go:356] "Generic (PLEG): container finished" podID="f4a15c35-a180-40ac-b968-75c76e63adc1" containerID="904b0372aba724c1a1a77cbfe1f7b36246feb9af00c0c455086222627ed7356d" exitCode=2 Sep 17 16:54:21.975186 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:21.975102 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" event={"ID":"f4a15c35-a180-40ac-b968-75c76e63adc1","Type":"ContainerDied","Data":"904b0372aba724c1a1a77cbfe1f7b36246feb9af00c0c455086222627ed7356d"} Sep 17 16:54:24.981358 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:24.981331 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" Sep 17 16:54:24.989937 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:24.989911 2574 generic.go:356] "Generic (PLEG): container finished" podID="500ef483-8f7c-4c9f-a4f8-601ca66cd05e" containerID="78dc11c8f132075ae6f9c4383b2cf5b0730fc2200a771435690dcec28a9fd5e3" exitCode=0 Sep 17 16:54:24.990093 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:24.989965 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" Sep 17 16:54:24.990093 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:24.989968 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" event={"ID":"500ef483-8f7c-4c9f-a4f8-601ca66cd05e","Type":"ContainerDied","Data":"78dc11c8f132075ae6f9c4383b2cf5b0730fc2200a771435690dcec28a9fd5e3"} Sep 17 16:54:24.990195 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:24.990121 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs" event={"ID":"500ef483-8f7c-4c9f-a4f8-601ca66cd05e","Type":"ContainerDied","Data":"6a958caf79040414066fdddd3fe6765dd2183ea90d3d5cd31c8c933a483e7927"} Sep 17 16:54:24.990195 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:24.990148 2574 scope.go:117] "RemoveContainer" containerID="22593dae4aaeebcda4759cf7020d3f07d5654eea8707644d18d7e4be2e3c37b0" Sep 17 16:54:24.998550 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:24.998532 2574 scope.go:117] "RemoveContainer" containerID="78dc11c8f132075ae6f9c4383b2cf5b0730fc2200a771435690dcec28a9fd5e3" Sep 17 16:54:25.007400 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.007378 2574 scope.go:117] "RemoveContainer" containerID="c2ad9bb1cf5f9e837dc877a084cf2e86d4648a0192576cd965a71106254da31e" Sep 17 16:54:25.015838 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.015812 2574 scope.go:117] "RemoveContainer" containerID="22593dae4aaeebcda4759cf7020d3f07d5654eea8707644d18d7e4be2e3c37b0" Sep 17 16:54:25.016149 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:54:25.016130 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22593dae4aaeebcda4759cf7020d3f07d5654eea8707644d18d7e4be2e3c37b0\": container with ID starting with 22593dae4aaeebcda4759cf7020d3f07d5654eea8707644d18d7e4be2e3c37b0 not found: ID does not exist" containerID="22593dae4aaeebcda4759cf7020d3f07d5654eea8707644d18d7e4be2e3c37b0" Sep 17 16:54:25.016235 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.016159 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22593dae4aaeebcda4759cf7020d3f07d5654eea8707644d18d7e4be2e3c37b0"} err="failed to get container status \"22593dae4aaeebcda4759cf7020d3f07d5654eea8707644d18d7e4be2e3c37b0\": rpc error: code = NotFound desc = could not find container \"22593dae4aaeebcda4759cf7020d3f07d5654eea8707644d18d7e4be2e3c37b0\": container with ID starting with 22593dae4aaeebcda4759cf7020d3f07d5654eea8707644d18d7e4be2e3c37b0 not found: ID does not exist" Sep 17 16:54:25.016235 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.016179 2574 scope.go:117] "RemoveContainer" containerID="78dc11c8f132075ae6f9c4383b2cf5b0730fc2200a771435690dcec28a9fd5e3" Sep 17 16:54:25.016476 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:54:25.016431 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78dc11c8f132075ae6f9c4383b2cf5b0730fc2200a771435690dcec28a9fd5e3\": container with ID starting with 78dc11c8f132075ae6f9c4383b2cf5b0730fc2200a771435690dcec28a9fd5e3 not found: ID does not exist" containerID="78dc11c8f132075ae6f9c4383b2cf5b0730fc2200a771435690dcec28a9fd5e3" Sep 17 16:54:25.016548 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.016481 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78dc11c8f132075ae6f9c4383b2cf5b0730fc2200a771435690dcec28a9fd5e3"} err="failed to get container status \"78dc11c8f132075ae6f9c4383b2cf5b0730fc2200a771435690dcec28a9fd5e3\": rpc error: code = NotFound desc = could not find container \"78dc11c8f132075ae6f9c4383b2cf5b0730fc2200a771435690dcec28a9fd5e3\": container with ID starting with 78dc11c8f132075ae6f9c4383b2cf5b0730fc2200a771435690dcec28a9fd5e3 not found: ID does not exist" Sep 17 16:54:25.016548 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.016498 2574 scope.go:117] "RemoveContainer" containerID="c2ad9bb1cf5f9e837dc877a084cf2e86d4648a0192576cd965a71106254da31e" Sep 17 16:54:25.016746 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:54:25.016732 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2ad9bb1cf5f9e837dc877a084cf2e86d4648a0192576cd965a71106254da31e\": container with ID starting with c2ad9bb1cf5f9e837dc877a084cf2e86d4648a0192576cd965a71106254da31e not found: ID does not exist" containerID="c2ad9bb1cf5f9e837dc877a084cf2e86d4648a0192576cd965a71106254da31e" Sep 17 16:54:25.016804 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.016749 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2ad9bb1cf5f9e837dc877a084cf2e86d4648a0192576cd965a71106254da31e"} err="failed to get container status \"c2ad9bb1cf5f9e837dc877a084cf2e86d4648a0192576cd965a71106254da31e\": rpc error: code = NotFound desc = could not find container \"c2ad9bb1cf5f9e837dc877a084cf2e86d4648a0192576cd965a71106254da31e\": container with ID starting with c2ad9bb1cf5f9e837dc877a084cf2e86d4648a0192576cd965a71106254da31e not found: ID does not exist" Sep 17 16:54:25.137489 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.137382 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/500ef483-8f7c-4c9f-a4f8-601ca66cd05e-kube-rbac-proxy-sar-config\") pod \"500ef483-8f7c-4c9f-a4f8-601ca66cd05e\" (UID: \"500ef483-8f7c-4c9f-a4f8-601ca66cd05e\") " Sep 17 16:54:25.137489 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.137426 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/500ef483-8f7c-4c9f-a4f8-601ca66cd05e-cabundle-cert\") pod \"500ef483-8f7c-4c9f-a4f8-601ca66cd05e\" (UID: \"500ef483-8f7c-4c9f-a4f8-601ca66cd05e\") " Sep 17 16:54:25.137700 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.137509 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/500ef483-8f7c-4c9f-a4f8-601ca66cd05e-kserve-provision-location\") pod \"500ef483-8f7c-4c9f-a4f8-601ca66cd05e\" (UID: \"500ef483-8f7c-4c9f-a4f8-601ca66cd05e\") " Sep 17 16:54:25.137700 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.137540 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9l56\" (UniqueName: \"kubernetes.io/projected/500ef483-8f7c-4c9f-a4f8-601ca66cd05e-kube-api-access-c9l56\") pod \"500ef483-8f7c-4c9f-a4f8-601ca66cd05e\" (UID: \"500ef483-8f7c-4c9f-a4f8-601ca66cd05e\") " Sep 17 16:54:25.137700 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.137628 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/500ef483-8f7c-4c9f-a4f8-601ca66cd05e-proxy-tls\") pod \"500ef483-8f7c-4c9f-a4f8-601ca66cd05e\" (UID: \"500ef483-8f7c-4c9f-a4f8-601ca66cd05e\") " Sep 17 16:54:25.137819 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.137792 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/500ef483-8f7c-4c9f-a4f8-601ca66cd05e-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "500ef483-8f7c-4c9f-a4f8-601ca66cd05e" (UID: "500ef483-8f7c-4c9f-a4f8-601ca66cd05e"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:54:25.137864 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.137821 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/500ef483-8f7c-4c9f-a4f8-601ca66cd05e-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "500ef483-8f7c-4c9f-a4f8-601ca66cd05e" (UID: "500ef483-8f7c-4c9f-a4f8-601ca66cd05e"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 16:54:25.137864 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.137821 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/500ef483-8f7c-4c9f-a4f8-601ca66cd05e-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "500ef483-8f7c-4c9f-a4f8-601ca66cd05e" (UID: "500ef483-8f7c-4c9f-a4f8-601ca66cd05e"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:54:25.137984 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.137925 2574 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/500ef483-8f7c-4c9f-a4f8-601ca66cd05e-kube-rbac-proxy-sar-config\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:54:25.137984 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.137946 2574 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/500ef483-8f7c-4c9f-a4f8-601ca66cd05e-cabundle-cert\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:54:25.137984 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.137959 2574 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/500ef483-8f7c-4c9f-a4f8-601ca66cd05e-kserve-provision-location\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:54:25.139927 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.139906 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/500ef483-8f7c-4c9f-a4f8-601ca66cd05e-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "500ef483-8f7c-4c9f-a4f8-601ca66cd05e" (UID: "500ef483-8f7c-4c9f-a4f8-601ca66cd05e"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:54:25.139927 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.139917 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/500ef483-8f7c-4c9f-a4f8-601ca66cd05e-kube-api-access-c9l56" (OuterVolumeSpecName: "kube-api-access-c9l56") pod "500ef483-8f7c-4c9f-a4f8-601ca66cd05e" (UID: "500ef483-8f7c-4c9f-a4f8-601ca66cd05e"). InnerVolumeSpecName "kube-api-access-c9l56". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 16:54:25.239168 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.239118 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9l56\" (UniqueName: \"kubernetes.io/projected/500ef483-8f7c-4c9f-a4f8-601ca66cd05e-kube-api-access-c9l56\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:54:25.239168 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.239163 2574 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/500ef483-8f7c-4c9f-a4f8-601ca66cd05e-proxy-tls\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:54:25.317250 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.317206 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs"] Sep 17 16:54:25.318978 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.318954 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-st7bs"] Sep 17 16:54:25.589614 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.589588 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" Sep 17 16:54:25.743313 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.743286 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f4a15c35-a180-40ac-b968-75c76e63adc1-kube-rbac-proxy-sar-config\") pod \"f4a15c35-a180-40ac-b968-75c76e63adc1\" (UID: \"f4a15c35-a180-40ac-b968-75c76e63adc1\") " Sep 17 16:54:25.743313 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.743318 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmn9w\" (UniqueName: \"kubernetes.io/projected/f4a15c35-a180-40ac-b968-75c76e63adc1-kube-api-access-nmn9w\") pod \"f4a15c35-a180-40ac-b968-75c76e63adc1\" (UID: \"f4a15c35-a180-40ac-b968-75c76e63adc1\") " Sep 17 16:54:25.743601 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.743353 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f4a15c35-a180-40ac-b968-75c76e63adc1-cabundle-cert\") pod \"f4a15c35-a180-40ac-b968-75c76e63adc1\" (UID: \"f4a15c35-a180-40ac-b968-75c76e63adc1\") " Sep 17 16:54:25.743601 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.743423 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f4a15c35-a180-40ac-b968-75c76e63adc1-proxy-tls\") pod \"f4a15c35-a180-40ac-b968-75c76e63adc1\" (UID: \"f4a15c35-a180-40ac-b968-75c76e63adc1\") " Sep 17 16:54:25.743601 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.743494 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f4a15c35-a180-40ac-b968-75c76e63adc1-kserve-provision-location\") pod \"f4a15c35-a180-40ac-b968-75c76e63adc1\" (UID: \"f4a15c35-a180-40ac-b968-75c76e63adc1\") " Sep 17 16:54:25.743769 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.743696 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4a15c35-a180-40ac-b968-75c76e63adc1-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "f4a15c35-a180-40ac-b968-75c76e63adc1" (UID: "f4a15c35-a180-40ac-b968-75c76e63adc1"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:54:25.743844 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.743819 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4a15c35-a180-40ac-b968-75c76e63adc1-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "f4a15c35-a180-40ac-b968-75c76e63adc1" (UID: "f4a15c35-a180-40ac-b968-75c76e63adc1"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:54:25.743900 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.743846 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4a15c35-a180-40ac-b968-75c76e63adc1-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "f4a15c35-a180-40ac-b968-75c76e63adc1" (UID: "f4a15c35-a180-40ac-b968-75c76e63adc1"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 16:54:25.745633 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.745611 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4a15c35-a180-40ac-b968-75c76e63adc1-kube-api-access-nmn9w" (OuterVolumeSpecName: "kube-api-access-nmn9w") pod "f4a15c35-a180-40ac-b968-75c76e63adc1" (UID: "f4a15c35-a180-40ac-b968-75c76e63adc1"). InnerVolumeSpecName "kube-api-access-nmn9w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 16:54:25.745702 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.745632 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4a15c35-a180-40ac-b968-75c76e63adc1-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "f4a15c35-a180-40ac-b968-75c76e63adc1" (UID: "f4a15c35-a180-40ac-b968-75c76e63adc1"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:54:25.845023 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.844984 2574 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f4a15c35-a180-40ac-b968-75c76e63adc1-proxy-tls\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:54:25.845023 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.845020 2574 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f4a15c35-a180-40ac-b968-75c76e63adc1-kserve-provision-location\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:54:25.845023 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.845032 2574 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f4a15c35-a180-40ac-b968-75c76e63adc1-kube-rbac-proxy-sar-config\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:54:25.845280 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.845043 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmn9w\" (UniqueName: \"kubernetes.io/projected/f4a15c35-a180-40ac-b968-75c76e63adc1-kube-api-access-nmn9w\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:54:25.845280 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.845052 2574 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f4a15c35-a180-40ac-b968-75c76e63adc1-cabundle-cert\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 16:54:25.999948 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.999850 2574 generic.go:356] "Generic (PLEG): container finished" podID="f4a15c35-a180-40ac-b968-75c76e63adc1" containerID="ec6eb154a9b6e7b4581278574f8d89c870f4f3a9d057185ca2da404cb5bf7841" exitCode=0 Sep 17 16:54:25.999948 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.999900 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" event={"ID":"f4a15c35-a180-40ac-b968-75c76e63adc1","Type":"ContainerDied","Data":"ec6eb154a9b6e7b4581278574f8d89c870f4f3a9d057185ca2da404cb5bf7841"} Sep 17 16:54:25.999948 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.999918 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" Sep 17 16:54:26.000501 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:25.999975 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7" event={"ID":"f4a15c35-a180-40ac-b968-75c76e63adc1","Type":"ContainerDied","Data":"12420b86dc5d0d603ede041b2592cfd94afa6f9dc6002ad99db248998b9d8640"} Sep 17 16:54:26.000501 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:26.000016 2574 scope.go:117] "RemoveContainer" containerID="904b0372aba724c1a1a77cbfe1f7b36246feb9af00c0c455086222627ed7356d" Sep 17 16:54:26.008707 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:26.008690 2574 scope.go:117] "RemoveContainer" containerID="ec6eb154a9b6e7b4581278574f8d89c870f4f3a9d057185ca2da404cb5bf7841" Sep 17 16:54:26.016597 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:26.016575 2574 scope.go:117] "RemoveContainer" containerID="5953adf3f179aca62b67a07c3159f959958e9fa79c3e1cd826c05f29c2423130" Sep 17 16:54:26.027559 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:26.025008 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7"] Sep 17 16:54:26.028380 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:26.028357 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7756fccfc-8b9k7"] Sep 17 16:54:26.030881 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:26.030867 2574 scope.go:117] "RemoveContainer" containerID="904b0372aba724c1a1a77cbfe1f7b36246feb9af00c0c455086222627ed7356d" Sep 17 16:54:26.031154 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:54:26.031135 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"904b0372aba724c1a1a77cbfe1f7b36246feb9af00c0c455086222627ed7356d\": container with ID starting with 904b0372aba724c1a1a77cbfe1f7b36246feb9af00c0c455086222627ed7356d not found: ID does not exist" containerID="904b0372aba724c1a1a77cbfe1f7b36246feb9af00c0c455086222627ed7356d" Sep 17 16:54:26.031209 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:26.031162 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"904b0372aba724c1a1a77cbfe1f7b36246feb9af00c0c455086222627ed7356d"} err="failed to get container status \"904b0372aba724c1a1a77cbfe1f7b36246feb9af00c0c455086222627ed7356d\": rpc error: code = NotFound desc = could not find container \"904b0372aba724c1a1a77cbfe1f7b36246feb9af00c0c455086222627ed7356d\": container with ID starting with 904b0372aba724c1a1a77cbfe1f7b36246feb9af00c0c455086222627ed7356d not found: ID does not exist" Sep 17 16:54:26.031209 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:26.031180 2574 scope.go:117] "RemoveContainer" containerID="ec6eb154a9b6e7b4581278574f8d89c870f4f3a9d057185ca2da404cb5bf7841" Sep 17 16:54:26.031472 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:54:26.031453 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec6eb154a9b6e7b4581278574f8d89c870f4f3a9d057185ca2da404cb5bf7841\": container with ID starting with ec6eb154a9b6e7b4581278574f8d89c870f4f3a9d057185ca2da404cb5bf7841 not found: ID does not exist" containerID="ec6eb154a9b6e7b4581278574f8d89c870f4f3a9d057185ca2da404cb5bf7841" Sep 17 16:54:26.031518 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:26.031475 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec6eb154a9b6e7b4581278574f8d89c870f4f3a9d057185ca2da404cb5bf7841"} err="failed to get container status \"ec6eb154a9b6e7b4581278574f8d89c870f4f3a9d057185ca2da404cb5bf7841\": rpc error: code = NotFound desc = could not find container \"ec6eb154a9b6e7b4581278574f8d89c870f4f3a9d057185ca2da404cb5bf7841\": container with ID starting with ec6eb154a9b6e7b4581278574f8d89c870f4f3a9d057185ca2da404cb5bf7841 not found: ID does not exist" Sep 17 16:54:26.031518 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:26.031489 2574 scope.go:117] "RemoveContainer" containerID="5953adf3f179aca62b67a07c3159f959958e9fa79c3e1cd826c05f29c2423130" Sep 17 16:54:26.031703 ip-10-0-142-146 kubenswrapper[2574]: E0917 16:54:26.031687 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5953adf3f179aca62b67a07c3159f959958e9fa79c3e1cd826c05f29c2423130\": container with ID starting with 5953adf3f179aca62b67a07c3159f959958e9fa79c3e1cd826c05f29c2423130 not found: ID does not exist" containerID="5953adf3f179aca62b67a07c3159f959958e9fa79c3e1cd826c05f29c2423130" Sep 17 16:54:26.031741 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:26.031706 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5953adf3f179aca62b67a07c3159f959958e9fa79c3e1cd826c05f29c2423130"} err="failed to get container status \"5953adf3f179aca62b67a07c3159f959958e9fa79c3e1cd826c05f29c2423130\": rpc error: code = NotFound desc = could not find container \"5953adf3f179aca62b67a07c3159f959958e9fa79c3e1cd826c05f29c2423130\": container with ID starting with 5953adf3f179aca62b67a07c3159f959958e9fa79c3e1cd826c05f29c2423130 not found: ID does not exist" Sep 17 16:54:26.328386 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:26.328316 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="500ef483-8f7c-4c9f-a4f8-601ca66cd05e" path="/var/lib/kubelet/pods/500ef483-8f7c-4c9f-a4f8-601ca66cd05e/volumes" Sep 17 16:54:26.328815 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:26.328802 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4a15c35-a180-40ac-b968-75c76e63adc1" path="/var/lib/kubelet/pods/f4a15c35-a180-40ac-b968-75c76e63adc1/volumes" Sep 17 16:54:30.632697 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:30.632660 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:54:30.749749 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:54:30.749716 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:55:20.952867 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:55:20.952788 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:55:21.146763 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:55:21.146729 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 16:57:30.133595 ip-10-0-142-146 kubenswrapper[2574]: I0917 16:57:30.133558 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:00:13.534558 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:00:13.534521 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:02:45.324060 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:02:45.324026 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:02:45.412821 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:02:45.412782 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:02:45.512161 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:02:45.512129 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:02:45.595464 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:02:45.595358 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:02:45.657664 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:02:45.657630 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:02:45.940016 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:02:45.939970 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:02:46.140813 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:02:46.140778 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:03:35.674230 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:03:35.674193 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:03:35.793309 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:03:35.793269 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:03:35.868568 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:03:35.868536 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:03:35.974582 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:03:35.974465 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:03:36.443743 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:03:36.443714 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:03:36.518270 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:03:36.518233 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:03:45.896177 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:03:45.896137 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:03:46.100001 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:03:46.099960 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:03:49.035714 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:03:49.035659 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:03:55.709123 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:03:55.709086 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:03:55.921179 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:03:55.921141 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:03:56.161383 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:03:56.161294 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:03:56.268349 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:03:56.268317 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:03:56.366502 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:03:56.366471 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:03:56.740462 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:03:56.740414 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:04:35.857819 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:04:35.857738 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:04:35.936736 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:04:35.936698 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:04:45.971394 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:04:45.971363 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:04:46.086565 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:04:46.086527 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:04:46.180867 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:04:46.180831 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:04:46.281259 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:04:46.281181 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:04:46.884349 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:04:46.884312 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:04:46.984751 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:04:46.984716 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:04:55.964760 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:04:55.964725 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:04:56.128709 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:04:56.128665 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:05:46.225632 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:05:46.225594 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:05:48.609028 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:05:48.608996 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:07:42.041337 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:07:42.041304 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:08:53.333227 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:08:53.333197 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:13:05.367357 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:13:05.367314 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:13:10.690376 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:13:10.690328 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:13:10.808359 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:13:10.808324 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:13:10.911621 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:13:10.911573 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:13:11.029932 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:13:11.029842 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:13:11.176510 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:13:11.176468 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:14:00.875382 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:14:00.875342 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:14:00.975497 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:14:00.975463 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:14:01.077614 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:14:01.077582 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:14:01.171503 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:14:01.171404 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:14:01.348190 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:14:01.348152 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:14:01.564949 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:14:01.564909 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:14:10.888089 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:14:10.888054 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:14:10.986393 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:14:10.986354 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:14:20.976350 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:14:20.976311 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:14:21.103372 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:14:21.103336 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:14:21.209009 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:14:21.208971 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:14:21.316151 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:14:21.316050 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:14:21.506558 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:14:21.506523 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:14:21.656173 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:14:21.656083 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:15:01.125161 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:15:01.125112 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:15:01.413711 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:15:01.413612 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:15:21.201010 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:15:21.200959 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:15:21.485250 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:15:21.485206 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:17:34.636848 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:17:34.636818 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:18:42.282809 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:18:42.282777 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:18:59.539258 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:18:59.539224 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:19:36.674400 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:19:36.674328 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:23:36.011330 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:23:36.011240 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:23:36.124652 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:23:36.124614 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:23:37.170827 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:23:37.170785 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:24:27.043522 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:24:27.043481 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:24:38.442365 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:24:38.442321 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:28:49.811069 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:28:49.811021 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:30:43.633478 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:30:43.633423 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:31:20.369700 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:20.369611 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:31:20.668132 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:20.668047 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:31:20.869165 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:20.869127 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:31:22.028319 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.028277 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vq85g/must-gather-278sp"] Sep 17 17:31:22.028873 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.028852 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4a15c35-a180-40ac-b968-75c76e63adc1" containerName="storage-initializer" Sep 17 17:31:22.028950 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.028876 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4a15c35-a180-40ac-b968-75c76e63adc1" containerName="storage-initializer" Sep 17 17:31:22.028950 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.028893 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="500ef483-8f7c-4c9f-a4f8-601ca66cd05e" containerName="storage-initializer" Sep 17 17:31:22.028950 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.028901 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="500ef483-8f7c-4c9f-a4f8-601ca66cd05e" containerName="storage-initializer" Sep 17 17:31:22.028950 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.028912 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4a15c35-a180-40ac-b968-75c76e63adc1" containerName="kube-rbac-proxy" Sep 17 17:31:22.028950 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.028920 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4a15c35-a180-40ac-b968-75c76e63adc1" containerName="kube-rbac-proxy" Sep 17 17:31:22.028950 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.028940 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="500ef483-8f7c-4c9f-a4f8-601ca66cd05e" containerName="kserve-container" Sep 17 17:31:22.028950 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.028948 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="500ef483-8f7c-4c9f-a4f8-601ca66cd05e" containerName="kserve-container" Sep 17 17:31:22.029294 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.028963 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="500ef483-8f7c-4c9f-a4f8-601ca66cd05e" containerName="kube-rbac-proxy" Sep 17 17:31:22.029294 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.028971 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="500ef483-8f7c-4c9f-a4f8-601ca66cd05e" containerName="kube-rbac-proxy" Sep 17 17:31:22.029294 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.028987 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4a15c35-a180-40ac-b968-75c76e63adc1" containerName="kserve-container" Sep 17 17:31:22.029294 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.028995 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4a15c35-a180-40ac-b968-75c76e63adc1" containerName="kserve-container" Sep 17 17:31:22.029294 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.029085 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="500ef483-8f7c-4c9f-a4f8-601ca66cd05e" containerName="kube-rbac-proxy" Sep 17 17:31:22.029294 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.029098 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4a15c35-a180-40ac-b968-75c76e63adc1" containerName="kube-rbac-proxy" Sep 17 17:31:22.029294 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.029108 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4a15c35-a180-40ac-b968-75c76e63adc1" containerName="kserve-container" Sep 17 17:31:22.029294 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.029123 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="500ef483-8f7c-4c9f-a4f8-601ca66cd05e" containerName="kserve-container" Sep 17 17:31:22.032555 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.032531 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vq85g/must-gather-278sp" Sep 17 17:31:22.038184 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.038125 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vq85g\"/\"kube-root-ca.crt\"" Sep 17 17:31:22.039461 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.039198 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vq85g\"/\"openshift-service-ca.crt\"" Sep 17 17:31:22.039539 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.039498 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vq85g\"/\"default-dockercfg-4l4ml\"" Sep 17 17:31:22.050660 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.050634 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vq85g/must-gather-278sp"] Sep 17 17:31:22.055715 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.055683 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:31:22.146618 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.146581 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:31:22.180765 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.180725 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dac36f56-b4e2-4464-9a07-6fb29a27897c-must-gather-output\") pod \"must-gather-278sp\" (UID: \"dac36f56-b4e2-4464-9a07-6fb29a27897c\") " pod="openshift-must-gather-vq85g/must-gather-278sp" Sep 17 17:31:22.180948 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.180839 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vf6v\" (UniqueName: \"kubernetes.io/projected/dac36f56-b4e2-4464-9a07-6fb29a27897c-kube-api-access-5vf6v\") pod \"must-gather-278sp\" (UID: \"dac36f56-b4e2-4464-9a07-6fb29a27897c\") " pod="openshift-must-gather-vq85g/must-gather-278sp" Sep 17 17:31:22.281390 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.281291 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vf6v\" (UniqueName: \"kubernetes.io/projected/dac36f56-b4e2-4464-9a07-6fb29a27897c-kube-api-access-5vf6v\") pod \"must-gather-278sp\" (UID: \"dac36f56-b4e2-4464-9a07-6fb29a27897c\") " pod="openshift-must-gather-vq85g/must-gather-278sp" Sep 17 17:31:22.281390 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.281373 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dac36f56-b4e2-4464-9a07-6fb29a27897c-must-gather-output\") pod \"must-gather-278sp\" (UID: \"dac36f56-b4e2-4464-9a07-6fb29a27897c\") " pod="openshift-must-gather-vq85g/must-gather-278sp" Sep 17 17:31:22.281760 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.281739 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dac36f56-b4e2-4464-9a07-6fb29a27897c-must-gather-output\") pod \"must-gather-278sp\" (UID: \"dac36f56-b4e2-4464-9a07-6fb29a27897c\") " pod="openshift-must-gather-vq85g/must-gather-278sp" Sep 17 17:31:22.289736 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.289707 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vf6v\" (UniqueName: \"kubernetes.io/projected/dac36f56-b4e2-4464-9a07-6fb29a27897c-kube-api-access-5vf6v\") pod \"must-gather-278sp\" (UID: \"dac36f56-b4e2-4464-9a07-6fb29a27897c\") " pod="openshift-must-gather-vq85g/must-gather-278sp" Sep 17 17:31:22.342548 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.342518 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vq85g/must-gather-278sp" Sep 17 17:31:22.616904 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.616879 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vq85g/must-gather-278sp"] Sep 17 17:31:22.619482 ip-10-0-142-146 kubenswrapper[2574]: W0917 17:31:22.619427 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddac36f56_b4e2_4464_9a07_6fb29a27897c.slice/crio-56f05358cba1cfaaad4496433e9279218d677ec4b2ad488dc57dd4c658a09b0e WatchSource:0}: Error finding container 56f05358cba1cfaaad4496433e9279218d677ec4b2ad488dc57dd4c658a09b0e: Status 404 returned error can't find the container with id 56f05358cba1cfaaad4496433e9279218d677ec4b2ad488dc57dd4c658a09b0e Sep 17 17:31:22.621283 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:22.621266 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 17:31:23.309774 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:23.309736 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vq85g/must-gather-278sp" event={"ID":"dac36f56-b4e2-4464-9a07-6fb29a27897c","Type":"ContainerStarted","Data":"56f05358cba1cfaaad4496433e9279218d677ec4b2ad488dc57dd4c658a09b0e"} Sep 17 17:31:29.342893 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:29.342853 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vq85g/must-gather-278sp" event={"ID":"dac36f56-b4e2-4464-9a07-6fb29a27897c","Type":"ContainerStarted","Data":"083efd75d53511917f56a0b3a5c19cf7a2a58a760213fce1fc52268c491a8567"} Sep 17 17:31:29.342893 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:29.342898 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vq85g/must-gather-278sp" event={"ID":"dac36f56-b4e2-4464-9a07-6fb29a27897c","Type":"ContainerStarted","Data":"532c1ed185636951cc6fa2a22df1bcf8da0e4435f23c295b90e8019a8fc12b70"} Sep 17 17:31:29.364364 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:29.364305 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vq85g/must-gather-278sp" podStartSLOduration=1.334754355 podStartE2EDuration="7.364285794s" totalImagesPullingTime="6.029531439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:31:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:31:29.362180138 +0000 UTC m=+2985.558174294" watchObservedRunningTime="2026-09-17 17:31:29.364285794 +0000 UTC m=+2985.560279942" Sep 17 17:31:52.456654 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:52.456624 2574 generic.go:356] "Generic (PLEG): container finished" podID="dac36f56-b4e2-4464-9a07-6fb29a27897c" containerID="532c1ed185636951cc6fa2a22df1bcf8da0e4435f23c295b90e8019a8fc12b70" exitCode=0 Sep 17 17:31:52.457089 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:52.456693 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vq85g/must-gather-278sp" event={"ID":"dac36f56-b4e2-4464-9a07-6fb29a27897c","Type":"ContainerDied","Data":"532c1ed185636951cc6fa2a22df1bcf8da0e4435f23c295b90e8019a8fc12b70"} Sep 17 17:31:52.457089 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:52.457001 2574 scope.go:117] "RemoveContainer" containerID="532c1ed185636951cc6fa2a22df1bcf8da0e4435f23c295b90e8019a8fc12b70" Sep 17 17:31:52.964021 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:52.963989 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-vq85g_must-gather-278sp_dac36f56-b4e2-4464-9a07-6fb29a27897c/gather/0.log" Sep 17 17:31:53.425158 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:53.425129 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:31:53.578657 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:53.578622 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:31:53.686710 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:53.686628 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:31:56.213487 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:56.213459 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-99gp5_e8b1cfd1-164c-4442-b711-c429d1f4a719/global-pull-secret-syncer/0.log" Sep 17 17:31:56.346090 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:56.346065 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" Sep 17 17:31:56.431935 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:56.431908 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-146.ec2.internal_d0d4a61112593ffdf8087d8d186a27c8/haproxy/0.log" Sep 17 17:31:58.403685 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:58.403650 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-vq85g/must-gather-278sp"] Sep 17 17:31:58.404122 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:58.403824 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-vq85g/must-gather-278sp" podUID="dac36f56-b4e2-4464-9a07-6fb29a27897c" containerName="copy" containerID="cri-o://083efd75d53511917f56a0b3a5c19cf7a2a58a760213fce1fc52268c491a8567" gracePeriod=2 Sep 17 17:31:58.419147 ip-10-0-142-146 kubenswrapper[2574]: E0917 17:31:58.410958 2574 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"dac36f56-b4e2-4464-9a07-6fb29a27897c\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"openshift-must-gather-vq85g\"/\"must-gather-278sp\": pods \"must-gather-278sp\" not found" pod="openshift-must-gather-vq85g/must-gather-278sp" Sep 17 17:31:58.419147 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:58.413494 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-vq85g/must-gather-278sp"] Sep 17 17:31:58.634314 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:58.634291 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-vq85g_must-gather-278sp_dac36f56-b4e2-4464-9a07-6fb29a27897c/copy/0.log" Sep 17 17:31:58.636774 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:58.636756 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vq85g/must-gather-278sp" Sep 17 17:31:58.639162 ip-10-0-142-146 kubenswrapper[2574]: E0917 17:31:58.639140 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-278sp\" is forbidden: User \"system:node:ip-10-0-142-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-vq85g\": no relationship found between node 'ip-10-0-142-146.ec2.internal' and this object" podUID="dac36f56-b4e2-4464-9a07-6fb29a27897c" pod="openshift-must-gather-vq85g/must-gather-278sp" Sep 17 17:31:58.703538 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:58.703494 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vf6v\" (UniqueName: \"kubernetes.io/projected/dac36f56-b4e2-4464-9a07-6fb29a27897c-kube-api-access-5vf6v\") pod \"dac36f56-b4e2-4464-9a07-6fb29a27897c\" (UID: \"dac36f56-b4e2-4464-9a07-6fb29a27897c\") " Sep 17 17:31:58.703743 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:58.703585 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dac36f56-b4e2-4464-9a07-6fb29a27897c-must-gather-output\") pod \"dac36f56-b4e2-4464-9a07-6fb29a27897c\" (UID: \"dac36f56-b4e2-4464-9a07-6fb29a27897c\") " Sep 17 17:31:58.704930 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:58.704903 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dac36f56-b4e2-4464-9a07-6fb29a27897c-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "dac36f56-b4e2-4464-9a07-6fb29a27897c" (UID: "dac36f56-b4e2-4464-9a07-6fb29a27897c"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 17:31:58.705962 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:58.705938 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dac36f56-b4e2-4464-9a07-6fb29a27897c-kube-api-access-5vf6v" (OuterVolumeSpecName: "kube-api-access-5vf6v") pod "dac36f56-b4e2-4464-9a07-6fb29a27897c" (UID: "dac36f56-b4e2-4464-9a07-6fb29a27897c"). InnerVolumeSpecName "kube-api-access-5vf6v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 17:31:58.804822 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:58.804782 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vf6v\" (UniqueName: \"kubernetes.io/projected/dac36f56-b4e2-4464-9a07-6fb29a27897c-kube-api-access-5vf6v\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 17:31:58.804822 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:58.804815 2574 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dac36f56-b4e2-4464-9a07-6fb29a27897c-must-gather-output\") on node \"ip-10-0-142-146.ec2.internal\" DevicePath \"\"" Sep 17 17:31:59.489841 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:59.489812 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-vq85g_must-gather-278sp_dac36f56-b4e2-4464-9a07-6fb29a27897c/copy/0.log" Sep 17 17:31:59.490250 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:59.490124 2574 generic.go:356] "Generic (PLEG): container finished" podID="dac36f56-b4e2-4464-9a07-6fb29a27897c" containerID="083efd75d53511917f56a0b3a5c19cf7a2a58a760213fce1fc52268c491a8567" exitCode=143 Sep 17 17:31:59.490250 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:59.490177 2574 scope.go:117] "RemoveContainer" containerID="083efd75d53511917f56a0b3a5c19cf7a2a58a760213fce1fc52268c491a8567" Sep 17 17:31:59.490357 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:59.490177 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vq85g/must-gather-278sp" Sep 17 17:31:59.492711 ip-10-0-142-146 kubenswrapper[2574]: E0917 17:31:59.492684 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-278sp\" is forbidden: User \"system:node:ip-10-0-142-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-vq85g\": no relationship found between node 'ip-10-0-142-146.ec2.internal' and this object" podUID="dac36f56-b4e2-4464-9a07-6fb29a27897c" pod="openshift-must-gather-vq85g/must-gather-278sp" Sep 17 17:31:59.498693 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:59.498673 2574 scope.go:117] "RemoveContainer" containerID="532c1ed185636951cc6fa2a22df1bcf8da0e4435f23c295b90e8019a8fc12b70" Sep 17 17:31:59.501008 ip-10-0-142-146 kubenswrapper[2574]: E0917 17:31:59.500985 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-278sp\" is forbidden: User \"system:node:ip-10-0-142-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-vq85g\": no relationship found between node 'ip-10-0-142-146.ec2.internal' and this object" podUID="dac36f56-b4e2-4464-9a07-6fb29a27897c" pod="openshift-must-gather-vq85g/must-gather-278sp" Sep 17 17:31:59.511987 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:59.511969 2574 scope.go:117] "RemoveContainer" containerID="083efd75d53511917f56a0b3a5c19cf7a2a58a760213fce1fc52268c491a8567" Sep 17 17:31:59.512260 ip-10-0-142-146 kubenswrapper[2574]: E0917 17:31:59.512243 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"083efd75d53511917f56a0b3a5c19cf7a2a58a760213fce1fc52268c491a8567\": container with ID starting with 083efd75d53511917f56a0b3a5c19cf7a2a58a760213fce1fc52268c491a8567 not found: ID does not exist" containerID="083efd75d53511917f56a0b3a5c19cf7a2a58a760213fce1fc52268c491a8567" Sep 17 17:31:59.512312 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:59.512268 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"083efd75d53511917f56a0b3a5c19cf7a2a58a760213fce1fc52268c491a8567"} err="failed to get container status \"083efd75d53511917f56a0b3a5c19cf7a2a58a760213fce1fc52268c491a8567\": rpc error: code = NotFound desc = could not find container \"083efd75d53511917f56a0b3a5c19cf7a2a58a760213fce1fc52268c491a8567\": container with ID starting with 083efd75d53511917f56a0b3a5c19cf7a2a58a760213fce1fc52268c491a8567 not found: ID does not exist" Sep 17 17:31:59.512312 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:59.512286 2574 scope.go:117] "RemoveContainer" containerID="532c1ed185636951cc6fa2a22df1bcf8da0e4435f23c295b90e8019a8fc12b70" Sep 17 17:31:59.512572 ip-10-0-142-146 kubenswrapper[2574]: E0917 17:31:59.512551 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"532c1ed185636951cc6fa2a22df1bcf8da0e4435f23c295b90e8019a8fc12b70\": container with ID starting with 532c1ed185636951cc6fa2a22df1bcf8da0e4435f23c295b90e8019a8fc12b70 not found: ID does not exist" containerID="532c1ed185636951cc6fa2a22df1bcf8da0e4435f23c295b90e8019a8fc12b70" Sep 17 17:31:59.512643 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:59.512580 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"532c1ed185636951cc6fa2a22df1bcf8da0e4435f23c295b90e8019a8fc12b70"} err="failed to get container status \"532c1ed185636951cc6fa2a22df1bcf8da0e4435f23c295b90e8019a8fc12b70\": rpc error: code = NotFound desc = could not find container \"532c1ed185636951cc6fa2a22df1bcf8da0e4435f23c295b90e8019a8fc12b70\": container with ID starting with 532c1ed185636951cc6fa2a22df1bcf8da0e4435f23c295b90e8019a8fc12b70 not found: ID does not exist" Sep 17 17:31:59.654967 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:59.654934 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:31:59.754565 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:31:59.754471 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9f79b_f639c21b-ffa0-4516-b1b7-528597d477e4/konnectivity-agent/0.log" limit=1024 Sep 17 17:32:00.327207 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:00.327182 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dac36f56-b4e2-4464-9a07-6fb29a27897c" path="/var/lib/kubelet/pods/dac36f56-b4e2-4464-9a07-6fb29a27897c/volumes" Sep 17 17:32:00.505535 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:00.505492 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-847b8bd8d7-6zz8j_e0d51f98-f18d-426d-a626-e068dc133c6d/cluster-monitoring-operator/0.log" Sep 17 17:32:00.531307 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:00.531285 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-r2lls_47c0a509-9f12-49c2-ba40-70f94c2f5fbb/kube-state-metrics/0.log" Sep 17 17:32:00.556688 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:00.556652 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-r2lls_47c0a509-9f12-49c2-ba40-70f94c2f5fbb/kube-rbac-proxy-main/0.log" Sep 17 17:32:00.586550 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:00.586461 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-r2lls_47c0a509-9f12-49c2-ba40-70f94c2f5fbb/kube-rbac-proxy-self/0.log" Sep 17 17:32:00.617331 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:00.617286 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5dd46dc8f7-d6jhh_e5875730-f41c-4301-82a0-1884350931a9/metrics-server/0.log" Sep 17 17:32:00.833943 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:00.833918 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mrkmf_8b372a8d-e81e-4541-b8b6-b3d4c181cd29/node-exporter/0.log" Sep 17 17:32:00.863254 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:00.863182 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mrkmf_8b372a8d-e81e-4541-b8b6-b3d4c181cd29/kube-rbac-proxy/0.log" Sep 17 17:32:00.889968 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:00.889941 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mrkmf_8b372a8d-e81e-4541-b8b6-b3d4c181cd29/init-textfile/0.log" Sep 17 17:32:00.921165 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:00.921136 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-rrbx5_c1ab5c3c-0989-46db-9bfa-c7183c759c2d/kube-rbac-proxy-main/0.log" Sep 17 17:32:00.943890 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:00.943851 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-rrbx5_c1ab5c3c-0989-46db-9bfa-c7183c759c2d/kube-rbac-proxy-self/0.log" Sep 17 17:32:00.971487 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:00.971433 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-rrbx5_c1ab5c3c-0989-46db-9bfa-c7183c759c2d/openshift-state-metrics/0.log" Sep 17 17:32:01.021234 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:01.021211 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_31dd95c5-1214-42f2-b124-14c43097aa18/prometheus/0.log" Sep 17 17:32:01.051867 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:01.051830 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_31dd95c5-1214-42f2-b124-14c43097aa18/config-reloader/0.log" Sep 17 17:32:01.079003 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:01.078981 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_31dd95c5-1214-42f2-b124-14c43097aa18/thanos-sidecar/0.log" Sep 17 17:32:01.113474 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:01.113398 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_31dd95c5-1214-42f2-b124-14c43097aa18/kube-rbac-proxy-web/0.log" Sep 17 17:32:01.145489 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:01.145467 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_31dd95c5-1214-42f2-b124-14c43097aa18/kube-rbac-proxy/0.log" Sep 17 17:32:01.170975 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:01.170953 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_31dd95c5-1214-42f2-b124-14c43097aa18/kube-rbac-proxy-thanos/0.log" Sep 17 17:32:01.202570 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:01.202543 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_31dd95c5-1214-42f2-b124-14c43097aa18/init-config-reloader/0.log" Sep 17 17:32:01.235161 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:01.235131 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-2szks_03747b4e-5a9e-4e06-bc5a-57fad1591b08/prometheus-operator/0.log" Sep 17 17:32:01.264272 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:01.264245 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-2szks_03747b4e-5a9e-4e06-bc5a-57fad1591b08/kube-rbac-proxy/0.log" Sep 17 17:32:01.295499 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:01.295472 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-vgt9j_eb418122-1020-47db-9bcb-f10d09e20bb5/prometheus-operator-admission-webhook/0.log" Sep 17 17:32:01.329910 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:01.329889 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6bf5689f-mnmw4_6c268bae-d302-4d8f-82ac-febe6e14acdb/telemeter-client/0.log" Sep 17 17:32:01.360034 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:01.360010 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6bf5689f-mnmw4_6c268bae-d302-4d8f-82ac-febe6e14acdb/reload/0.log" Sep 17 17:32:01.382950 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:01.382878 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6bf5689f-mnmw4_6c268bae-d302-4d8f-82ac-febe6e14acdb/kube-rbac-proxy/0.log" Sep 17 17:32:01.415376 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:01.415350 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d894d8899-cz27w_f3679ce8-c91f-4cf8-989a-235beaef7e4f/thanos-query/0.log" Sep 17 17:32:01.438858 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:01.438831 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d894d8899-cz27w_f3679ce8-c91f-4cf8-989a-235beaef7e4f/kube-rbac-proxy-web/0.log" Sep 17 17:32:01.462131 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:01.462113 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d894d8899-cz27w_f3679ce8-c91f-4cf8-989a-235beaef7e4f/kube-rbac-proxy/0.log" Sep 17 17:32:01.489034 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:01.488999 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d894d8899-cz27w_f3679ce8-c91f-4cf8-989a-235beaef7e4f/prom-label-proxy/0.log" Sep 17 17:32:01.512039 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:01.512014 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d894d8899-cz27w_f3679ce8-c91f-4cf8-989a-235beaef7e4f/kube-rbac-proxy-rules/0.log" Sep 17 17:32:01.533689 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:01.533664 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d894d8899-cz27w_f3679ce8-c91f-4cf8-989a-235beaef7e4f/kube-rbac-proxy-metrics/0.log" Sep 17 17:32:02.861828 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:02.861799 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6446c8d75d-hjn8z_1c761116-f06f-4a8f-a486-b38feaf57447/networking-console-plugin/0.log" Sep 17 17:32:03.901484 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:03.901448 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6594f4c75-9fvdm_c3d10027-2f6c-420a-9acb-7410e8d57b4c/download-server/0.log" Sep 17 17:32:04.781689 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:04.781650 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t6kqg/perf-node-gather-daemonset-m5vd6"] Sep 17 17:32:04.782039 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:04.782025 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dac36f56-b4e2-4464-9a07-6fb29a27897c" containerName="copy" Sep 17 17:32:04.782083 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:04.782041 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dac36f56-b4e2-4464-9a07-6fb29a27897c" containerName="copy" Sep 17 17:32:04.782083 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:04.782059 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dac36f56-b4e2-4464-9a07-6fb29a27897c" containerName="gather" Sep 17 17:32:04.782083 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:04.782065 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dac36f56-b4e2-4464-9a07-6fb29a27897c" containerName="gather" Sep 17 17:32:04.782214 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:04.782123 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="dac36f56-b4e2-4464-9a07-6fb29a27897c" containerName="copy" Sep 17 17:32:04.782214 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:04.782137 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="dac36f56-b4e2-4464-9a07-6fb29a27897c" containerName="gather" Sep 17 17:32:04.787390 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:04.787368 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-m5vd6" Sep 17 17:32:04.790164 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:04.790143 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t6kqg\"/\"openshift-service-ca.crt\"" Sep 17 17:32:04.790310 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:04.790207 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-t6kqg\"/\"default-dockercfg-gk9tj\"" Sep 17 17:32:04.790310 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:04.790223 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t6kqg\"/\"kube-root-ca.crt\"" Sep 17 17:32:04.794958 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:04.794937 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t6kqg/perf-node-gather-daemonset-m5vd6"] Sep 17 17:32:04.858049 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:04.858012 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc34fcfe-62ed-408a-afad-5f9769e32f7e-proc\") pod \"perf-node-gather-daemonset-m5vd6\" (UID: \"cc34fcfe-62ed-408a-afad-5f9769e32f7e\") " pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-m5vd6" Sep 17 17:32:04.858049 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:04.858050 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc34fcfe-62ed-408a-afad-5f9769e32f7e-sys\") pod \"perf-node-gather-daemonset-m5vd6\" (UID: \"cc34fcfe-62ed-408a-afad-5f9769e32f7e\") " pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-m5vd6" Sep 17 17:32:04.858311 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:04.858142 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc34fcfe-62ed-408a-afad-5f9769e32f7e-podres\") pod \"perf-node-gather-daemonset-m5vd6\" (UID: \"cc34fcfe-62ed-408a-afad-5f9769e32f7e\") " pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-m5vd6" Sep 17 17:32:04.858311 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:04.858227 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c9vq\" (UniqueName: \"kubernetes.io/projected/cc34fcfe-62ed-408a-afad-5f9769e32f7e-kube-api-access-4c9vq\") pod \"perf-node-gather-daemonset-m5vd6\" (UID: \"cc34fcfe-62ed-408a-afad-5f9769e32f7e\") " pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-m5vd6" Sep 17 17:32:04.858311 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:04.858255 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc34fcfe-62ed-408a-afad-5f9769e32f7e-lib-modules\") pod \"perf-node-gather-daemonset-m5vd6\" (UID: \"cc34fcfe-62ed-408a-afad-5f9769e32f7e\") " pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-m5vd6" Sep 17 17:32:04.959042 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:04.959014 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc34fcfe-62ed-408a-afad-5f9769e32f7e-podres\") pod \"perf-node-gather-daemonset-m5vd6\" (UID: \"cc34fcfe-62ed-408a-afad-5f9769e32f7e\") " pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-m5vd6" Sep 17 17:32:04.959566 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:04.959084 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c9vq\" (UniqueName: \"kubernetes.io/projected/cc34fcfe-62ed-408a-afad-5f9769e32f7e-kube-api-access-4c9vq\") pod \"perf-node-gather-daemonset-m5vd6\" (UID: \"cc34fcfe-62ed-408a-afad-5f9769e32f7e\") " pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-m5vd6" Sep 17 17:32:04.959566 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:04.959116 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc34fcfe-62ed-408a-afad-5f9769e32f7e-lib-modules\") pod \"perf-node-gather-daemonset-m5vd6\" (UID: \"cc34fcfe-62ed-408a-afad-5f9769e32f7e\") " pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-m5vd6" Sep 17 17:32:04.959566 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:04.959157 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc34fcfe-62ed-408a-afad-5f9769e32f7e-proc\") pod \"perf-node-gather-daemonset-m5vd6\" (UID: \"cc34fcfe-62ed-408a-afad-5f9769e32f7e\") " pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-m5vd6" Sep 17 17:32:04.959566 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:04.959180 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc34fcfe-62ed-408a-afad-5f9769e32f7e-podres\") pod \"perf-node-gather-daemonset-m5vd6\" (UID: \"cc34fcfe-62ed-408a-afad-5f9769e32f7e\") " pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-m5vd6" Sep 17 17:32:04.959566 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:04.959185 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc34fcfe-62ed-408a-afad-5f9769e32f7e-sys\") pod \"perf-node-gather-daemonset-m5vd6\" (UID: \"cc34fcfe-62ed-408a-afad-5f9769e32f7e\") " pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-m5vd6" Sep 17 17:32:04.959566 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:04.959237 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc34fcfe-62ed-408a-afad-5f9769e32f7e-sys\") pod \"perf-node-gather-daemonset-m5vd6\" (UID: \"cc34fcfe-62ed-408a-afad-5f9769e32f7e\") " pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-m5vd6" Sep 17 17:32:04.959566 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:04.959259 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc34fcfe-62ed-408a-afad-5f9769e32f7e-lib-modules\") pod \"perf-node-gather-daemonset-m5vd6\" (UID: \"cc34fcfe-62ed-408a-afad-5f9769e32f7e\") " pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-m5vd6" Sep 17 17:32:04.959566 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:04.959287 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc34fcfe-62ed-408a-afad-5f9769e32f7e-proc\") pod \"perf-node-gather-daemonset-m5vd6\" (UID: \"cc34fcfe-62ed-408a-afad-5f9769e32f7e\") " pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-m5vd6" Sep 17 17:32:04.967823 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:04.967797 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c9vq\" (UniqueName: \"kubernetes.io/projected/cc34fcfe-62ed-408a-afad-5f9769e32f7e-kube-api-access-4c9vq\") pod \"perf-node-gather-daemonset-m5vd6\" (UID: \"cc34fcfe-62ed-408a-afad-5f9769e32f7e\") " pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-m5vd6" Sep 17 17:32:05.098299 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:05.098211 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-m5vd6" Sep 17 17:32:05.368544 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:05.368498 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t6kqg/perf-node-gather-daemonset-m5vd6"] Sep 17 17:32:05.370796 ip-10-0-142-146 kubenswrapper[2574]: W0917 17:32:05.370772 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcc34fcfe_62ed_408a_afad_5f9769e32f7e.slice/crio-029887eea7cfe497e83e19a3d0d6fb6e34044de64e1332859812880a9916c196 WatchSource:0}: Error finding container 029887eea7cfe497e83e19a3d0d6fb6e34044de64e1332859812880a9916c196: Status 404 returned error can't find the container with id 029887eea7cfe497e83e19a3d0d6fb6e34044de64e1332859812880a9916c196 Sep 17 17:32:05.471927 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:05.471884 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tkgdr_f724cc35-e114-45e0-ae6b-07b4d9653424/dns/0.log" Sep 17 17:32:05.495692 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:05.495669 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tkgdr_f724cc35-e114-45e0-ae6b-07b4d9653424/kube-rbac-proxy/0.log" Sep 17 17:32:05.521667 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:05.521642 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-m5vd6" event={"ID":"cc34fcfe-62ed-408a-afad-5f9769e32f7e","Type":"ContainerStarted","Data":"4e2a5c9252ff199b9800f8a41acb69d2f49efaa8820c1609abb88eb9780094d0"} Sep 17 17:32:05.521786 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:05.521687 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-m5vd6" event={"ID":"cc34fcfe-62ed-408a-afad-5f9769e32f7e","Type":"ContainerStarted","Data":"029887eea7cfe497e83e19a3d0d6fb6e34044de64e1332859812880a9916c196"} Sep 17 17:32:05.521786 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:05.521717 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-m5vd6" Sep 17 17:32:05.542006 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:05.541962 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-m5vd6" podStartSLOduration=1.541949352 podStartE2EDuration="1.541949352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:32:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:32:05.540117117 +0000 UTC m=+3021.736111266" watchObservedRunningTime="2026-09-17 17:32:05.541949352 +0000 UTC m=+3021.737943499" Sep 17 17:32:05.552564 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:05.552540 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-spcc4_804bc511-5b2f-407e-b47f-ddd4333a6064/dns-node-resolver/0.log" Sep 17 17:32:06.100725 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:06.100696 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7xjlf_dcc9a981-3536-4588-a119-b7912e2fa48e/node-ca/0.log" Sep 17 17:32:06.910395 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:06.910365 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5dc4c55b4-tls6x_a19b7131-de33-4c65-924f-b582e08a1eb2/router/0.log" Sep 17 17:32:07.293335 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:07.293307 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wlfqv_7f1bf12a-2d8f-462c-aef7-499c90c24bcc/serve-healthcheck-canary/0.log" Sep 17 17:32:07.682429 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:07.682404 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cj4n5_b159f372-3935-4843-bc51-50f8d456496b/kube-rbac-proxy/0.log" Sep 17 17:32:07.703954 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:07.703936 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cj4n5_b159f372-3935-4843-bc51-50f8d456496b/exporter/0.log" Sep 17 17:32:07.731736 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:07.731713 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cj4n5_b159f372-3935-4843-bc51-50f8d456496b/extractor/0.log" Sep 17 17:32:10.333401 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:10.333364 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-bmt22_7a5a0494-df23-4557-a244-5fa8f14afa81/s3-init/0.log" Sep 17 17:32:10.350591 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:10.350561 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-bmt22_7a5a0494-df23-4557-a244-5fa8f14afa81/download-hf-model/0.log" Sep 17 17:32:11.536994 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:11.536964 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-t6kqg/perf-node-gather-daemonset-m5vd6" Sep 17 17:32:14.682628 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:14.682591 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-89kjv_135ba22b-5655-469a-aa63-e28de41a34dd/migrator/0.log" Sep 17 17:32:14.705103 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:14.705079 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-89kjv_135ba22b-5655-469a-aa63-e28de41a34dd/graceful-termination/0.log" Sep 17 17:32:16.209340 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:16.209316 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cjknd_85a077ee-c427-421c-930d-0deeda5fb58c/kube-multus-additional-cni-plugins/0.log" Sep 17 17:32:16.230732 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:16.230706 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cjknd_85a077ee-c427-421c-930d-0deeda5fb58c/egress-router-binary-copy/0.log" Sep 17 17:32:16.251192 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:16.251168 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cjknd_85a077ee-c427-421c-930d-0deeda5fb58c/cni-plugins/0.log" Sep 17 17:32:16.271192 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:16.271167 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cjknd_85a077ee-c427-421c-930d-0deeda5fb58c/bond-cni-plugin/0.log" Sep 17 17:32:16.291714 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:16.291691 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cjknd_85a077ee-c427-421c-930d-0deeda5fb58c/routeoverride-cni/0.log" Sep 17 17:32:16.311672 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:16.311597 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cjknd_85a077ee-c427-421c-930d-0deeda5fb58c/whereabouts-cni-bincopy/0.log" Sep 17 17:32:16.332302 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:16.332268 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cjknd_85a077ee-c427-421c-930d-0deeda5fb58c/whereabouts-cni/0.log" Sep 17 17:32:16.602346 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:16.602263 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rqj26_4e9d0c9e-7030-4ef1-8d43-9f6af050bae5/kube-multus/0.log" Sep 17 17:32:16.626224 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:16.626198 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-glhzf_c0f01af1-e02f-4105-8edb-33a5b8acab5c/network-metrics-daemon/0.log" Sep 17 17:32:16.648963 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:16.648931 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-glhzf_c0f01af1-e02f-4105-8edb-33a5b8acab5c/kube-rbac-proxy/0.log" Sep 17 17:32:17.712728 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:17.712697 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k2rxg_f165c12c-1f10-400e-b4f7-270a1a0e9805/ovn-controller/0.log" Sep 17 17:32:17.737407 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:17.737371 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k2rxg_f165c12c-1f10-400e-b4f7-270a1a0e9805/ovn-acl-logging/0.log" Sep 17 17:32:17.764257 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:17.764226 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k2rxg_f165c12c-1f10-400e-b4f7-270a1a0e9805/kube-rbac-proxy-node/0.log" Sep 17 17:32:17.787425 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:17.787396 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k2rxg_f165c12c-1f10-400e-b4f7-270a1a0e9805/kube-rbac-proxy-ovn-metrics/0.log" Sep 17 17:32:17.812154 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:17.812128 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k2rxg_f165c12c-1f10-400e-b4f7-270a1a0e9805/northd/0.log" Sep 17 17:32:17.841026 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:17.840987 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k2rxg_f165c12c-1f10-400e-b4f7-270a1a0e9805/nbdb/0.log" Sep 17 17:32:17.865565 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:17.865536 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k2rxg_f165c12c-1f10-400e-b4f7-270a1a0e9805/sbdb/0.log" Sep 17 17:32:17.910608 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:17.910574 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k2rxg_f165c12c-1f10-400e-b4f7-270a1a0e9805/ovnkube-controller/0.log" Sep 17 17:32:19.178636 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:19.178603 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7cbc45fddc-gld2l_4535c6ab-9627-43cf-a304-72247fafef62/check-endpoints/0.log" Sep 17 17:32:19.232722 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:19.232688 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-fqfbx_447eed93-408e-4029-b493-f9ec83f577b4/network-check-target-container/0.log" Sep 17 17:32:20.175331 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:20.175302 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-tb4rk_211fa1c6-ea59-4f31-a5e8-80a5b88fef83/iptables-alerter/0.log" Sep 17 17:32:20.886294 ip-10-0-142-146 kubenswrapper[2574]: I0917 17:32:20.886220 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-5qmf9_a25c2c44-9ff7-4d0b-9b8b-2b11d0515e01/tuned/0.log"