Sep 17 03:30:28.197928 ip-10-0-143-180 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 17 03:30:28.198064 ip-10-0-143-180 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 17 03:30:28.198157 ip-10-0-143-180 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 17 03:30:28.198663 ip-10-0-143-180 systemd[1]: Failed to start Kubernetes Kubelet. Sep 17 03:30:38.446736 ip-10-0-143-180 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 17 03:30:38.446753 ip-10-0-143-180 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 0ca5c3da6c284108b1c0c2cc93b50ee2 -- Sep 17 03:32:23.099078 ip-10-0-143-180 systemd[1]: Starting Kubernetes Kubelet... Sep 17 03:32:23.551824 ip-10-0-143-180 kubenswrapper[2551]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 03:32:23.551824 ip-10-0-143-180 kubenswrapper[2551]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 17 03:32:23.551824 ip-10-0-143-180 kubenswrapper[2551]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 03:32:23.551824 ip-10-0-143-180 kubenswrapper[2551]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 17 03:32:23.551824 ip-10-0-143-180 kubenswrapper[2551]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 03:32:23.552887 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.552736 2551 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 17 03:32:23.558021 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558005 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 03:32:23.558021 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558021 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 03:32:23.558085 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558024 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 03:32:23.558085 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558030 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 03:32:23.558085 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558035 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 03:32:23.558085 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558038 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 03:32:23.558085 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558041 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 03:32:23.558085 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558044 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 03:32:23.558085 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558046 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 03:32:23.558085 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558049 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 03:32:23.558085 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558052 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 03:32:23.558085 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558054 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 03:32:23.558085 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558057 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 03:32:23.558085 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558059 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 03:32:23.558085 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558063 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 03:32:23.558085 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558066 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 03:32:23.558085 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558069 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 03:32:23.558085 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558071 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 03:32:23.558085 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558074 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 03:32:23.558085 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558077 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 03:32:23.558085 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558079 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 03:32:23.558627 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558082 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 03:32:23.558627 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558085 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 03:32:23.558627 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558088 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 03:32:23.558627 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558090 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 03:32:23.558627 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558093 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 03:32:23.558627 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558096 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 03:32:23.558627 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558099 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 03:32:23.558627 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558102 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 03:32:23.558627 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558104 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 03:32:23.558627 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558107 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 03:32:23.558627 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558110 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 03:32:23.558627 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558112 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 03:32:23.558627 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558115 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 03:32:23.558627 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558117 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 03:32:23.558627 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558120 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 03:32:23.558627 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558122 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 03:32:23.558627 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558125 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 03:32:23.558627 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558127 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 03:32:23.558627 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558130 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 03:32:23.559103 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558133 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 03:32:23.559103 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558135 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 03:32:23.559103 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558138 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 03:32:23.559103 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558140 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 03:32:23.559103 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558143 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 03:32:23.559103 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558145 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 03:32:23.559103 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558148 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 03:32:23.559103 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558150 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 03:32:23.559103 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558153 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 03:32:23.559103 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558156 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 03:32:23.559103 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558158 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 03:32:23.559103 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558161 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 03:32:23.559103 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558164 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 03:32:23.559103 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558167 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 03:32:23.559103 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558170 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 03:32:23.559103 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558174 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 03:32:23.559103 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558176 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 03:32:23.559103 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558179 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 03:32:23.559103 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558181 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 03:32:23.559576 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558184 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 03:32:23.559576 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558187 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 03:32:23.559576 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558189 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 03:32:23.559576 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558192 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 03:32:23.559576 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558194 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 03:32:23.559576 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558197 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 03:32:23.559576 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558199 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 03:32:23.559576 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558205 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 03:32:23.559576 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558208 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 03:32:23.559576 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558211 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 03:32:23.559576 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558214 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 03:32:23.559576 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558217 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 03:32:23.559576 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558220 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 03:32:23.559576 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558223 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 03:32:23.559576 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558227 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 03:32:23.559576 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558230 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 03:32:23.559576 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558232 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 03:32:23.559576 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558235 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 03:32:23.559576 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558237 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 03:32:23.559576 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558240 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 03:32:23.560077 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558243 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 03:32:23.560077 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558245 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 03:32:23.560077 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558248 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 03:32:23.560077 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558250 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 03:32:23.560077 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558253 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 03:32:23.560077 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558255 2551 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 03:32:23.560077 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558258 2551 feature_gate.go:328] unrecognized feature gate: Example Sep 17 03:32:23.560077 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558261 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 03:32:23.560077 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558263 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 03:32:23.560077 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558267 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 03:32:23.560077 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558271 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 03:32:23.560077 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558274 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 03:32:23.560077 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558277 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 03:32:23.560077 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558280 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 03:32:23.560077 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558283 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 03:32:23.560077 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558285 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 03:32:23.560077 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558288 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 03:32:23.560077 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558291 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 03:32:23.560077 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558294 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 03:32:23.560077 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.558297 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 03:32:23.560599 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559006 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 03:32:23.560599 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559014 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 03:32:23.560599 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559017 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 03:32:23.560599 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559019 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 03:32:23.560599 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559024 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 03:32:23.560599 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559029 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 03:32:23.560599 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559032 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 03:32:23.560599 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559035 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 03:32:23.560599 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559038 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 03:32:23.560599 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559042 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 03:32:23.560599 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559044 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 03:32:23.560599 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559047 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 03:32:23.560599 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559050 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 03:32:23.560599 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559052 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 03:32:23.560599 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559054 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 03:32:23.560599 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559057 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 03:32:23.560599 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559060 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 03:32:23.560599 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559062 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 03:32:23.560599 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559065 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 03:32:23.561088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559067 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 03:32:23.561088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559070 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 03:32:23.561088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559073 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 03:32:23.561088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559076 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 03:32:23.561088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559079 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 03:32:23.561088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559082 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 03:32:23.561088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559084 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 03:32:23.561088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559087 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 03:32:23.561088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559089 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 03:32:23.561088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559092 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 03:32:23.561088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559095 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 03:32:23.561088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559098 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 03:32:23.561088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559100 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 03:32:23.561088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559103 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 03:32:23.561088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559105 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 03:32:23.561088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559108 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 03:32:23.561088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559110 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 03:32:23.561088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559113 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 03:32:23.561088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559116 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 03:32:23.561088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559120 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 03:32:23.561575 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559123 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 03:32:23.561575 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559125 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 03:32:23.561575 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559128 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 03:32:23.561575 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559130 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 03:32:23.561575 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559133 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 03:32:23.561575 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559135 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 03:32:23.561575 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559138 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 03:32:23.561575 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559140 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 03:32:23.561575 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559144 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 03:32:23.561575 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559148 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 03:32:23.561575 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559150 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 03:32:23.561575 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559153 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 03:32:23.561575 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559156 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 03:32:23.561575 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559159 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 03:32:23.561575 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559162 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 03:32:23.561575 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559165 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 03:32:23.561575 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559168 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 03:32:23.561575 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559171 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 03:32:23.561575 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559174 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 03:32:23.562047 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559176 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 03:32:23.562047 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559179 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 03:32:23.562047 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559182 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 03:32:23.562047 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559185 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 03:32:23.562047 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559187 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 03:32:23.562047 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559189 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 03:32:23.562047 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559192 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 03:32:23.562047 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559195 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 03:32:23.562047 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559197 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 03:32:23.562047 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559200 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 03:32:23.562047 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559202 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 03:32:23.562047 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559204 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 03:32:23.562047 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559208 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 03:32:23.562047 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559213 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 03:32:23.562047 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559216 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 03:32:23.562047 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559219 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 03:32:23.562047 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559221 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 03:32:23.562047 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559224 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 03:32:23.562047 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559227 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 03:32:23.562047 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559229 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 03:32:23.562536 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559231 2551 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 03:32:23.562536 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559234 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 03:32:23.562536 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559236 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 03:32:23.562536 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559239 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 03:32:23.562536 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559241 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 03:32:23.562536 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559245 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 03:32:23.562536 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559247 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 03:32:23.562536 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559250 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 03:32:23.562536 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559252 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 03:32:23.562536 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559257 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 03:32:23.562536 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559260 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 03:32:23.562536 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559262 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 03:32:23.562536 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559265 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 03:32:23.562536 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559268 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 03:32:23.562536 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559270 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 03:32:23.562536 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559272 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 03:32:23.562536 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559275 2551 feature_gate.go:328] unrecognized feature gate: Example Sep 17 03:32:23.562536 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559277 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 03:32:23.562536 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559281 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 03:32:23.563091 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559285 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 03:32:23.563091 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559287 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 03:32:23.563091 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559712 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 03:32:23.563091 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559719 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 03:32:23.563091 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559723 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 03:32:23.563091 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559726 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 03:32:23.563091 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559730 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 03:32:23.563091 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559733 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 03:32:23.563091 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559735 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 03:32:23.563091 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559738 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 03:32:23.563091 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559741 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 03:32:23.563091 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559744 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 03:32:23.563091 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559747 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 03:32:23.563091 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559749 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 03:32:23.563091 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559752 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 03:32:23.563091 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559755 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 03:32:23.563091 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559757 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 03:32:23.563091 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559760 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 03:32:23.563091 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559763 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 03:32:23.563635 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559765 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 03:32:23.563635 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559768 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 03:32:23.563635 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559770 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 03:32:23.563635 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559786 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 03:32:23.563635 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559789 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 03:32:23.563635 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559791 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 03:32:23.563635 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559794 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 03:32:23.563635 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559798 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 03:32:23.563635 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559802 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 03:32:23.563635 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559806 2551 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 03:32:23.563635 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559810 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 03:32:23.563635 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559815 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 03:32:23.563635 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559818 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 03:32:23.563635 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559820 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 03:32:23.563635 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559823 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 03:32:23.563635 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559825 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 03:32:23.563635 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559828 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 03:32:23.563635 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559831 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 03:32:23.563635 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559833 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 03:32:23.563635 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559836 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 03:32:23.564204 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559839 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 03:32:23.564204 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559842 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 03:32:23.564204 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559845 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 03:32:23.564204 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559848 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 03:32:23.564204 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559850 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 03:32:23.564204 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559853 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 03:32:23.564204 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559856 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 03:32:23.564204 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559858 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 03:32:23.564204 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559861 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 03:32:23.564204 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559863 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 03:32:23.564204 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559866 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 03:32:23.564204 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559869 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 03:32:23.564204 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559872 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 03:32:23.564204 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559874 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 03:32:23.564204 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559877 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 03:32:23.564204 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559880 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 03:32:23.564204 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559883 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 03:32:23.564204 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559886 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 03:32:23.564204 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559888 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 03:32:23.564204 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559891 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 03:32:23.564752 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559893 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 03:32:23.564752 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559896 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 03:32:23.564752 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559898 2551 feature_gate.go:328] unrecognized feature gate: Example Sep 17 03:32:23.564752 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559901 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 03:32:23.564752 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559904 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 03:32:23.564752 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559906 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 03:32:23.564752 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559909 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 03:32:23.564752 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559911 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 03:32:23.564752 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559914 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 03:32:23.564752 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559917 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 03:32:23.564752 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559919 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 03:32:23.564752 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559922 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 03:32:23.564752 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559924 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 03:32:23.564752 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559927 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 03:32:23.564752 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559930 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 03:32:23.564752 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559933 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 03:32:23.564752 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559937 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 03:32:23.564752 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559940 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 03:32:23.564752 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559943 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 03:32:23.565332 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559946 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 03:32:23.565332 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559949 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 03:32:23.565332 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559951 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 03:32:23.565332 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559954 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 03:32:23.565332 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559957 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 03:32:23.565332 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559960 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 03:32:23.565332 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559962 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 03:32:23.565332 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559965 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 03:32:23.565332 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559967 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 03:32:23.565332 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559970 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 03:32:23.565332 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559973 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 03:32:23.565332 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559975 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 03:32:23.565332 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559978 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 03:32:23.565332 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559982 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 03:32:23.565332 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559986 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 03:32:23.565332 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559988 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 03:32:23.565332 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559991 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 03:32:23.565332 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559993 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 03:32:23.565332 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559996 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 03:32:23.565876 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.559998 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 03:32:23.565876 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560001 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 03:32:23.565876 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560004 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 03:32:23.565876 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560007 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 03:32:23.565876 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560071 2551 flags.go:64] FLAG: --address="0.0.0.0" Sep 17 03:32:23.565876 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560114 2551 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 17 03:32:23.565876 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560123 2551 flags.go:64] FLAG: --anonymous-auth="true" Sep 17 03:32:23.565876 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560128 2551 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 17 03:32:23.565876 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560134 2551 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 17 03:32:23.565876 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560137 2551 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 17 03:32:23.565876 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560141 2551 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 17 03:32:23.565876 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560149 2551 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 17 03:32:23.565876 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560152 2551 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 17 03:32:23.565876 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560155 2551 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 17 03:32:23.565876 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560158 2551 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 17 03:32:23.565876 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560162 2551 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 17 03:32:23.565876 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560165 2551 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 17 03:32:23.565876 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560168 2551 flags.go:64] FLAG: --cgroup-root="" Sep 17 03:32:23.565876 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560171 2551 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 17 03:32:23.565876 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560174 2551 flags.go:64] FLAG: --client-ca-file="" Sep 17 03:32:23.565876 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560177 2551 flags.go:64] FLAG: --cloud-provider="external" Sep 17 03:32:23.565876 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560180 2551 flags.go:64] FLAG: --cluster-dns="[]" Sep 17 03:32:23.565876 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560184 2551 flags.go:64] FLAG: --cluster-domain="" Sep 17 03:32:23.565876 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560187 2551 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 17 03:32:23.566528 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560190 2551 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 17 03:32:23.566528 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560193 2551 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 17 03:32:23.566528 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560196 2551 flags.go:64] FLAG: --container-log-max-files="5" Sep 17 03:32:23.566528 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560200 2551 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 17 03:32:23.566528 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560203 2551 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 17 03:32:23.566528 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560206 2551 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 17 03:32:23.566528 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560209 2551 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 17 03:32:23.566528 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560212 2551 flags.go:64] FLAG: --contention-profiling="false" Sep 17 03:32:23.566528 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560217 2551 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 17 03:32:23.566528 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560220 2551 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 17 03:32:23.566528 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560223 2551 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 17 03:32:23.566528 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560227 2551 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 17 03:32:23.566528 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560231 2551 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 17 03:32:23.566528 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560234 2551 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 17 03:32:23.566528 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560237 2551 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 17 03:32:23.566528 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560239 2551 flags.go:64] FLAG: --enable-load-reader="false" Sep 17 03:32:23.566528 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560243 2551 flags.go:64] FLAG: --enable-server="true" Sep 17 03:32:23.566528 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560246 2551 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 17 03:32:23.566528 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560251 2551 flags.go:64] FLAG: --event-burst="100" Sep 17 03:32:23.566528 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560254 2551 flags.go:64] FLAG: --event-qps="50" Sep 17 03:32:23.566528 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560257 2551 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 17 03:32:23.566528 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560260 2551 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 17 03:32:23.566528 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560263 2551 flags.go:64] FLAG: --eviction-hard="" Sep 17 03:32:23.566528 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560267 2551 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 17 03:32:23.567164 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560270 2551 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 17 03:32:23.567164 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560273 2551 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 17 03:32:23.567164 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560276 2551 flags.go:64] FLAG: --eviction-soft="" Sep 17 03:32:23.567164 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560279 2551 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 17 03:32:23.567164 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560282 2551 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 17 03:32:23.567164 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560285 2551 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 17 03:32:23.567164 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560288 2551 flags.go:64] FLAG: --experimental-mounter-path="" Sep 17 03:32:23.567164 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560291 2551 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 17 03:32:23.567164 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560294 2551 flags.go:64] FLAG: --fail-swap-on="true" Sep 17 03:32:23.567164 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560297 2551 flags.go:64] FLAG: --feature-gates="" Sep 17 03:32:23.567164 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560301 2551 flags.go:64] FLAG: --file-check-frequency="20s" Sep 17 03:32:23.567164 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560304 2551 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 17 03:32:23.567164 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560307 2551 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 17 03:32:23.567164 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560310 2551 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 17 03:32:23.567164 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560313 2551 flags.go:64] FLAG: --healthz-port="10248" Sep 17 03:32:23.567164 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560316 2551 flags.go:64] FLAG: --help="false" Sep 17 03:32:23.567164 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560321 2551 flags.go:64] FLAG: --hostname-override="ip-10-0-143-180.ec2.internal" Sep 17 03:32:23.567164 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560324 2551 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 17 03:32:23.567164 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560327 2551 flags.go:64] FLAG: --http-check-frequency="20s" Sep 17 03:32:23.567164 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560330 2551 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 17 03:32:23.567164 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560333 2551 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 17 03:32:23.567164 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560337 2551 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 17 03:32:23.567164 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560340 2551 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 17 03:32:23.567164 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560342 2551 flags.go:64] FLAG: --image-service-endpoint="" Sep 17 03:32:23.567818 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560345 2551 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 17 03:32:23.567818 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560348 2551 flags.go:64] FLAG: --kube-api-burst="100" Sep 17 03:32:23.567818 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560351 2551 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 17 03:32:23.567818 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560355 2551 flags.go:64] FLAG: --kube-api-qps="50" Sep 17 03:32:23.567818 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560359 2551 flags.go:64] FLAG: --kube-reserved="" Sep 17 03:32:23.567818 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560362 2551 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 17 03:32:23.567818 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560365 2551 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 17 03:32:23.567818 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560368 2551 flags.go:64] FLAG: --kubelet-cgroups="" Sep 17 03:32:23.567818 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560371 2551 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 17 03:32:23.567818 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560374 2551 flags.go:64] FLAG: --lock-file="" Sep 17 03:32:23.567818 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560377 2551 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 17 03:32:23.567818 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560380 2551 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 17 03:32:23.567818 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560383 2551 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 17 03:32:23.567818 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560388 2551 flags.go:64] FLAG: --log-json-split-stream="false" Sep 17 03:32:23.567818 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560391 2551 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 17 03:32:23.567818 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560394 2551 flags.go:64] FLAG: --log-text-split-stream="false" Sep 17 03:32:23.567818 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560396 2551 flags.go:64] FLAG: --logging-format="text" Sep 17 03:32:23.567818 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560399 2551 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 17 03:32:23.567818 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560402 2551 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 17 03:32:23.567818 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560405 2551 flags.go:64] FLAG: --manifest-url="" Sep 17 03:32:23.567818 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560408 2551 flags.go:64] FLAG: --manifest-url-header="" Sep 17 03:32:23.567818 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560412 2551 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 17 03:32:23.567818 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560415 2551 flags.go:64] FLAG: --max-open-files="1000000" Sep 17 03:32:23.567818 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560419 2551 flags.go:64] FLAG: --max-pods="110" Sep 17 03:32:23.567818 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560424 2551 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 17 03:32:23.568446 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560427 2551 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 17 03:32:23.568446 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560430 2551 flags.go:64] FLAG: --memory-manager-policy="None" Sep 17 03:32:23.568446 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560433 2551 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 17 03:32:23.568446 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560436 2551 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 17 03:32:23.568446 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560439 2551 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 17 03:32:23.568446 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560442 2551 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 17 03:32:23.568446 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560449 2551 flags.go:64] FLAG: --node-status-max-images="50" Sep 17 03:32:23.568446 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560452 2551 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 17 03:32:23.568446 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560455 2551 flags.go:64] FLAG: --oom-score-adj="-999" Sep 17 03:32:23.568446 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560458 2551 flags.go:64] FLAG: --pod-cidr="" Sep 17 03:32:23.568446 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560461 2551 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 17 03:32:23.568446 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560467 2551 flags.go:64] FLAG: --pod-manifest-path="" Sep 17 03:32:23.568446 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560471 2551 flags.go:64] FLAG: --pod-max-pids="-1" Sep 17 03:32:23.568446 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560475 2551 flags.go:64] FLAG: --pods-per-core="0" Sep 17 03:32:23.568446 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560478 2551 flags.go:64] FLAG: --port="10250" Sep 17 03:32:23.568446 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560481 2551 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 17 03:32:23.568446 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560484 2551 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b3bc12c5c191a32c" Sep 17 03:32:23.568446 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560487 2551 flags.go:64] FLAG: --qos-reserved="" Sep 17 03:32:23.568446 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560490 2551 flags.go:64] FLAG: --read-only-port="10255" Sep 17 03:32:23.568446 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560493 2551 flags.go:64] FLAG: --register-node="true" Sep 17 03:32:23.568446 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560496 2551 flags.go:64] FLAG: --register-with-taints="" Sep 17 03:32:23.568446 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560499 2551 flags.go:64] FLAG: --registry-burst="10" Sep 17 03:32:23.568446 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560502 2551 flags.go:64] FLAG: --registry-qps="5" Sep 17 03:32:23.568446 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560505 2551 flags.go:64] FLAG: --reserved-cpus="" Sep 17 03:32:23.569080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560508 2551 flags.go:64] FLAG: --reserved-memory="" Sep 17 03:32:23.569080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560512 2551 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 17 03:32:23.569080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560515 2551 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 17 03:32:23.569080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560518 2551 flags.go:64] FLAG: --rotate-certificates="false" Sep 17 03:32:23.569080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560521 2551 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 17 03:32:23.569080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560524 2551 flags.go:64] FLAG: --runonce="false" Sep 17 03:32:23.569080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560527 2551 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 17 03:32:23.569080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560532 2551 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 17 03:32:23.569080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560535 2551 flags.go:64] FLAG: --seccomp-default="false" Sep 17 03:32:23.569080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560538 2551 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 17 03:32:23.569080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560541 2551 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 17 03:32:23.569080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560544 2551 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 17 03:32:23.569080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560547 2551 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 17 03:32:23.569080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560550 2551 flags.go:64] FLAG: --storage-driver-password="root" Sep 17 03:32:23.569080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560553 2551 flags.go:64] FLAG: --storage-driver-secure="false" Sep 17 03:32:23.569080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560556 2551 flags.go:64] FLAG: --storage-driver-table="stats" Sep 17 03:32:23.569080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560560 2551 flags.go:64] FLAG: --storage-driver-user="root" Sep 17 03:32:23.569080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560562 2551 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 17 03:32:23.569080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560565 2551 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 17 03:32:23.569080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560569 2551 flags.go:64] FLAG: --system-cgroups="" Sep 17 03:32:23.569080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560573 2551 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 17 03:32:23.569080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560579 2551 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 17 03:32:23.569080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560582 2551 flags.go:64] FLAG: --tls-cert-file="" Sep 17 03:32:23.569080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560584 2551 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 17 03:32:23.569080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560588 2551 flags.go:64] FLAG: --tls-min-version="" Sep 17 03:32:23.569747 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560591 2551 flags.go:64] FLAG: --tls-private-key-file="" Sep 17 03:32:23.569747 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560594 2551 flags.go:64] FLAG: --topology-manager-policy="none" Sep 17 03:32:23.569747 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560597 2551 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 17 03:32:23.569747 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560600 2551 flags.go:64] FLAG: --topology-manager-scope="container" Sep 17 03:32:23.569747 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560603 2551 flags.go:64] FLAG: --v="2" Sep 17 03:32:23.569747 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560607 2551 flags.go:64] FLAG: --version="false" Sep 17 03:32:23.569747 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560612 2551 flags.go:64] FLAG: --vmodule="" Sep 17 03:32:23.569747 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560615 2551 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 17 03:32:23.569747 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.560619 2551 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 17 03:32:23.569747 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560731 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 03:32:23.569747 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560734 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 03:32:23.569747 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560737 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 03:32:23.569747 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560739 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 03:32:23.569747 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560742 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 03:32:23.569747 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560748 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 03:32:23.569747 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560751 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 03:32:23.569747 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560754 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 03:32:23.569747 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560757 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 03:32:23.569747 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560759 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 03:32:23.569747 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560762 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 03:32:23.569747 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560764 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 03:32:23.569747 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560767 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 03:32:23.570309 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560770 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 03:32:23.570309 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560785 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 03:32:23.570309 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560788 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 03:32:23.570309 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560792 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 03:32:23.570309 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560795 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 03:32:23.570309 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560802 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 03:32:23.570309 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560805 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 03:32:23.570309 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560807 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 03:32:23.570309 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560810 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 03:32:23.570309 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560813 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 03:32:23.570309 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560816 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 03:32:23.570309 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560820 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 03:32:23.570309 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560824 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 03:32:23.570309 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560827 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 03:32:23.570309 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560830 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 03:32:23.570309 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560833 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 03:32:23.570309 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560835 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 03:32:23.570309 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560838 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 03:32:23.570309 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560840 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 03:32:23.570787 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560843 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 03:32:23.570787 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560846 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 03:32:23.570787 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560848 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 03:32:23.570787 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560852 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 03:32:23.570787 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560855 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 03:32:23.570787 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560860 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 03:32:23.570787 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560863 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 03:32:23.570787 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560866 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 03:32:23.570787 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560869 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 03:32:23.570787 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560871 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 03:32:23.570787 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560874 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 03:32:23.570787 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560877 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 03:32:23.570787 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560880 2551 feature_gate.go:328] unrecognized feature gate: Example Sep 17 03:32:23.570787 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560882 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 03:32:23.570787 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560885 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 03:32:23.570787 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560887 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 03:32:23.570787 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560890 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 03:32:23.570787 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560893 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 03:32:23.570787 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560897 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 03:32:23.570787 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560900 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 03:32:23.571291 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560902 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 03:32:23.571291 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560905 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 03:32:23.571291 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560908 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 03:32:23.571291 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560911 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 03:32:23.571291 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560913 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 03:32:23.571291 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560916 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 03:32:23.571291 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560918 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 03:32:23.571291 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560921 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 03:32:23.571291 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560924 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 03:32:23.571291 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560926 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 03:32:23.571291 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560929 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 03:32:23.571291 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560931 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 03:32:23.571291 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560934 2551 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 03:32:23.571291 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560936 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 03:32:23.571291 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560940 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 03:32:23.571291 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560942 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 03:32:23.571291 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560945 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 03:32:23.571291 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560949 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 03:32:23.571291 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560951 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 03:32:23.571291 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560954 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 03:32:23.571811 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560957 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 03:32:23.571811 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560959 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 03:32:23.571811 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560962 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 03:32:23.571811 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560964 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 03:32:23.571811 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560968 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 03:32:23.571811 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560971 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 03:32:23.571811 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560973 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 03:32:23.571811 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560976 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 03:32:23.571811 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560978 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 03:32:23.571811 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560981 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 03:32:23.571811 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560985 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 03:32:23.571811 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560988 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 03:32:23.571811 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560991 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 03:32:23.571811 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560993 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 03:32:23.571811 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560996 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 03:32:23.571811 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.560998 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 03:32:23.571811 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.561001 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 03:32:23.571811 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.561004 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 03:32:23.571811 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.561006 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 03:32:23.571811 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.561009 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 03:32:23.572314 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.561011 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 03:32:23.572314 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.561021 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 03:32:23.572314 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.561024 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 03:32:23.572314 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.561027 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 03:32:23.572314 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.561029 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 03:32:23.572314 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.561032 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 03:32:23.572314 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.561035 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 03:32:23.572314 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.561959 2551 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 03:32:23.572314 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.570742 2551 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 17 03:32:23.572314 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.570760 2551 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 17 03:32:23.572314 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.570789 2551 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 17 03:32:23.572314 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.570799 2551 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 17 03:32:23.572314 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570857 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 03:32:23.572314 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570862 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 03:32:23.572824 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570866 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 03:32:23.572824 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570869 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 03:32:23.572824 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570873 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 03:32:23.572824 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570876 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 03:32:23.572824 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570879 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 03:32:23.572824 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570882 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 03:32:23.572824 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570885 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 03:32:23.572824 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570889 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 03:32:23.572824 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570893 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 03:32:23.572824 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570897 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 03:32:23.572824 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570900 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 03:32:23.572824 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570903 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 03:32:23.572824 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570906 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 03:32:23.572824 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570909 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 03:32:23.572824 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570912 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 03:32:23.572824 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570915 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 03:32:23.572824 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570917 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 03:32:23.572824 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570920 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 03:32:23.572824 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570922 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 03:32:23.573586 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570925 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 03:32:23.573586 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570927 2551 feature_gate.go:328] unrecognized feature gate: Example Sep 17 03:32:23.573586 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570930 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 03:32:23.573586 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570932 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 03:32:23.573586 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570935 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 03:32:23.573586 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570938 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 03:32:23.573586 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570940 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 03:32:23.573586 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570942 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 03:32:23.573586 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570946 2551 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 03:32:23.573586 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570949 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 03:32:23.573586 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570952 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 03:32:23.573586 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570955 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 03:32:23.573586 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570958 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 03:32:23.573586 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570960 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 03:32:23.573586 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570963 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 03:32:23.573586 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570965 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 03:32:23.573586 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570968 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 03:32:23.573586 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570970 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 03:32:23.573586 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570973 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 03:32:23.573586 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570975 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 03:32:23.574219 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570978 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 03:32:23.574219 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570981 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 03:32:23.574219 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570983 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 03:32:23.574219 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570985 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 03:32:23.574219 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570988 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 03:32:23.574219 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570990 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 03:32:23.574219 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570993 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 03:32:23.574219 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570996 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 03:32:23.574219 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.570998 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 03:32:23.574219 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571002 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 03:32:23.574219 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571005 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 03:32:23.574219 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571008 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 03:32:23.574219 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571011 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 03:32:23.574219 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571014 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 03:32:23.574219 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571017 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 03:32:23.574219 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571019 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 03:32:23.574219 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571022 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 03:32:23.574219 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571024 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 03:32:23.574219 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571027 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 03:32:23.574694 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571029 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 03:32:23.574694 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571032 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 03:32:23.574694 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571035 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 03:32:23.574694 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571038 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 03:32:23.574694 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571041 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 03:32:23.574694 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571043 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 03:32:23.574694 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571046 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 03:32:23.574694 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571048 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 03:32:23.574694 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571051 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 03:32:23.574694 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571053 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 03:32:23.574694 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571056 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 03:32:23.574694 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571058 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 03:32:23.574694 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571061 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 03:32:23.574694 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571064 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 03:32:23.574694 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571066 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 03:32:23.574694 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571069 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 03:32:23.574694 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571071 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 03:32:23.574694 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571074 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 03:32:23.574694 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571076 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 03:32:23.574694 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571079 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 03:32:23.575195 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571081 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 03:32:23.575195 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571084 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 03:32:23.575195 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571086 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 03:32:23.575195 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571089 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 03:32:23.575195 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571091 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 03:32:23.575195 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571094 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 03:32:23.575195 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571097 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 03:32:23.575195 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571101 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 03:32:23.575195 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571104 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 03:32:23.575195 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571106 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 03:32:23.575195 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571109 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 03:32:23.575195 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571111 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 03:32:23.575195 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571114 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 03:32:23.575195 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571117 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 03:32:23.575195 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571120 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 03:32:23.575195 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571123 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 03:32:23.575195 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571125 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 03:32:23.575195 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571128 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 03:32:23.575195 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571130 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 03:32:23.575659 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.571135 2551 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 03:32:23.575659 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571268 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 03:32:23.575659 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571273 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 03:32:23.575659 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571276 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 03:32:23.575659 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571279 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 03:32:23.575659 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571282 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 03:32:23.575659 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571285 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 03:32:23.575659 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571289 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 03:32:23.575659 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571293 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 03:32:23.575659 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571296 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 03:32:23.575659 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571299 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 03:32:23.575659 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571302 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 03:32:23.575659 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571305 2551 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 03:32:23.575659 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571308 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 03:32:23.575659 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571310 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 03:32:23.576088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571313 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 03:32:23.576088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571315 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 03:32:23.576088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571317 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 03:32:23.576088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571320 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 03:32:23.576088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571323 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 03:32:23.576088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571325 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 03:32:23.576088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571328 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 03:32:23.576088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571330 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 03:32:23.576088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571333 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 03:32:23.576088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571335 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 03:32:23.576088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571338 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 03:32:23.576088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571341 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 03:32:23.576088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571344 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 03:32:23.576088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571346 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 03:32:23.576088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571350 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 03:32:23.576088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571352 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 03:32:23.576088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571355 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 03:32:23.576088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571357 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 03:32:23.576088 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571360 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 03:32:23.576591 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571362 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 03:32:23.576591 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571365 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 03:32:23.576591 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571367 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 03:32:23.576591 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571370 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 03:32:23.576591 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571372 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 03:32:23.576591 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571374 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 03:32:23.576591 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571377 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 03:32:23.576591 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571379 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 03:32:23.576591 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571382 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 03:32:23.576591 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571384 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 03:32:23.576591 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571387 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 03:32:23.576591 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571389 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 03:32:23.576591 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571392 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 03:32:23.576591 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571394 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 03:32:23.576591 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571397 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 03:32:23.576591 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571399 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 03:32:23.576591 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571402 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 03:32:23.576591 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571404 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 03:32:23.576591 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571407 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 03:32:23.576591 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571409 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 03:32:23.577329 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571412 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 03:32:23.577329 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571414 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 03:32:23.577329 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571417 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 03:32:23.577329 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571420 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 03:32:23.577329 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571422 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 03:32:23.577329 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571425 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 03:32:23.577329 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571427 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 03:32:23.577329 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571430 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 03:32:23.577329 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571433 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 03:32:23.577329 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571436 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 03:32:23.577329 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571438 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 03:32:23.577329 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571442 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 03:32:23.577329 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571445 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 03:32:23.577329 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571448 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 03:32:23.577329 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571451 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 03:32:23.577329 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571454 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 03:32:23.577329 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571457 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 03:32:23.577329 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571459 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 03:32:23.577329 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571462 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 03:32:23.577839 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571464 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 03:32:23.577839 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571467 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 03:32:23.577839 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571469 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 03:32:23.577839 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571472 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 03:32:23.577839 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571474 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 03:32:23.577839 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571477 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 03:32:23.577839 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571480 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 03:32:23.577839 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571482 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 03:32:23.577839 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571485 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 03:32:23.577839 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571487 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 03:32:23.577839 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571490 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 03:32:23.577839 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571492 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 03:32:23.577839 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571495 2551 feature_gate.go:328] unrecognized feature gate: Example Sep 17 03:32:23.577839 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571506 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 03:32:23.577839 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571510 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 03:32:23.577839 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571512 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 03:32:23.577839 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571515 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 03:32:23.577839 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571518 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 03:32:23.577839 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571521 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 03:32:23.577839 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571523 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 03:32:23.578565 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571526 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 03:32:23.578565 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571529 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 03:32:23.578565 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571532 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 03:32:23.578565 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571535 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 03:32:23.578565 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571539 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 03:32:23.578565 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571542 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 03:32:23.578565 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:23.571545 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 03:32:23.578565 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.571550 2551 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 03:32:23.578565 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.571657 2551 server.go:962] "Client rotation is on, will bootstrap in background" Sep 17 03:32:23.578565 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.575616 2551 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 17 03:32:23.578565 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.576768 2551 server.go:1019] "Starting client certificate rotation" Sep 17 03:32:23.578565 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.576891 2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 03:32:23.578565 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.576944 2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 03:32:23.579745 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.579730 2551 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 03:32:23.581801 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.581768 2551 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 03:32:23.594866 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.594844 2551 log.go:25] "Validated CRI v1 runtime API" Sep 17 03:32:23.598360 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.598347 2551 log.go:25] "Validated CRI v1 image API" Sep 17 03:32:23.599190 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.599176 2551 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 17 03:32:23.603469 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.603451 2551 fs.go:135] Filesystem UUIDs: map[781dd280-863d-468d-97db-92e10bd1de1a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d7a42e63-e2a4-46ff-92c6-02805be7aeea:/dev/nvme0n1p3] Sep 17 03:32:23.603541 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.603468 2551 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 17 03:32:23.606366 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.606347 2551 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 03:32:23.609726 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.609611 2551 manager.go:216] Machine: {Timestamp:2026-09-17 03:32:23.608219126 +0000 UTC m=+0.380078302 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099919 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24281f8f8a65c3ba70db1769bd1519 SystemUUID:ec24281f-8f8a-65c3-ba70-db1769bd1519 BootID:0ca5c3da-6c28-4108-b1c0-c2cc93b50ee2 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:c4:09:f1:3b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:c4:09:f1:3b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:09:9a:dd:bf:3c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 17 03:32:23.609726 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.609724 2551 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 17 03:32:23.609901 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.609818 2551 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 17 03:32:23.613329 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.613304 2551 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 17 03:32:23.613463 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.613332 2551 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-180.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 17 03:32:23.614163 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.614152 2551 topology_manager.go:138] "Creating topology manager with none policy" Sep 17 03:32:23.614195 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.614166 2551 container_manager_linux.go:309] "Creating device plugin manager" Sep 17 03:32:23.614195 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.614174 2551 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 03:32:23.614195 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.614188 2551 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 03:32:23.615539 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.615527 2551 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 17 03:32:23.620416 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.620284 2551 state_mem.go:36] "Initialized new in-memory state store" Sep 17 03:32:23.620537 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.620528 2551 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 17 03:32:23.620570 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.620560 2551 kubelet.go:486] "Attempting to sync node with API server" Sep 17 03:32:23.620597 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.620570 2551 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 17 03:32:23.620597 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.620581 2551 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 17 03:32:23.620597 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.620590 2551 kubelet.go:398] "Adding apiserver pod source" Sep 17 03:32:23.620688 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.620600 2551 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 17 03:32:23.620967 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.620953 2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 03:32:23.621015 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.620977 2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 03:32:23.623802 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.623729 2551 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 17 03:32:23.626289 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.626269 2551 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 17 03:32:23.626357 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.626302 2551 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 17 03:32:23.628280 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.628268 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 17 03:32:23.628329 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.628285 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 17 03:32:23.628329 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.628292 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 17 03:32:23.628329 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.628297 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 17 03:32:23.628329 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.628306 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 17 03:32:23.628329 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.628316 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 17 03:32:23.628464 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.628332 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 17 03:32:23.628464 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.628338 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 17 03:32:23.628464 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.628345 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 17 03:32:23.628464 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.628351 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 17 03:32:23.628464 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.628360 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 17 03:32:23.628464 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.628366 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 17 03:32:23.629225 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.629206 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 17 03:32:23.629225 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.629224 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 17 03:32:23.631598 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.631576 2551 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-180.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 17 03:32:23.631732 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:23.631711 2551 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-180.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 17 03:32:23.631807 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:23.631713 2551 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 17 03:32:23.633227 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.633215 2551 server.go:1268] "Started kubelet" Sep 17 03:32:23.633339 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.633289 2551 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 17 03:32:23.633389 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.633357 2551 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 17 03:32:23.633444 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.633311 2551 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 17 03:32:23.634076 ip-10-0-143-180 systemd[1]: Started Kubernetes Kubelet. Sep 17 03:32:23.635582 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.635565 2551 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 17 03:32:23.636335 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.636316 2551 server.go:310] "Adding debug handlers to kubelet server" Sep 17 03:32:23.638826 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.638791 2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f5khw" Sep 17 03:32:23.639437 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:23.639416 2551 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 17 03:32:23.642179 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:23.641055 2551 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-180.ec2.internal.18d5fe380ca1bd6a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-180.ec2.internal,UID:ip-10-0-143-180.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-180.ec2.internal,},FirstTimestamp:2026-09-17 03:32:23.63319025 +0000 UTC m=+0.405049424,LastTimestamp:2026-09-17 03:32:23.63319025 +0000 UTC m=+0.405049424,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-180.ec2.internal,}" Sep 17 03:32:23.642737 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.642717 2551 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 17 03:32:23.642835 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.642738 2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 17 03:32:23.642889 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:23.642831 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-180.ec2.internal\" not found" Sep 17 03:32:23.643563 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.643543 2551 factory.go:55] Registering systemd factory Sep 17 03:32:23.643563 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.643565 2551 factory.go:223] Registration of the systemd container factory successfully Sep 17 03:32:23.643705 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.643587 2551 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 17 03:32:23.643705 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.643590 2551 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 17 03:32:23.643705 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.643609 2551 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 17 03:32:23.643705 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.643684 2551 reconstruct.go:97] "Volume reconstruction finished" Sep 17 03:32:23.643705 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.643694 2551 reconciler.go:29] "Reconciler: start to sync state" Sep 17 03:32:23.643965 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.643810 2551 factory.go:153] Registering CRI-O factory Sep 17 03:32:23.643965 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.643822 2551 factory.go:223] Registration of the crio container factory successfully Sep 17 03:32:23.643965 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.643873 2551 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 17 03:32:23.643965 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.643889 2551 factory.go:103] Registering Raw factory Sep 17 03:32:23.643965 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.643902 2551 manager.go:1196] Started watching for new ooms in manager Sep 17 03:32:23.645219 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.645167 2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f5khw" Sep 17 03:32:23.645349 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.645330 2551 manager.go:349] Starting recovery of all containers Sep 17 03:32:23.648142 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:23.648116 2551 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-180.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 17 03:32:23.648228 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:23.648202 2551 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 17 03:32:23.657785 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.657755 2551 manager.go:354] Recovery completed Sep 17 03:32:23.661807 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.661794 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:32:23.663739 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.663716 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-180.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:32:23.663830 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.663751 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-180.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:32:23.663830 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.663767 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-180.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:32:23.664349 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.664338 2551 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 17 03:32:23.664349 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.664347 2551 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 17 03:32:23.664411 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.664351 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:32:23.664411 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.664363 2551 state_mem.go:36] "Initialized new in-memory state store" Sep 17 03:32:23.666087 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:23.666019 2551 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-180.ec2.internal.18d5fe380e73d73a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-180.ec2.internal,UID:ip-10-0-143-180.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-180.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-180.ec2.internal,},FirstTimestamp:2026-09-17 03:32:23.663736634 +0000 UTC m=+0.435595811,LastTimestamp:2026-09-17 03:32:23.663736634 +0000 UTC m=+0.435595811,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-180.ec2.internal,}" Sep 17 03:32:23.666453 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.666439 2551 policy_none.go:49] "None policy: Start" Sep 17 03:32:23.666453 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.666454 2551 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 17 03:32:23.666562 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.666465 2551 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 17 03:32:23.668451 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.668439 2551 policy_none.go:47] "Start" Sep 17 03:32:23.669125 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.669111 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-180.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:32:23.669197 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.669137 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-180.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:32:23.669197 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.669149 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-180.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:32:23.705401 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.705384 2551 manager.go:337] "Starting Device Plugin manager" Sep 17 03:32:23.727521 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:23.705429 2551 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 17 03:32:23.727521 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.705442 2551 server.go:87] "Starting device plugin registration server" Sep 17 03:32:23.727521 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.705725 2551 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 17 03:32:23.727521 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.705739 2551 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 17 03:32:23.727521 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.705936 2551 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 17 03:32:23.727521 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.706011 2551 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 17 03:32:23.727521 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.706018 2551 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 17 03:32:23.727521 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:23.706499 2551 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 17 03:32:23.727521 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:23.706552 2551 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-180.ec2.internal\" not found" Sep 17 03:32:23.727521 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.716485 2551 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 17 03:32:23.727521 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.717620 2551 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 17 03:32:23.727521 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.717660 2551 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 17 03:32:23.727521 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.717679 2551 kubelet.go:2448] "Starting kubelet main sync loop" Sep 17 03:32:23.727521 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:23.717719 2551 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 17 03:32:23.727521 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.719872 2551 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 03:32:23.806321 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.806206 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:32:23.807312 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.807295 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-180.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:32:23.807384 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.807326 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-180.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:32:23.807384 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.807349 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-180.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:32:23.807384 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.807376 2551 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-180.ec2.internal" Sep 17 03:32:23.814141 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.814126 2551 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-180.ec2.internal" Sep 17 03:32:23.814183 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:23.814150 2551 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-180.ec2.internal\": node \"ip-10-0-143-180.ec2.internal\" not found" Sep 17 03:32:23.817826 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.817786 2551 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-180.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-180.ec2.internal"] Sep 17 03:32:23.817943 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.817870 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:32:23.821294 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.821279 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-180.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:32:23.821361 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.821307 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-180.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:32:23.821361 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.821317 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-180.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:32:23.823537 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.823524 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:32:23.823649 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.823635 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-180.ec2.internal" Sep 17 03:32:23.823698 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.823663 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:32:23.824307 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.824282 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-180.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:32:23.824393 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.824328 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-180.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:32:23.824393 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.824348 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-180.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:32:23.824676 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.824659 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-180.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:32:23.824724 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.824688 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-180.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:32:23.824724 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.824698 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-180.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:32:23.826600 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.826582 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-180.ec2.internal" Sep 17 03:32:23.826686 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.826611 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 03:32:23.827302 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.827285 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-180.ec2.internal" event="NodeHasSufficientMemory" Sep 17 03:32:23.827381 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.827319 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-180.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 03:32:23.827381 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.827332 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-180.ec2.internal" event="NodeHasSufficientPID" Sep 17 03:32:23.840144 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:23.840123 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-180.ec2.internal\" not found" Sep 17 03:32:23.849582 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:23.849559 2551 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-180.ec2.internal\" not found" node="ip-10-0-143-180.ec2.internal" Sep 17 03:32:23.853901 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:23.853886 2551 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-180.ec2.internal\" not found" node="ip-10-0-143-180.ec2.internal" Sep 17 03:32:23.940789 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:23.940748 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-180.ec2.internal\" not found" Sep 17 03:32:23.945064 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.945035 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ae5517c1a906653611f35437758c68a1-config\") pod \"kube-apiserver-proxy-ip-10-0-143-180.ec2.internal\" (UID: \"ae5517c1a906653611f35437758c68a1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-180.ec2.internal" Sep 17 03:32:23.945125 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.945079 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1f0b96daeb2e00308a6fb177bc7b1434-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-180.ec2.internal\" (UID: \"1f0b96daeb2e00308a6fb177bc7b1434\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-180.ec2.internal" Sep 17 03:32:23.945125 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:23.945098 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f0b96daeb2e00308a6fb177bc7b1434-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-180.ec2.internal\" (UID: \"1f0b96daeb2e00308a6fb177bc7b1434\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-180.ec2.internal" Sep 17 03:32:24.041830 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:24.041795 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-180.ec2.internal\" not found" Sep 17 03:32:24.046146 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:24.046125 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f0b96daeb2e00308a6fb177bc7b1434-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-180.ec2.internal\" (UID: \"1f0b96daeb2e00308a6fb177bc7b1434\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-180.ec2.internal" Sep 17 03:32:24.046199 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:24.046155 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ae5517c1a906653611f35437758c68a1-config\") pod \"kube-apiserver-proxy-ip-10-0-143-180.ec2.internal\" (UID: \"ae5517c1a906653611f35437758c68a1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-180.ec2.internal" Sep 17 03:32:24.046199 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:24.046188 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1f0b96daeb2e00308a6fb177bc7b1434-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-180.ec2.internal\" (UID: \"1f0b96daeb2e00308a6fb177bc7b1434\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-180.ec2.internal" Sep 17 03:32:24.046264 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:24.046211 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f0b96daeb2e00308a6fb177bc7b1434-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-180.ec2.internal\" (UID: \"1f0b96daeb2e00308a6fb177bc7b1434\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-180.ec2.internal" Sep 17 03:32:24.046264 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:24.046232 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1f0b96daeb2e00308a6fb177bc7b1434-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-180.ec2.internal\" (UID: \"1f0b96daeb2e00308a6fb177bc7b1434\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-180.ec2.internal" Sep 17 03:32:24.046264 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:24.046243 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ae5517c1a906653611f35437758c68a1-config\") pod \"kube-apiserver-proxy-ip-10-0-143-180.ec2.internal\" (UID: \"ae5517c1a906653611f35437758c68a1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-180.ec2.internal" Sep 17 03:32:25.187216 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:25.187182 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-180.ec2.internal\" not found" Sep 17 03:32:25.197591 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:25.197569 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-180.ec2.internal" Sep 17 03:32:25.203093 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:25.202884 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-180.ec2.internal" Sep 17 03:32:25.288154 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:25.288109 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-180.ec2.internal\" not found" Sep 17 03:32:25.388589 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:25.388524 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-180.ec2.internal\" not found" Sep 17 03:32:25.489017 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:25.488983 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-180.ec2.internal\" not found" Sep 17 03:32:25.589478 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:25.589431 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-180.ec2.internal\" not found" Sep 17 03:32:25.620757 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:25.620735 2551 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 17 03:32:25.621136 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:25.620900 2551 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 03:32:25.689628 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:25.689567 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-180.ec2.internal\" not found" Sep 17 03:32:25.700238 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:25.700210 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 03:27:24 +0000 UTC" deadline="2028-03-23 05:37:52.19342705 +0000 UTC" Sep 17 03:32:25.700238 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:25.700237 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13274h5m26.493193408s" Sep 17 03:32:25.757038 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:25.756987 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae5517c1a906653611f35437758c68a1.slice/crio-175c74b1134ff4ba3b4909b6068fd1e882155ad1ef50f0b120df787563064e3d WatchSource:0}: Error finding container 175c74b1134ff4ba3b4909b6068fd1e882155ad1ef50f0b120df787563064e3d: Status 404 returned error can't find the container with id 175c74b1134ff4ba3b4909b6068fd1e882155ad1ef50f0b120df787563064e3d Sep 17 03:32:25.757205 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:25.757188 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f0b96daeb2e00308a6fb177bc7b1434.slice/crio-b64ecbb2a12424ec145205927ba474186eea0f7236386395376d9544cef67e47 WatchSource:0}: Error finding container b64ecbb2a12424ec145205927ba474186eea0f7236386395376d9544cef67e47: Status 404 returned error can't find the container with id b64ecbb2a12424ec145205927ba474186eea0f7236386395376d9544cef67e47 Sep 17 03:32:25.761442 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:25.761421 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 03:32:25.766771 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:25.766730 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-180.ec2.internal" event={"ID":"ae5517c1a906653611f35437758c68a1","Type":"ContainerStarted","Data":"175c74b1134ff4ba3b4909b6068fd1e882155ad1ef50f0b120df787563064e3d"} Sep 17 03:32:25.767962 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:25.767936 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-180.ec2.internal" event={"ID":"1f0b96daeb2e00308a6fb177bc7b1434","Type":"ContainerStarted","Data":"b64ecbb2a12424ec145205927ba474186eea0f7236386395376d9544cef67e47"} Sep 17 03:32:25.790092 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:25.790056 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-180.ec2.internal\" not found" Sep 17 03:32:25.890593 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:25.890551 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-180.ec2.internal\" not found" Sep 17 03:32:25.933662 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:25.933635 2551 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 03:32:25.988377 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:25.988294 2551 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-180.ec2.internal" Sep 17 03:32:26.000357 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.000338 2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 03:32:26.002381 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.002359 2551 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-180.ec2.internal" Sep 17 03:32:26.013772 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.013755 2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 03:32:26.151974 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.151951 2551 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 03:32:26.261712 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.261357 2551 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 03:32:26.666130 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.666065 2551 apiserver.go:52] "Watching apiserver" Sep 17 03:32:26.672733 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.672704 2551 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 17 03:32:26.674841 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.674817 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-c8wtl","kube-system/global-pull-secret-syncer-k5lh2","kube-system/konnectivity-agent-7rvl5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-947d6","openshift-image-registry/node-ca-vwzf5","openshift-multus/multus-additional-cni-plugins-qffv4","openshift-multus/multus-hqg86","openshift-network-diagnostics/network-check-target-t9lsl","openshift-network-operator/iptables-alerter-n98w6","kube-system/kube-apiserver-proxy-ip-10-0-143-180.ec2.internal","openshift-cluster-node-tuning-operator/tuned-pf7zm","openshift-dns/node-resolver-59x2n","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-180.ec2.internal","openshift-multus/network-metrics-daemon-4qjvl"] Sep 17 03:32:26.677226 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.677206 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.679443 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.679416 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.679872 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.679836 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 17 03:32:26.679872 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.679855 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 17 03:32:26.680013 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.679870 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-t4srz\"" Sep 17 03:32:26.680013 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.679854 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 17 03:32:26.680013 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.679854 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 17 03:32:26.681602 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.681583 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2h7rt\"" Sep 17 03:32:26.681602 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.681597 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 17 03:32:26.681753 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.681686 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 17 03:32:26.682506 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.682485 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7rvl5" Sep 17 03:32:26.684482 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.684450 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-947d6" Sep 17 03:32:26.684720 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.684705 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 17 03:32:26.684906 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.684889 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wzjnf\"" Sep 17 03:32:26.686038 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.686020 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 17 03:32:26.686703 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.686686 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vwzf5" Sep 17 03:32:26.686809 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.686689 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 17 03:32:26.686809 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.686803 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-x7845\"" Sep 17 03:32:26.687041 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.687024 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 17 03:32:26.687041 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.687035 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 17 03:32:26.688290 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.688272 2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 17 03:32:26.689602 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.689582 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 17 03:32:26.689694 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.689608 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7mr5h\"" Sep 17 03:32:26.689917 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.689895 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 17 03:32:26.690016 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.689929 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 17 03:32:26.690309 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.690290 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qffv4" Sep 17 03:32:26.693365 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.693338 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 17 03:32:26.693466 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.693366 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s7qn6\"" Sep 17 03:32:26.693517 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.693470 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n98w6" Sep 17 03:32:26.694608 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.694580 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 17 03:32:26.696018 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.696000 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tpt5z\"" Sep 17 03:32:26.696155 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.696137 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 17 03:32:26.696242 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.696218 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 17 03:32:26.696300 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.696280 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 17 03:32:26.696898 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.696880 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4qjvl" Sep 17 03:32:26.696996 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:26.696940 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4qjvl" podUID="7f900dc7-747d-47b8-8834-51afc05d4bac" Sep 17 03:32:26.698774 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.698738 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-multus-socket-dir-parent\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.698774 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.698769 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-host-var-lib-cni-multus\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.698922 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.698791 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-host-var-lib-kubelet\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.698922 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.698813 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-run\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.698922 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.698833 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/02aebf6f-0ada-47f6-bb17-a994d4d1634e-registration-dir\") pod \"aws-ebs-csi-driver-node-947d6\" (UID: \"02aebf6f-0ada-47f6-bb17-a994d4d1634e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-947d6" Sep 17 03:32:26.698922 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.698874 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-etc-sysconfig\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.698922 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.698899 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-etc-sysctl-conf\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.698922 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.698920 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/84e7e42d-c122-4884-9239-baa4d830034a-etc-tuned\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.699201 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.698943 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d48289c-a388-4c7e-b67d-98b2471cc4ec-cni-binary-copy\") pod \"multus-additional-cni-plugins-qffv4\" (UID: \"3d48289c-a388-4c7e-b67d-98b2471cc4ec\") " pod="openshift-multus/multus-additional-cni-plugins-qffv4" Sep 17 03:32:26.699201 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.698972 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-host-run-k8s-cni-cncf-io\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.699201 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.698993 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-host-var-lib-cni-bin\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.699201 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699017 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-etc-systemd\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.699201 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699040 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sq4x\" (UniqueName: \"kubernetes.io/projected/84e7e42d-c122-4884-9239-baa4d830034a-kube-api-access-7sq4x\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.699201 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699059 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9lsl" Sep 17 03:32:26.699201 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699063 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/02aebf6f-0ada-47f6-bb17-a994d4d1634e-device-dir\") pod \"aws-ebs-csi-driver-node-947d6\" (UID: \"02aebf6f-0ada-47f6-bb17-a994d4d1634e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-947d6" Sep 17 03:32:26.699201 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699085 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d016862b-e142-4a1e-a9e2-6610f3f75c78-cni-binary-copy\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.699201 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699107 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-host-run-multus-certs\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.699201 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699130 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-sys\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.699201 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:26.699130 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9lsl" podUID="6f01992d-cdf0-47be-ab65-9714e39d371d" Sep 17 03:32:26.699201 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699152 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d48289c-a388-4c7e-b67d-98b2471cc4ec-system-cni-dir\") pod \"multus-additional-cni-plugins-qffv4\" (UID: \"3d48289c-a388-4c7e-b67d-98b2471cc4ec\") " pod="openshift-multus/multus-additional-cni-plugins-qffv4" Sep 17 03:32:26.699201 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699174 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3d48289c-a388-4c7e-b67d-98b2471cc4ec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qffv4\" (UID: \"3d48289c-a388-4c7e-b67d-98b2471cc4ec\") " pod="openshift-multus/multus-additional-cni-plugins-qffv4" Sep 17 03:32:26.699650 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699207 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-multus-cni-dir\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.699650 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699236 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d016862b-e142-4a1e-a9e2-6610f3f75c78-multus-daemon-config\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.699650 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699264 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-etc-kubernetes\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.699650 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699285 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nmnc\" (UniqueName: \"kubernetes.io/projected/d016862b-e142-4a1e-a9e2-6610f3f75c78-kube-api-access-6nmnc\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.699650 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699300 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-etc-modprobe-d\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.699650 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699321 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-host\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.699650 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699338 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/79c78cce-a88d-4dc5-965a-6b69880e9bfa-konnectivity-ca\") pod \"konnectivity-agent-7rvl5\" (UID: \"79c78cce-a88d-4dc5-965a-6b69880e9bfa\") " pod="kube-system/konnectivity-agent-7rvl5" Sep 17 03:32:26.699650 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699350 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e65d15d-2cdc-43a5-8b87-11aec8eaa83a-host\") pod \"node-ca-vwzf5\" (UID: \"0e65d15d-2cdc-43a5-8b87-11aec8eaa83a\") " pod="openshift-image-registry/node-ca-vwzf5" Sep 17 03:32:26.699650 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699376 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-host-run-netns\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.699650 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699398 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-hostroot\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.699650 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699434 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-var-lib-kubelet\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.699650 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699454 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/79c78cce-a88d-4dc5-965a-6b69880e9bfa-agent-certs\") pod \"konnectivity-agent-7rvl5\" (UID: \"79c78cce-a88d-4dc5-965a-6b69880e9bfa\") " pod="kube-system/konnectivity-agent-7rvl5" Sep 17 03:32:26.699650 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699471 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/02aebf6f-0ada-47f6-bb17-a994d4d1634e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-947d6\" (UID: \"02aebf6f-0ada-47f6-bb17-a994d4d1634e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-947d6" Sep 17 03:32:26.699650 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699499 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/02aebf6f-0ada-47f6-bb17-a994d4d1634e-sys-fs\") pod \"aws-ebs-csi-driver-node-947d6\" (UID: \"02aebf6f-0ada-47f6-bb17-a994d4d1634e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-947d6" Sep 17 03:32:26.699650 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699524 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbl9j\" (UniqueName: \"kubernetes.io/projected/02aebf6f-0ada-47f6-bb17-a994d4d1634e-kube-api-access-hbl9j\") pod \"aws-ebs-csi-driver-node-947d6\" (UID: \"02aebf6f-0ada-47f6-bb17-a994d4d1634e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-947d6" Sep 17 03:32:26.699650 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699547 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0e65d15d-2cdc-43a5-8b87-11aec8eaa83a-serviceca\") pod \"node-ca-vwzf5\" (UID: \"0e65d15d-2cdc-43a5-8b87-11aec8eaa83a\") " pod="openshift-image-registry/node-ca-vwzf5" Sep 17 03:32:26.699650 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699567 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-system-cni-dir\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.700378 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699589 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-etc-kubernetes\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.700378 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699610 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-etc-sysctl-d\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.700378 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699626 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84e7e42d-c122-4884-9239-baa4d830034a-tmp\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.700378 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699642 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/02aebf6f-0ada-47f6-bb17-a994d4d1634e-etc-selinux\") pod \"aws-ebs-csi-driver-node-947d6\" (UID: \"02aebf6f-0ada-47f6-bb17-a994d4d1634e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-947d6" Sep 17 03:32:26.700378 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699662 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b6xb\" (UniqueName: \"kubernetes.io/projected/0e65d15d-2cdc-43a5-8b87-11aec8eaa83a-kube-api-access-5b6xb\") pod \"node-ca-vwzf5\" (UID: \"0e65d15d-2cdc-43a5-8b87-11aec8eaa83a\") " pod="openshift-image-registry/node-ca-vwzf5" Sep 17 03:32:26.700378 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699677 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d48289c-a388-4c7e-b67d-98b2471cc4ec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qffv4\" (UID: \"3d48289c-a388-4c7e-b67d-98b2471cc4ec\") " pod="openshift-multus/multus-additional-cni-plugins-qffv4" Sep 17 03:32:26.700378 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699694 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3d48289c-a388-4c7e-b67d-98b2471cc4ec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qffv4\" (UID: \"3d48289c-a388-4c7e-b67d-98b2471cc4ec\") " pod="openshift-multus/multus-additional-cni-plugins-qffv4" Sep 17 03:32:26.700378 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699795 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-multus-conf-dir\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.700378 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699833 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-lib-modules\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.700378 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699857 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/02aebf6f-0ada-47f6-bb17-a994d4d1634e-socket-dir\") pod \"aws-ebs-csi-driver-node-947d6\" (UID: \"02aebf6f-0ada-47f6-bb17-a994d4d1634e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-947d6" Sep 17 03:32:26.700378 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699880 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d48289c-a388-4c7e-b67d-98b2471cc4ec-cnibin\") pod \"multus-additional-cni-plugins-qffv4\" (UID: \"3d48289c-a388-4c7e-b67d-98b2471cc4ec\") " pod="openshift-multus/multus-additional-cni-plugins-qffv4" Sep 17 03:32:26.700378 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699903 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5qk4\" (UniqueName: \"kubernetes.io/projected/3d48289c-a388-4c7e-b67d-98b2471cc4ec-kube-api-access-q5qk4\") pod \"multus-additional-cni-plugins-qffv4\" (UID: \"3d48289c-a388-4c7e-b67d-98b2471cc4ec\") " pod="openshift-multus/multus-additional-cni-plugins-qffv4" Sep 17 03:32:26.700378 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.699926 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-cnibin\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.701442 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.701427 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-59x2n" Sep 17 03:32:26.703225 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.703207 2551 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 03:32:26.703642 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.703588 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 17 03:32:26.703817 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.703801 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 17 03:32:26.704696 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.704098 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4kpdx\"" Sep 17 03:32:26.704696 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.704118 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.706694 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.706637 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:26.706694 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.706663 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fhqfs\"" Sep 17 03:32:26.706856 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:26.706725 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5lh2" podUID="7f67c23a-21e7-465e-a87c-29c1e5a3eadd" Sep 17 03:32:26.707695 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.707674 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 17 03:32:26.707822 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.707706 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 17 03:32:26.707822 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.707674 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 17 03:32:26.707971 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.707680 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 17 03:32:26.708107 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.708093 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 17 03:32:26.708340 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.708327 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 17 03:32:26.729003 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.728984 2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-85pd2" Sep 17 03:32:26.741468 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.741445 2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-85pd2" Sep 17 03:32:26.780118 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.780089 2551 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 03:32:26.789075 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.789046 2551 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 17 03:32:26.800152 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.800128 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-etc-sysconfig\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.800322 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.800215 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-etc-sysconfig\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.800322 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.800261 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.800322 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.800299 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-host-run-k8s-cni-cncf-io\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.800522 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.800342 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-host-var-lib-cni-bin\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.800522 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.800377 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sq4x\" (UniqueName: \"kubernetes.io/projected/84e7e42d-c122-4884-9239-baa4d830034a-kube-api-access-7sq4x\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.800522 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.800393 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-host-run-k8s-cni-cncf-io\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.800522 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.800439 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-host-slash\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.800522 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.800464 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-host-run-multus-certs\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.800522 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.800494 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-sys\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.800522 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.800466 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-host-var-lib-cni-bin\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.800866 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.800542 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-sys\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.800866 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.800552 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-host-run-multus-certs\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.800866 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.800574 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d48289c-a388-4c7e-b67d-98b2471cc4ec-system-cni-dir\") pod \"multus-additional-cni-plugins-qffv4\" (UID: \"3d48289c-a388-4c7e-b67d-98b2471cc4ec\") " pod="openshift-multus/multus-additional-cni-plugins-qffv4" Sep 17 03:32:26.800866 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.800602 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-var-lib-openvswitch\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.800866 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.800630 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d48289c-a388-4c7e-b67d-98b2471cc4ec-system-cni-dir\") pod \"multus-additional-cni-plugins-qffv4\" (UID: \"3d48289c-a388-4c7e-b67d-98b2471cc4ec\") " pod="openshift-multus/multus-additional-cni-plugins-qffv4" Sep 17 03:32:26.800866 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.800660 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-etc-openvswitch\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.800866 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.800678 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-log-socket\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.800866 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.800697 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/228ee255-c87b-42f0-b012-56cf65fa77db-ovnkube-config\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.800866 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.800721 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-multus-cni-dir\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.800866 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.800791 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-multus-cni-dir\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.800866 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.800821 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d016862b-e142-4a1e-a9e2-6610f3f75c78-multus-daemon-config\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.800866 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.800854 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nmnc\" (UniqueName: \"kubernetes.io/projected/d016862b-e142-4a1e-a9e2-6610f3f75c78-kube-api-access-6nmnc\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.801336 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.800952 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-etc-modprobe-d\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.801336 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.800976 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/79c78cce-a88d-4dc5-965a-6b69880e9bfa-konnectivity-ca\") pod \"konnectivity-agent-7rvl5\" (UID: \"79c78cce-a88d-4dc5-965a-6b69880e9bfa\") " pod="kube-system/konnectivity-agent-7rvl5" Sep 17 03:32:26.801336 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.800999 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e65d15d-2cdc-43a5-8b87-11aec8eaa83a-host\") pod \"node-ca-vwzf5\" (UID: \"0e65d15d-2cdc-43a5-8b87-11aec8eaa83a\") " pod="openshift-image-registry/node-ca-vwzf5" Sep 17 03:32:26.801336 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.801022 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-systemd-units\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.801336 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.801041 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-hostroot\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.801336 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.801069 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e65d15d-2cdc-43a5-8b87-11aec8eaa83a-host\") pod \"node-ca-vwzf5\" (UID: \"0e65d15d-2cdc-43a5-8b87-11aec8eaa83a\") " pod="openshift-image-registry/node-ca-vwzf5" Sep 17 03:32:26.801336 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.801083 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/79c78cce-a88d-4dc5-965a-6b69880e9bfa-agent-certs\") pod \"konnectivity-agent-7rvl5\" (UID: \"79c78cce-a88d-4dc5-965a-6b69880e9bfa\") " pod="kube-system/konnectivity-agent-7rvl5" Sep 17 03:32:26.801336 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.801108 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/02aebf6f-0ada-47f6-bb17-a994d4d1634e-sys-fs\") pod \"aws-ebs-csi-driver-node-947d6\" (UID: \"02aebf6f-0ada-47f6-bb17-a994d4d1634e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-947d6" Sep 17 03:32:26.801336 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.801134 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc5jm\" (UniqueName: \"kubernetes.io/projected/7f900dc7-747d-47b8-8834-51afc05d4bac-kube-api-access-bc5jm\") pod \"network-metrics-daemon-4qjvl\" (UID: \"7f900dc7-747d-47b8-8834-51afc05d4bac\") " pod="openshift-multus/network-metrics-daemon-4qjvl" Sep 17 03:32:26.801729 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.801175 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/228ee255-c87b-42f0-b012-56cf65fa77db-ovnkube-script-lib\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.801729 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.801428 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/02aebf6f-0ada-47f6-bb17-a994d4d1634e-sys-fs\") pod \"aws-ebs-csi-driver-node-947d6\" (UID: \"02aebf6f-0ada-47f6-bb17-a994d4d1634e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-947d6" Sep 17 03:32:26.801729 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.801440 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-system-cni-dir\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.801729 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.801466 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-etc-kubernetes\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.801729 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.801501 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-etc-sysctl-d\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.801729 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.801558 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-etc-kubernetes\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.801729 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.801196 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-etc-modprobe-d\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.801729 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.801581 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-etc-sysctl-d\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.801729 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.801612 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-system-cni-dir\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.801729 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.801634 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d016862b-e142-4a1e-a9e2-6610f3f75c78-multus-daemon-config\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.801729 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.801642 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84e7e42d-c122-4884-9239-baa4d830034a-tmp\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.801729 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.801671 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/79c78cce-a88d-4dc5-965a-6b69880e9bfa-konnectivity-ca\") pod \"konnectivity-agent-7rvl5\" (UID: \"79c78cce-a88d-4dc5-965a-6b69880e9bfa\") " pod="kube-system/konnectivity-agent-7rvl5" Sep 17 03:32:26.801729 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.801708 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-hostroot\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.802342 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.801759 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3d48289c-a388-4c7e-b67d-98b2471cc4ec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qffv4\" (UID: \"3d48289c-a388-4c7e-b67d-98b2471cc4ec\") " pod="openshift-multus/multus-additional-cni-plugins-qffv4" Sep 17 03:32:26.802342 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.801822 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r49sp\" (UniqueName: \"kubernetes.io/projected/336341fa-ffd3-45fa-98fd-bba7ab551273-kube-api-access-r49sp\") pod \"iptables-alerter-n98w6\" (UID: \"336341fa-ffd3-45fa-98fd-bba7ab551273\") " pod="openshift-network-operator/iptables-alerter-n98w6" Sep 17 03:32:26.802342 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.801881 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1db844ea-66f3-4982-b510-b488327b00ed-tmp-dir\") pod \"node-resolver-59x2n\" (UID: \"1db844ea-66f3-4982-b510-b488327b00ed\") " pod="openshift-dns/node-resolver-59x2n" Sep 17 03:32:26.802342 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.801925 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-multus-conf-dir\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.802342 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.801950 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-lib-modules\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.802342 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.801948 2551 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 17 03:32:26.802342 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.801977 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5qk4\" (UniqueName: \"kubernetes.io/projected/3d48289c-a388-4c7e-b67d-98b2471cc4ec-kube-api-access-q5qk4\") pod \"multus-additional-cni-plugins-qffv4\" (UID: \"3d48289c-a388-4c7e-b67d-98b2471cc4ec\") " pod="openshift-multus/multus-additional-cni-plugins-qffv4" Sep 17 03:32:26.802342 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.802000 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f67c23a-21e7-465e-a87c-29c1e5a3eadd-kubelet-config\") pod \"global-pull-secret-syncer-k5lh2\" (UID: \"7f67c23a-21e7-465e-a87c-29c1e5a3eadd\") " pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:26.802342 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.802016 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-multus-conf-dir\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.802342 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.802030 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f67c23a-21e7-465e-a87c-29c1e5a3eadd-dbus\") pod \"global-pull-secret-syncer-k5lh2\" (UID: \"7f67c23a-21e7-465e-a87c-29c1e5a3eadd\") " pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:26.802342 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.802056 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-run-ovn\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.802342 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.802104 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-cnibin\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.802342 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.802157 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-cnibin\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.802342 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.802187 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-host-var-lib-cni-multus\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.802342 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.802168 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-lib-modules\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.802342 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.802217 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-host-var-lib-kubelet\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.802994 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.802890 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-host-var-lib-cni-multus\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.803162 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.803113 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-host-var-lib-kubelet\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.803162 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.802238 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/02aebf6f-0ada-47f6-bb17-a994d4d1634e-registration-dir\") pod \"aws-ebs-csi-driver-node-947d6\" (UID: \"02aebf6f-0ada-47f6-bb17-a994d4d1634e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-947d6" Sep 17 03:32:26.803317 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.803153 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3d48289c-a388-4c7e-b67d-98b2471cc4ec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qffv4\" (UID: \"3d48289c-a388-4c7e-b67d-98b2471cc4ec\") " pod="openshift-multus/multus-additional-cni-plugins-qffv4" Sep 17 03:32:26.803317 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.803186 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-host-cni-bin\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.803317 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.803246 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-etc-sysctl-conf\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.803317 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.803267 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/84e7e42d-c122-4884-9239-baa4d830034a-etc-tuned\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.803317 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.803287 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/02aebf6f-0ada-47f6-bb17-a994d4d1634e-registration-dir\") pod \"aws-ebs-csi-driver-node-947d6\" (UID: \"02aebf6f-0ada-47f6-bb17-a994d4d1634e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-947d6" Sep 17 03:32:26.803317 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.803295 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d48289c-a388-4c7e-b67d-98b2471cc4ec-cni-binary-copy\") pod \"multus-additional-cni-plugins-qffv4\" (UID: \"3d48289c-a388-4c7e-b67d-98b2471cc4ec\") " pod="openshift-multus/multus-additional-cni-plugins-qffv4" Sep 17 03:32:26.803588 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.803431 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-etc-sysctl-conf\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.803646 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.803628 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/228ee255-c87b-42f0-b012-56cf65fa77db-env-overrides\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.803712 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.803674 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-etc-systemd\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.803754 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.803733 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/02aebf6f-0ada-47f6-bb17-a994d4d1634e-device-dir\") pod \"aws-ebs-csi-driver-node-947d6\" (UID: \"02aebf6f-0ada-47f6-bb17-a994d4d1634e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-947d6" Sep 17 03:32:26.803790 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.803771 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f900dc7-747d-47b8-8834-51afc05d4bac-metrics-certs\") pod \"network-metrics-daemon-4qjvl\" (UID: \"7f900dc7-747d-47b8-8834-51afc05d4bac\") " pod="openshift-multus/network-metrics-daemon-4qjvl" Sep 17 03:32:26.803838 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.803805 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-host-run-ovn-kubernetes\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.803888 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.803867 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d016862b-e142-4a1e-a9e2-6610f3f75c78-cni-binary-copy\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.807214 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.803932 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d48289c-a388-4c7e-b67d-98b2471cc4ec-cni-binary-copy\") pod \"multus-additional-cni-plugins-qffv4\" (UID: \"3d48289c-a388-4c7e-b67d-98b2471cc4ec\") " pod="openshift-multus/multus-additional-cni-plugins-qffv4" Sep 17 03:32:26.807214 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.803960 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/02aebf6f-0ada-47f6-bb17-a994d4d1634e-device-dir\") pod \"aws-ebs-csi-driver-node-947d6\" (UID: \"02aebf6f-0ada-47f6-bb17-a994d4d1634e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-947d6" Sep 17 03:32:26.807214 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.804014 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3d48289c-a388-4c7e-b67d-98b2471cc4ec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qffv4\" (UID: \"3d48289c-a388-4c7e-b67d-98b2471cc4ec\") " pod="openshift-multus/multus-additional-cni-plugins-qffv4" Sep 17 03:32:26.807214 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.804079 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx9cd\" (UniqueName: \"kubernetes.io/projected/6f01992d-cdf0-47be-ab65-9714e39d371d-kube-api-access-gx9cd\") pod \"network-check-target-t9lsl\" (UID: \"6f01992d-cdf0-47be-ab65-9714e39d371d\") " pod="openshift-network-diagnostics/network-check-target-t9lsl" Sep 17 03:32:26.807214 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.804117 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-host-run-netns\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.807214 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.804170 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-etc-kubernetes\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.807214 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.804200 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-host\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.807214 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.804230 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d48289c-a388-4c7e-b67d-98b2471cc4ec-cnibin\") pod \"multus-additional-cni-plugins-qffv4\" (UID: \"3d48289c-a388-4c7e-b67d-98b2471cc4ec\") " pod="openshift-multus/multus-additional-cni-plugins-qffv4" Sep 17 03:32:26.807214 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.804256 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/336341fa-ffd3-45fa-98fd-bba7ab551273-iptables-alerter-script\") pod \"iptables-alerter-n98w6\" (UID: \"336341fa-ffd3-45fa-98fd-bba7ab551273\") " pod="openshift-network-operator/iptables-alerter-n98w6" Sep 17 03:32:26.807214 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.804287 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-host-kubelet\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.807214 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.804317 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/228ee255-c87b-42f0-b012-56cf65fa77db-ovn-node-metrics-cert\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.807214 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.804371 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-host-run-netns\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.807214 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.804439 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-var-lib-kubelet\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.807214 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.804494 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d016862b-e142-4a1e-a9e2-6610f3f75c78-cni-binary-copy\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.807214 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.804502 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/02aebf6f-0ada-47f6-bb17-a994d4d1634e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-947d6\" (UID: \"02aebf6f-0ada-47f6-bb17-a994d4d1634e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-947d6" Sep 17 03:32:26.807214 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.804578 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbl9j\" (UniqueName: \"kubernetes.io/projected/02aebf6f-0ada-47f6-bb17-a994d4d1634e-kube-api-access-hbl9j\") pod \"aws-ebs-csi-driver-node-947d6\" (UID: \"02aebf6f-0ada-47f6-bb17-a994d4d1634e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-947d6" Sep 17 03:32:26.807214 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.804609 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-etc-kubernetes\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.808086 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.804611 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0e65d15d-2cdc-43a5-8b87-11aec8eaa83a-serviceca\") pod \"node-ca-vwzf5\" (UID: \"0e65d15d-2cdc-43a5-8b87-11aec8eaa83a\") " pod="openshift-image-registry/node-ca-vwzf5" Sep 17 03:32:26.808086 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.804654 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-node-log\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.808086 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.804681 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3d48289c-a388-4c7e-b67d-98b2471cc4ec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qffv4\" (UID: \"3d48289c-a388-4c7e-b67d-98b2471cc4ec\") " pod="openshift-multus/multus-additional-cni-plugins-qffv4" Sep 17 03:32:26.808086 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.804691 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cftbs\" (UniqueName: \"kubernetes.io/projected/228ee255-c87b-42f0-b012-56cf65fa77db-kube-api-access-cftbs\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.808086 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.804738 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/02aebf6f-0ada-47f6-bb17-a994d4d1634e-etc-selinux\") pod \"aws-ebs-csi-driver-node-947d6\" (UID: \"02aebf6f-0ada-47f6-bb17-a994d4d1634e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-947d6" Sep 17 03:32:26.808086 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.804785 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b6xb\" (UniqueName: \"kubernetes.io/projected/0e65d15d-2cdc-43a5-8b87-11aec8eaa83a-kube-api-access-5b6xb\") pod \"node-ca-vwzf5\" (UID: \"0e65d15d-2cdc-43a5-8b87-11aec8eaa83a\") " pod="openshift-image-registry/node-ca-vwzf5" Sep 17 03:32:26.808086 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.804824 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-etc-systemd\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.808086 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.804850 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d48289c-a388-4c7e-b67d-98b2471cc4ec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qffv4\" (UID: \"3d48289c-a388-4c7e-b67d-98b2471cc4ec\") " pod="openshift-multus/multus-additional-cni-plugins-qffv4" Sep 17 03:32:26.808086 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.804893 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1db844ea-66f3-4982-b510-b488327b00ed-hosts-file\") pod \"node-resolver-59x2n\" (UID: \"1db844ea-66f3-4982-b510-b488327b00ed\") " pod="openshift-dns/node-resolver-59x2n" Sep 17 03:32:26.808086 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.804927 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp7bq\" (UniqueName: \"kubernetes.io/projected/1db844ea-66f3-4982-b510-b488327b00ed-kube-api-access-bp7bq\") pod \"node-resolver-59x2n\" (UID: \"1db844ea-66f3-4982-b510-b488327b00ed\") " pod="openshift-dns/node-resolver-59x2n" Sep 17 03:32:26.808086 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.805075 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-host-cni-netd\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.808086 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.805081 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0e65d15d-2cdc-43a5-8b87-11aec8eaa83a-serviceca\") pod \"node-ca-vwzf5\" (UID: \"0e65d15d-2cdc-43a5-8b87-11aec8eaa83a\") " pod="openshift-image-registry/node-ca-vwzf5" Sep 17 03:32:26.808086 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.805186 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-host\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.808086 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.805875 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/02aebf6f-0ada-47f6-bb17-a994d4d1634e-socket-dir\") pod \"aws-ebs-csi-driver-node-947d6\" (UID: \"02aebf6f-0ada-47f6-bb17-a994d4d1634e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-947d6" Sep 17 03:32:26.808086 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.805975 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-host-run-netns\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.808086 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.806037 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-var-lib-kubelet\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.808086 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.806120 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/02aebf6f-0ada-47f6-bb17-a994d4d1634e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-947d6\" (UID: \"02aebf6f-0ada-47f6-bb17-a994d4d1634e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-947d6" Sep 17 03:32:26.808882 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.806173 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d48289c-a388-4c7e-b67d-98b2471cc4ec-cnibin\") pod \"multus-additional-cni-plugins-qffv4\" (UID: \"3d48289c-a388-4c7e-b67d-98b2471cc4ec\") " pod="openshift-multus/multus-additional-cni-plugins-qffv4" Sep 17 03:32:26.808882 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.806272 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/02aebf6f-0ada-47f6-bb17-a994d4d1634e-etc-selinux\") pod \"aws-ebs-csi-driver-node-947d6\" (UID: \"02aebf6f-0ada-47f6-bb17-a994d4d1634e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-947d6" Sep 17 03:32:26.808882 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.806371 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/84e7e42d-c122-4884-9239-baa4d830034a-etc-tuned\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.808882 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.806542 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84e7e42d-c122-4884-9239-baa4d830034a-tmp\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.808882 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.806636 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f67c23a-21e7-465e-a87c-29c1e5a3eadd-original-pull-secret\") pod \"global-pull-secret-syncer-k5lh2\" (UID: \"7f67c23a-21e7-465e-a87c-29c1e5a3eadd\") " pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:26.808882 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.806698 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-run-openvswitch\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.808882 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.806739 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-multus-socket-dir-parent\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.808882 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.806832 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-run\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.808882 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.806880 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/336341fa-ffd3-45fa-98fd-bba7ab551273-host-slash\") pod \"iptables-alerter-n98w6\" (UID: \"336341fa-ffd3-45fa-98fd-bba7ab551273\") " pod="openshift-network-operator/iptables-alerter-n98w6" Sep 17 03:32:26.808882 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.806912 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-run-systemd\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.808882 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.807027 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d48289c-a388-4c7e-b67d-98b2471cc4ec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qffv4\" (UID: \"3d48289c-a388-4c7e-b67d-98b2471cc4ec\") " pod="openshift-multus/multus-additional-cni-plugins-qffv4" Sep 17 03:32:26.808882 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.807097 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d016862b-e142-4a1e-a9e2-6610f3f75c78-multus-socket-dir-parent\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.808882 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.807138 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/02aebf6f-0ada-47f6-bb17-a994d4d1634e-socket-dir\") pod \"aws-ebs-csi-driver-node-947d6\" (UID: \"02aebf6f-0ada-47f6-bb17-a994d4d1634e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-947d6" Sep 17 03:32:26.808882 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.807192 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/84e7e42d-c122-4884-9239-baa4d830034a-run\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.811133 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.811066 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5qk4\" (UniqueName: \"kubernetes.io/projected/3d48289c-a388-4c7e-b67d-98b2471cc4ec-kube-api-access-q5qk4\") pod \"multus-additional-cni-plugins-qffv4\" (UID: \"3d48289c-a388-4c7e-b67d-98b2471cc4ec\") " pod="openshift-multus/multus-additional-cni-plugins-qffv4" Sep 17 03:32:26.811238 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.811217 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sq4x\" (UniqueName: \"kubernetes.io/projected/84e7e42d-c122-4884-9239-baa4d830034a-kube-api-access-7sq4x\") pod \"tuned-pf7zm\" (UID: \"84e7e42d-c122-4884-9239-baa4d830034a\") " pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:26.811358 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.811334 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nmnc\" (UniqueName: \"kubernetes.io/projected/d016862b-e142-4a1e-a9e2-6610f3f75c78-kube-api-access-6nmnc\") pod \"multus-hqg86\" (UID: \"d016862b-e142-4a1e-a9e2-6610f3f75c78\") " pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.811823 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.811790 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/79c78cce-a88d-4dc5-965a-6b69880e9bfa-agent-certs\") pod \"konnectivity-agent-7rvl5\" (UID: \"79c78cce-a88d-4dc5-965a-6b69880e9bfa\") " pod="kube-system/konnectivity-agent-7rvl5" Sep 17 03:32:26.815650 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.815631 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b6xb\" (UniqueName: \"kubernetes.io/projected/0e65d15d-2cdc-43a5-8b87-11aec8eaa83a-kube-api-access-5b6xb\") pod \"node-ca-vwzf5\" (UID: \"0e65d15d-2cdc-43a5-8b87-11aec8eaa83a\") " pod="openshift-image-registry/node-ca-vwzf5" Sep 17 03:32:26.815903 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.815886 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbl9j\" (UniqueName: \"kubernetes.io/projected/02aebf6f-0ada-47f6-bb17-a994d4d1634e-kube-api-access-hbl9j\") pod \"aws-ebs-csi-driver-node-947d6\" (UID: \"02aebf6f-0ada-47f6-bb17-a994d4d1634e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-947d6" Sep 17 03:32:26.907480 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.907448 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r49sp\" (UniqueName: \"kubernetes.io/projected/336341fa-ffd3-45fa-98fd-bba7ab551273-kube-api-access-r49sp\") pod \"iptables-alerter-n98w6\" (UID: \"336341fa-ffd3-45fa-98fd-bba7ab551273\") " pod="openshift-network-operator/iptables-alerter-n98w6" Sep 17 03:32:26.907480 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.907487 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1db844ea-66f3-4982-b510-b488327b00ed-tmp-dir\") pod \"node-resolver-59x2n\" (UID: \"1db844ea-66f3-4982-b510-b488327b00ed\") " pod="openshift-dns/node-resolver-59x2n" Sep 17 03:32:26.907744 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.907517 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f67c23a-21e7-465e-a87c-29c1e5a3eadd-kubelet-config\") pod \"global-pull-secret-syncer-k5lh2\" (UID: \"7f67c23a-21e7-465e-a87c-29c1e5a3eadd\") " pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:26.907744 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.907535 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f67c23a-21e7-465e-a87c-29c1e5a3eadd-dbus\") pod \"global-pull-secret-syncer-k5lh2\" (UID: \"7f67c23a-21e7-465e-a87c-29c1e5a3eadd\") " pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:26.907744 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.907567 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-run-ovn\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.907744 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.907592 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-host-cni-bin\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.907744 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.907614 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f67c23a-21e7-465e-a87c-29c1e5a3eadd-kubelet-config\") pod \"global-pull-secret-syncer-k5lh2\" (UID: \"7f67c23a-21e7-465e-a87c-29c1e5a3eadd\") " pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:26.907744 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.907636 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/228ee255-c87b-42f0-b012-56cf65fa77db-env-overrides\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.907744 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.907692 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f900dc7-747d-47b8-8834-51afc05d4bac-metrics-certs\") pod \"network-metrics-daemon-4qjvl\" (UID: \"7f900dc7-747d-47b8-8834-51afc05d4bac\") " pod="openshift-multus/network-metrics-daemon-4qjvl" Sep 17 03:32:26.907744 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.907692 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f67c23a-21e7-465e-a87c-29c1e5a3eadd-dbus\") pod \"global-pull-secret-syncer-k5lh2\" (UID: \"7f67c23a-21e7-465e-a87c-29c1e5a3eadd\") " pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:26.907744 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.907718 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-host-run-ovn-kubernetes\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.907744 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.907747 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx9cd\" (UniqueName: \"kubernetes.io/projected/6f01992d-cdf0-47be-ab65-9714e39d371d-kube-api-access-gx9cd\") pod \"network-check-target-t9lsl\" (UID: \"6f01992d-cdf0-47be-ab65-9714e39d371d\") " pod="openshift-network-diagnostics/network-check-target-t9lsl" Sep 17 03:32:26.908082 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.907789 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-host-run-netns\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.908082 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.907791 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-host-run-ovn-kubernetes\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.908082 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:26.907808 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:32:26.908082 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.907814 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/336341fa-ffd3-45fa-98fd-bba7ab551273-iptables-alerter-script\") pod \"iptables-alerter-n98w6\" (UID: \"336341fa-ffd3-45fa-98fd-bba7ab551273\") " pod="openshift-network-operator/iptables-alerter-n98w6" Sep 17 03:32:26.908082 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.907837 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-run-ovn\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.908082 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.907841 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-host-kubelet\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.908082 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.907877 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-host-kubelet\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.908082 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:26.907903 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f900dc7-747d-47b8-8834-51afc05d4bac-metrics-certs podName:7f900dc7-747d-47b8-8834-51afc05d4bac nodeName:}" failed. No retries permitted until 2026-09-17 03:32:27.407865781 +0000 UTC m=+3.135098932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f900dc7-747d-47b8-8834-51afc05d4bac-metrics-certs") pod "network-metrics-daemon-4qjvl" (UID: "7f900dc7-747d-47b8-8834-51afc05d4bac") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:32:26.908082 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.907894 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-host-cni-bin\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.908082 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.907928 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/228ee255-c87b-42f0-b012-56cf65fa77db-ovn-node-metrics-cert\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.908082 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.907966 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-node-log\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.908082 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.907991 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cftbs\" (UniqueName: \"kubernetes.io/projected/228ee255-c87b-42f0-b012-56cf65fa77db-kube-api-access-cftbs\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.908082 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908019 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1db844ea-66f3-4982-b510-b488327b00ed-hosts-file\") pod \"node-resolver-59x2n\" (UID: \"1db844ea-66f3-4982-b510-b488327b00ed\") " pod="openshift-dns/node-resolver-59x2n" Sep 17 03:32:26.908082 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908035 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-host-run-netns\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.908082 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908042 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp7bq\" (UniqueName: \"kubernetes.io/projected/1db844ea-66f3-4982-b510-b488327b00ed-kube-api-access-bp7bq\") pod \"node-resolver-59x2n\" (UID: \"1db844ea-66f3-4982-b510-b488327b00ed\") " pod="openshift-dns/node-resolver-59x2n" Sep 17 03:32:26.908082 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908075 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-host-cni-netd\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.908082 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908087 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/228ee255-c87b-42f0-b012-56cf65fa77db-env-overrides\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.908686 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908102 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f67c23a-21e7-465e-a87c-29c1e5a3eadd-original-pull-secret\") pod \"global-pull-secret-syncer-k5lh2\" (UID: \"7f67c23a-21e7-465e-a87c-29c1e5a3eadd\") " pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:26.908686 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908146 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-run-openvswitch\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.908686 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908173 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-node-log\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.908686 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908212 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/336341fa-ffd3-45fa-98fd-bba7ab551273-host-slash\") pod \"iptables-alerter-n98w6\" (UID: \"336341fa-ffd3-45fa-98fd-bba7ab551273\") " pod="openshift-network-operator/iptables-alerter-n98w6" Sep 17 03:32:26.908686 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908215 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-host-cni-netd\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.908686 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908173 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/336341fa-ffd3-45fa-98fd-bba7ab551273-host-slash\") pod \"iptables-alerter-n98w6\" (UID: \"336341fa-ffd3-45fa-98fd-bba7ab551273\") " pod="openshift-network-operator/iptables-alerter-n98w6" Sep 17 03:32:26.908686 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908248 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-run-systemd\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.908686 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908290 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.908686 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908318 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-host-slash\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.908686 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908262 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-run-openvswitch\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.908686 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908348 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-var-lib-openvswitch\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.908686 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908362 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-run-systemd\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.908686 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908372 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-etc-openvswitch\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.908686 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908416 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-log-socket\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.908686 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908424 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-etc-openvswitch\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.908686 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908443 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/228ee255-c87b-42f0-b012-56cf65fa77db-ovnkube-config\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.908686 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908458 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.909371 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908476 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-systemd-units\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.909371 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908509 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc5jm\" (UniqueName: \"kubernetes.io/projected/7f900dc7-747d-47b8-8834-51afc05d4bac-kube-api-access-bc5jm\") pod \"network-metrics-daemon-4qjvl\" (UID: \"7f900dc7-747d-47b8-8834-51afc05d4bac\") " pod="openshift-multus/network-metrics-daemon-4qjvl" Sep 17 03:32:26.909371 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908534 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/228ee255-c87b-42f0-b012-56cf65fa77db-ovnkube-script-lib\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.909371 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908538 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-host-slash\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.909371 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:26.908322 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:32:26.909371 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908510 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1db844ea-66f3-4982-b510-b488327b00ed-hosts-file\") pod \"node-resolver-59x2n\" (UID: \"1db844ea-66f3-4982-b510-b488327b00ed\") " pod="openshift-dns/node-resolver-59x2n" Sep 17 03:32:26.909371 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908577 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1db844ea-66f3-4982-b510-b488327b00ed-tmp-dir\") pod \"node-resolver-59x2n\" (UID: \"1db844ea-66f3-4982-b510-b488327b00ed\") " pod="openshift-dns/node-resolver-59x2n" Sep 17 03:32:26.909371 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908600 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/336341fa-ffd3-45fa-98fd-bba7ab551273-iptables-alerter-script\") pod \"iptables-alerter-n98w6\" (UID: \"336341fa-ffd3-45fa-98fd-bba7ab551273\") " pod="openshift-network-operator/iptables-alerter-n98w6" Sep 17 03:32:26.909371 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908598 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-systemd-units\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.909371 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908628 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-log-socket\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.909371 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.908661 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/228ee255-c87b-42f0-b012-56cf65fa77db-var-lib-openvswitch\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.909371 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:26.908658 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f67c23a-21e7-465e-a87c-29c1e5a3eadd-original-pull-secret podName:7f67c23a-21e7-465e-a87c-29c1e5a3eadd nodeName:}" failed. No retries permitted until 2026-09-17 03:32:27.408641536 +0000 UTC m=+3.135874681 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f67c23a-21e7-465e-a87c-29c1e5a3eadd-original-pull-secret") pod "global-pull-secret-syncer-k5lh2" (UID: "7f67c23a-21e7-465e-a87c-29c1e5a3eadd") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:32:26.909371 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.909031 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/228ee255-c87b-42f0-b012-56cf65fa77db-ovnkube-config\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.909371 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.909136 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/228ee255-c87b-42f0-b012-56cf65fa77db-ovnkube-script-lib\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.911037 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.910974 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/228ee255-c87b-42f0-b012-56cf65fa77db-ovn-node-metrics-cert\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.917867 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:26.917775 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:32:26.917867 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:26.917801 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:32:26.917867 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:26.917817 2551 projected.go:196] Error preparing data for projected volume kube-api-access-gx9cd for pod openshift-network-diagnostics/network-check-target-t9lsl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:32:26.918074 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:26.917881 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f01992d-cdf0-47be-ab65-9714e39d371d-kube-api-access-gx9cd podName:6f01992d-cdf0-47be-ab65-9714e39d371d nodeName:}" failed. No retries permitted until 2026-09-17 03:32:27.417865876 +0000 UTC m=+3.145099013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gx9cd" (UniqueName: "kubernetes.io/projected/6f01992d-cdf0-47be-ab65-9714e39d371d-kube-api-access-gx9cd") pod "network-check-target-t9lsl" (UID: "6f01992d-cdf0-47be-ab65-9714e39d371d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:32:26.920301 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.920259 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp7bq\" (UniqueName: \"kubernetes.io/projected/1db844ea-66f3-4982-b510-b488327b00ed-kube-api-access-bp7bq\") pod \"node-resolver-59x2n\" (UID: \"1db844ea-66f3-4982-b510-b488327b00ed\") " pod="openshift-dns/node-resolver-59x2n" Sep 17 03:32:26.920656 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.920618 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cftbs\" (UniqueName: \"kubernetes.io/projected/228ee255-c87b-42f0-b012-56cf65fa77db-kube-api-access-cftbs\") pod \"ovnkube-node-c8wtl\" (UID: \"228ee255-c87b-42f0-b012-56cf65fa77db\") " pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:26.920771 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.920751 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc5jm\" (UniqueName: \"kubernetes.io/projected/7f900dc7-747d-47b8-8834-51afc05d4bac-kube-api-access-bc5jm\") pod \"network-metrics-daemon-4qjvl\" (UID: \"7f900dc7-747d-47b8-8834-51afc05d4bac\") " pod="openshift-multus/network-metrics-daemon-4qjvl" Sep 17 03:32:26.920828 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.920801 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r49sp\" (UniqueName: \"kubernetes.io/projected/336341fa-ffd3-45fa-98fd-bba7ab551273-kube-api-access-r49sp\") pod \"iptables-alerter-n98w6\" (UID: \"336341fa-ffd3-45fa-98fd-bba7ab551273\") " pod="openshift-network-operator/iptables-alerter-n98w6" Sep 17 03:32:26.987900 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.987859 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hqg86" Sep 17 03:32:26.995909 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:26.995877 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" Sep 17 03:32:27.005637 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:27.005617 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7rvl5" Sep 17 03:32:27.010208 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:27.010189 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-947d6" Sep 17 03:32:27.016321 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:27.016304 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vwzf5" Sep 17 03:32:27.024886 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:27.024870 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qffv4" Sep 17 03:32:27.031480 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:27.031463 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n98w6" Sep 17 03:32:27.037080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:27.037062 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-59x2n" Sep 17 03:32:27.042754 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:27.042732 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:27.411701 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:27.411633 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f900dc7-747d-47b8-8834-51afc05d4bac-metrics-certs\") pod \"network-metrics-daemon-4qjvl\" (UID: \"7f900dc7-747d-47b8-8834-51afc05d4bac\") " pod="openshift-multus/network-metrics-daemon-4qjvl" Sep 17 03:32:27.411701 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:27.411685 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f67c23a-21e7-465e-a87c-29c1e5a3eadd-original-pull-secret\") pod \"global-pull-secret-syncer-k5lh2\" (UID: \"7f67c23a-21e7-465e-a87c-29c1e5a3eadd\") " pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:27.411850 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:27.411794 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:32:27.411850 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:27.411797 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:32:27.411850 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:27.411847 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f67c23a-21e7-465e-a87c-29c1e5a3eadd-original-pull-secret podName:7f67c23a-21e7-465e-a87c-29c1e5a3eadd nodeName:}" failed. No retries permitted until 2026-09-17 03:32:28.411833417 +0000 UTC m=+4.139066549 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f67c23a-21e7-465e-a87c-29c1e5a3eadd-original-pull-secret") pod "global-pull-secret-syncer-k5lh2" (UID: "7f67c23a-21e7-465e-a87c-29c1e5a3eadd") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:32:27.411957 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:27.411859 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f900dc7-747d-47b8-8834-51afc05d4bac-metrics-certs podName:7f900dc7-747d-47b8-8834-51afc05d4bac nodeName:}" failed. No retries permitted until 2026-09-17 03:32:28.41185364 +0000 UTC m=+4.139086772 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f900dc7-747d-47b8-8834-51afc05d4bac-metrics-certs") pod "network-metrics-daemon-4qjvl" (UID: "7f900dc7-747d-47b8-8834-51afc05d4bac") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:32:27.512941 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:27.512907 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx9cd\" (UniqueName: \"kubernetes.io/projected/6f01992d-cdf0-47be-ab65-9714e39d371d-kube-api-access-gx9cd\") pod \"network-check-target-t9lsl\" (UID: \"6f01992d-cdf0-47be-ab65-9714e39d371d\") " pod="openshift-network-diagnostics/network-check-target-t9lsl" Sep 17 03:32:27.513118 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:27.513097 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:32:27.513172 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:27.513127 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:32:27.513172 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:27.513142 2551 projected.go:196] Error preparing data for projected volume kube-api-access-gx9cd for pod openshift-network-diagnostics/network-check-target-t9lsl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:32:27.513253 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:27.513214 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f01992d-cdf0-47be-ab65-9714e39d371d-kube-api-access-gx9cd podName:6f01992d-cdf0-47be-ab65-9714e39d371d nodeName:}" failed. No retries permitted until 2026-09-17 03:32:28.513199842 +0000 UTC m=+4.240432974 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gx9cd" (UniqueName: "kubernetes.io/projected/6f01992d-cdf0-47be-ab65-9714e39d371d-kube-api-access-gx9cd") pod "network-check-target-t9lsl" (UID: "6f01992d-cdf0-47be-ab65-9714e39d371d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:32:27.664707 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:27.664682 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e65d15d_2cdc_43a5_8b87_11aec8eaa83a.slice/crio-d04ce54a9b5b81307ba95369120b8017fb0f76b445b1b1df6a772eb6c4e74aeb WatchSource:0}: Error finding container d04ce54a9b5b81307ba95369120b8017fb0f76b445b1b1df6a772eb6c4e74aeb: Status 404 returned error can't find the container with id d04ce54a9b5b81307ba95369120b8017fb0f76b445b1b1df6a772eb6c4e74aeb Sep 17 03:32:27.686370 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:27.686349 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79c78cce_a88d_4dc5_965a_6b69880e9bfa.slice/crio-7068e44b199528645c997f1613b2a69257bf36b70130698ee56d86e7bd3c8a9f WatchSource:0}: Error finding container 7068e44b199528645c997f1613b2a69257bf36b70130698ee56d86e7bd3c8a9f: Status 404 returned error can't find the container with id 7068e44b199528645c997f1613b2a69257bf36b70130698ee56d86e7bd3c8a9f Sep 17 03:32:27.687854 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:27.687831 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod336341fa_ffd3_45fa_98fd_bba7ab551273.slice/crio-d8c0de723a7c78b5a4d7785523d8e50c1fbabe665d432ea92f560b53f4da19ce WatchSource:0}: Error finding container d8c0de723a7c78b5a4d7785523d8e50c1fbabe665d432ea92f560b53f4da19ce: Status 404 returned error can't find the container with id d8c0de723a7c78b5a4d7785523d8e50c1fbabe665d432ea92f560b53f4da19ce Sep 17 03:32:27.691678 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:27.691653 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84e7e42d_c122_4884_9239_baa4d830034a.slice/crio-79ad2ae0a0e75d6b3106f45f746122d5fb41da3c072db607dc9297acb6ecdce0 WatchSource:0}: Error finding container 79ad2ae0a0e75d6b3106f45f746122d5fb41da3c072db607dc9297acb6ecdce0: Status 404 returned error can't find the container with id 79ad2ae0a0e75d6b3106f45f746122d5fb41da3c072db607dc9297acb6ecdce0 Sep 17 03:32:27.692736 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:27.692715 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1db844ea_66f3_4982_b510_b488327b00ed.slice/crio-1beeeb5acf36e17fa838db9415fff17c50dea15de4a92842160f65ba704b514c WatchSource:0}: Error finding container 1beeeb5acf36e17fa838db9415fff17c50dea15de4a92842160f65ba704b514c: Status 404 returned error can't find the container with id 1beeeb5acf36e17fa838db9415fff17c50dea15de4a92842160f65ba704b514c Sep 17 03:32:27.694148 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:27.694128 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd016862b_e142_4a1e_a9e2_6610f3f75c78.slice/crio-3bba806063753e5b02afcb75fa48101dcf1ed5d5f28c0e7bc33f844f7c5396d8 WatchSource:0}: Error finding container 3bba806063753e5b02afcb75fa48101dcf1ed5d5f28c0e7bc33f844f7c5396d8: Status 404 returned error can't find the container with id 3bba806063753e5b02afcb75fa48101dcf1ed5d5f28c0e7bc33f844f7c5396d8 Sep 17 03:32:27.695142 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:27.694944 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d48289c_a388_4c7e_b67d_98b2471cc4ec.slice/crio-a345e60a3afb181a6dead78fa32e89831b94f8df616d9adf6126792118c686a2 WatchSource:0}: Error finding container a345e60a3afb181a6dead78fa32e89831b94f8df616d9adf6126792118c686a2: Status 404 returned error can't find the container with id a345e60a3afb181a6dead78fa32e89831b94f8df616d9adf6126792118c686a2 Sep 17 03:32:27.696538 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:27.696005 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02aebf6f_0ada_47f6_bb17_a994d4d1634e.slice/crio-e954f9991a377a7ee436b5e7d07eded0f047e775b3cfa76a86b6950f646d5d80 WatchSource:0}: Error finding container e954f9991a377a7ee436b5e7d07eded0f047e775b3cfa76a86b6950f646d5d80: Status 404 returned error can't find the container with id e954f9991a377a7ee436b5e7d07eded0f047e775b3cfa76a86b6950f646d5d80 Sep 17 03:32:27.696736 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:27.696645 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod228ee255_c87b_42f0_b012_56cf65fa77db.slice/crio-01066ded07fcd7bc34b198bcc8779e9fddf580a201e92dd01ff4a8c672a99468 WatchSource:0}: Error finding container 01066ded07fcd7bc34b198bcc8779e9fddf580a201e92dd01ff4a8c672a99468: Status 404 returned error can't find the container with id 01066ded07fcd7bc34b198bcc8779e9fddf580a201e92dd01ff4a8c672a99468 Sep 17 03:32:27.744299 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:27.744266 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 03:27:26 +0000 UTC" deadline="2028-04-19 08:55:58.982062294 +0000 UTC" Sep 17 03:32:27.744299 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:27.744294 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13925h23m31.237771158s" Sep 17 03:32:27.772003 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:27.771908 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qffv4" event={"ID":"3d48289c-a388-4c7e-b67d-98b2471cc4ec","Type":"ContainerStarted","Data":"a345e60a3afb181a6dead78fa32e89831b94f8df616d9adf6126792118c686a2"} Sep 17 03:32:27.773225 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:27.773194 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-947d6" event={"ID":"02aebf6f-0ada-47f6-bb17-a994d4d1634e","Type":"ContainerStarted","Data":"e954f9991a377a7ee436b5e7d07eded0f047e775b3cfa76a86b6950f646d5d80"} Sep 17 03:32:27.777223 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:27.777193 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-59x2n" event={"ID":"1db844ea-66f3-4982-b510-b488327b00ed","Type":"ContainerStarted","Data":"1beeeb5acf36e17fa838db9415fff17c50dea15de4a92842160f65ba704b514c"} Sep 17 03:32:27.778355 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:27.778321 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" event={"ID":"84e7e42d-c122-4884-9239-baa4d830034a","Type":"ContainerStarted","Data":"79ad2ae0a0e75d6b3106f45f746122d5fb41da3c072db607dc9297acb6ecdce0"} Sep 17 03:32:27.779753 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:27.779732 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n98w6" event={"ID":"336341fa-ffd3-45fa-98fd-bba7ab551273","Type":"ContainerStarted","Data":"d8c0de723a7c78b5a4d7785523d8e50c1fbabe665d432ea92f560b53f4da19ce"} Sep 17 03:32:27.783459 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:27.783428 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vwzf5" event={"ID":"0e65d15d-2cdc-43a5-8b87-11aec8eaa83a","Type":"ContainerStarted","Data":"d04ce54a9b5b81307ba95369120b8017fb0f76b445b1b1df6a772eb6c4e74aeb"} Sep 17 03:32:27.784516 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:27.784490 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hqg86" event={"ID":"d016862b-e142-4a1e-a9e2-6610f3f75c78","Type":"ContainerStarted","Data":"3bba806063753e5b02afcb75fa48101dcf1ed5d5f28c0e7bc33f844f7c5396d8"} Sep 17 03:32:27.785504 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:27.785484 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7rvl5" event={"ID":"79c78cce-a88d-4dc5-965a-6b69880e9bfa","Type":"ContainerStarted","Data":"7068e44b199528645c997f1613b2a69257bf36b70130698ee56d86e7bd3c8a9f"} Sep 17 03:32:27.793177 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:27.793139 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" event={"ID":"228ee255-c87b-42f0-b012-56cf65fa77db","Type":"ContainerStarted","Data":"01066ded07fcd7bc34b198bcc8779e9fddf580a201e92dd01ff4a8c672a99468"} Sep 17 03:32:27.801619 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:27.801565 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-180.ec2.internal" podStartSLOduration=2.801549766 podStartE2EDuration="2.801549766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:32:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:32:27.801254603 +0000 UTC m=+3.528487756" watchObservedRunningTime="2026-09-17 03:32:27.801549766 +0000 UTC m=+3.528782920" Sep 17 03:32:28.420704 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:28.420624 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f900dc7-747d-47b8-8834-51afc05d4bac-metrics-certs\") pod \"network-metrics-daemon-4qjvl\" (UID: \"7f900dc7-747d-47b8-8834-51afc05d4bac\") " pod="openshift-multus/network-metrics-daemon-4qjvl" Sep 17 03:32:28.420704 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:28.420688 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f67c23a-21e7-465e-a87c-29c1e5a3eadd-original-pull-secret\") pod \"global-pull-secret-syncer-k5lh2\" (UID: \"7f67c23a-21e7-465e-a87c-29c1e5a3eadd\") " pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:28.420902 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:28.420833 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:32:28.420902 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:28.420893 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f67c23a-21e7-465e-a87c-29c1e5a3eadd-original-pull-secret podName:7f67c23a-21e7-465e-a87c-29c1e5a3eadd nodeName:}" failed. No retries permitted until 2026-09-17 03:32:30.420875492 +0000 UTC m=+6.148108642 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f67c23a-21e7-465e-a87c-29c1e5a3eadd-original-pull-secret") pod "global-pull-secret-syncer-k5lh2" (UID: "7f67c23a-21e7-465e-a87c-29c1e5a3eadd") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:32:28.421254 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:28.421233 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:32:28.421351 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:28.421288 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f900dc7-747d-47b8-8834-51afc05d4bac-metrics-certs podName:7f900dc7-747d-47b8-8834-51afc05d4bac nodeName:}" failed. No retries permitted until 2026-09-17 03:32:30.4212724 +0000 UTC m=+6.148505547 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f900dc7-747d-47b8-8834-51afc05d4bac-metrics-certs") pod "network-metrics-daemon-4qjvl" (UID: "7f900dc7-747d-47b8-8834-51afc05d4bac") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:32:28.521934 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:28.521163 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx9cd\" (UniqueName: \"kubernetes.io/projected/6f01992d-cdf0-47be-ab65-9714e39d371d-kube-api-access-gx9cd\") pod \"network-check-target-t9lsl\" (UID: \"6f01992d-cdf0-47be-ab65-9714e39d371d\") " pod="openshift-network-diagnostics/network-check-target-t9lsl" Sep 17 03:32:28.521934 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:28.521385 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:32:28.521934 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:28.521433 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:32:28.521934 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:28.521447 2551 projected.go:196] Error preparing data for projected volume kube-api-access-gx9cd for pod openshift-network-diagnostics/network-check-target-t9lsl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:32:28.521934 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:28.521506 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f01992d-cdf0-47be-ab65-9714e39d371d-kube-api-access-gx9cd podName:6f01992d-cdf0-47be-ab65-9714e39d371d nodeName:}" failed. No retries permitted until 2026-09-17 03:32:30.521488838 +0000 UTC m=+6.248721976 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gx9cd" (UniqueName: "kubernetes.io/projected/6f01992d-cdf0-47be-ab65-9714e39d371d-kube-api-access-gx9cd") pod "network-check-target-t9lsl" (UID: "6f01992d-cdf0-47be-ab65-9714e39d371d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:32:28.744747 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:28.744628 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 03:27:26 +0000 UTC" deadline="2028-03-11 06:50:35.450600331 +0000 UTC" Sep 17 03:32:28.744747 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:28.744693 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12987h18m6.705911599s" Sep 17 03:32:28.764999 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:28.764971 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4qjvl" Sep 17 03:32:28.765142 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:28.765093 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4qjvl" podUID="7f900dc7-747d-47b8-8834-51afc05d4bac" Sep 17 03:32:28.765542 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:28.765520 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9lsl" Sep 17 03:32:28.765677 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:28.765615 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9lsl" podUID="6f01992d-cdf0-47be-ab65-9714e39d371d" Sep 17 03:32:28.765742 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:28.765680 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:28.765790 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:28.765755 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5lh2" podUID="7f67c23a-21e7-465e-a87c-29c1e5a3eadd" Sep 17 03:32:28.805795 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:28.805765 2551 generic.go:356] "Generic (PLEG): container finished" podID="1f0b96daeb2e00308a6fb177bc7b1434" containerID="9088070dd9ffdfc3e74b01de794d7d96e179148d701c6a981b3b685c371ccdcc" exitCode=0 Sep 17 03:32:28.806010 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:28.805855 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-180.ec2.internal" event={"ID":"1f0b96daeb2e00308a6fb177bc7b1434","Type":"ContainerDied","Data":"9088070dd9ffdfc3e74b01de794d7d96e179148d701c6a981b3b685c371ccdcc"} Sep 17 03:32:28.817470 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:28.816979 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-180.ec2.internal" event={"ID":"ae5517c1a906653611f35437758c68a1","Type":"ContainerStarted","Data":"ac7bd0338a658c0f283d945a181f5fa5420b6c5ffc06d00bd53e152fda2ce5b0"} Sep 17 03:32:29.843261 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:29.842658 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-180.ec2.internal" event={"ID":"1f0b96daeb2e00308a6fb177bc7b1434","Type":"ContainerStarted","Data":"045fda1f08318d5e57fa016e6a09cd106e47feda34a6dc6ffd0065cfc079dd14"} Sep 17 03:32:30.437581 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:30.436806 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f67c23a-21e7-465e-a87c-29c1e5a3eadd-original-pull-secret\") pod \"global-pull-secret-syncer-k5lh2\" (UID: \"7f67c23a-21e7-465e-a87c-29c1e5a3eadd\") " pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:30.437581 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:30.436892 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f900dc7-747d-47b8-8834-51afc05d4bac-metrics-certs\") pod \"network-metrics-daemon-4qjvl\" (UID: \"7f900dc7-747d-47b8-8834-51afc05d4bac\") " pod="openshift-multus/network-metrics-daemon-4qjvl" Sep 17 03:32:30.437581 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:30.437017 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:32:30.437581 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:30.437078 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f900dc7-747d-47b8-8834-51afc05d4bac-metrics-certs podName:7f900dc7-747d-47b8-8834-51afc05d4bac nodeName:}" failed. No retries permitted until 2026-09-17 03:32:34.437059739 +0000 UTC m=+10.164292878 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f900dc7-747d-47b8-8834-51afc05d4bac-metrics-certs") pod "network-metrics-daemon-4qjvl" (UID: "7f900dc7-747d-47b8-8834-51afc05d4bac") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:32:30.437581 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:30.437483 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:32:30.437581 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:30.437536 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f67c23a-21e7-465e-a87c-29c1e5a3eadd-original-pull-secret podName:7f67c23a-21e7-465e-a87c-29c1e5a3eadd nodeName:}" failed. No retries permitted until 2026-09-17 03:32:34.437519854 +0000 UTC m=+10.164753004 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f67c23a-21e7-465e-a87c-29c1e5a3eadd-original-pull-secret") pod "global-pull-secret-syncer-k5lh2" (UID: "7f67c23a-21e7-465e-a87c-29c1e5a3eadd") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:32:30.538667 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:30.538017 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx9cd\" (UniqueName: \"kubernetes.io/projected/6f01992d-cdf0-47be-ab65-9714e39d371d-kube-api-access-gx9cd\") pod \"network-check-target-t9lsl\" (UID: \"6f01992d-cdf0-47be-ab65-9714e39d371d\") " pod="openshift-network-diagnostics/network-check-target-t9lsl" Sep 17 03:32:30.538667 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:30.538212 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:32:30.538667 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:30.538233 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:32:30.538667 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:30.538247 2551 projected.go:196] Error preparing data for projected volume kube-api-access-gx9cd for pod openshift-network-diagnostics/network-check-target-t9lsl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:32:30.538667 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:30.538318 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f01992d-cdf0-47be-ab65-9714e39d371d-kube-api-access-gx9cd podName:6f01992d-cdf0-47be-ab65-9714e39d371d nodeName:}" failed. No retries permitted until 2026-09-17 03:32:34.538297571 +0000 UTC m=+10.265530703 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gx9cd" (UniqueName: "kubernetes.io/projected/6f01992d-cdf0-47be-ab65-9714e39d371d-kube-api-access-gx9cd") pod "network-check-target-t9lsl" (UID: "6f01992d-cdf0-47be-ab65-9714e39d371d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:32:30.764964 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:30.764424 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9lsl" Sep 17 03:32:30.764964 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:30.764424 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4qjvl" Sep 17 03:32:30.764964 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:30.764566 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9lsl" podUID="6f01992d-cdf0-47be-ab65-9714e39d371d" Sep 17 03:32:30.764964 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:30.764662 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4qjvl" podUID="7f900dc7-747d-47b8-8834-51afc05d4bac" Sep 17 03:32:30.764964 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:30.764424 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:30.764964 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:30.764753 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5lh2" podUID="7f67c23a-21e7-465e-a87c-29c1e5a3eadd" Sep 17 03:32:32.763430 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:32.763293 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4qjvl" Sep 17 03:32:32.763430 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:32.763293 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9lsl" Sep 17 03:32:32.763960 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:32.763466 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4qjvl" podUID="7f900dc7-747d-47b8-8834-51afc05d4bac" Sep 17 03:32:32.763960 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:32.763508 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:32.763960 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:32.763621 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9lsl" podUID="6f01992d-cdf0-47be-ab65-9714e39d371d" Sep 17 03:32:32.763960 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:32.763708 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5lh2" podUID="7f67c23a-21e7-465e-a87c-29c1e5a3eadd" Sep 17 03:32:34.472110 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:34.472076 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f67c23a-21e7-465e-a87c-29c1e5a3eadd-original-pull-secret\") pod \"global-pull-secret-syncer-k5lh2\" (UID: \"7f67c23a-21e7-465e-a87c-29c1e5a3eadd\") " pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:34.472599 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:34.472162 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f900dc7-747d-47b8-8834-51afc05d4bac-metrics-certs\") pod \"network-metrics-daemon-4qjvl\" (UID: \"7f900dc7-747d-47b8-8834-51afc05d4bac\") " pod="openshift-multus/network-metrics-daemon-4qjvl" Sep 17 03:32:34.472599 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:34.472259 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:32:34.472599 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:34.472281 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:32:34.472599 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:34.472333 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f67c23a-21e7-465e-a87c-29c1e5a3eadd-original-pull-secret podName:7f67c23a-21e7-465e-a87c-29c1e5a3eadd nodeName:}" failed. No retries permitted until 2026-09-17 03:32:42.472313344 +0000 UTC m=+18.199546494 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f67c23a-21e7-465e-a87c-29c1e5a3eadd-original-pull-secret") pod "global-pull-secret-syncer-k5lh2" (UID: "7f67c23a-21e7-465e-a87c-29c1e5a3eadd") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:32:34.472599 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:34.472353 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f900dc7-747d-47b8-8834-51afc05d4bac-metrics-certs podName:7f900dc7-747d-47b8-8834-51afc05d4bac nodeName:}" failed. No retries permitted until 2026-09-17 03:32:42.472343459 +0000 UTC m=+18.199576597 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f900dc7-747d-47b8-8834-51afc05d4bac-metrics-certs") pod "network-metrics-daemon-4qjvl" (UID: "7f900dc7-747d-47b8-8834-51afc05d4bac") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:32:34.573206 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:34.573169 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx9cd\" (UniqueName: \"kubernetes.io/projected/6f01992d-cdf0-47be-ab65-9714e39d371d-kube-api-access-gx9cd\") pod \"network-check-target-t9lsl\" (UID: \"6f01992d-cdf0-47be-ab65-9714e39d371d\") " pod="openshift-network-diagnostics/network-check-target-t9lsl" Sep 17 03:32:34.573613 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:34.573355 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:32:34.573613 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:34.573380 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:32:34.573613 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:34.573395 2551 projected.go:196] Error preparing data for projected volume kube-api-access-gx9cd for pod openshift-network-diagnostics/network-check-target-t9lsl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:32:34.573613 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:34.573475 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f01992d-cdf0-47be-ab65-9714e39d371d-kube-api-access-gx9cd podName:6f01992d-cdf0-47be-ab65-9714e39d371d nodeName:}" failed. No retries permitted until 2026-09-17 03:32:42.573455139 +0000 UTC m=+18.300688278 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gx9cd" (UniqueName: "kubernetes.io/projected/6f01992d-cdf0-47be-ab65-9714e39d371d-kube-api-access-gx9cd") pod "network-check-target-t9lsl" (UID: "6f01992d-cdf0-47be-ab65-9714e39d371d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:32:34.763536 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:34.763452 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4qjvl" Sep 17 03:32:34.763536 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:34.763480 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9lsl" Sep 17 03:32:34.763739 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:34.763574 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4qjvl" podUID="7f900dc7-747d-47b8-8834-51afc05d4bac" Sep 17 03:32:34.763739 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:34.763711 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9lsl" podUID="6f01992d-cdf0-47be-ab65-9714e39d371d" Sep 17 03:32:34.763848 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:34.763768 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:34.763897 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:34.763845 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5lh2" podUID="7f67c23a-21e7-465e-a87c-29c1e5a3eadd" Sep 17 03:32:36.763225 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:36.763190 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9lsl" Sep 17 03:32:36.763656 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:36.763190 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4qjvl" Sep 17 03:32:36.763656 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:36.763297 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9lsl" podUID="6f01992d-cdf0-47be-ab65-9714e39d371d" Sep 17 03:32:36.763656 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:36.763318 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:36.763656 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:36.763442 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4qjvl" podUID="7f900dc7-747d-47b8-8834-51afc05d4bac" Sep 17 03:32:36.763656 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:36.763467 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5lh2" podUID="7f67c23a-21e7-465e-a87c-29c1e5a3eadd" Sep 17 03:32:38.763377 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:38.763342 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:38.763377 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:38.763379 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9lsl" Sep 17 03:32:38.763900 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:38.763351 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4qjvl" Sep 17 03:32:38.763900 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:38.763473 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5lh2" podUID="7f67c23a-21e7-465e-a87c-29c1e5a3eadd" Sep 17 03:32:38.763900 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:38.763581 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4qjvl" podUID="7f900dc7-747d-47b8-8834-51afc05d4bac" Sep 17 03:32:38.763900 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:38.763668 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9lsl" podUID="6f01992d-cdf0-47be-ab65-9714e39d371d" Sep 17 03:32:40.763271 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:40.763227 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4qjvl" Sep 17 03:32:40.763773 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:40.763228 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9lsl" Sep 17 03:32:40.763773 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:40.763345 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4qjvl" podUID="7f900dc7-747d-47b8-8834-51afc05d4bac" Sep 17 03:32:40.763773 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:40.763358 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:40.763773 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:40.763459 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9lsl" podUID="6f01992d-cdf0-47be-ab65-9714e39d371d" Sep 17 03:32:40.763773 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:40.763518 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5lh2" podUID="7f67c23a-21e7-465e-a87c-29c1e5a3eadd" Sep 17 03:32:42.527898 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:42.527857 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f900dc7-747d-47b8-8834-51afc05d4bac-metrics-certs\") pod \"network-metrics-daemon-4qjvl\" (UID: \"7f900dc7-747d-47b8-8834-51afc05d4bac\") " pod="openshift-multus/network-metrics-daemon-4qjvl" Sep 17 03:32:42.528394 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:42.527944 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f67c23a-21e7-465e-a87c-29c1e5a3eadd-original-pull-secret\") pod \"global-pull-secret-syncer-k5lh2\" (UID: \"7f67c23a-21e7-465e-a87c-29c1e5a3eadd\") " pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:42.528394 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:42.527993 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:32:42.528394 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:42.528057 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:32:42.528394 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:42.528077 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f900dc7-747d-47b8-8834-51afc05d4bac-metrics-certs podName:7f900dc7-747d-47b8-8834-51afc05d4bac nodeName:}" failed. No retries permitted until 2026-09-17 03:32:58.528056188 +0000 UTC m=+34.255289328 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f900dc7-747d-47b8-8834-51afc05d4bac-metrics-certs") pod "network-metrics-daemon-4qjvl" (UID: "7f900dc7-747d-47b8-8834-51afc05d4bac") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:32:42.528394 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:42.528109 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f67c23a-21e7-465e-a87c-29c1e5a3eadd-original-pull-secret podName:7f67c23a-21e7-465e-a87c-29c1e5a3eadd nodeName:}" failed. No retries permitted until 2026-09-17 03:32:58.528093003 +0000 UTC m=+34.255326136 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f67c23a-21e7-465e-a87c-29c1e5a3eadd-original-pull-secret") pod "global-pull-secret-syncer-k5lh2" (UID: "7f67c23a-21e7-465e-a87c-29c1e5a3eadd") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:32:42.628504 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:42.628468 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx9cd\" (UniqueName: \"kubernetes.io/projected/6f01992d-cdf0-47be-ab65-9714e39d371d-kube-api-access-gx9cd\") pod \"network-check-target-t9lsl\" (UID: \"6f01992d-cdf0-47be-ab65-9714e39d371d\") " pod="openshift-network-diagnostics/network-check-target-t9lsl" Sep 17 03:32:42.628689 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:42.628665 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:32:42.628773 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:42.628699 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:32:42.628773 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:42.628713 2551 projected.go:196] Error preparing data for projected volume kube-api-access-gx9cd for pod openshift-network-diagnostics/network-check-target-t9lsl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:32:42.628870 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:42.628776 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f01992d-cdf0-47be-ab65-9714e39d371d-kube-api-access-gx9cd podName:6f01992d-cdf0-47be-ab65-9714e39d371d nodeName:}" failed. No retries permitted until 2026-09-17 03:32:58.628757627 +0000 UTC m=+34.355990773 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gx9cd" (UniqueName: "kubernetes.io/projected/6f01992d-cdf0-47be-ab65-9714e39d371d-kube-api-access-gx9cd") pod "network-check-target-t9lsl" (UID: "6f01992d-cdf0-47be-ab65-9714e39d371d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:32:42.762573 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:42.762537 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4qjvl" Sep 17 03:32:42.762731 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:42.762537 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9lsl" Sep 17 03:32:42.762731 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:42.762692 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4qjvl" podUID="7f900dc7-747d-47b8-8834-51afc05d4bac" Sep 17 03:32:42.762731 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:42.762537 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:42.762731 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:42.762724 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9lsl" podUID="6f01992d-cdf0-47be-ab65-9714e39d371d" Sep 17 03:32:42.762948 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:42.762788 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5lh2" podUID="7f67c23a-21e7-465e-a87c-29c1e5a3eadd" Sep 17 03:32:44.763417 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:44.763377 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:44.763877 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:44.763491 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4qjvl" Sep 17 03:32:44.763877 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:44.763520 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9lsl" Sep 17 03:32:44.763877 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:44.763494 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5lh2" podUID="7f67c23a-21e7-465e-a87c-29c1e5a3eadd" Sep 17 03:32:44.763877 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:44.763628 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4qjvl" podUID="7f900dc7-747d-47b8-8834-51afc05d4bac" Sep 17 03:32:44.763877 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:44.763699 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9lsl" podUID="6f01992d-cdf0-47be-ab65-9714e39d371d" Sep 17 03:32:45.880551 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:45.880227 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hqg86" event={"ID":"d016862b-e142-4a1e-a9e2-6610f3f75c78","Type":"ContainerStarted","Data":"cf4f560d1ef03c75b277909cab78144a928db4dc22f02b57904250ecaf470e74"} Sep 17 03:32:45.883080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:45.882716 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7rvl5" event={"ID":"79c78cce-a88d-4dc5-965a-6b69880e9bfa","Type":"ContainerStarted","Data":"936992631e1c9f2ccbd6225f756359598b8df74654004761c05998d6b28588e8"} Sep 17 03:32:45.884964 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:45.884941 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7rvl5" Sep 17 03:32:45.885945 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:45.885908 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7rvl5" Sep 17 03:32:45.887233 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:45.887176 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c8wtl_228ee255-c87b-42f0-b012-56cf65fa77db/ovn-acl-logging/0.log" Sep 17 03:32:45.888081 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:45.887683 2551 generic.go:356] "Generic (PLEG): container finished" podID="228ee255-c87b-42f0-b012-56cf65fa77db" containerID="f6ae027064be8d720079a6e5f909fd2b99093340bc92724e4ad6ca034646cd8f" exitCode=1 Sep 17 03:32:45.888081 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:45.887764 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" event={"ID":"228ee255-c87b-42f0-b012-56cf65fa77db","Type":"ContainerStarted","Data":"041b0ae5e6ae9dd7be22fe0f3c96e6ba4bcd3ba558482d3b57e7d21889bf079b"} Sep 17 03:32:45.888081 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:45.887832 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" event={"ID":"228ee255-c87b-42f0-b012-56cf65fa77db","Type":"ContainerStarted","Data":"ee407e94fc0878d5812ba5d18fbd0a2f22e0b7007acd2624dde81588ad1e9b77"} Sep 17 03:32:45.888081 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:45.887884 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" event={"ID":"228ee255-c87b-42f0-b012-56cf65fa77db","Type":"ContainerStarted","Data":"351c9c39fec5da0fd3bb428c47f650bbbe0d8dbc137f0f2392d4e602626d236d"} Sep 17 03:32:45.888081 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:45.887935 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" event={"ID":"228ee255-c87b-42f0-b012-56cf65fa77db","Type":"ContainerStarted","Data":"050fd75739eeea3da228724a92b66b70f514e25ae72ddc4588456e26c2e10de0"} Sep 17 03:32:45.888081 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:45.887982 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" event={"ID":"228ee255-c87b-42f0-b012-56cf65fa77db","Type":"ContainerDied","Data":"f6ae027064be8d720079a6e5f909fd2b99093340bc92724e4ad6ca034646cd8f"} Sep 17 03:32:45.888081 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:45.888029 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" event={"ID":"228ee255-c87b-42f0-b012-56cf65fa77db","Type":"ContainerStarted","Data":"c80f5d1aa63e9f3ec27704fdb59f3b16dc96c54de13fe6b0101a0c5e2231f401"} Sep 17 03:32:45.890200 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:45.889931 2551 generic.go:356] "Generic (PLEG): container finished" podID="3d48289c-a388-4c7e-b67d-98b2471cc4ec" containerID="b9a825dcd991b855c315a81a242f92fbf8a81d9fbcb7487d05de0647ec3eda88" exitCode=0 Sep 17 03:32:45.890200 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:45.890015 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qffv4" event={"ID":"3d48289c-a388-4c7e-b67d-98b2471cc4ec","Type":"ContainerDied","Data":"b9a825dcd991b855c315a81a242f92fbf8a81d9fbcb7487d05de0647ec3eda88"} Sep 17 03:32:45.892006 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:45.891953 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-947d6" event={"ID":"02aebf6f-0ada-47f6-bb17-a994d4d1634e","Type":"ContainerStarted","Data":"4cdbbb5b2e1a26ea3ed4c87587381312986c80dc0f09cdcc38823a77de3d252c"} Sep 17 03:32:45.893855 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:45.893830 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-59x2n" event={"ID":"1db844ea-66f3-4982-b510-b488327b00ed","Type":"ContainerStarted","Data":"c07b3c6fa78fea3bfd464e6a7cfd7a4e95fa59e409bf9a8492af94acdd6125ef"} Sep 17 03:32:45.896039 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:45.896012 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" event={"ID":"84e7e42d-c122-4884-9239-baa4d830034a","Type":"ContainerStarted","Data":"d96295d5745e18b004a02f1feb26e6d66c73e222c2006b9344a5ea43f811f7f7"} Sep 17 03:32:45.897860 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:45.897838 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vwzf5" event={"ID":"0e65d15d-2cdc-43a5-8b87-11aec8eaa83a","Type":"ContainerStarted","Data":"94544ce03d7c3764c67a56524a146811c216296922999b1e75fb4396cf047d9a"} Sep 17 03:32:45.903619 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:45.903573 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hqg86" podStartSLOduration=3.92311794 podStartE2EDuration="21.903556632s" totalImagesPullingTime="17.980438692s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:32:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:32:45.903181834 +0000 UTC m=+21.630414990" watchObservedRunningTime="2026-09-17 03:32:45.903556632 +0000 UTC m=+21.630789803" Sep 17 03:32:45.904082 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:45.903949 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-180.ec2.internal" podStartSLOduration=19.903938441 podStartE2EDuration="19.903938441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:32:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:32:29.860816872 +0000 UTC m=+5.588050052" watchObservedRunningTime="2026-09-17 03:32:45.903938441 +0000 UTC m=+21.631171799" Sep 17 03:32:45.922371 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:45.922298 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7rvl5" podStartSLOduration=8.443912239 podStartE2EDuration="21.922276488s" totalImagesPullingTime="13.478364249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:32:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:32:45.921465942 +0000 UTC m=+21.648699096" watchObservedRunningTime="2026-09-17 03:32:45.922276488 +0000 UTC m=+21.649509644" Sep 17 03:32:45.964952 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:45.964746 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-59x2n" podStartSLOduration=8.490761724 podStartE2EDuration="21.964725125s" totalImagesPullingTime="13.473963401s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:32:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:32:45.964332778 +0000 UTC m=+21.691565932" watchObservedRunningTime="2026-09-17 03:32:45.964725125 +0000 UTC m=+21.691958280" Sep 17 03:32:45.990704 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:45.990644 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pf7zm" podStartSLOduration=4.441418245 podStartE2EDuration="21.990626037s" totalImagesPullingTime="17.549207792s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:32:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:32:45.990475026 +0000 UTC m=+21.717708184" watchObservedRunningTime="2026-09-17 03:32:45.990626037 +0000 UTC m=+21.717859190" Sep 17 03:32:46.014552 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:46.014501 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vwzf5" podStartSLOduration=4.456483284 podStartE2EDuration="22.014484818s" totalImagesPullingTime="17.558001534s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:32:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:32:46.0141621 +0000 UTC m=+21.741395255" watchObservedRunningTime="2026-09-17 03:32:46.014484818 +0000 UTC m=+21.741717972" Sep 17 03:32:46.400882 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:46.400675 2551 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 17 03:32:46.760957 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:46.760840 2551 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T03:32:46.400878506Z","UUID":"a16a1942-5874-46a8-b34c-4e96f9f284dc","Handler":null,"Name":"","Endpoint":""} Sep 17 03:32:46.762746 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:46.762712 2551 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 17 03:32:46.762892 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:46.762751 2551 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 17 03:32:46.762892 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:46.762879 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4qjvl" Sep 17 03:32:46.762892 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:46.762886 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9lsl" Sep 17 03:32:46.763046 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:46.762908 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:46.763046 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:46.763011 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4qjvl" podUID="7f900dc7-747d-47b8-8834-51afc05d4bac" Sep 17 03:32:46.763142 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:46.763096 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9lsl" podUID="6f01992d-cdf0-47be-ab65-9714e39d371d" Sep 17 03:32:46.763204 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:46.763182 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5lh2" podUID="7f67c23a-21e7-465e-a87c-29c1e5a3eadd" Sep 17 03:32:46.902037 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:46.901953 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-947d6" event={"ID":"02aebf6f-0ada-47f6-bb17-a994d4d1634e","Type":"ContainerStarted","Data":"9001a5257cabb901bc426ee38bbde5760bc5d7083cec973392975c92caf2ecad"} Sep 17 03:32:46.903521 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:46.903455 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n98w6" event={"ID":"336341fa-ffd3-45fa-98fd-bba7ab551273","Type":"ContainerStarted","Data":"61c5d46f07216cd8bfdea5bf7d18599ef4b7e6e96fae59ea10b255a764652fc4"} Sep 17 03:32:46.922419 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:46.922359 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-n98w6" podStartSLOduration=5.371344449 podStartE2EDuration="22.922344804s" totalImagesPullingTime="17.551000355s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:32:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:32:46.921968549 +0000 UTC m=+22.649201702" watchObservedRunningTime="2026-09-17 03:32:46.922344804 +0000 UTC m=+22.649577957" Sep 17 03:32:47.907818 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:47.907791 2551 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 17 03:32:47.908138 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:47.907817 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-947d6" event={"ID":"02aebf6f-0ada-47f6-bb17-a994d4d1634e","Type":"ContainerStarted","Data":"49ca85a9e14b2c12bffd1c706c8890d6b584bb68c5133d47e9df40bbb30b9cea"} Sep 17 03:32:47.927188 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:47.927144 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-947d6" podStartSLOduration=4.421482941 podStartE2EDuration="23.927129329s" totalImagesPullingTime="19.505646388s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:32:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:32:47.926787165 +0000 UTC m=+23.654020319" watchObservedRunningTime="2026-09-17 03:32:47.927129329 +0000 UTC m=+23.654362501" Sep 17 03:32:48.203046 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:48.203003 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:32:48.296752 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:48.296711 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:32:48.584138 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:48.584060 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:32:48.671302 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:48.671264 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:32:48.762700 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:48.762661 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:48.762700 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:48.762682 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4qjvl" Sep 17 03:32:48.762893 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:48.762768 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5lh2" podUID="7f67c23a-21e7-465e-a87c-29c1e5a3eadd" Sep 17 03:32:48.762893 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:48.762834 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4qjvl" podUID="7f900dc7-747d-47b8-8834-51afc05d4bac" Sep 17 03:32:48.762893 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:48.762873 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9lsl" Sep 17 03:32:48.762986 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:48.762954 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9lsl" podUID="6f01992d-cdf0-47be-ab65-9714e39d371d" Sep 17 03:32:48.912803 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:48.912740 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c8wtl_228ee255-c87b-42f0-b012-56cf65fa77db/ovn-acl-logging/0.log" Sep 17 03:32:48.913243 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:48.913112 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" event={"ID":"228ee255-c87b-42f0-b012-56cf65fa77db","Type":"ContainerStarted","Data":"0069018a2e1d1c0921f5994ff60bc55ed690fb927504b79ac9cfb927c6c0b6c7"} Sep 17 03:32:50.763194 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:50.763011 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9lsl" Sep 17 03:32:50.763816 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:50.763048 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:50.763816 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:50.763272 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9lsl" podUID="6f01992d-cdf0-47be-ab65-9714e39d371d" Sep 17 03:32:50.763816 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:50.763062 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4qjvl" Sep 17 03:32:50.763816 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:50.763362 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5lh2" podUID="7f67c23a-21e7-465e-a87c-29c1e5a3eadd" Sep 17 03:32:50.763816 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:50.763471 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4qjvl" podUID="7f900dc7-747d-47b8-8834-51afc05d4bac" Sep 17 03:32:50.920984 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:50.920958 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c8wtl_228ee255-c87b-42f0-b012-56cf65fa77db/ovn-acl-logging/0.log" Sep 17 03:32:50.921386 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:50.921356 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" event={"ID":"228ee255-c87b-42f0-b012-56cf65fa77db","Type":"ContainerStarted","Data":"cb0488b36daeb5be92cb55dbba2766325750844325cb85528a41846774c5c3a1"} Sep 17 03:32:50.921678 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:50.921628 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:50.921806 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:50.921785 2551 scope.go:117] "RemoveContainer" containerID="f6ae027064be8d720079a6e5f909fd2b99093340bc92724e4ad6ca034646cd8f" Sep 17 03:32:50.923522 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:50.923500 2551 generic.go:356] "Generic (PLEG): container finished" podID="3d48289c-a388-4c7e-b67d-98b2471cc4ec" containerID="76e35b79a9c10ae4c5e2d5244921af0bb256b039be0037506d7d7dcd6c41914a" exitCode=0 Sep 17 03:32:50.923618 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:50.923542 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qffv4" event={"ID":"3d48289c-a388-4c7e-b67d-98b2471cc4ec","Type":"ContainerDied","Data":"76e35b79a9c10ae4c5e2d5244921af0bb256b039be0037506d7d7dcd6c41914a"} Sep 17 03:32:50.938367 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:50.938346 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:51.928675 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:51.928651 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c8wtl_228ee255-c87b-42f0-b012-56cf65fa77db/ovn-acl-logging/0.log" Sep 17 03:32:51.929292 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:51.928977 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" event={"ID":"228ee255-c87b-42f0-b012-56cf65fa77db","Type":"ContainerStarted","Data":"e2669b91660d99732db20e8632d03a4d85cbaab6f819f15f9bba28b72feb1d08"} Sep 17 03:32:51.929292 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:51.929273 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:51.929455 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:51.929436 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:51.943661 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:51.943641 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:32:51.958114 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:51.958076 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" podStartSLOduration=10.391676156 podStartE2EDuration="27.958063467s" totalImagesPullingTime="17.566387311s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:32:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:32:51.956564186 +0000 UTC m=+27.683797339" watchObservedRunningTime="2026-09-17 03:32:51.958063467 +0000 UTC m=+27.685296620" Sep 17 03:32:52.224803 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:52.224639 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:32:52.292572 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:52.292534 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:32:52.554345 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:52.554231 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k5lh2"] Sep 17 03:32:52.554345 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:52.554344 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:52.554621 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:52.554495 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5lh2" podUID="7f67c23a-21e7-465e-a87c-29c1e5a3eadd" Sep 17 03:32:52.558168 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:52.558144 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t9lsl"] Sep 17 03:32:52.558293 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:52.558238 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9lsl" Sep 17 03:32:52.558335 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:52.558314 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9lsl" podUID="6f01992d-cdf0-47be-ab65-9714e39d371d" Sep 17 03:32:52.561735 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:52.561712 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4qjvl"] Sep 17 03:32:52.561861 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:52.561812 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4qjvl" Sep 17 03:32:52.561929 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:52.561912 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4qjvl" podUID="7f900dc7-747d-47b8-8834-51afc05d4bac" Sep 17 03:32:52.933345 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:52.933315 2551 generic.go:356] "Generic (PLEG): container finished" podID="3d48289c-a388-4c7e-b67d-98b2471cc4ec" containerID="e919f5960a87c8b41a0b94e72f2cd4216dbd4587921b2fe47af3b17e1dcb63f4" exitCode=0 Sep 17 03:32:52.933793 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:52.933397 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qffv4" event={"ID":"3d48289c-a388-4c7e-b67d-98b2471cc4ec","Type":"ContainerDied","Data":"e919f5960a87c8b41a0b94e72f2cd4216dbd4587921b2fe47af3b17e1dcb63f4"} Sep 17 03:32:53.696147 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:53.696102 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:32:53.763140 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:53.763114 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:53.763264 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:53.763241 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5lh2" podUID="7f67c23a-21e7-465e-a87c-29c1e5a3eadd" Sep 17 03:32:53.763318 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:53.763114 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9lsl" Sep 17 03:32:53.763360 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:53.763341 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9lsl" podUID="6f01992d-cdf0-47be-ab65-9714e39d371d" Sep 17 03:32:53.799845 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:53.799803 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:32:53.938679 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:53.938643 2551 generic.go:356] "Generic (PLEG): container finished" podID="3d48289c-a388-4c7e-b67d-98b2471cc4ec" containerID="aee3094072b5dddc4b20e1200547368f539d4c1e7099543d7493e8244c5f1a4b" exitCode=0 Sep 17 03:32:53.939116 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:53.938720 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qffv4" event={"ID":"3d48289c-a388-4c7e-b67d-98b2471cc4ec","Type":"ContainerDied","Data":"aee3094072b5dddc4b20e1200547368f539d4c1e7099543d7493e8244c5f1a4b"} Sep 17 03:32:54.531076 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:54.531047 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:32:54.764582 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:54.763963 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4qjvl" Sep 17 03:32:54.764582 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:54.764081 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4qjvl" podUID="7f900dc7-747d-47b8-8834-51afc05d4bac" Sep 17 03:32:55.740735 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:55.740699 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7rvl5" Sep 17 03:32:55.741195 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:55.740845 2551 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 17 03:32:55.741418 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:55.741376 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7rvl5" Sep 17 03:32:55.762701 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:55.762634 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:55.762848 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:55.762754 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5lh2" podUID="7f67c23a-21e7-465e-a87c-29c1e5a3eadd" Sep 17 03:32:55.762848 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:55.762799 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9lsl" Sep 17 03:32:55.762969 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:55.762882 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9lsl" podUID="6f01992d-cdf0-47be-ab65-9714e39d371d" Sep 17 03:32:55.803335 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:55.803302 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:32:56.763457 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:56.763425 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4qjvl" Sep 17 03:32:56.763932 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:56.763568 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4qjvl" podUID="7f900dc7-747d-47b8-8834-51afc05d4bac" Sep 17 03:32:57.762799 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:57.762760 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9lsl" Sep 17 03:32:57.763082 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:57.762761 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:57.763082 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:57.762902 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9lsl" podUID="6f01992d-cdf0-47be-ab65-9714e39d371d" Sep 17 03:32:57.763082 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:57.762967 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5lh2" podUID="7f67c23a-21e7-465e-a87c-29c1e5a3eadd" Sep 17 03:32:58.549694 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.549491 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f900dc7-747d-47b8-8834-51afc05d4bac-metrics-certs\") pod \"network-metrics-daemon-4qjvl\" (UID: \"7f900dc7-747d-47b8-8834-51afc05d4bac\") " pod="openshift-multus/network-metrics-daemon-4qjvl" Sep 17 03:32:58.550140 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.549740 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f67c23a-21e7-465e-a87c-29c1e5a3eadd-original-pull-secret\") pod \"global-pull-secret-syncer-k5lh2\" (UID: \"7f67c23a-21e7-465e-a87c-29c1e5a3eadd\") " pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:58.550140 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:58.549643 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:32:58.550140 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:58.549826 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f900dc7-747d-47b8-8834-51afc05d4bac-metrics-certs podName:7f900dc7-747d-47b8-8834-51afc05d4bac nodeName:}" failed. No retries permitted until 2026-09-17 03:33:30.549808057 +0000 UTC m=+66.277041206 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f900dc7-747d-47b8-8834-51afc05d4bac-metrics-certs") pod "network-metrics-daemon-4qjvl" (UID: "7f900dc7-747d-47b8-8834-51afc05d4bac") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 03:32:58.550140 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:58.549859 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 03:32:58.550140 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:58.549915 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f67c23a-21e7-465e-a87c-29c1e5a3eadd-original-pull-secret podName:7f67c23a-21e7-465e-a87c-29c1e5a3eadd nodeName:}" failed. No retries permitted until 2026-09-17 03:33:30.549899523 +0000 UTC m=+66.277132660 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f67c23a-21e7-465e-a87c-29c1e5a3eadd-original-pull-secret") pod "global-pull-secret-syncer-k5lh2" (UID: "7f67c23a-21e7-465e-a87c-29c1e5a3eadd") : object "kube-system"/"original-pull-secret" not registered Sep 17 03:32:58.623001 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.622968 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-180.ec2.internal" event="NodeReady" Sep 17 03:32:58.623166 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.623126 2551 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 17 03:32:58.650029 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.650003 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx9cd\" (UniqueName: \"kubernetes.io/projected/6f01992d-cdf0-47be-ab65-9714e39d371d-kube-api-access-gx9cd\") pod \"network-check-target-t9lsl\" (UID: \"6f01992d-cdf0-47be-ab65-9714e39d371d\") " pod="openshift-network-diagnostics/network-check-target-t9lsl" Sep 17 03:32:58.650195 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:58.650145 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 03:32:58.650195 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:58.650165 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 03:32:58.650195 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:58.650175 2551 projected.go:196] Error preparing data for projected volume kube-api-access-gx9cd for pod openshift-network-diagnostics/network-check-target-t9lsl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:32:58.650304 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:58.650216 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f01992d-cdf0-47be-ab65-9714e39d371d-kube-api-access-gx9cd podName:6f01992d-cdf0-47be-ab65-9714e39d371d nodeName:}" failed. No retries permitted until 2026-09-17 03:33:30.650205032 +0000 UTC m=+66.377438168 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gx9cd" (UniqueName: "kubernetes.io/projected/6f01992d-cdf0-47be-ab65-9714e39d371d-kube-api-access-gx9cd") pod "network-check-target-t9lsl" (UID: "6f01992d-cdf0-47be-ab65-9714e39d371d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 03:32:58.678524 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.678495 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9kgwj"] Sep 17 03:32:58.698592 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.698559 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6w5pf"] Sep 17 03:32:58.698740 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.698629 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9kgwj" Sep 17 03:32:58.701648 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.701626 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 17 03:32:58.701768 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.701748 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 17 03:32:58.702250 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.702224 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5fsf8\"" Sep 17 03:32:58.716705 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.716687 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9kgwj"] Sep 17 03:32:58.716782 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.716716 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6w5pf"] Sep 17 03:32:58.716828 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.716784 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6w5pf" Sep 17 03:32:58.720690 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.720669 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 17 03:32:58.720690 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.720688 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9bbtb\"" Sep 17 03:32:58.720844 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.720705 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 17 03:32:58.720892 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.720880 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 17 03:32:58.762697 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.762677 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4qjvl" Sep 17 03:32:58.766429 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.765544 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 03:32:58.766429 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.765720 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-55bt6\"" Sep 17 03:32:58.851742 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.851668 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/231922a7-9b04-43e5-ae55-e3a0247da747-metrics-tls\") pod \"dns-default-9kgwj\" (UID: \"231922a7-9b04-43e5-ae55-e3a0247da747\") " pod="openshift-dns/dns-default-9kgwj" Sep 17 03:32:58.851949 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.851740 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwrgx\" (UniqueName: \"kubernetes.io/projected/9c6d07b9-4073-4582-ad02-c6979ac3a0ca-kube-api-access-wwrgx\") pod \"ingress-canary-6w5pf\" (UID: \"9c6d07b9-4073-4582-ad02-c6979ac3a0ca\") " pod="openshift-ingress-canary/ingress-canary-6w5pf" Sep 17 03:32:58.851949 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.851772 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4gm9\" (UniqueName: \"kubernetes.io/projected/231922a7-9b04-43e5-ae55-e3a0247da747-kube-api-access-l4gm9\") pod \"dns-default-9kgwj\" (UID: \"231922a7-9b04-43e5-ae55-e3a0247da747\") " pod="openshift-dns/dns-default-9kgwj" Sep 17 03:32:58.851949 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.851799 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/231922a7-9b04-43e5-ae55-e3a0247da747-config-volume\") pod \"dns-default-9kgwj\" (UID: \"231922a7-9b04-43e5-ae55-e3a0247da747\") " pod="openshift-dns/dns-default-9kgwj" Sep 17 03:32:58.851949 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.851873 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c6d07b9-4073-4582-ad02-c6979ac3a0ca-cert\") pod \"ingress-canary-6w5pf\" (UID: \"9c6d07b9-4073-4582-ad02-c6979ac3a0ca\") " pod="openshift-ingress-canary/ingress-canary-6w5pf" Sep 17 03:32:58.851949 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.851894 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/231922a7-9b04-43e5-ae55-e3a0247da747-tmp-dir\") pod \"dns-default-9kgwj\" (UID: \"231922a7-9b04-43e5-ae55-e3a0247da747\") " pod="openshift-dns/dns-default-9kgwj" Sep 17 03:32:58.952329 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.952303 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c6d07b9-4073-4582-ad02-c6979ac3a0ca-cert\") pod \"ingress-canary-6w5pf\" (UID: \"9c6d07b9-4073-4582-ad02-c6979ac3a0ca\") " pod="openshift-ingress-canary/ingress-canary-6w5pf" Sep 17 03:32:58.952329 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.952331 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/231922a7-9b04-43e5-ae55-e3a0247da747-tmp-dir\") pod \"dns-default-9kgwj\" (UID: \"231922a7-9b04-43e5-ae55-e3a0247da747\") " pod="openshift-dns/dns-default-9kgwj" Sep 17 03:32:58.952577 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.952352 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/231922a7-9b04-43e5-ae55-e3a0247da747-metrics-tls\") pod \"dns-default-9kgwj\" (UID: \"231922a7-9b04-43e5-ae55-e3a0247da747\") " pod="openshift-dns/dns-default-9kgwj" Sep 17 03:32:58.952577 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.952375 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwrgx\" (UniqueName: \"kubernetes.io/projected/9c6d07b9-4073-4582-ad02-c6979ac3a0ca-kube-api-access-wwrgx\") pod \"ingress-canary-6w5pf\" (UID: \"9c6d07b9-4073-4582-ad02-c6979ac3a0ca\") " pod="openshift-ingress-canary/ingress-canary-6w5pf" Sep 17 03:32:58.952577 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.952393 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4gm9\" (UniqueName: \"kubernetes.io/projected/231922a7-9b04-43e5-ae55-e3a0247da747-kube-api-access-l4gm9\") pod \"dns-default-9kgwj\" (UID: \"231922a7-9b04-43e5-ae55-e3a0247da747\") " pod="openshift-dns/dns-default-9kgwj" Sep 17 03:32:58.952577 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.952484 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/231922a7-9b04-43e5-ae55-e3a0247da747-config-volume\") pod \"dns-default-9kgwj\" (UID: \"231922a7-9b04-43e5-ae55-e3a0247da747\") " pod="openshift-dns/dns-default-9kgwj" Sep 17 03:32:58.952577 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:58.952509 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:32:58.952577 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:58.952577 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/231922a7-9b04-43e5-ae55-e3a0247da747-metrics-tls podName:231922a7-9b04-43e5-ae55-e3a0247da747 nodeName:}" failed. No retries permitted until 2026-09-17 03:32:59.452556537 +0000 UTC m=+35.179789669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/231922a7-9b04-43e5-ae55-e3a0247da747-metrics-tls") pod "dns-default-9kgwj" (UID: "231922a7-9b04-43e5-ae55-e3a0247da747") : secret "dns-default-metrics-tls" not found Sep 17 03:32:58.952835 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.952703 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/231922a7-9b04-43e5-ae55-e3a0247da747-tmp-dir\") pod \"dns-default-9kgwj\" (UID: \"231922a7-9b04-43e5-ae55-e3a0247da747\") " pod="openshift-dns/dns-default-9kgwj" Sep 17 03:32:58.953055 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.953035 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/231922a7-9b04-43e5-ae55-e3a0247da747-config-volume\") pod \"dns-default-9kgwj\" (UID: \"231922a7-9b04-43e5-ae55-e3a0247da747\") " pod="openshift-dns/dns-default-9kgwj" Sep 17 03:32:58.956444 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.956423 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c6d07b9-4073-4582-ad02-c6979ac3a0ca-cert\") pod \"ingress-canary-6w5pf\" (UID: \"9c6d07b9-4073-4582-ad02-c6979ac3a0ca\") " pod="openshift-ingress-canary/ingress-canary-6w5pf" Sep 17 03:32:58.961860 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.961837 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwrgx\" (UniqueName: \"kubernetes.io/projected/9c6d07b9-4073-4582-ad02-c6979ac3a0ca-kube-api-access-wwrgx\") pod \"ingress-canary-6w5pf\" (UID: \"9c6d07b9-4073-4582-ad02-c6979ac3a0ca\") " pod="openshift-ingress-canary/ingress-canary-6w5pf" Sep 17 03:32:58.961860 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:58.961852 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4gm9\" (UniqueName: \"kubernetes.io/projected/231922a7-9b04-43e5-ae55-e3a0247da747-kube-api-access-l4gm9\") pod \"dns-default-9kgwj\" (UID: \"231922a7-9b04-43e5-ae55-e3a0247da747\") " pod="openshift-dns/dns-default-9kgwj" Sep 17 03:32:59.024534 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:59.024502 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6w5pf" Sep 17 03:32:59.384453 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:59.384350 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6w5pf"] Sep 17 03:32:59.415195 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:32:59.415169 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c6d07b9_4073_4582_ad02_c6979ac3a0ca.slice/crio-1f103d7e8d62b006dbe551122ef0deeeb0062dc6ecb5bb0ae9a746ee7de11e5d WatchSource:0}: Error finding container 1f103d7e8d62b006dbe551122ef0deeeb0062dc6ecb5bb0ae9a746ee7de11e5d: Status 404 returned error can't find the container with id 1f103d7e8d62b006dbe551122ef0deeeb0062dc6ecb5bb0ae9a746ee7de11e5d Sep 17 03:32:59.456788 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:59.456761 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/231922a7-9b04-43e5-ae55-e3a0247da747-metrics-tls\") pod \"dns-default-9kgwj\" (UID: \"231922a7-9b04-43e5-ae55-e3a0247da747\") " pod="openshift-dns/dns-default-9kgwj" Sep 17 03:32:59.456901 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:59.456867 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:32:59.456941 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:32:59.456915 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/231922a7-9b04-43e5-ae55-e3a0247da747-metrics-tls podName:231922a7-9b04-43e5-ae55-e3a0247da747 nodeName:}" failed. No retries permitted until 2026-09-17 03:33:00.45690277 +0000 UTC m=+36.184135903 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/231922a7-9b04-43e5-ae55-e3a0247da747-metrics-tls") pod "dns-default-9kgwj" (UID: "231922a7-9b04-43e5-ae55-e3a0247da747") : secret "dns-default-metrics-tls" not found Sep 17 03:32:59.762594 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:59.762563 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9lsl" Sep 17 03:32:59.763347 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:59.762563 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:32:59.765878 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:59.765682 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-znwr5\"" Sep 17 03:32:59.765996 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:59.765685 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 03:32:59.765996 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:59.765775 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 03:32:59.765996 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:59.765809 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 03:32:59.952446 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:59.952412 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6w5pf" event={"ID":"9c6d07b9-4073-4582-ad02-c6979ac3a0ca","Type":"ContainerStarted","Data":"1f103d7e8d62b006dbe551122ef0deeeb0062dc6ecb5bb0ae9a746ee7de11e5d"} Sep 17 03:32:59.955047 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:59.955023 2551 generic.go:356] "Generic (PLEG): container finished" podID="3d48289c-a388-4c7e-b67d-98b2471cc4ec" containerID="2fee10f00685eed94f368574a0bb9e7ce057b13e3d84211cfc9fea84b335b19e" exitCode=0 Sep 17 03:32:59.955160 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:32:59.955070 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qffv4" event={"ID":"3d48289c-a388-4c7e-b67d-98b2471cc4ec","Type":"ContainerDied","Data":"2fee10f00685eed94f368574a0bb9e7ce057b13e3d84211cfc9fea84b335b19e"} Sep 17 03:33:00.465241 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:00.465207 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/231922a7-9b04-43e5-ae55-e3a0247da747-metrics-tls\") pod \"dns-default-9kgwj\" (UID: \"231922a7-9b04-43e5-ae55-e3a0247da747\") " pod="openshift-dns/dns-default-9kgwj" Sep 17 03:33:00.465434 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:00.465361 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:33:00.465510 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:00.465449 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/231922a7-9b04-43e5-ae55-e3a0247da747-metrics-tls podName:231922a7-9b04-43e5-ae55-e3a0247da747 nodeName:}" failed. No retries permitted until 2026-09-17 03:33:02.465430226 +0000 UTC m=+38.192663375 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/231922a7-9b04-43e5-ae55-e3a0247da747-metrics-tls") pod "dns-default-9kgwj" (UID: "231922a7-9b04-43e5-ae55-e3a0247da747") : secret "dns-default-metrics-tls" not found Sep 17 03:33:00.960779 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:00.960740 2551 generic.go:356] "Generic (PLEG): container finished" podID="3d48289c-a388-4c7e-b67d-98b2471cc4ec" containerID="95ea74bc783669e510e9afe5f7b29dcc3d9c5687ce6111f5783364851b1df214" exitCode=0 Sep 17 03:33:00.961185 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:00.960806 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qffv4" event={"ID":"3d48289c-a388-4c7e-b67d-98b2471cc4ec","Type":"ContainerDied","Data":"95ea74bc783669e510e9afe5f7b29dcc3d9c5687ce6111f5783364851b1df214"} Sep 17 03:33:01.966259 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:01.966221 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qffv4" event={"ID":"3d48289c-a388-4c7e-b67d-98b2471cc4ec","Type":"ContainerStarted","Data":"7ef6dd8f3ef62ad13ce1abb48b5ade7642d527901f343376fbabef35f4a459ce"} Sep 17 03:33:01.988215 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:01.988168 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qffv4" podStartSLOduration=8.570796407 podStartE2EDuration="37.988153632s" totalImagesPullingTime="29.417357225s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:32:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:33:01.986788117 +0000 UTC m=+37.714021282" watchObservedRunningTime="2026-09-17 03:33:01.988153632 +0000 UTC m=+37.715386825" Sep 17 03:33:02.109570 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:02.109538 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:02.210110 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:02.210082 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:02.342077 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:02.341995 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:02.442189 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:02.442158 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:02.480574 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:02.480542 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/231922a7-9b04-43e5-ae55-e3a0247da747-metrics-tls\") pod \"dns-default-9kgwj\" (UID: \"231922a7-9b04-43e5-ae55-e3a0247da747\") " pod="openshift-dns/dns-default-9kgwj" Sep 17 03:33:02.480736 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:02.480655 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:33:02.480736 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:02.480717 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/231922a7-9b04-43e5-ae55-e3a0247da747-metrics-tls podName:231922a7-9b04-43e5-ae55-e3a0247da747 nodeName:}" failed. No retries permitted until 2026-09-17 03:33:06.480703274 +0000 UTC m=+42.207936406 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/231922a7-9b04-43e5-ae55-e3a0247da747-metrics-tls") pod "dns-default-9kgwj" (UID: "231922a7-9b04-43e5-ae55-e3a0247da747") : secret "dns-default-metrics-tls" not found Sep 17 03:33:02.849971 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:02.849936 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:02.955110 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:02.955076 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:02.970059 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:02.970029 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6w5pf" event={"ID":"9c6d07b9-4073-4582-ad02-c6979ac3a0ca","Type":"ContainerStarted","Data":"076a3752af0ec6b316d04540d1f2bfe1e3e78c3b53d14236ce9997edbbca0186"} Sep 17 03:33:03.070491 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:03.070461 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:03.155144 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:03.155061 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:03.469204 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:03.469170 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:03.559533 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:03.559496 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:03.739044 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:03.738977 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:03.810952 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:03.810921 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:06.508253 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:06.508215 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/231922a7-9b04-43e5-ae55-e3a0247da747-metrics-tls\") pod \"dns-default-9kgwj\" (UID: \"231922a7-9b04-43e5-ae55-e3a0247da747\") " pod="openshift-dns/dns-default-9kgwj" Sep 17 03:33:06.508677 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:06.508343 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:33:06.508677 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:06.508416 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/231922a7-9b04-43e5-ae55-e3a0247da747-metrics-tls podName:231922a7-9b04-43e5-ae55-e3a0247da747 nodeName:}" failed. No retries permitted until 2026-09-17 03:33:14.508384324 +0000 UTC m=+50.235617460 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/231922a7-9b04-43e5-ae55-e3a0247da747-metrics-tls") pod "dns-default-9kgwj" (UID: "231922a7-9b04-43e5-ae55-e3a0247da747") : secret "dns-default-metrics-tls" not found Sep 17 03:33:09.111633 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.111576 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6w5pf" podStartSLOduration=8.489933348 podStartE2EDuration="11.111557535s" totalImagesPullingTime="2.621624187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:33:02.993594236 +0000 UTC m=+38.720827390" watchObservedRunningTime="2026-09-17 03:33:09.111557535 +0000 UTC m=+44.838790709" Sep 17 03:33:09.112194 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.111814 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ltcvj"] Sep 17 03:33:09.162440 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.162386 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8pnxl"] Sep 17 03:33:09.162593 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.162510 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ltcvj" Sep 17 03:33:09.165434 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.165390 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-wrl7f\"" Sep 17 03:33:09.165552 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.165462 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 17 03:33:09.165672 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.165659 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 17 03:33:09.182004 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.181974 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8pnxl"] Sep 17 03:33:09.182004 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.182007 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ltcvj"] Sep 17 03:33:09.182171 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.182063 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8pnxl" Sep 17 03:33:09.184783 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.184768 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 17 03:33:09.184862 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.184788 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lr6n6\"" Sep 17 03:33:09.184862 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.184788 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 17 03:33:09.185332 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.185318 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 17 03:33:09.196274 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.196254 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-7vmjw"] Sep 17 03:33:09.215109 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.215086 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-7vmjw" Sep 17 03:33:09.217993 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.217973 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-rlgr5\"" Sep 17 03:33:09.218258 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.218240 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-7vmjw"] Sep 17 03:33:09.301131 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.301097 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-749b7f9657-fxq68"] Sep 17 03:33:09.319768 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.319738 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-jq242"] Sep 17 03:33:09.319986 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.319870 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:09.322819 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.322795 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 17 03:33:09.323258 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.323238 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 17 03:33:09.323438 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.323417 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 17 03:33:09.323530 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.323505 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rfj5j\"" Sep 17 03:33:09.328104 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.328082 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/41d488f5-5a66-4e5d-a85f-db3dc2bad818-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-8pnxl\" (UID: \"41d488f5-5a66-4e5d-a85f-db3dc2bad818\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8pnxl" Sep 17 03:33:09.328250 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.328129 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv84q\" (UniqueName: \"kubernetes.io/projected/8e1a5081-a762-4ca0-ad24-6555253ffa92-kube-api-access-gv84q\") pod \"volume-data-source-validator-86695b7cc7-ltcvj\" (UID: \"8e1a5081-a762-4ca0-ad24-6555253ffa92\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ltcvj" Sep 17 03:33:09.328250 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.328161 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mmj4\" (UniqueName: \"kubernetes.io/projected/41d488f5-5a66-4e5d-a85f-db3dc2bad818-kube-api-access-6mmj4\") pod \"cluster-samples-operator-86499c89c4-8pnxl\" (UID: \"41d488f5-5a66-4e5d-a85f-db3dc2bad818\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8pnxl" Sep 17 03:33:09.328355 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.328275 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p84jj\" (UniqueName: \"kubernetes.io/projected/aa32bfc4-d4ad-4713-84f1-551123c26489-kube-api-access-p84jj\") pod \"network-check-source-6f8b768455-7vmjw\" (UID: \"aa32bfc4-d4ad-4713-84f1-551123c26489\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-7vmjw" Sep 17 03:33:09.328622 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.328607 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 17 03:33:09.344129 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.344102 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-6bzcs"] Sep 17 03:33:09.344186 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.344162 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jq242" Sep 17 03:33:09.346973 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.346952 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 17 03:33:09.346973 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.346968 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 17 03:33:09.347120 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.346969 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 17 03:33:09.347120 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.346959 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-5w82h\"" Sep 17 03:33:09.347850 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.347832 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 17 03:33:09.368213 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.368168 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-749b7f9657-fxq68"] Sep 17 03:33:09.368213 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.368193 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-jq242"] Sep 17 03:33:09.368213 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.368206 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-6bzcs"] Sep 17 03:33:09.368344 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.368276 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-6bzcs" Sep 17 03:33:09.370644 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.370630 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 17 03:33:09.370923 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.370907 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 17 03:33:09.371264 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.371248 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 17 03:33:09.371328 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.371263 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-vg8th\"" Sep 17 03:33:09.371328 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.371270 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 17 03:33:09.408835 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.408801 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:09.428845 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.428814 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/41d488f5-5a66-4e5d-a85f-db3dc2bad818-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-8pnxl\" (UID: \"41d488f5-5a66-4e5d-a85f-db3dc2bad818\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8pnxl" Sep 17 03:33:09.428952 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.428859 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv84q\" (UniqueName: \"kubernetes.io/projected/8e1a5081-a762-4ca0-ad24-6555253ffa92-kube-api-access-gv84q\") pod \"volume-data-source-validator-86695b7cc7-ltcvj\" (UID: \"8e1a5081-a762-4ca0-ad24-6555253ffa92\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ltcvj" Sep 17 03:33:09.428952 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.428882 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7dc05124-275e-43af-87e5-f2b9d4def851-ca-trust-extracted\") pod \"image-registry-749b7f9657-fxq68\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:09.428952 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.428917 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7dc05124-275e-43af-87e5-f2b9d4def851-installation-pull-secrets\") pod \"image-registry-749b7f9657-fxq68\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:09.428952 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.428944 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e0116b6b-a212-4bca-9993-4b5e4c91a2bf-config\") pod \"service-ca-operator-cf7c776b7-jq242\" (UID: \"e0116b6b-a212-4bca-9993-4b5e4c91a2bf\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jq242" Sep 17 03:33:09.429106 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:09.428961 2551 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 03:33:09.429106 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.428976 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s98sg\" (UniqueName: \"kubernetes.io/projected/e0116b6b-a212-4bca-9993-4b5e4c91a2bf-kube-api-access-s98sg\") pod \"service-ca-operator-cf7c776b7-jq242\" (UID: \"e0116b6b-a212-4bca-9993-4b5e4c91a2bf\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jq242" Sep 17 03:33:09.429106 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:09.429035 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41d488f5-5a66-4e5d-a85f-db3dc2bad818-samples-operator-tls podName:41d488f5-5a66-4e5d-a85f-db3dc2bad818 nodeName:}" failed. No retries permitted until 2026-09-17 03:33:09.929015578 +0000 UTC m=+45.656248736 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/41d488f5-5a66-4e5d-a85f-db3dc2bad818-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-8pnxl" (UID: "41d488f5-5a66-4e5d-a85f-db3dc2bad818") : secret "samples-operator-tls" not found Sep 17 03:33:09.429106 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.429053 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mmj4\" (UniqueName: \"kubernetes.io/projected/41d488f5-5a66-4e5d-a85f-db3dc2bad818-kube-api-access-6mmj4\") pod \"cluster-samples-operator-86499c89c4-8pnxl\" (UID: \"41d488f5-5a66-4e5d-a85f-db3dc2bad818\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8pnxl" Sep 17 03:33:09.429301 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.429106 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7dc05124-275e-43af-87e5-f2b9d4def851-image-registry-private-configuration\") pod \"image-registry-749b7f9657-fxq68\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:09.429301 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.429135 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-registry-tls\") pod \"image-registry-749b7f9657-fxq68\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:09.429301 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.429160 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0116b6b-a212-4bca-9993-4b5e4c91a2bf-serving-cert\") pod \"service-ca-operator-cf7c776b7-jq242\" (UID: \"e0116b6b-a212-4bca-9993-4b5e4c91a2bf\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jq242" Sep 17 03:33:09.429301 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.429199 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8skh9\" (UniqueName: \"kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-kube-api-access-8skh9\") pod \"image-registry-749b7f9657-fxq68\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:09.429301 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.429252 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7dc05124-275e-43af-87e5-f2b9d4def851-registry-certificates\") pod \"image-registry-749b7f9657-fxq68\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:09.429301 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.429277 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p84jj\" (UniqueName: \"kubernetes.io/projected/aa32bfc4-d4ad-4713-84f1-551123c26489-kube-api-access-p84jj\") pod \"network-check-source-6f8b768455-7vmjw\" (UID: \"aa32bfc4-d4ad-4713-84f1-551123c26489\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-7vmjw" Sep 17 03:33:09.429301 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.429292 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7dc05124-275e-43af-87e5-f2b9d4def851-trusted-ca\") pod \"image-registry-749b7f9657-fxq68\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:09.429555 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.429308 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-bound-sa-token\") pod \"image-registry-749b7f9657-fxq68\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:09.439215 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.439195 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv84q\" (UniqueName: \"kubernetes.io/projected/8e1a5081-a762-4ca0-ad24-6555253ffa92-kube-api-access-gv84q\") pod \"volume-data-source-validator-86695b7cc7-ltcvj\" (UID: \"8e1a5081-a762-4ca0-ad24-6555253ffa92\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ltcvj" Sep 17 03:33:09.439341 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.439320 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p84jj\" (UniqueName: \"kubernetes.io/projected/aa32bfc4-d4ad-4713-84f1-551123c26489-kube-api-access-p84jj\") pod \"network-check-source-6f8b768455-7vmjw\" (UID: \"aa32bfc4-d4ad-4713-84f1-551123c26489\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-7vmjw" Sep 17 03:33:09.439380 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.439368 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mmj4\" (UniqueName: \"kubernetes.io/projected/41d488f5-5a66-4e5d-a85f-db3dc2bad818-kube-api-access-6mmj4\") pod \"cluster-samples-operator-86499c89c4-8pnxl\" (UID: \"41d488f5-5a66-4e5d-a85f-db3dc2bad818\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8pnxl" Sep 17 03:33:09.478293 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.478265 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:09.488206 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.488182 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ltcvj" Sep 17 03:33:09.524210 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.524184 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-7vmjw" Sep 17 03:33:09.529958 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.529928 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7dc05124-275e-43af-87e5-f2b9d4def851-ca-trust-extracted\") pod \"image-registry-749b7f9657-fxq68\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:09.530086 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.529964 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7dc05124-275e-43af-87e5-f2b9d4def851-installation-pull-secrets\") pod \"image-registry-749b7f9657-fxq68\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:09.530086 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.529986 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e0116b6b-a212-4bca-9993-4b5e4c91a2bf-config\") pod \"service-ca-operator-cf7c776b7-jq242\" (UID: \"e0116b6b-a212-4bca-9993-4b5e4c91a2bf\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jq242" Sep 17 03:33:09.530086 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.530005 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cldtv\" (UniqueName: \"kubernetes.io/projected/80df0c88-0ab2-482f-bd76-d757451830fb-kube-api-access-cldtv\") pod \"kube-storage-version-migrator-operator-6c8f84f897-6bzcs\" (UID: \"80df0c88-0ab2-482f-bd76-d757451830fb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-6bzcs" Sep 17 03:33:09.530261 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.530077 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s98sg\" (UniqueName: \"kubernetes.io/projected/e0116b6b-a212-4bca-9993-4b5e4c91a2bf-kube-api-access-s98sg\") pod \"service-ca-operator-cf7c776b7-jq242\" (UID: \"e0116b6b-a212-4bca-9993-4b5e4c91a2bf\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jq242" Sep 17 03:33:09.530261 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.530169 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7dc05124-275e-43af-87e5-f2b9d4def851-image-registry-private-configuration\") pod \"image-registry-749b7f9657-fxq68\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:09.530261 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.530189 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-registry-tls\") pod \"image-registry-749b7f9657-fxq68\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:09.530261 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.530207 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0116b6b-a212-4bca-9993-4b5e4c91a2bf-serving-cert\") pod \"service-ca-operator-cf7c776b7-jq242\" (UID: \"e0116b6b-a212-4bca-9993-4b5e4c91a2bf\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jq242" Sep 17 03:33:09.530261 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.530231 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80df0c88-0ab2-482f-bd76-d757451830fb-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-6bzcs\" (UID: \"80df0c88-0ab2-482f-bd76-d757451830fb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-6bzcs" Sep 17 03:33:09.530531 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.530264 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8skh9\" (UniqueName: \"kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-kube-api-access-8skh9\") pod \"image-registry-749b7f9657-fxq68\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:09.530531 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.530314 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7dc05124-275e-43af-87e5-f2b9d4def851-registry-certificates\") pod \"image-registry-749b7f9657-fxq68\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:09.530531 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.530332 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7dc05124-275e-43af-87e5-f2b9d4def851-ca-trust-extracted\") pod \"image-registry-749b7f9657-fxq68\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:09.530531 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.530346 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7dc05124-275e-43af-87e5-f2b9d4def851-trusted-ca\") pod \"image-registry-749b7f9657-fxq68\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:09.530531 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.530371 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-bound-sa-token\") pod \"image-registry-749b7f9657-fxq68\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:09.530531 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:09.530458 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 03:33:09.530531 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:09.530476 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-749b7f9657-fxq68: secret "image-registry-tls" not found Sep 17 03:33:09.530531 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.530503 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80df0c88-0ab2-482f-bd76-d757451830fb-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-6bzcs\" (UID: \"80df0c88-0ab2-482f-bd76-d757451830fb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-6bzcs" Sep 17 03:33:09.530898 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:09.530582 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-registry-tls podName:7dc05124-275e-43af-87e5-f2b9d4def851 nodeName:}" failed. No retries permitted until 2026-09-17 03:33:10.030559518 +0000 UTC m=+45.757792863 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-registry-tls") pod "image-registry-749b7f9657-fxq68" (UID: "7dc05124-275e-43af-87e5-f2b9d4def851") : secret "image-registry-tls" not found Sep 17 03:33:09.530898 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.530630 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e0116b6b-a212-4bca-9993-4b5e4c91a2bf-config\") pod \"service-ca-operator-cf7c776b7-jq242\" (UID: \"e0116b6b-a212-4bca-9993-4b5e4c91a2bf\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jq242" Sep 17 03:33:09.531122 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.531096 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7dc05124-275e-43af-87e5-f2b9d4def851-registry-certificates\") pod \"image-registry-749b7f9657-fxq68\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:09.531463 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.531441 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7dc05124-275e-43af-87e5-f2b9d4def851-trusted-ca\") pod \"image-registry-749b7f9657-fxq68\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:09.532732 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.532707 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7dc05124-275e-43af-87e5-f2b9d4def851-installation-pull-secrets\") pod \"image-registry-749b7f9657-fxq68\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:09.532827 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.532810 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0116b6b-a212-4bca-9993-4b5e4c91a2bf-serving-cert\") pod \"service-ca-operator-cf7c776b7-jq242\" (UID: \"e0116b6b-a212-4bca-9993-4b5e4c91a2bf\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jq242" Sep 17 03:33:09.533089 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.533068 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7dc05124-275e-43af-87e5-f2b9d4def851-image-registry-private-configuration\") pod \"image-registry-749b7f9657-fxq68\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:09.542395 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.542366 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-bound-sa-token\") pod \"image-registry-749b7f9657-fxq68\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:09.542395 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.542387 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s98sg\" (UniqueName: \"kubernetes.io/projected/e0116b6b-a212-4bca-9993-4b5e4c91a2bf-kube-api-access-s98sg\") pod \"service-ca-operator-cf7c776b7-jq242\" (UID: \"e0116b6b-a212-4bca-9993-4b5e4c91a2bf\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jq242" Sep 17 03:33:09.542574 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.542462 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8skh9\" (UniqueName: \"kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-kube-api-access-8skh9\") pod \"image-registry-749b7f9657-fxq68\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:09.631355 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.631276 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80df0c88-0ab2-482f-bd76-d757451830fb-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-6bzcs\" (UID: \"80df0c88-0ab2-482f-bd76-d757451830fb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-6bzcs" Sep 17 03:33:09.631355 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.631324 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80df0c88-0ab2-482f-bd76-d757451830fb-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-6bzcs\" (UID: \"80df0c88-0ab2-482f-bd76-d757451830fb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-6bzcs" Sep 17 03:33:09.631590 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.631375 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cldtv\" (UniqueName: \"kubernetes.io/projected/80df0c88-0ab2-482f-bd76-d757451830fb-kube-api-access-cldtv\") pod \"kube-storage-version-migrator-operator-6c8f84f897-6bzcs\" (UID: \"80df0c88-0ab2-482f-bd76-d757451830fb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-6bzcs" Sep 17 03:33:09.631808 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.631788 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80df0c88-0ab2-482f-bd76-d757451830fb-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-6bzcs\" (UID: \"80df0c88-0ab2-482f-bd76-d757451830fb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-6bzcs" Sep 17 03:33:09.633718 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.633696 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80df0c88-0ab2-482f-bd76-d757451830fb-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-6bzcs\" (UID: \"80df0c88-0ab2-482f-bd76-d757451830fb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-6bzcs" Sep 17 03:33:09.639664 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.639643 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cldtv\" (UniqueName: \"kubernetes.io/projected/80df0c88-0ab2-482f-bd76-d757451830fb-kube-api-access-cldtv\") pod \"kube-storage-version-migrator-operator-6c8f84f897-6bzcs\" (UID: \"80df0c88-0ab2-482f-bd76-d757451830fb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-6bzcs" Sep 17 03:33:09.652696 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.652677 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jq242" Sep 17 03:33:09.676105 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.676074 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-6bzcs" Sep 17 03:33:09.777561 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.777499 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ltcvj"] Sep 17 03:33:09.781128 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:33:09.781094 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e1a5081_a762_4ca0_ad24_6555253ffa92.slice/crio-02ed988c03cbf69cde8ca0c19993ee1a90a721dec07c82cab4f29abc785fd9dc WatchSource:0}: Error finding container 02ed988c03cbf69cde8ca0c19993ee1a90a721dec07c82cab4f29abc785fd9dc: Status 404 returned error can't find the container with id 02ed988c03cbf69cde8ca0c19993ee1a90a721dec07c82cab4f29abc785fd9dc Sep 17 03:33:09.812021 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.811984 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-7vmjw"] Sep 17 03:33:09.816141 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:33:09.816110 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa32bfc4_d4ad_4713_84f1_551123c26489.slice/crio-c4cc83be3256b173dda340485a0708555c012ac4b658dbc70ecccb6048efb977 WatchSource:0}: Error finding container c4cc83be3256b173dda340485a0708555c012ac4b658dbc70ecccb6048efb977: Status 404 returned error can't find the container with id c4cc83be3256b173dda340485a0708555c012ac4b658dbc70ecccb6048efb977 Sep 17 03:33:09.933343 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.933315 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/41d488f5-5a66-4e5d-a85f-db3dc2bad818-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-8pnxl\" (UID: \"41d488f5-5a66-4e5d-a85f-db3dc2bad818\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8pnxl" Sep 17 03:33:09.933512 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:09.933490 2551 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 03:33:09.933580 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:09.933568 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41d488f5-5a66-4e5d-a85f-db3dc2bad818-samples-operator-tls podName:41d488f5-5a66-4e5d-a85f-db3dc2bad818 nodeName:}" failed. No retries permitted until 2026-09-17 03:33:10.933546825 +0000 UTC m=+46.660779960 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/41d488f5-5a66-4e5d-a85f-db3dc2bad818-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-8pnxl" (UID: "41d488f5-5a66-4e5d-a85f-db3dc2bad818") : secret "samples-operator-tls" not found Sep 17 03:33:09.947260 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.947231 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-jq242"] Sep 17 03:33:09.949984 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:33:09.949957 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0116b6b_a212_4bca_9993_4b5e4c91a2bf.slice/crio-452999bb33a06938ebe161d46b3d38a1d5d47350abb5a99423fc19fbb11c6eaf WatchSource:0}: Error finding container 452999bb33a06938ebe161d46b3d38a1d5d47350abb5a99423fc19fbb11c6eaf: Status 404 returned error can't find the container with id 452999bb33a06938ebe161d46b3d38a1d5d47350abb5a99423fc19fbb11c6eaf Sep 17 03:33:09.987558 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.987526 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-7vmjw" event={"ID":"aa32bfc4-d4ad-4713-84f1-551123c26489","Type":"ContainerStarted","Data":"c4cc83be3256b173dda340485a0708555c012ac4b658dbc70ecccb6048efb977"} Sep 17 03:33:09.988692 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.988668 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jq242" event={"ID":"e0116b6b-a212-4bca-9993-4b5e4c91a2bf","Type":"ContainerStarted","Data":"452999bb33a06938ebe161d46b3d38a1d5d47350abb5a99423fc19fbb11c6eaf"} Sep 17 03:33:09.989718 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.989692 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ltcvj" event={"ID":"8e1a5081-a762-4ca0-ad24-6555253ffa92","Type":"ContainerStarted","Data":"02ed988c03cbf69cde8ca0c19993ee1a90a721dec07c82cab4f29abc785fd9dc"} Sep 17 03:33:09.992417 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:09.992379 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-6bzcs"] Sep 17 03:33:09.995353 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:33:09.995332 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80df0c88_0ab2_482f_bd76_d757451830fb.slice/crio-d1eb182adea2b2baacccc640ad4c7996772bb62e4f77bc8c4490acaa54d84cdb WatchSource:0}: Error finding container d1eb182adea2b2baacccc640ad4c7996772bb62e4f77bc8c4490acaa54d84cdb: Status 404 returned error can't find the container with id d1eb182adea2b2baacccc640ad4c7996772bb62e4f77bc8c4490acaa54d84cdb Sep 17 03:33:10.034067 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:10.034040 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-registry-tls\") pod \"image-registry-749b7f9657-fxq68\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:10.034206 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:10.034184 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 03:33:10.034206 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:10.034201 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-749b7f9657-fxq68: secret "image-registry-tls" not found Sep 17 03:33:10.034281 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:10.034250 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-registry-tls podName:7dc05124-275e-43af-87e5-f2b9d4def851 nodeName:}" failed. No retries permitted until 2026-09-17 03:33:11.03423617 +0000 UTC m=+46.761469302 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-registry-tls") pod "image-registry-749b7f9657-fxq68" (UID: "7dc05124-275e-43af-87e5-f2b9d4def851") : secret "image-registry-tls" not found Sep 17 03:33:10.941604 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:10.941557 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/41d488f5-5a66-4e5d-a85f-db3dc2bad818-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-8pnxl\" (UID: \"41d488f5-5a66-4e5d-a85f-db3dc2bad818\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8pnxl" Sep 17 03:33:10.942060 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:10.941828 2551 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 03:33:10.942060 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:10.941896 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41d488f5-5a66-4e5d-a85f-db3dc2bad818-samples-operator-tls podName:41d488f5-5a66-4e5d-a85f-db3dc2bad818 nodeName:}" failed. No retries permitted until 2026-09-17 03:33:12.941876792 +0000 UTC m=+48.669109923 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/41d488f5-5a66-4e5d-a85f-db3dc2bad818-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-8pnxl" (UID: "41d488f5-5a66-4e5d-a85f-db3dc2bad818") : secret "samples-operator-tls" not found Sep 17 03:33:10.996836 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:10.996757 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-6bzcs" event={"ID":"80df0c88-0ab2-482f-bd76-d757451830fb","Type":"ContainerStarted","Data":"d1eb182adea2b2baacccc640ad4c7996772bb62e4f77bc8c4490acaa54d84cdb"} Sep 17 03:33:11.042363 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:11.042324 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-registry-tls\") pod \"image-registry-749b7f9657-fxq68\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:11.042554 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:11.042499 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 03:33:11.042554 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:11.042522 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-749b7f9657-fxq68: secret "image-registry-tls" not found Sep 17 03:33:11.042682 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:11.042592 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-registry-tls podName:7dc05124-275e-43af-87e5-f2b9d4def851 nodeName:}" failed. No retries permitted until 2026-09-17 03:33:13.042571062 +0000 UTC m=+48.769804195 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-registry-tls") pod "image-registry-749b7f9657-fxq68" (UID: "7dc05124-275e-43af-87e5-f2b9d4def851") : secret "image-registry-tls" not found Sep 17 03:33:12.002010 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:12.001960 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ltcvj" event={"ID":"8e1a5081-a762-4ca0-ad24-6555253ffa92","Type":"ContainerStarted","Data":"d2ff9c919dbdf67bc2dc84c40dd720bcaaecdbd91c5c9b8892a21511d31be1f4"} Sep 17 03:33:12.018770 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:12.018715 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-ltcvj" podStartSLOduration=1.2377138890000001 podStartE2EDuration="3.018694036s" totalImagesPullingTime="1.780980147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:33:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:33:12.017657086 +0000 UTC m=+47.744890254" watchObservedRunningTime="2026-09-17 03:33:12.018694036 +0000 UTC m=+47.745927194" Sep 17 03:33:12.131958 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:12.131909 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:12.186730 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:12.186694 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:12.958624 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:12.958581 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/41d488f5-5a66-4e5d-a85f-db3dc2bad818-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-8pnxl\" (UID: \"41d488f5-5a66-4e5d-a85f-db3dc2bad818\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8pnxl" Sep 17 03:33:12.958806 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:12.958727 2551 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 03:33:12.958806 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:12.958796 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41d488f5-5a66-4e5d-a85f-db3dc2bad818-samples-operator-tls podName:41d488f5-5a66-4e5d-a85f-db3dc2bad818 nodeName:}" failed. No retries permitted until 2026-09-17 03:33:16.958779325 +0000 UTC m=+52.686012460 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/41d488f5-5a66-4e5d-a85f-db3dc2bad818-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-8pnxl" (UID: "41d488f5-5a66-4e5d-a85f-db3dc2bad818") : secret "samples-operator-tls" not found Sep 17 03:33:13.059175 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:13.059141 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-registry-tls\") pod \"image-registry-749b7f9657-fxq68\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:13.059619 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:13.059265 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 03:33:13.059619 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:13.059280 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-749b7f9657-fxq68: secret "image-registry-tls" not found Sep 17 03:33:13.059619 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:13.059336 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-registry-tls podName:7dc05124-275e-43af-87e5-f2b9d4def851 nodeName:}" failed. No retries permitted until 2026-09-17 03:33:17.059320398 +0000 UTC m=+52.786553530 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-registry-tls") pod "image-registry-749b7f9657-fxq68" (UID: "7dc05124-275e-43af-87e5-f2b9d4def851") : secret "image-registry-tls" not found Sep 17 03:33:14.156149 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:14.156109 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pbcm5"] Sep 17 03:33:14.168057 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:14.168036 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pbcm5" Sep 17 03:33:14.172217 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:14.172194 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 17 03:33:14.172317 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:14.172203 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-djgnt\"" Sep 17 03:33:14.172554 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:14.172537 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 17 03:33:14.173478 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:14.173457 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 17 03:33:14.186082 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:14.186058 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 17 03:33:14.193906 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:14.193837 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pbcm5"] Sep 17 03:33:14.197607 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:14.197578 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:14.268902 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:14.268874 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72fedd4c-6ffe-4536-b22b-a220953eaf81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbcm5\" (UID: \"72fedd4c-6ffe-4536-b22b-a220953eaf81\") " pod="openshift-insights/insights-runtime-extractor-pbcm5" Sep 17 03:33:14.268902 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:14.268906 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/72fedd4c-6ffe-4536-b22b-a220953eaf81-data-volume\") pod \"insights-runtime-extractor-pbcm5\" (UID: \"72fedd4c-6ffe-4536-b22b-a220953eaf81\") " pod="openshift-insights/insights-runtime-extractor-pbcm5" Sep 17 03:33:14.269099 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:14.268981 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72fedd4c-6ffe-4536-b22b-a220953eaf81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbcm5\" (UID: \"72fedd4c-6ffe-4536-b22b-a220953eaf81\") " pod="openshift-insights/insights-runtime-extractor-pbcm5" Sep 17 03:33:14.269099 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:14.269011 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/72fedd4c-6ffe-4536-b22b-a220953eaf81-crio-socket\") pod \"insights-runtime-extractor-pbcm5\" (UID: \"72fedd4c-6ffe-4536-b22b-a220953eaf81\") " pod="openshift-insights/insights-runtime-extractor-pbcm5" Sep 17 03:33:14.269099 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:14.269026 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cdtb\" (UniqueName: \"kubernetes.io/projected/72fedd4c-6ffe-4536-b22b-a220953eaf81-kube-api-access-2cdtb\") pod \"insights-runtime-extractor-pbcm5\" (UID: \"72fedd4c-6ffe-4536-b22b-a220953eaf81\") " pod="openshift-insights/insights-runtime-extractor-pbcm5" Sep 17 03:33:14.370318 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:14.370290 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72fedd4c-6ffe-4536-b22b-a220953eaf81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbcm5\" (UID: \"72fedd4c-6ffe-4536-b22b-a220953eaf81\") " pod="openshift-insights/insights-runtime-extractor-pbcm5" Sep 17 03:33:14.370474 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:14.370336 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/72fedd4c-6ffe-4536-b22b-a220953eaf81-crio-socket\") pod \"insights-runtime-extractor-pbcm5\" (UID: \"72fedd4c-6ffe-4536-b22b-a220953eaf81\") " pod="openshift-insights/insights-runtime-extractor-pbcm5" Sep 17 03:33:14.370474 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:14.370356 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cdtb\" (UniqueName: \"kubernetes.io/projected/72fedd4c-6ffe-4536-b22b-a220953eaf81-kube-api-access-2cdtb\") pod \"insights-runtime-extractor-pbcm5\" (UID: \"72fedd4c-6ffe-4536-b22b-a220953eaf81\") " pod="openshift-insights/insights-runtime-extractor-pbcm5" Sep 17 03:33:14.370474 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:14.370419 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72fedd4c-6ffe-4536-b22b-a220953eaf81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbcm5\" (UID: \"72fedd4c-6ffe-4536-b22b-a220953eaf81\") " pod="openshift-insights/insights-runtime-extractor-pbcm5" Sep 17 03:33:14.370474 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:14.370439 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/72fedd4c-6ffe-4536-b22b-a220953eaf81-data-volume\") pod \"insights-runtime-extractor-pbcm5\" (UID: \"72fedd4c-6ffe-4536-b22b-a220953eaf81\") " pod="openshift-insights/insights-runtime-extractor-pbcm5" Sep 17 03:33:14.370474 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:14.370465 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 03:33:14.370774 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:14.370530 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72fedd4c-6ffe-4536-b22b-a220953eaf81-insights-runtime-extractor-tls podName:72fedd4c-6ffe-4536-b22b-a220953eaf81 nodeName:}" failed. No retries permitted until 2026-09-17 03:33:14.870515002 +0000 UTC m=+50.597748134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72fedd4c-6ffe-4536-b22b-a220953eaf81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pbcm5" (UID: "72fedd4c-6ffe-4536-b22b-a220953eaf81") : secret "insights-runtime-extractor-tls" not found Sep 17 03:33:14.370774 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:14.370539 2551 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 03:33:14.370774 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:14.370553 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/72fedd4c-6ffe-4536-b22b-a220953eaf81-crio-socket\") pod \"insights-runtime-extractor-pbcm5\" (UID: \"72fedd4c-6ffe-4536-b22b-a220953eaf81\") " pod="openshift-insights/insights-runtime-extractor-pbcm5" Sep 17 03:33:14.370774 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:14.370612 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72fedd4c-6ffe-4536-b22b-a220953eaf81-kube-rbac-proxy-cm podName:72fedd4c-6ffe-4536-b22b-a220953eaf81 nodeName:}" failed. No retries permitted until 2026-09-17 03:33:14.870597609 +0000 UTC m=+50.597830767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/72fedd4c-6ffe-4536-b22b-a220953eaf81-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pbcm5" (UID: "72fedd4c-6ffe-4536-b22b-a220953eaf81") : configmap "kube-rbac-proxy" not found Sep 17 03:33:14.370774 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:14.370736 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/72fedd4c-6ffe-4536-b22b-a220953eaf81-data-volume\") pod \"insights-runtime-extractor-pbcm5\" (UID: \"72fedd4c-6ffe-4536-b22b-a220953eaf81\") " pod="openshift-insights/insights-runtime-extractor-pbcm5" Sep 17 03:33:14.381382 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:14.381361 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cdtb\" (UniqueName: \"kubernetes.io/projected/72fedd4c-6ffe-4536-b22b-a220953eaf81-kube-api-access-2cdtb\") pod \"insights-runtime-extractor-pbcm5\" (UID: \"72fedd4c-6ffe-4536-b22b-a220953eaf81\") " pod="openshift-insights/insights-runtime-extractor-pbcm5" Sep 17 03:33:14.572197 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:14.572174 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/231922a7-9b04-43e5-ae55-e3a0247da747-metrics-tls\") pod \"dns-default-9kgwj\" (UID: \"231922a7-9b04-43e5-ae55-e3a0247da747\") " pod="openshift-dns/dns-default-9kgwj" Sep 17 03:33:14.572352 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:14.572332 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 03:33:14.572450 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:14.572432 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/231922a7-9b04-43e5-ae55-e3a0247da747-metrics-tls podName:231922a7-9b04-43e5-ae55-e3a0247da747 nodeName:}" failed. No retries permitted until 2026-09-17 03:33:30.572383612 +0000 UTC m=+66.299616758 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/231922a7-9b04-43e5-ae55-e3a0247da747-metrics-tls") pod "dns-default-9kgwj" (UID: "231922a7-9b04-43e5-ae55-e3a0247da747") : secret "dns-default-metrics-tls" not found Sep 17 03:33:14.873910 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:14.873823 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72fedd4c-6ffe-4536-b22b-a220953eaf81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbcm5\" (UID: \"72fedd4c-6ffe-4536-b22b-a220953eaf81\") " pod="openshift-insights/insights-runtime-extractor-pbcm5" Sep 17 03:33:14.874077 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:14.873919 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72fedd4c-6ffe-4536-b22b-a220953eaf81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbcm5\" (UID: \"72fedd4c-6ffe-4536-b22b-a220953eaf81\") " pod="openshift-insights/insights-runtime-extractor-pbcm5" Sep 17 03:33:14.874077 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:14.873952 2551 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 03:33:14.874077 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:14.874010 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72fedd4c-6ffe-4536-b22b-a220953eaf81-kube-rbac-proxy-cm podName:72fedd4c-6ffe-4536-b22b-a220953eaf81 nodeName:}" failed. No retries permitted until 2026-09-17 03:33:15.873994855 +0000 UTC m=+51.601228008 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/72fedd4c-6ffe-4536-b22b-a220953eaf81-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pbcm5" (UID: "72fedd4c-6ffe-4536-b22b-a220953eaf81") : configmap "kube-rbac-proxy" not found Sep 17 03:33:14.874077 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:14.874058 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 03:33:14.874290 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:14.874134 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72fedd4c-6ffe-4536-b22b-a220953eaf81-insights-runtime-extractor-tls podName:72fedd4c-6ffe-4536-b22b-a220953eaf81 nodeName:}" failed. No retries permitted until 2026-09-17 03:33:15.874116942 +0000 UTC m=+51.601350080 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72fedd4c-6ffe-4536-b22b-a220953eaf81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pbcm5" (UID: "72fedd4c-6ffe-4536-b22b-a220953eaf81") : secret "insights-runtime-extractor-tls" not found Sep 17 03:33:15.013777 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:15.013742 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jq242" event={"ID":"e0116b6b-a212-4bca-9993-4b5e4c91a2bf","Type":"ContainerStarted","Data":"3f3fac08c9db3dbb27198f323cd841297f40e32ee9649ed39ed5f8f543163a5a"} Sep 17 03:33:15.015343 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:15.015315 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-7vmjw" event={"ID":"aa32bfc4-d4ad-4713-84f1-551123c26489","Type":"ContainerStarted","Data":"9d8525672db57ecda9762c746981eed8ccb90d33c98f82aa64a13bb6478f1fe3"} Sep 17 03:33:15.016957 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:15.016929 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-6bzcs" event={"ID":"80df0c88-0ab2-482f-bd76-d757451830fb","Type":"ContainerStarted","Data":"b967967e62c996e967374da2378b36ed5ee86e7c8bbe242aaedd2e61e2da9628"} Sep 17 03:33:15.034667 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:15.034617 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jq242" podStartSLOduration=1.464141271 podStartE2EDuration="6.034600109s" totalImagesPullingTime="4.570458838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:33:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:33:15.034458677 +0000 UTC m=+50.761691832" watchObservedRunningTime="2026-09-17 03:33:15.034600109 +0000 UTC m=+50.761833279" Sep 17 03:33:15.049913 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:15.049855 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-6bzcs" podStartSLOduration=1.519418057 podStartE2EDuration="6.049836761s" totalImagesPullingTime="4.530418704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:33:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:33:15.049747496 +0000 UTC m=+50.776980651" watchObservedRunningTime="2026-09-17 03:33:15.049836761 +0000 UTC m=+50.777069916" Sep 17 03:33:15.066167 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:15.066108 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-7vmjw" podStartSLOduration=1.361846903 podStartE2EDuration="6.066086982s" totalImagesPullingTime="4.704240079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:33:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:33:15.065755709 +0000 UTC m=+50.792988860" watchObservedRunningTime="2026-09-17 03:33:15.066086982 +0000 UTC m=+50.793320145" Sep 17 03:33:15.515798 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:15.515767 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:15.616389 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:15.616351 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:15.873222 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:15.873143 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-59x2n_1db844ea-66f3-4982-b510-b488327b00ed/dns-node-resolver/0.log" Sep 17 03:33:15.882484 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:15.882442 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72fedd4c-6ffe-4536-b22b-a220953eaf81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbcm5\" (UID: \"72fedd4c-6ffe-4536-b22b-a220953eaf81\") " pod="openshift-insights/insights-runtime-extractor-pbcm5" Sep 17 03:33:15.882575 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:15.882560 2551 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 03:33:15.882575 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:15.882567 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72fedd4c-6ffe-4536-b22b-a220953eaf81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbcm5\" (UID: \"72fedd4c-6ffe-4536-b22b-a220953eaf81\") " pod="openshift-insights/insights-runtime-extractor-pbcm5" Sep 17 03:33:15.882661 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:15.882623 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72fedd4c-6ffe-4536-b22b-a220953eaf81-kube-rbac-proxy-cm podName:72fedd4c-6ffe-4536-b22b-a220953eaf81 nodeName:}" failed. No retries permitted until 2026-09-17 03:33:17.882604447 +0000 UTC m=+53.609837602 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/72fedd4c-6ffe-4536-b22b-a220953eaf81-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pbcm5" (UID: "72fedd4c-6ffe-4536-b22b-a220953eaf81") : configmap "kube-rbac-proxy" not found Sep 17 03:33:15.882737 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:15.882672 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 03:33:15.882737 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:15.882703 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72fedd4c-6ffe-4536-b22b-a220953eaf81-insights-runtime-extractor-tls podName:72fedd4c-6ffe-4536-b22b-a220953eaf81 nodeName:}" failed. No retries permitted until 2026-09-17 03:33:17.88269385 +0000 UTC m=+53.609926982 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72fedd4c-6ffe-4536-b22b-a220953eaf81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pbcm5" (UID: "72fedd4c-6ffe-4536-b22b-a220953eaf81") : secret "insights-runtime-extractor-tls" not found Sep 17 03:33:16.442117 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:16.442084 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:16.459700 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:16.459667 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-wmvnm"] Sep 17 03:33:16.462656 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:16.462639 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-wmvnm" Sep 17 03:33:16.465205 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:16.465186 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 17 03:33:16.466188 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:16.466165 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 17 03:33:16.466289 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:16.466193 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-m9qnh\"" Sep 17 03:33:16.471663 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:16.471640 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-wmvnm"] Sep 17 03:33:16.540750 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:16.540714 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:16.587470 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:16.587443 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z22ps\" (UniqueName: \"kubernetes.io/projected/fc3c2b75-9c32-495c-b427-9d1fbdcc0b4f-kube-api-access-z22ps\") pod \"migrator-8b4d697c5-wmvnm\" (UID: \"fc3c2b75-9c32-495c-b427-9d1fbdcc0b4f\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-wmvnm" Sep 17 03:33:16.640588 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:16.640561 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:16.688169 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:16.688142 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z22ps\" (UniqueName: \"kubernetes.io/projected/fc3c2b75-9c32-495c-b427-9d1fbdcc0b4f-kube-api-access-z22ps\") pod \"migrator-8b4d697c5-wmvnm\" (UID: \"fc3c2b75-9c32-495c-b427-9d1fbdcc0b4f\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-wmvnm" Sep 17 03:33:16.705932 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:16.705875 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z22ps\" (UniqueName: \"kubernetes.io/projected/fc3c2b75-9c32-495c-b427-9d1fbdcc0b4f-kube-api-access-z22ps\") pod \"migrator-8b4d697c5-wmvnm\" (UID: \"fc3c2b75-9c32-495c-b427-9d1fbdcc0b4f\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-wmvnm" Sep 17 03:33:16.773218 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:16.773194 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-wmvnm" Sep 17 03:33:16.852609 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:16.852555 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:16.912330 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:16.912303 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:16.991590 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:16.991527 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/41d488f5-5a66-4e5d-a85f-db3dc2bad818-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-8pnxl\" (UID: \"41d488f5-5a66-4e5d-a85f-db3dc2bad818\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8pnxl" Sep 17 03:33:16.991723 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:16.991701 2551 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 17 03:33:16.991793 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:16.991782 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41d488f5-5a66-4e5d-a85f-db3dc2bad818-samples-operator-tls podName:41d488f5-5a66-4e5d-a85f-db3dc2bad818 nodeName:}" failed. No retries permitted until 2026-09-17 03:33:24.991762409 +0000 UTC m=+60.718995556 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/41d488f5-5a66-4e5d-a85f-db3dc2bad818-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-8pnxl" (UID: "41d488f5-5a66-4e5d-a85f-db3dc2bad818") : secret "samples-operator-tls" not found Sep 17 03:33:17.041034 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:17.041010 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-wmvnm"] Sep 17 03:33:17.043918 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:33:17.043894 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc3c2b75_9c32_495c_b427_9d1fbdcc0b4f.slice/crio-e6e397a871c3949607e176ae2771056e1ee63da7a69ff03260d48d652cbe3f17 WatchSource:0}: Error finding container e6e397a871c3949607e176ae2771056e1ee63da7a69ff03260d48d652cbe3f17: Status 404 returned error can't find the container with id e6e397a871c3949607e176ae2771056e1ee63da7a69ff03260d48d652cbe3f17 Sep 17 03:33:17.092710 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:17.092689 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-registry-tls\") pod \"image-registry-749b7f9657-fxq68\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:17.092850 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:17.092833 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 03:33:17.092885 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:17.092852 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-749b7f9657-fxq68: secret "image-registry-tls" not found Sep 17 03:33:17.092924 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:17.092906 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-registry-tls podName:7dc05124-275e-43af-87e5-f2b9d4def851 nodeName:}" failed. No retries permitted until 2026-09-17 03:33:25.092892945 +0000 UTC m=+60.820126080 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-registry-tls") pod "image-registry-749b7f9657-fxq68" (UID: "7dc05124-275e-43af-87e5-f2b9d4def851") : secret "image-registry-tls" not found Sep 17 03:33:17.273504 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:17.273436 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vwzf5_0e65d15d-2cdc-43a5-8b87-11aec8eaa83a/node-ca/0.log" Sep 17 03:33:17.287132 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:17.287107 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:17.343173 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:17.343151 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:17.561427 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:17.561332 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:17.660804 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:17.660773 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:17.873733 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:17.873632 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6w5pf_9c6d07b9-4073-4582-ad02-c6979ac3a0ca/serve-healthcheck-canary/0.log" Sep 17 03:33:17.899034 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:17.899001 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72fedd4c-6ffe-4536-b22b-a220953eaf81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbcm5\" (UID: \"72fedd4c-6ffe-4536-b22b-a220953eaf81\") " pod="openshift-insights/insights-runtime-extractor-pbcm5" Sep 17 03:33:17.899163 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:17.899108 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72fedd4c-6ffe-4536-b22b-a220953eaf81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbcm5\" (UID: \"72fedd4c-6ffe-4536-b22b-a220953eaf81\") " pod="openshift-insights/insights-runtime-extractor-pbcm5" Sep 17 03:33:17.899163 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:17.899127 2551 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 03:33:17.899463 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:17.899184 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72fedd4c-6ffe-4536-b22b-a220953eaf81-kube-rbac-proxy-cm podName:72fedd4c-6ffe-4536-b22b-a220953eaf81 nodeName:}" failed. No retries permitted until 2026-09-17 03:33:21.899169363 +0000 UTC m=+57.626402511 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/72fedd4c-6ffe-4536-b22b-a220953eaf81-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pbcm5" (UID: "72fedd4c-6ffe-4536-b22b-a220953eaf81") : configmap "kube-rbac-proxy" not found Sep 17 03:33:17.899463 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:17.899237 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 03:33:17.899463 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:17.899294 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72fedd4c-6ffe-4536-b22b-a220953eaf81-insights-runtime-extractor-tls podName:72fedd4c-6ffe-4536-b22b-a220953eaf81 nodeName:}" failed. No retries permitted until 2026-09-17 03:33:21.899278647 +0000 UTC m=+57.626511796 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72fedd4c-6ffe-4536-b22b-a220953eaf81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pbcm5" (UID: "72fedd4c-6ffe-4536-b22b-a220953eaf81") : secret "insights-runtime-extractor-tls" not found Sep 17 03:33:18.028950 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:18.028911 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-wmvnm" event={"ID":"fc3c2b75-9c32-495c-b427-9d1fbdcc0b4f","Type":"ContainerStarted","Data":"e6e397a871c3949607e176ae2771056e1ee63da7a69ff03260d48d652cbe3f17"} Sep 17 03:33:19.034457 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:19.034417 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-wmvnm" event={"ID":"fc3c2b75-9c32-495c-b427-9d1fbdcc0b4f","Type":"ContainerStarted","Data":"91438a40fb4296615536a1d01aa33627ba967644079b413eb1b7f5851bbd5e5a"} Sep 17 03:33:19.034801 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:19.034480 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-wmvnm" event={"ID":"fc3c2b75-9c32-495c-b427-9d1fbdcc0b4f","Type":"ContainerStarted","Data":"7b9e7d646e32eaf8aa61dce01f29008295e9e9a6b88d511da6b651f57aedba1b"} Sep 17 03:33:19.052849 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:19.052802 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-wmvnm" podStartSLOduration=1.89825537 podStartE2EDuration="3.052786469s" totalImagesPullingTime="1.154531099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:33:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:33:19.051611558 +0000 UTC m=+54.778844713" watchObservedRunningTime="2026-09-17 03:33:19.052786469 +0000 UTC m=+54.780019669" Sep 17 03:33:19.142739 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:19.142701 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:19.159093 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:19.159069 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-gsh57"] Sep 17 03:33:19.162025 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:19.162009 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-gsh57" Sep 17 03:33:19.164826 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:19.164765 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 17 03:33:19.164826 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:19.164808 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 17 03:33:19.165024 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:19.164865 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 17 03:33:19.165086 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:19.165069 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-6bw5g\"" Sep 17 03:33:19.165237 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:19.165218 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 17 03:33:19.169528 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:19.169507 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-gsh57"] Sep 17 03:33:19.206398 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:19.206373 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:19.209087 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:19.209071 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8x5b\" (UniqueName: \"kubernetes.io/projected/ad0ba3a3-b5c7-4bce-ac0a-bf291017c368-kube-api-access-c8x5b\") pod \"service-ca-568869fdc5-gsh57\" (UID: \"ad0ba3a3-b5c7-4bce-ac0a-bf291017c368\") " pod="openshift-service-ca/service-ca-568869fdc5-gsh57" Sep 17 03:33:19.209142 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:19.209102 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ad0ba3a3-b5c7-4bce-ac0a-bf291017c368-signing-cabundle\") pod \"service-ca-568869fdc5-gsh57\" (UID: \"ad0ba3a3-b5c7-4bce-ac0a-bf291017c368\") " pod="openshift-service-ca/service-ca-568869fdc5-gsh57" Sep 17 03:33:19.209193 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:19.209181 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ad0ba3a3-b5c7-4bce-ac0a-bf291017c368-signing-key\") pod \"service-ca-568869fdc5-gsh57\" (UID: \"ad0ba3a3-b5c7-4bce-ac0a-bf291017c368\") " pod="openshift-service-ca/service-ca-568869fdc5-gsh57" Sep 17 03:33:19.309963 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:19.309900 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8x5b\" (UniqueName: \"kubernetes.io/projected/ad0ba3a3-b5c7-4bce-ac0a-bf291017c368-kube-api-access-c8x5b\") pod \"service-ca-568869fdc5-gsh57\" (UID: \"ad0ba3a3-b5c7-4bce-ac0a-bf291017c368\") " pod="openshift-service-ca/service-ca-568869fdc5-gsh57" Sep 17 03:33:19.309963 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:19.309932 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ad0ba3a3-b5c7-4bce-ac0a-bf291017c368-signing-cabundle\") pod \"service-ca-568869fdc5-gsh57\" (UID: \"ad0ba3a3-b5c7-4bce-ac0a-bf291017c368\") " pod="openshift-service-ca/service-ca-568869fdc5-gsh57" Sep 17 03:33:19.310094 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:19.310002 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ad0ba3a3-b5c7-4bce-ac0a-bf291017c368-signing-key\") pod \"service-ca-568869fdc5-gsh57\" (UID: \"ad0ba3a3-b5c7-4bce-ac0a-bf291017c368\") " pod="openshift-service-ca/service-ca-568869fdc5-gsh57" Sep 17 03:33:19.310580 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:19.310563 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ad0ba3a3-b5c7-4bce-ac0a-bf291017c368-signing-cabundle\") pod \"service-ca-568869fdc5-gsh57\" (UID: \"ad0ba3a3-b5c7-4bce-ac0a-bf291017c368\") " pod="openshift-service-ca/service-ca-568869fdc5-gsh57" Sep 17 03:33:19.312631 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:19.312608 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ad0ba3a3-b5c7-4bce-ac0a-bf291017c368-signing-key\") pod \"service-ca-568869fdc5-gsh57\" (UID: \"ad0ba3a3-b5c7-4bce-ac0a-bf291017c368\") " pod="openshift-service-ca/service-ca-568869fdc5-gsh57" Sep 17 03:33:19.318559 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:19.318540 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8x5b\" (UniqueName: \"kubernetes.io/projected/ad0ba3a3-b5c7-4bce-ac0a-bf291017c368-kube-api-access-c8x5b\") pod \"service-ca-568869fdc5-gsh57\" (UID: \"ad0ba3a3-b5c7-4bce-ac0a-bf291017c368\") " pod="openshift-service-ca/service-ca-568869fdc5-gsh57" Sep 17 03:33:19.470854 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:19.470829 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-gsh57" Sep 17 03:33:19.741136 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:19.741105 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-gsh57"] Sep 17 03:33:19.743994 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:33:19.743970 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad0ba3a3_b5c7_4bce_ac0a_bf291017c368.slice/crio-e9318dbf40aa5252887e391d5af5ed8ee4051385da656efd4fbc7d957f52171e WatchSource:0}: Error finding container e9318dbf40aa5252887e391d5af5ed8ee4051385da656efd4fbc7d957f52171e: Status 404 returned error can't find the container with id e9318dbf40aa5252887e391d5af5ed8ee4051385da656efd4fbc7d957f52171e Sep 17 03:33:20.038990 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:20.038908 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-gsh57" event={"ID":"ad0ba3a3-b5c7-4bce-ac0a-bf291017c368","Type":"ContainerStarted","Data":"675712b272699e313e2632c9b5ba9bbd80da716bedc724053fb4c9dfbacfd4e1"} Sep 17 03:33:20.038990 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:20.038960 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-gsh57" event={"ID":"ad0ba3a3-b5c7-4bce-ac0a-bf291017c368","Type":"ContainerStarted","Data":"e9318dbf40aa5252887e391d5af5ed8ee4051385da656efd4fbc7d957f52171e"} Sep 17 03:33:20.057717 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:20.057667 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-gsh57" podStartSLOduration=1.057653692 podStartE2EDuration="1.057653692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:33:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:33:20.057236046 +0000 UTC m=+55.784469201" watchObservedRunningTime="2026-09-17 03:33:20.057653692 +0000 UTC m=+55.784886846" Sep 17 03:33:20.118350 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:20.118324 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:20.573770 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:20.573694 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:20.773375 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:20.773343 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:20.866050 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:20.865970 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:20.965786 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:20.965752 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:21.067448 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:21.067398 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:21.447198 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:21.447166 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:21.861100 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:21.861035 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:21.929174 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:21.929147 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72fedd4c-6ffe-4536-b22b-a220953eaf81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbcm5\" (UID: \"72fedd4c-6ffe-4536-b22b-a220953eaf81\") " pod="openshift-insights/insights-runtime-extractor-pbcm5" Sep 17 03:33:21.929327 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:21.929223 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72fedd4c-6ffe-4536-b22b-a220953eaf81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbcm5\" (UID: \"72fedd4c-6ffe-4536-b22b-a220953eaf81\") " pod="openshift-insights/insights-runtime-extractor-pbcm5" Sep 17 03:33:21.929327 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:21.929262 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 03:33:21.929327 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:21.929306 2551 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 03:33:21.929505 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:21.929333 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72fedd4c-6ffe-4536-b22b-a220953eaf81-insights-runtime-extractor-tls podName:72fedd4c-6ffe-4536-b22b-a220953eaf81 nodeName:}" failed. No retries permitted until 2026-09-17 03:33:29.929314477 +0000 UTC m=+65.656547618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72fedd4c-6ffe-4536-b22b-a220953eaf81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pbcm5" (UID: "72fedd4c-6ffe-4536-b22b-a220953eaf81") : secret "insights-runtime-extractor-tls" not found Sep 17 03:33:21.929505 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:21.929354 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72fedd4c-6ffe-4536-b22b-a220953eaf81-kube-rbac-proxy-cm podName:72fedd4c-6ffe-4536-b22b-a220953eaf81 nodeName:}" failed. No retries permitted until 2026-09-17 03:33:29.929343232 +0000 UTC m=+65.656576367 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/72fedd4c-6ffe-4536-b22b-a220953eaf81-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pbcm5" (UID: "72fedd4c-6ffe-4536-b22b-a220953eaf81") : configmap "kube-rbac-proxy" not found Sep 17 03:33:22.442284 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:22.442254 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:23.045755 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:23.045718 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:23.250558 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:23.250528 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:23.450100 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:23.450070 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:23.646031 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:23.645998 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:23.771928 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:23.771857 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:23.949100 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:23.949075 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c8wtl" Sep 17 03:33:24.355490 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:24.355464 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:24.456462 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:24.456432 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:24.548095 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:24.548068 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:25.039340 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:25.039307 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:25.051633 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:25.051600 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/41d488f5-5a66-4e5d-a85f-db3dc2bad818-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-8pnxl\" (UID: \"41d488f5-5a66-4e5d-a85f-db3dc2bad818\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8pnxl" Sep 17 03:33:25.053969 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:25.053945 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/41d488f5-5a66-4e5d-a85f-db3dc2bad818-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-8pnxl\" (UID: \"41d488f5-5a66-4e5d-a85f-db3dc2bad818\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8pnxl" Sep 17 03:33:25.092748 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:25.092725 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lr6n6\"" Sep 17 03:33:25.100692 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:25.100677 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8pnxl" Sep 17 03:33:25.152911 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:25.152885 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-registry-tls\") pod \"image-registry-749b7f9657-fxq68\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:25.155154 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:25.155132 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-registry-tls\") pod \"image-registry-749b7f9657-fxq68\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:25.233357 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:25.233332 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rfj5j\"" Sep 17 03:33:25.241559 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:25.241540 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:25.248247 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:25.248225 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:25.321124 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:25.321099 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:25.367081 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:25.367062 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8pnxl"] Sep 17 03:33:25.529615 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:25.529591 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-749b7f9657-fxq68"] Sep 17 03:33:25.532312 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:33:25.532290 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dc05124_275e_43af_87e5_f2b9d4def851.slice/crio-b36f1cf28e4b779198b3e08e910feefcd5b0a45d8a460500793fd64599c7f91d WatchSource:0}: Error finding container b36f1cf28e4b779198b3e08e910feefcd5b0a45d8a460500793fd64599c7f91d: Status 404 returned error can't find the container with id b36f1cf28e4b779198b3e08e910feefcd5b0a45d8a460500793fd64599c7f91d Sep 17 03:33:25.637469 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:25.637434 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:25.838710 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:25.838633 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:26.058550 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:26.058515 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8pnxl" event={"ID":"41d488f5-5a66-4e5d-a85f-db3dc2bad818","Type":"ContainerStarted","Data":"eb7324417792aa8ce1c8ba04fcc50485281fe155d290d84fc9c2df0fe643124f"} Sep 17 03:33:26.060057 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:26.060029 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-749b7f9657-fxq68" event={"ID":"7dc05124-275e-43af-87e5-f2b9d4def851","Type":"ContainerStarted","Data":"b7f4c4b8bb0ee7219fcc164620705d27e8848da40573e3a4c01d4733669b313f"} Sep 17 03:33:26.060191 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:26.060071 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-749b7f9657-fxq68" event={"ID":"7dc05124-275e-43af-87e5-f2b9d4def851","Type":"ContainerStarted","Data":"b36f1cf28e4b779198b3e08e910feefcd5b0a45d8a460500793fd64599c7f91d"} Sep 17 03:33:26.060191 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:26.060168 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:26.241137 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:26.241088 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:26.836381 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:26.836343 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:26.948846 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:26.948805 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:27.323535 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:27.323502 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:27.442537 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:27.442462 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:27.638788 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:27.638752 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:27.840810 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:27.840734 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:28.068543 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:28.068510 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8pnxl" event={"ID":"41d488f5-5a66-4e5d-a85f-db3dc2bad818","Type":"ContainerStarted","Data":"1aced52d46284c31603229525268078dc123d7ad9ba2e867cba3cd79dc118ea9"} Sep 17 03:33:28.068714 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:28.068567 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8pnxl" event={"ID":"41d488f5-5a66-4e5d-a85f-db3dc2bad818","Type":"ContainerStarted","Data":"7432c53a9830a7bacb117a46affc97ea0246ecedb252a196e0f6f78f0f90280f"} Sep 17 03:33:28.085096 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:28.085048 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-749b7f9657-fxq68" podStartSLOduration=19.085028421 podStartE2EDuration="19.085028421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:33:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:33:26.081635167 +0000 UTC m=+61.808868321" watchObservedRunningTime="2026-09-17 03:33:28.085028421 +0000 UTC m=+63.812261576" Sep 17 03:33:28.086046 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:28.086016 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-8pnxl" podStartSLOduration=17.312493999 podStartE2EDuration="19.086002287s" totalImagesPullingTime="1.773508288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:33:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:33:28.085300758 +0000 UTC m=+63.812533922" watchObservedRunningTime="2026-09-17 03:33:28.086002287 +0000 UTC m=+63.813235440" Sep 17 03:33:28.223665 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:28.223635 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:28.291530 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:28.291504 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:29.048346 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:29.048315 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:29.441965 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:29.441938 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:29.636576 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:29.636546 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:29.838845 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:29.838766 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:29.989077 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:29.989048 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72fedd4c-6ffe-4536-b22b-a220953eaf81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbcm5\" (UID: \"72fedd4c-6ffe-4536-b22b-a220953eaf81\") " pod="openshift-insights/insights-runtime-extractor-pbcm5" Sep 17 03:33:29.989212 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:29.989103 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72fedd4c-6ffe-4536-b22b-a220953eaf81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbcm5\" (UID: \"72fedd4c-6ffe-4536-b22b-a220953eaf81\") " pod="openshift-insights/insights-runtime-extractor-pbcm5" Sep 17 03:33:29.989212 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:29.989184 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 03:33:29.989277 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:29.989240 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72fedd4c-6ffe-4536-b22b-a220953eaf81-insights-runtime-extractor-tls podName:72fedd4c-6ffe-4536-b22b-a220953eaf81 nodeName:}" failed. No retries permitted until 2026-09-17 03:33:45.98922686 +0000 UTC m=+81.716459992 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72fedd4c-6ffe-4536-b22b-a220953eaf81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pbcm5" (UID: "72fedd4c-6ffe-4536-b22b-a220953eaf81") : secret "insights-runtime-extractor-tls" not found Sep 17 03:33:29.989580 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:29.989562 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72fedd4c-6ffe-4536-b22b-a220953eaf81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pbcm5\" (UID: \"72fedd4c-6ffe-4536-b22b-a220953eaf81\") " pod="openshift-insights/insights-runtime-extractor-pbcm5" Sep 17 03:33:30.037212 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:30.037190 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:30.594252 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:30.594218 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f67c23a-21e7-465e-a87c-29c1e5a3eadd-original-pull-secret\") pod \"global-pull-secret-syncer-k5lh2\" (UID: \"7f67c23a-21e7-465e-a87c-29c1e5a3eadd\") " pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:33:30.594740 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:30.594262 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/231922a7-9b04-43e5-ae55-e3a0247da747-metrics-tls\") pod \"dns-default-9kgwj\" (UID: \"231922a7-9b04-43e5-ae55-e3a0247da747\") " pod="openshift-dns/dns-default-9kgwj" Sep 17 03:33:30.594740 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:30.594303 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f900dc7-747d-47b8-8834-51afc05d4bac-metrics-certs\") pod \"network-metrics-daemon-4qjvl\" (UID: \"7f900dc7-747d-47b8-8834-51afc05d4bac\") " pod="openshift-multus/network-metrics-daemon-4qjvl" Sep 17 03:33:30.596744 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:30.596712 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/231922a7-9b04-43e5-ae55-e3a0247da747-metrics-tls\") pod \"dns-default-9kgwj\" (UID: \"231922a7-9b04-43e5-ae55-e3a0247da747\") " pod="openshift-dns/dns-default-9kgwj" Sep 17 03:33:30.596868 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:30.596854 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 03:33:30.597698 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:30.597684 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 03:33:30.606780 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:30.606752 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f67c23a-21e7-465e-a87c-29c1e5a3eadd-original-pull-secret\") pod \"global-pull-secret-syncer-k5lh2\" (UID: \"7f67c23a-21e7-465e-a87c-29c1e5a3eadd\") " pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:33:30.606862 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:30.606842 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f900dc7-747d-47b8-8834-51afc05d4bac-metrics-certs\") pod \"network-metrics-daemon-4qjvl\" (UID: \"7f900dc7-747d-47b8-8834-51afc05d4bac\") " pod="openshift-multus/network-metrics-daemon-4qjvl" Sep 17 03:33:30.677432 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:30.677414 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5lh2" Sep 17 03:33:30.694701 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:30.694681 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx9cd\" (UniqueName: \"kubernetes.io/projected/6f01992d-cdf0-47be-ab65-9714e39d371d-kube-api-access-gx9cd\") pod \"network-check-target-t9lsl\" (UID: \"6f01992d-cdf0-47be-ab65-9714e39d371d\") " pod="openshift-network-diagnostics/network-check-target-t9lsl" Sep 17 03:33:30.696865 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:30.696844 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx9cd\" (UniqueName: \"kubernetes.io/projected/6f01992d-cdf0-47be-ab65-9714e39d371d-kube-api-access-gx9cd\") pod \"network-check-target-t9lsl\" (UID: \"6f01992d-cdf0-47be-ab65-9714e39d371d\") " pod="openshift-network-diagnostics/network-check-target-t9lsl" Sep 17 03:33:30.811119 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:30.811094 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5fsf8\"" Sep 17 03:33:30.819118 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:30.819096 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9kgwj" Sep 17 03:33:30.837555 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:30.837530 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:30.880483 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:30.880462 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-55bt6\"" Sep 17 03:33:30.883227 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:30.883206 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4qjvl" Sep 17 03:33:30.949360 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:30.949290 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k5lh2"] Sep 17 03:33:30.952895 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:33:30.952870 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f67c23a_21e7_465e_a87c_29c1e5a3eadd.slice/crio-dc2c2d931c20383e8f3683838a5450eefc5181b7726bfb1ec44acd575224cb9c WatchSource:0}: Error finding container dc2c2d931c20383e8f3683838a5450eefc5181b7726bfb1ec44acd575224cb9c: Status 404 returned error can't find the container with id dc2c2d931c20383e8f3683838a5450eefc5181b7726bfb1ec44acd575224cb9c Sep 17 03:33:30.975470 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:30.975450 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-znwr5\"" Sep 17 03:33:30.983438 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:30.983423 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9lsl" Sep 17 03:33:31.046072 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:31.046048 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:31.078528 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:31.078503 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k5lh2" event={"ID":"7f67c23a-21e7-465e-a87c-29c1e5a3eadd","Type":"ContainerStarted","Data":"dc2c2d931c20383e8f3683838a5450eefc5181b7726bfb1ec44acd575224cb9c"} Sep 17 03:33:31.089326 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:31.089304 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9kgwj"] Sep 17 03:33:31.092631 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:33:31.092128 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod231922a7_9b04_43e5_ae55_e3a0247da747.slice/crio-78cecae1d535a0a646d9ce6b94bf352ae261a9f76bfe57a581d169964b413e9f WatchSource:0}: Error finding container 78cecae1d535a0a646d9ce6b94bf352ae261a9f76bfe57a581d169964b413e9f: Status 404 returned error can't find the container with id 78cecae1d535a0a646d9ce6b94bf352ae261a9f76bfe57a581d169964b413e9f Sep 17 03:33:31.148534 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:31.148480 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4qjvl"] Sep 17 03:33:31.152067 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:33:31.152045 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f900dc7_747d_47b8_8834_51afc05d4bac.slice/crio-921175189fa863ea094d48601d7ca79605d9ddbd7e9487c6c4967a1f918bde21 WatchSource:0}: Error finding container 921175189fa863ea094d48601d7ca79605d9ddbd7e9487c6c4967a1f918bde21: Status 404 returned error can't find the container with id 921175189fa863ea094d48601d7ca79605d9ddbd7e9487c6c4967a1f918bde21 Sep 17 03:33:31.236302 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:31.236278 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:31.247480 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:31.247456 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t9lsl"] Sep 17 03:33:31.250215 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:33:31.250198 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f01992d_cdf0_47be_ab65_9714e39d371d.slice/crio-bf86dfc1b840c4c5fce5f3dd9f80b2c0e5fe53d88b8bc6be64fd9fa6d229c9ce WatchSource:0}: Error finding container bf86dfc1b840c4c5fce5f3dd9f80b2c0e5fe53d88b8bc6be64fd9fa6d229c9ce: Status 404 returned error can't find the container with id bf86dfc1b840c4c5fce5f3dd9f80b2c0e5fe53d88b8bc6be64fd9fa6d229c9ce Sep 17 03:33:32.084591 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:32.084554 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t9lsl" event={"ID":"6f01992d-cdf0-47be-ab65-9714e39d371d","Type":"ContainerStarted","Data":"0eb6a1666fc8f40c298496fa95662e51eb1027050da01a41bd962e2c0a9984e2"} Sep 17 03:33:32.085033 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:32.084612 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t9lsl" event={"ID":"6f01992d-cdf0-47be-ab65-9714e39d371d","Type":"ContainerStarted","Data":"bf86dfc1b840c4c5fce5f3dd9f80b2c0e5fe53d88b8bc6be64fd9fa6d229c9ce"} Sep 17 03:33:32.085033 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:32.084663 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-t9lsl" Sep 17 03:33:32.086424 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:32.086378 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9kgwj" event={"ID":"231922a7-9b04-43e5-ae55-e3a0247da747","Type":"ContainerStarted","Data":"78cecae1d535a0a646d9ce6b94bf352ae261a9f76bfe57a581d169964b413e9f"} Sep 17 03:33:32.088640 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:32.088611 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4qjvl" event={"ID":"7f900dc7-747d-47b8-8834-51afc05d4bac","Type":"ContainerStarted","Data":"921175189fa863ea094d48601d7ca79605d9ddbd7e9487c6c4967a1f918bde21"} Sep 17 03:33:32.100669 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:32.100624 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-t9lsl" podStartSLOduration=68.100604788 podStartE2EDuration="1m8.100604788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:32:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:33:32.099225112 +0000 UTC m=+67.826458267" watchObservedRunningTime="2026-09-17 03:33:32.100604788 +0000 UTC m=+67.827837943" Sep 17 03:33:32.157818 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:32.157789 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:33.094571 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:33.094512 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9kgwj" event={"ID":"231922a7-9b04-43e5-ae55-e3a0247da747","Type":"ContainerStarted","Data":"67e47841f87f9f64ad0d5e889890400ba2848dc685db3aa8e98856292713f8be"} Sep 17 03:33:33.096729 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:33.096691 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4qjvl" event={"ID":"7f900dc7-747d-47b8-8834-51afc05d4bac","Type":"ContainerStarted","Data":"a2468be050036e3eda2f807c7610ec613308022a3e3a2abaaf7346daa8196d12"} Sep 17 03:33:33.096839 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:33.096757 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4qjvl" event={"ID":"7f900dc7-747d-47b8-8834-51afc05d4bac","Type":"ContainerStarted","Data":"e6860c681a10bd5c7fefa7c993ad4319d275bae8c6beaa4b25335323e7d32ea2"} Sep 17 03:33:33.114806 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:33.114736 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4qjvl" podStartSLOduration=68.174187969 podStartE2EDuration="1m9.114717813s" totalImagesPullingTime="940.529844ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:32:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:33:33.114564287 +0000 UTC m=+68.841797443" watchObservedRunningTime="2026-09-17 03:33:33.114717813 +0000 UTC m=+68.841950980" Sep 17 03:33:34.102212 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:34.102171 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9kgwj" event={"ID":"231922a7-9b04-43e5-ae55-e3a0247da747","Type":"ContainerStarted","Data":"3b9f8bfecb1dfd93e7850e46ac9928b0191f847bb5316a030bc70fff16bde8a4"} Sep 17 03:33:34.119821 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:34.119771 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9kgwj" podStartSLOduration=34.293812561 podStartE2EDuration="36.119756259s" totalImagesPullingTime="1.825943698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:33:34.119543464 +0000 UTC m=+69.846776620" watchObservedRunningTime="2026-09-17 03:33:34.119756259 +0000 UTC m=+69.846989413" Sep 17 03:33:35.106215 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:35.106187 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9kgwj" Sep 17 03:33:36.110863 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:36.110824 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k5lh2" event={"ID":"7f67c23a-21e7-465e-a87c-29c1e5a3eadd","Type":"ContainerStarted","Data":"672bd487f9b31cc91ab1ead71dd57a8d56844709b34f81c49994dfb9c89de6c0"} Sep 17 03:33:36.125916 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:36.125855 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k5lh2" podStartSLOduration=66.964184865 podStartE2EDuration="1m11.125841228s" totalImagesPullingTime="4.161656363s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:33:36.12462713 +0000 UTC m=+71.851860283" watchObservedRunningTime="2026-09-17 03:33:36.125841228 +0000 UTC m=+71.853074384" Sep 17 03:33:37.176784 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:37.176751 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:37.278455 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:37.278422 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:39.525201 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:39.525171 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-749b7f9657-fxq68"] Sep 17 03:33:39.611060 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:39.611027 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:39.739698 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:39.739665 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:39.838668 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:39.838589 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:39.945310 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:39.945254 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:40.004689 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:40.004658 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:43.428422 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:43.428373 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:43.527066 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:43.527029 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:43.632282 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:43.632252 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:43.645349 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:43.645324 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-z6f88"] Sep 17 03:33:43.651807 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:43.651792 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-z6f88" Sep 17 03:33:43.654487 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:43.654469 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 17 03:33:43.654592 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:43.654487 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-kpr86\"" Sep 17 03:33:43.661781 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:43.661762 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-z6f88"] Sep 17 03:33:43.685434 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:43.685357 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b228daf5-ad55-403c-9d2e-2673af53e57b-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-z6f88\" (UID: \"b228daf5-ad55-403c-9d2e-2673af53e57b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-z6f88" Sep 17 03:33:43.785870 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:43.785843 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b228daf5-ad55-403c-9d2e-2673af53e57b-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-z6f88\" (UID: \"b228daf5-ad55-403c-9d2e-2673af53e57b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-z6f88" Sep 17 03:33:43.785983 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:43.785966 2551 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 17 03:33:43.786061 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:43.786050 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b228daf5-ad55-403c-9d2e-2673af53e57b-tls-certificates podName:b228daf5-ad55-403c-9d2e-2673af53e57b nodeName:}" failed. No retries permitted until 2026-09-17 03:33:44.286030529 +0000 UTC m=+80.013263663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/b228daf5-ad55-403c-9d2e-2673af53e57b-tls-certificates") pod "prometheus-operator-admission-webhook-5864cd99d7-z6f88" (UID: "b228daf5-ad55-403c-9d2e-2673af53e57b") : secret "prometheus-operator-admission-webhook-tls" not found Sep 17 03:33:43.973764 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:43.973699 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:44.289354 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:44.289290 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b228daf5-ad55-403c-9d2e-2673af53e57b-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-z6f88\" (UID: \"b228daf5-ad55-403c-9d2e-2673af53e57b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-z6f88" Sep 17 03:33:44.291648 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:44.291630 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b228daf5-ad55-403c-9d2e-2673af53e57b-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-z6f88\" (UID: \"b228daf5-ad55-403c-9d2e-2673af53e57b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-z6f88" Sep 17 03:33:44.562238 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:44.562181 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-z6f88" Sep 17 03:33:44.830844 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:44.830779 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-z6f88"] Sep 17 03:33:44.833712 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:33:44.833694 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb228daf5_ad55_403c_9d2e_2673af53e57b.slice/crio-c5038aaae6f1dda570c2da6b29bd2cc327a5fe5e60460f798b8c1586fb1b0bcf WatchSource:0}: Error finding container c5038aaae6f1dda570c2da6b29bd2cc327a5fe5e60460f798b8c1586fb1b0bcf: Status 404 returned error can't find the container with id c5038aaae6f1dda570c2da6b29bd2cc327a5fe5e60460f798b8c1586fb1b0bcf Sep 17 03:33:45.112987 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:45.112906 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9kgwj" Sep 17 03:33:45.143348 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:45.143309 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-z6f88" event={"ID":"b228daf5-ad55-403c-9d2e-2673af53e57b","Type":"ContainerStarted","Data":"c5038aaae6f1dda570c2da6b29bd2cc327a5fe5e60460f798b8c1586fb1b0bcf"} Sep 17 03:33:46.002199 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:46.002166 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72fedd4c-6ffe-4536-b22b-a220953eaf81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbcm5\" (UID: \"72fedd4c-6ffe-4536-b22b-a220953eaf81\") " pod="openshift-insights/insights-runtime-extractor-pbcm5" Sep 17 03:33:46.004399 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:46.004379 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72fedd4c-6ffe-4536-b22b-a220953eaf81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pbcm5\" (UID: \"72fedd4c-6ffe-4536-b22b-a220953eaf81\") " pod="openshift-insights/insights-runtime-extractor-pbcm5" Sep 17 03:33:46.148183 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:46.148111 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-z6f88" event={"ID":"b228daf5-ad55-403c-9d2e-2673af53e57b","Type":"ContainerStarted","Data":"f8d011ffe4ff38c3dbf18be1963209fcef2084a3a8bec0ea821994be9db50926"} Sep 17 03:33:46.148349 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:46.148332 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-z6f88" Sep 17 03:33:46.152670 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:46.152645 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-z6f88" Sep 17 03:33:46.164578 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:46.164541 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-z6f88" podStartSLOduration=2.114712744 podStartE2EDuration="3.164529127s" totalImagesPullingTime="1.049816383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:33:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:33:46.163494947 +0000 UTC m=+81.890728102" watchObservedRunningTime="2026-09-17 03:33:46.164529127 +0000 UTC m=+81.891762281" Sep 17 03:33:46.279172 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:46.279147 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-djgnt\"" Sep 17 03:33:46.287125 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:46.287108 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pbcm5" Sep 17 03:33:46.554425 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:46.554384 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pbcm5"] Sep 17 03:33:46.556981 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:33:46.556949 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72fedd4c_6ffe_4536_b22b_a220953eaf81.slice/crio-6f765fe99605c148e2db7475a9c2024ab281674f9e038b8f3cfb6284799762f0 WatchSource:0}: Error finding container 6f765fe99605c148e2db7475a9c2024ab281674f9e038b8f3cfb6284799762f0: Status 404 returned error can't find the container with id 6f765fe99605c148e2db7475a9c2024ab281674f9e038b8f3cfb6284799762f0 Sep 17 03:33:46.680652 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:46.680617 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:46.704098 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:46.704071 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-cgd2f"] Sep 17 03:33:46.728881 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:46.728863 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-cgd2f"] Sep 17 03:33:46.728972 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:46.728952 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-cgd2f" Sep 17 03:33:46.732173 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:46.732142 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 17 03:33:46.732173 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:46.732168 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 17 03:33:46.732479 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:46.732465 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 17 03:33:46.732554 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:46.732534 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-j954g\"" Sep 17 03:33:46.732554 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:46.732470 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 17 03:33:46.733295 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:46.733266 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 17 03:33:46.749203 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:46.749182 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:46.808632 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:46.808583 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-cgd2f\" (UID: \"6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-cgd2f" Sep 17 03:33:46.808632 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:46.808618 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-cgd2f\" (UID: \"6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-cgd2f" Sep 17 03:33:46.808741 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:46.808642 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l29hc\" (UniqueName: \"kubernetes.io/projected/6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8-kube-api-access-l29hc\") pod \"prometheus-operator-68bcd7f987-cgd2f\" (UID: \"6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-cgd2f" Sep 17 03:33:46.808776 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:46.808754 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-cgd2f\" (UID: \"6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-cgd2f" Sep 17 03:33:46.909320 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:46.909301 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-cgd2f\" (UID: \"6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-cgd2f" Sep 17 03:33:46.909394 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:46.909331 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l29hc\" (UniqueName: \"kubernetes.io/projected/6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8-kube-api-access-l29hc\") pod \"prometheus-operator-68bcd7f987-cgd2f\" (UID: \"6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-cgd2f" Sep 17 03:33:46.909394 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:46.909359 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-cgd2f\" (UID: \"6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-cgd2f" Sep 17 03:33:46.909498 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:46.909481 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-cgd2f\" (UID: \"6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-cgd2f" Sep 17 03:33:46.909605 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:46.909589 2551 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 17 03:33:46.909663 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:46.909652 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8-prometheus-operator-tls podName:6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8 nodeName:}" failed. No retries permitted until 2026-09-17 03:33:47.409635803 +0000 UTC m=+83.136868949 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-cgd2f" (UID: "6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8") : secret "prometheus-operator-tls" not found Sep 17 03:33:46.910038 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:46.910021 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-cgd2f\" (UID: \"6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-cgd2f" Sep 17 03:33:46.911588 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:46.911568 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-cgd2f\" (UID: \"6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-cgd2f" Sep 17 03:33:46.940114 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:46.940093 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l29hc\" (UniqueName: \"kubernetes.io/projected/6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8-kube-api-access-l29hc\") pod \"prometheus-operator-68bcd7f987-cgd2f\" (UID: \"6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-cgd2f" Sep 17 03:33:47.153452 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:47.153312 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pbcm5" event={"ID":"72fedd4c-6ffe-4536-b22b-a220953eaf81","Type":"ContainerStarted","Data":"f590bc050dc04a008dfebff79e50d008082f97d17545cc37c2ec9992076e4596"} Sep 17 03:33:47.153452 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:47.153364 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pbcm5" event={"ID":"72fedd4c-6ffe-4536-b22b-a220953eaf81","Type":"ContainerStarted","Data":"6f765fe99605c148e2db7475a9c2024ab281674f9e038b8f3cfb6284799762f0"} Sep 17 03:33:47.169204 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:47.169160 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:47.413663 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:47.413575 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-cgd2f\" (UID: \"6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-cgd2f" Sep 17 03:33:47.415901 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:47.415868 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-cgd2f\" (UID: \"6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-cgd2f" Sep 17 03:33:47.637464 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:47.637441 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-cgd2f" Sep 17 03:33:47.911671 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:47.911639 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-cgd2f"] Sep 17 03:33:47.914380 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:33:47.914340 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c8ab701_ddd2_481e_8c34_ba4ec0c7c6d8.slice/crio-c715c9a4fccfe58707b65c7094e5dfec0c07c629b329684022adb020813e0f5f WatchSource:0}: Error finding container c715c9a4fccfe58707b65c7094e5dfec0c07c629b329684022adb020813e0f5f: Status 404 returned error can't find the container with id c715c9a4fccfe58707b65c7094e5dfec0c07c629b329684022adb020813e0f5f Sep 17 03:33:48.157663 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:48.157634 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-cgd2f" event={"ID":"6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8","Type":"ContainerStarted","Data":"c715c9a4fccfe58707b65c7094e5dfec0c07c629b329684022adb020813e0f5f"} Sep 17 03:33:48.163709 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:48.163640 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pbcm5" event={"ID":"72fedd4c-6ffe-4536-b22b-a220953eaf81","Type":"ContainerStarted","Data":"10fffdb105e41c57abe4af516eb6ca99b9212a00f2cbc972f0796814946fa4da"} Sep 17 03:33:49.530557 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:49.530530 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:33:49.810250 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:49.810165 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:50.173273 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:50.173238 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pbcm5" event={"ID":"72fedd4c-6ffe-4536-b22b-a220953eaf81","Type":"ContainerStarted","Data":"8212bb8bf6c228d1d9546da2b43b423b97479c4f56a1416b07b0867e0de97e9d"} Sep 17 03:33:50.175019 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:50.174993 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-cgd2f" event={"ID":"6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8","Type":"ContainerStarted","Data":"3347f78e3ecdfe1c4ab4e143d1c7842458e8608d6c882a9570eab3d2fc52fd35"} Sep 17 03:33:50.175180 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:50.175046 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-cgd2f" event={"ID":"6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8","Type":"ContainerStarted","Data":"d2baec25c1e828d087b80d820425b92bfd09d28b6f47b3fa3cb54a2165a3eefa"} Sep 17 03:33:50.191467 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:50.191428 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pbcm5" podStartSLOduration=33.351709544 podStartE2EDuration="36.19139267s" totalImagesPullingTime="2.839683126s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:33:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:33:50.189908002 +0000 UTC m=+85.917141157" watchObservedRunningTime="2026-09-17 03:33:50.19139267 +0000 UTC m=+85.918625824" Sep 17 03:33:50.207235 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:50.207202 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-cgd2f" podStartSLOduration=2.583979156 podStartE2EDuration="4.207188455s" totalImagesPullingTime="1.623209299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:33:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:33:50.205641101 +0000 UTC m=+85.932874256" watchObservedRunningTime="2026-09-17 03:33:50.207188455 +0000 UTC m=+85.934421609" Sep 17 03:33:50.561073 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:50.561007 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:50.616861 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:50.616837 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:51.809604 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:51.809567 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:52.020506 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.020469 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:52.074422 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.074328 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7kdrs"] Sep 17 03:33:52.079042 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.079023 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7kdrs" Sep 17 03:33:52.081975 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.081825 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 17 03:33:52.081975 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.081857 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 17 03:33:52.081975 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.081890 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 17 03:33:52.082373 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.082348 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7jhd6\"" Sep 17 03:33:52.115395 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.115370 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:52.150582 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.150555 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6d727817-920b-41ee-990b-fa0d8db48e9a-node-exporter-accelerators-collector-config\") pod \"node-exporter-7kdrs\" (UID: \"6d727817-920b-41ee-990b-fa0d8db48e9a\") " pod="openshift-monitoring/node-exporter-7kdrs" Sep 17 03:33:52.150708 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.150584 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6d727817-920b-41ee-990b-fa0d8db48e9a-root\") pod \"node-exporter-7kdrs\" (UID: \"6d727817-920b-41ee-990b-fa0d8db48e9a\") " pod="openshift-monitoring/node-exporter-7kdrs" Sep 17 03:33:52.150708 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.150609 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6d727817-920b-41ee-990b-fa0d8db48e9a-node-exporter-wtmp\") pod \"node-exporter-7kdrs\" (UID: \"6d727817-920b-41ee-990b-fa0d8db48e9a\") " pod="openshift-monitoring/node-exporter-7kdrs" Sep 17 03:33:52.150708 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.150627 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6d727817-920b-41ee-990b-fa0d8db48e9a-node-exporter-textfile\") pod \"node-exporter-7kdrs\" (UID: \"6d727817-920b-41ee-990b-fa0d8db48e9a\") " pod="openshift-monitoring/node-exporter-7kdrs" Sep 17 03:33:52.150708 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.150681 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnqlc\" (UniqueName: \"kubernetes.io/projected/6d727817-920b-41ee-990b-fa0d8db48e9a-kube-api-access-bnqlc\") pod \"node-exporter-7kdrs\" (UID: \"6d727817-920b-41ee-990b-fa0d8db48e9a\") " pod="openshift-monitoring/node-exporter-7kdrs" Sep 17 03:33:52.150916 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.150722 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d727817-920b-41ee-990b-fa0d8db48e9a-sys\") pod \"node-exporter-7kdrs\" (UID: \"6d727817-920b-41ee-990b-fa0d8db48e9a\") " pod="openshift-monitoring/node-exporter-7kdrs" Sep 17 03:33:52.150916 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.150739 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6d727817-920b-41ee-990b-fa0d8db48e9a-node-exporter-tls\") pod \"node-exporter-7kdrs\" (UID: \"6d727817-920b-41ee-990b-fa0d8db48e9a\") " pod="openshift-monitoring/node-exporter-7kdrs" Sep 17 03:33:52.150916 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.150759 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d727817-920b-41ee-990b-fa0d8db48e9a-metrics-client-ca\") pod \"node-exporter-7kdrs\" (UID: \"6d727817-920b-41ee-990b-fa0d8db48e9a\") " pod="openshift-monitoring/node-exporter-7kdrs" Sep 17 03:33:52.150916 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.150790 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d727817-920b-41ee-990b-fa0d8db48e9a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7kdrs\" (UID: \"6d727817-920b-41ee-990b-fa0d8db48e9a\") " pod="openshift-monitoring/node-exporter-7kdrs" Sep 17 03:33:52.169383 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.169358 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:52.251789 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.251763 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6d727817-920b-41ee-990b-fa0d8db48e9a-node-exporter-accelerators-collector-config\") pod \"node-exporter-7kdrs\" (UID: \"6d727817-920b-41ee-990b-fa0d8db48e9a\") " pod="openshift-monitoring/node-exporter-7kdrs" Sep 17 03:33:52.251904 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.251792 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6d727817-920b-41ee-990b-fa0d8db48e9a-root\") pod \"node-exporter-7kdrs\" (UID: \"6d727817-920b-41ee-990b-fa0d8db48e9a\") " pod="openshift-monitoring/node-exporter-7kdrs" Sep 17 03:33:52.251904 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.251821 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6d727817-920b-41ee-990b-fa0d8db48e9a-node-exporter-wtmp\") pod \"node-exporter-7kdrs\" (UID: \"6d727817-920b-41ee-990b-fa0d8db48e9a\") " pod="openshift-monitoring/node-exporter-7kdrs" Sep 17 03:33:52.251904 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.251844 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6d727817-920b-41ee-990b-fa0d8db48e9a-node-exporter-textfile\") pod \"node-exporter-7kdrs\" (UID: \"6d727817-920b-41ee-990b-fa0d8db48e9a\") " pod="openshift-monitoring/node-exporter-7kdrs" Sep 17 03:33:52.251904 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.251874 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnqlc\" (UniqueName: \"kubernetes.io/projected/6d727817-920b-41ee-990b-fa0d8db48e9a-kube-api-access-bnqlc\") pod \"node-exporter-7kdrs\" (UID: \"6d727817-920b-41ee-990b-fa0d8db48e9a\") " pod="openshift-monitoring/node-exporter-7kdrs" Sep 17 03:33:52.251904 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.251886 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6d727817-920b-41ee-990b-fa0d8db48e9a-root\") pod \"node-exporter-7kdrs\" (UID: \"6d727817-920b-41ee-990b-fa0d8db48e9a\") " pod="openshift-monitoring/node-exporter-7kdrs" Sep 17 03:33:52.252150 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.251911 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d727817-920b-41ee-990b-fa0d8db48e9a-sys\") pod \"node-exporter-7kdrs\" (UID: \"6d727817-920b-41ee-990b-fa0d8db48e9a\") " pod="openshift-monitoring/node-exporter-7kdrs" Sep 17 03:33:52.252150 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.251933 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6d727817-920b-41ee-990b-fa0d8db48e9a-node-exporter-tls\") pod \"node-exporter-7kdrs\" (UID: \"6d727817-920b-41ee-990b-fa0d8db48e9a\") " pod="openshift-monitoring/node-exporter-7kdrs" Sep 17 03:33:52.252150 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.251960 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d727817-920b-41ee-990b-fa0d8db48e9a-metrics-client-ca\") pod \"node-exporter-7kdrs\" (UID: \"6d727817-920b-41ee-990b-fa0d8db48e9a\") " pod="openshift-monitoring/node-exporter-7kdrs" Sep 17 03:33:52.252150 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.251977 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6d727817-920b-41ee-990b-fa0d8db48e9a-node-exporter-wtmp\") pod \"node-exporter-7kdrs\" (UID: \"6d727817-920b-41ee-990b-fa0d8db48e9a\") " pod="openshift-monitoring/node-exporter-7kdrs" Sep 17 03:33:52.252150 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.251997 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d727817-920b-41ee-990b-fa0d8db48e9a-sys\") pod \"node-exporter-7kdrs\" (UID: \"6d727817-920b-41ee-990b-fa0d8db48e9a\") " pod="openshift-monitoring/node-exporter-7kdrs" Sep 17 03:33:52.252150 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.252007 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d727817-920b-41ee-990b-fa0d8db48e9a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7kdrs\" (UID: \"6d727817-920b-41ee-990b-fa0d8db48e9a\") " pod="openshift-monitoring/node-exporter-7kdrs" Sep 17 03:33:52.252466 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.252423 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6d727817-920b-41ee-990b-fa0d8db48e9a-node-exporter-textfile\") pod \"node-exporter-7kdrs\" (UID: \"6d727817-920b-41ee-990b-fa0d8db48e9a\") " pod="openshift-monitoring/node-exporter-7kdrs" Sep 17 03:33:52.252519 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.252500 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6d727817-920b-41ee-990b-fa0d8db48e9a-node-exporter-accelerators-collector-config\") pod \"node-exporter-7kdrs\" (UID: \"6d727817-920b-41ee-990b-fa0d8db48e9a\") " pod="openshift-monitoring/node-exporter-7kdrs" Sep 17 03:33:52.252571 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.252522 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d727817-920b-41ee-990b-fa0d8db48e9a-metrics-client-ca\") pod \"node-exporter-7kdrs\" (UID: \"6d727817-920b-41ee-990b-fa0d8db48e9a\") " pod="openshift-monitoring/node-exporter-7kdrs" Sep 17 03:33:52.254397 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.254381 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6d727817-920b-41ee-990b-fa0d8db48e9a-node-exporter-tls\") pod \"node-exporter-7kdrs\" (UID: \"6d727817-920b-41ee-990b-fa0d8db48e9a\") " pod="openshift-monitoring/node-exporter-7kdrs" Sep 17 03:33:52.254493 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.254473 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d727817-920b-41ee-990b-fa0d8db48e9a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7kdrs\" (UID: \"6d727817-920b-41ee-990b-fa0d8db48e9a\") " pod="openshift-monitoring/node-exporter-7kdrs" Sep 17 03:33:52.262747 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.262725 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnqlc\" (UniqueName: \"kubernetes.io/projected/6d727817-920b-41ee-990b-fa0d8db48e9a-kube-api-access-bnqlc\") pod \"node-exporter-7kdrs\" (UID: \"6d727817-920b-41ee-990b-fa0d8db48e9a\") " pod="openshift-monitoring/node-exporter-7kdrs" Sep 17 03:33:52.270935 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.270909 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:52.370468 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.370388 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:52.390301 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.390278 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7kdrs" Sep 17 03:33:52.403531 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:33:52.403509 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d727817_920b_41ee_990b_fa0d8db48e9a.slice/crio-89f55c2ee9d88675b0ea58f2ea9d67124134aba34b61358a27e588396c8e2e76 WatchSource:0}: Error finding container 89f55c2ee9d88675b0ea58f2ea9d67124134aba34b61358a27e588396c8e2e76: Status 404 returned error can't find the container with id 89f55c2ee9d88675b0ea58f2ea9d67124134aba34b61358a27e588396c8e2e76 Sep 17 03:33:52.469676 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.469657 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:52.572293 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.572272 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:52.647065 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:52.647003 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:53.036717 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:53.036679 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:53.114858 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:53.114825 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:53.187934 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:53.187894 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7kdrs" event={"ID":"6d727817-920b-41ee-990b-fa0d8db48e9a","Type":"ContainerStarted","Data":"89f55c2ee9d88675b0ea58f2ea9d67124134aba34b61358a27e588396c8e2e76"} Sep 17 03:33:53.498607 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:53.498584 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:54.194092 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:54.194056 2551 generic.go:356] "Generic (PLEG): container finished" podID="6d727817-920b-41ee-990b-fa0d8db48e9a" containerID="046b51070e80759d0c96796b08634d0483957b0dd56018d2aba89777ac1d45b7" exitCode=0 Sep 17 03:33:54.194455 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:54.194133 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7kdrs" event={"ID":"6d727817-920b-41ee-990b-fa0d8db48e9a","Type":"ContainerDied","Data":"046b51070e80759d0c96796b08634d0483957b0dd56018d2aba89777ac1d45b7"} Sep 17 03:33:55.009276 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:55.009241 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:55.109758 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:55.109726 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:55.199371 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:55.199337 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7kdrs" event={"ID":"6d727817-920b-41ee-990b-fa0d8db48e9a","Type":"ContainerStarted","Data":"82218e07f2fc7fb32a048e15e7dc9ba75ad5a408c863e2757fa56a1e07fcb197"} Sep 17 03:33:55.199837 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:55.199429 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7kdrs" event={"ID":"6d727817-920b-41ee-990b-fa0d8db48e9a","Type":"ContainerStarted","Data":"10f9e978538972c2ec088e235ed50a8bacd6e2ae1eb46033b79700590a8a55fd"} Sep 17 03:33:55.212335 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:55.212300 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:55.227267 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:55.227221 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7kdrs" podStartSLOduration=2.248591825 podStartE2EDuration="3.227204256s" totalImagesPullingTime="917.454407ms" totalInitContainerRuntime="61.158024ms" isStatefulPod=true podCreationTimestamp="2026-09-17 03:33:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:33:55.225276106 +0000 UTC m=+90.952509261" watchObservedRunningTime="2026-09-17 03:33:55.227204256 +0000 UTC m=+90.954437411" Sep 17 03:33:55.309140 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:55.309085 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:55.768117 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:55.768082 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:55.873646 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:55.873622 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:56.420316 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.420285 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-57f9c58b65-vvfvb"] Sep 17 03:33:56.423418 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.423390 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-57f9c58b65-vvfvb" Sep 17 03:33:56.427209 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.427170 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 17 03:33:56.427309 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.427206 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-njgh7\"" Sep 17 03:33:56.427309 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.427217 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-f2lc6io17i3st\"" Sep 17 03:33:56.427309 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.427238 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 17 03:33:56.427309 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.427279 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 17 03:33:56.427501 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.427489 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 17 03:33:56.433276 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.433255 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-57f9c58b65-vvfvb"] Sep 17 03:33:56.485889 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.485860 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25cb9b60-5a00-4a31-a6b7-da269a99ab21-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-57f9c58b65-vvfvb\" (UID: \"25cb9b60-5a00-4a31-a6b7-da269a99ab21\") " pod="openshift-monitoring/metrics-server-57f9c58b65-vvfvb" Sep 17 03:33:56.485889 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.485891 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/25cb9b60-5a00-4a31-a6b7-da269a99ab21-audit-log\") pod \"metrics-server-57f9c58b65-vvfvb\" (UID: \"25cb9b60-5a00-4a31-a6b7-da269a99ab21\") " pod="openshift-monitoring/metrics-server-57f9c58b65-vvfvb" Sep 17 03:33:56.486082 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.485910 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/25cb9b60-5a00-4a31-a6b7-da269a99ab21-secret-metrics-server-tls\") pod \"metrics-server-57f9c58b65-vvfvb\" (UID: \"25cb9b60-5a00-4a31-a6b7-da269a99ab21\") " pod="openshift-monitoring/metrics-server-57f9c58b65-vvfvb" Sep 17 03:33:56.486082 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.485926 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/25cb9b60-5a00-4a31-a6b7-da269a99ab21-metrics-server-audit-profiles\") pod \"metrics-server-57f9c58b65-vvfvb\" (UID: \"25cb9b60-5a00-4a31-a6b7-da269a99ab21\") " pod="openshift-monitoring/metrics-server-57f9c58b65-vvfvb" Sep 17 03:33:56.486082 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.485952 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25cb9b60-5a00-4a31-a6b7-da269a99ab21-client-ca-bundle\") pod \"metrics-server-57f9c58b65-vvfvb\" (UID: \"25cb9b60-5a00-4a31-a6b7-da269a99ab21\") " pod="openshift-monitoring/metrics-server-57f9c58b65-vvfvb" Sep 17 03:33:56.486082 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.485997 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs5q2\" (UniqueName: \"kubernetes.io/projected/25cb9b60-5a00-4a31-a6b7-da269a99ab21-kube-api-access-zs5q2\") pod \"metrics-server-57f9c58b65-vvfvb\" (UID: \"25cb9b60-5a00-4a31-a6b7-da269a99ab21\") " pod="openshift-monitoring/metrics-server-57f9c58b65-vvfvb" Sep 17 03:33:56.486082 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.486066 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/25cb9b60-5a00-4a31-a6b7-da269a99ab21-secret-metrics-server-client-certs\") pod \"metrics-server-57f9c58b65-vvfvb\" (UID: \"25cb9b60-5a00-4a31-a6b7-da269a99ab21\") " pod="openshift-monitoring/metrics-server-57f9c58b65-vvfvb" Sep 17 03:33:56.586713 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.586683 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25cb9b60-5a00-4a31-a6b7-da269a99ab21-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-57f9c58b65-vvfvb\" (UID: \"25cb9b60-5a00-4a31-a6b7-da269a99ab21\") " pod="openshift-monitoring/metrics-server-57f9c58b65-vvfvb" Sep 17 03:33:56.586931 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.586723 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/25cb9b60-5a00-4a31-a6b7-da269a99ab21-audit-log\") pod \"metrics-server-57f9c58b65-vvfvb\" (UID: \"25cb9b60-5a00-4a31-a6b7-da269a99ab21\") " pod="openshift-monitoring/metrics-server-57f9c58b65-vvfvb" Sep 17 03:33:56.586931 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.586749 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/25cb9b60-5a00-4a31-a6b7-da269a99ab21-secret-metrics-server-tls\") pod \"metrics-server-57f9c58b65-vvfvb\" (UID: \"25cb9b60-5a00-4a31-a6b7-da269a99ab21\") " pod="openshift-monitoring/metrics-server-57f9c58b65-vvfvb" Sep 17 03:33:56.586931 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.586771 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/25cb9b60-5a00-4a31-a6b7-da269a99ab21-metrics-server-audit-profiles\") pod \"metrics-server-57f9c58b65-vvfvb\" (UID: \"25cb9b60-5a00-4a31-a6b7-da269a99ab21\") " pod="openshift-monitoring/metrics-server-57f9c58b65-vvfvb" Sep 17 03:33:56.586931 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.586795 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25cb9b60-5a00-4a31-a6b7-da269a99ab21-client-ca-bundle\") pod \"metrics-server-57f9c58b65-vvfvb\" (UID: \"25cb9b60-5a00-4a31-a6b7-da269a99ab21\") " pod="openshift-monitoring/metrics-server-57f9c58b65-vvfvb" Sep 17 03:33:56.586931 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.586835 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs5q2\" (UniqueName: \"kubernetes.io/projected/25cb9b60-5a00-4a31-a6b7-da269a99ab21-kube-api-access-zs5q2\") pod \"metrics-server-57f9c58b65-vvfvb\" (UID: \"25cb9b60-5a00-4a31-a6b7-da269a99ab21\") " pod="openshift-monitoring/metrics-server-57f9c58b65-vvfvb" Sep 17 03:33:56.586931 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.586889 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/25cb9b60-5a00-4a31-a6b7-da269a99ab21-secret-metrics-server-client-certs\") pod \"metrics-server-57f9c58b65-vvfvb\" (UID: \"25cb9b60-5a00-4a31-a6b7-da269a99ab21\") " pod="openshift-monitoring/metrics-server-57f9c58b65-vvfvb" Sep 17 03:33:56.587218 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.587122 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/25cb9b60-5a00-4a31-a6b7-da269a99ab21-audit-log\") pod \"metrics-server-57f9c58b65-vvfvb\" (UID: \"25cb9b60-5a00-4a31-a6b7-da269a99ab21\") " pod="openshift-monitoring/metrics-server-57f9c58b65-vvfvb" Sep 17 03:33:56.587535 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.587507 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25cb9b60-5a00-4a31-a6b7-da269a99ab21-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-57f9c58b65-vvfvb\" (UID: \"25cb9b60-5a00-4a31-a6b7-da269a99ab21\") " pod="openshift-monitoring/metrics-server-57f9c58b65-vvfvb" Sep 17 03:33:56.587742 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.587723 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/25cb9b60-5a00-4a31-a6b7-da269a99ab21-metrics-server-audit-profiles\") pod \"metrics-server-57f9c58b65-vvfvb\" (UID: \"25cb9b60-5a00-4a31-a6b7-da269a99ab21\") " pod="openshift-monitoring/metrics-server-57f9c58b65-vvfvb" Sep 17 03:33:56.589511 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.589488 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/25cb9b60-5a00-4a31-a6b7-da269a99ab21-client-ca-bundle\") pod \"metrics-server-57f9c58b65-vvfvb\" (UID: \"25cb9b60-5a00-4a31-a6b7-da269a99ab21\") " pod="openshift-monitoring/metrics-server-57f9c58b65-vvfvb" Sep 17 03:33:56.589598 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.589509 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/25cb9b60-5a00-4a31-a6b7-da269a99ab21-secret-metrics-server-tls\") pod \"metrics-server-57f9c58b65-vvfvb\" (UID: \"25cb9b60-5a00-4a31-a6b7-da269a99ab21\") " pod="openshift-monitoring/metrics-server-57f9c58b65-vvfvb" Sep 17 03:33:56.589663 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.589643 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/25cb9b60-5a00-4a31-a6b7-da269a99ab21-secret-metrics-server-client-certs\") pod \"metrics-server-57f9c58b65-vvfvb\" (UID: \"25cb9b60-5a00-4a31-a6b7-da269a99ab21\") " pod="openshift-monitoring/metrics-server-57f9c58b65-vvfvb" Sep 17 03:33:56.596042 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.596024 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs5q2\" (UniqueName: \"kubernetes.io/projected/25cb9b60-5a00-4a31-a6b7-da269a99ab21-kube-api-access-zs5q2\") pod \"metrics-server-57f9c58b65-vvfvb\" (UID: \"25cb9b60-5a00-4a31-a6b7-da269a99ab21\") " pod="openshift-monitoring/metrics-server-57f9c58b65-vvfvb" Sep 17 03:33:56.733239 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.733195 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-57f9c58b65-vvfvb" Sep 17 03:33:56.823293 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.823247 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-s9llc"] Sep 17 03:33:56.827179 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.826683 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:56.830747 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.830724 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-s9llc" Sep 17 03:33:56.833499 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.833329 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 17 03:33:56.833499 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.833341 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-h4zll\"" Sep 17 03:33:56.836868 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.836847 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-s9llc"] Sep 17 03:33:56.990088 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.990031 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1a3eb32a-d5f3-4792-aa43-d212b31b94f6-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-s9llc\" (UID: \"1a3eb32a-d5f3-4792-aa43-d212b31b94f6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-s9llc" Sep 17 03:33:56.990202 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:56.990105 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs2vn\" (UniqueName: \"kubernetes.io/projected/1a3eb32a-d5f3-4792-aa43-d212b31b94f6-kube-api-access-fs2vn\") pod \"monitoring-plugin-5d85778b9d-s9llc\" (UID: \"1a3eb32a-d5f3-4792-aa43-d212b31b94f6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-s9llc" Sep 17 03:33:57.005173 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:57.005152 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-57f9c58b65-vvfvb"] Sep 17 03:33:57.007681 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:33:57.007659 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25cb9b60_5a00_4a31_a6b7_da269a99ab21.slice/crio-764d76472d61ecc48871b3ed0fd549d6b8c20c314ccaff648a91a8c4013bd9e8 WatchSource:0}: Error finding container 764d76472d61ecc48871b3ed0fd549d6b8c20c314ccaff648a91a8c4013bd9e8: Status 404 returned error can't find the container with id 764d76472d61ecc48871b3ed0fd549d6b8c20c314ccaff648a91a8c4013bd9e8 Sep 17 03:33:57.091492 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:57.091466 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs2vn\" (UniqueName: \"kubernetes.io/projected/1a3eb32a-d5f3-4792-aa43-d212b31b94f6-kube-api-access-fs2vn\") pod \"monitoring-plugin-5d85778b9d-s9llc\" (UID: \"1a3eb32a-d5f3-4792-aa43-d212b31b94f6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-s9llc" Sep 17 03:33:57.091576 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:57.091532 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1a3eb32a-d5f3-4792-aa43-d212b31b94f6-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-s9llc\" (UID: \"1a3eb32a-d5f3-4792-aa43-d212b31b94f6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-s9llc" Sep 17 03:33:57.091675 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:57.091662 2551 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 17 03:33:57.091748 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:33:57.091739 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a3eb32a-d5f3-4792-aa43-d212b31b94f6-monitoring-plugin-cert podName:1a3eb32a-d5f3-4792-aa43-d212b31b94f6 nodeName:}" failed. No retries permitted until 2026-09-17 03:33:57.591712304 +0000 UTC m=+93.318945437 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/1a3eb32a-d5f3-4792-aa43-d212b31b94f6-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-s9llc" (UID: "1a3eb32a-d5f3-4792-aa43-d212b31b94f6") : secret "monitoring-plugin-cert" not found Sep 17 03:33:57.099772 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:57.099749 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs2vn\" (UniqueName: \"kubernetes.io/projected/1a3eb32a-d5f3-4792-aa43-d212b31b94f6-kube-api-access-fs2vn\") pod \"monitoring-plugin-5d85778b9d-s9llc\" (UID: \"1a3eb32a-d5f3-4792-aa43-d212b31b94f6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-s9llc" Sep 17 03:33:57.207970 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:57.207940 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-57f9c58b65-vvfvb" event={"ID":"25cb9b60-5a00-4a31-a6b7-da269a99ab21","Type":"ContainerStarted","Data":"764d76472d61ecc48871b3ed0fd549d6b8c20c314ccaff648a91a8c4013bd9e8"} Sep 17 03:33:57.449617 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:57.449586 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:57.597058 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:57.597024 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1a3eb32a-d5f3-4792-aa43-d212b31b94f6-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-s9llc\" (UID: \"1a3eb32a-d5f3-4792-aa43-d212b31b94f6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-s9llc" Sep 17 03:33:57.599817 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:57.599791 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1a3eb32a-d5f3-4792-aa43-d212b31b94f6-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-s9llc\" (UID: \"1a3eb32a-d5f3-4792-aa43-d212b31b94f6\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-s9llc" Sep 17 03:33:57.741806 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:57.741728 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-s9llc" Sep 17 03:33:58.020761 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.020584 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-s9llc"] Sep 17 03:33:58.296232 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:33:58.296158 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a3eb32a_d5f3_4792_aa43_d212b31b94f6.slice/crio-678a669a82fb9688c527e6f246b205f5c78ea2b357a6e555e005b9ee390d2100 WatchSource:0}: Error finding container 678a669a82fb9688c527e6f246b205f5c78ea2b357a6e555e005b9ee390d2100: Status 404 returned error can't find the container with id 678a669a82fb9688c527e6f246b205f5c78ea2b357a6e555e005b9ee390d2100 Sep 17 03:33:58.381310 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.380537 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 03:33:58.381895 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.381868 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:58.385847 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.385828 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.388774 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.388610 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 03:33:58.388774 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.388690 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 03:33:58.388774 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.388708 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 03:33:58.388774 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.388695 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 03:33:58.389016 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.388695 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7q1hu5bs7r081\"" Sep 17 03:33:58.389061 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.389022 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 03:33:58.389096 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.389085 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 03:33:58.389178 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.389161 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 03:33:58.389803 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.389596 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 03:33:58.389803 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.389609 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 03:33:58.389803 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.389681 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 03:33:58.389944 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.389884 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 03:33:58.390927 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.390905 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 03:33:58.391348 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.391329 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hdjzm\"" Sep 17 03:33:58.402564 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.402541 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 03:33:58.404035 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.403997 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 03:33:58.404376 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.404355 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 03:33:58.499033 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.498997 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:58.505341 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.505312 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.505495 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.505355 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.505495 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.505386 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6534aa76-c13a-44e9-aff3-0406b9a4bac1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.505495 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.505466 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.505615 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.505495 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.505615 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.505518 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-config\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.505615 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.505535 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.505615 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.505561 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.505615 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.505582 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.505615 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.505599 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.505798 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.505619 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.505798 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.505639 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.505798 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.505683 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.505798 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.505724 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6534aa76-c13a-44e9-aff3-0406b9a4bac1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.505798 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.505752 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.505949 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.505797 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6534aa76-c13a-44e9-aff3-0406b9a4bac1-config-out\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.505949 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.505823 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fhmf\" (UniqueName: \"kubernetes.io/projected/6534aa76-c13a-44e9-aff3-0406b9a4bac1-kube-api-access-6fhmf\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.505949 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.505857 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.505949 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.505887 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.505949 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.505914 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-web-config\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.607335 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.607253 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.607335 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.607305 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-web-config\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.607567 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.607342 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.607567 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.607370 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.607567 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.607397 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6534aa76-c13a-44e9-aff3-0406b9a4bac1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.607567 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.607456 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.607567 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.607482 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.607567 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.607511 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-config\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.607567 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.607534 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.607567 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.607565 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.607958 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.607588 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.607958 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.607609 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.607958 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.607637 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.607958 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.607662 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.607958 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.607691 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.607958 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.607719 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6534aa76-c13a-44e9-aff3-0406b9a4bac1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.607958 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.607739 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.607958 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.607771 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6534aa76-c13a-44e9-aff3-0406b9a4bac1-config-out\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.607958 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.607797 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fhmf\" (UniqueName: \"kubernetes.io/projected/6534aa76-c13a-44e9-aff3-0406b9a4bac1-kube-api-access-6fhmf\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.607958 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.607832 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.608529 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.608458 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6534aa76-c13a-44e9-aff3-0406b9a4bac1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.610097 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.609227 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.610097 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.609460 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.611001 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.610974 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.611113 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.610986 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-web-config\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.612723 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.612698 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.613581 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.613555 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.614221 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.613676 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.614221 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.613751 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.614221 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.613869 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.614221 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.614015 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6534aa76-c13a-44e9-aff3-0406b9a4bac1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.614221 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.614177 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.614531 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.614373 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.615176 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.615013 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.615176 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.615118 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.615515 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.615231 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-config\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.615515 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.615251 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6534aa76-c13a-44e9-aff3-0406b9a4bac1-config-out\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.616171 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.616140 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.617115 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.617090 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.628287 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.628262 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fhmf\" (UniqueName: \"kubernetes.io/projected/6534aa76-c13a-44e9-aff3-0406b9a4bac1-kube-api-access-6fhmf\") pod \"prometheus-k8s-0\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:58.710009 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:58.709983 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:33:59.010254 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:59.010157 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 03:33:59.014495 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:33:59.014464 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6534aa76_c13a_44e9_aff3_0406b9a4bac1.slice/crio-6176ebb9aae1e3a0f3260ef0d10bdeb05ac2de6368060eb300f5333b52f807ae WatchSource:0}: Error finding container 6176ebb9aae1e3a0f3260ef0d10bdeb05ac2de6368060eb300f5333b52f807ae: Status 404 returned error can't find the container with id 6176ebb9aae1e3a0f3260ef0d10bdeb05ac2de6368060eb300f5333b52f807ae Sep 17 03:33:59.220225 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:59.220186 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-57f9c58b65-vvfvb" event={"ID":"25cb9b60-5a00-4a31-a6b7-da269a99ab21","Type":"ContainerStarted","Data":"efa7fbedb4f0cd04b97c4a0a39fe2fa2a72233fde1a435f96bb58bdc633f92da"} Sep 17 03:33:59.221611 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:59.221579 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-s9llc" event={"ID":"1a3eb32a-d5f3-4792-aa43-d212b31b94f6","Type":"ContainerStarted","Data":"678a669a82fb9688c527e6f246b205f5c78ea2b357a6e555e005b9ee390d2100"} Sep 17 03:33:59.222792 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:59.222770 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6534aa76-c13a-44e9-aff3-0406b9a4bac1","Type":"ContainerStarted","Data":"6176ebb9aae1e3a0f3260ef0d10bdeb05ac2de6368060eb300f5333b52f807ae"} Sep 17 03:33:59.238693 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:59.238639 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-57f9c58b65-vvfvb" podStartSLOduration=1.901277607 podStartE2EDuration="3.238621041s" totalImagesPullingTime="1.337343434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:33:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:33:59.237286813 +0000 UTC m=+94.964519971" watchObservedRunningTime="2026-09-17 03:33:59.238621041 +0000 UTC m=+94.965854198" Sep 17 03:33:59.633556 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:59.633526 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:33:59.734827 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:33:59.734780 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:00.228773 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:00.228735 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-s9llc" event={"ID":"1a3eb32a-d5f3-4792-aa43-d212b31b94f6","Type":"ContainerStarted","Data":"356c0e0c263c26ff7cc5ef0056237fa3e5b4002941841e96c62a1b6a64ece28d"} Sep 17 03:34:00.228912 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:00.228803 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-s9llc" Sep 17 03:34:00.230718 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:00.230683 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6534aa76-c13a-44e9-aff3-0406b9a4bac1","Type":"ContainerStarted","Data":"c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb"} Sep 17 03:34:00.234693 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:00.234674 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-s9llc" Sep 17 03:34:00.245398 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:00.245361 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-s9llc" podStartSLOduration=2.971611851 podStartE2EDuration="4.245347008s" totalImagesPullingTime="1.273735157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:33:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:34:00.245028574 +0000 UTC m=+95.972261751" watchObservedRunningTime="2026-09-17 03:34:00.245347008 +0000 UTC m=+95.972580171" Sep 17 03:34:01.235881 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:01.235846 2551 generic.go:356] "Generic (PLEG): container finished" podID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerID="c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb" exitCode=0 Sep 17 03:34:01.236285 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:01.235938 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6534aa76-c13a-44e9-aff3-0406b9a4bac1","Type":"ContainerDied","Data":"c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb"} Sep 17 03:34:01.392430 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:01.392387 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:01.446124 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:01.446099 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:03.100339 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:03.100308 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-t9lsl" Sep 17 03:34:04.546759 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:04.546730 2551 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-749b7f9657-fxq68" podUID="7dc05124-275e-43af-87e5-f2b9d4def851" containerName="registry" containerID="cri-o://b7f4c4b8bb0ee7219fcc164620705d27e8848da40573e3a4c01d4733669b313f" gracePeriod=30 Sep 17 03:34:04.801494 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:04.801261 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:34:04.963110 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:04.963078 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-bound-sa-token\") pod \"7dc05124-275e-43af-87e5-f2b9d4def851\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " Sep 17 03:34:04.963268 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:04.963129 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7dc05124-275e-43af-87e5-f2b9d4def851-installation-pull-secrets\") pod \"7dc05124-275e-43af-87e5-f2b9d4def851\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " Sep 17 03:34:04.963268 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:04.963155 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7dc05124-275e-43af-87e5-f2b9d4def851-image-registry-private-configuration\") pod \"7dc05124-275e-43af-87e5-f2b9d4def851\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " Sep 17 03:34:04.963268 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:04.963182 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7dc05124-275e-43af-87e5-f2b9d4def851-ca-trust-extracted\") pod \"7dc05124-275e-43af-87e5-f2b9d4def851\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " Sep 17 03:34:04.963268 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:04.963201 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8skh9\" (UniqueName: \"kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-kube-api-access-8skh9\") pod \"7dc05124-275e-43af-87e5-f2b9d4def851\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " Sep 17 03:34:04.963268 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:04.963225 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7dc05124-275e-43af-87e5-f2b9d4def851-trusted-ca\") pod \"7dc05124-275e-43af-87e5-f2b9d4def851\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " Sep 17 03:34:04.963268 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:04.963255 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-registry-tls\") pod \"7dc05124-275e-43af-87e5-f2b9d4def851\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " Sep 17 03:34:04.963603 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:04.963278 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7dc05124-275e-43af-87e5-f2b9d4def851-registry-certificates\") pod \"7dc05124-275e-43af-87e5-f2b9d4def851\" (UID: \"7dc05124-275e-43af-87e5-f2b9d4def851\") " Sep 17 03:34:04.963879 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:04.963847 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dc05124-275e-43af-87e5-f2b9d4def851-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7dc05124-275e-43af-87e5-f2b9d4def851" (UID: "7dc05124-275e-43af-87e5-f2b9d4def851"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:34:04.964210 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:04.963992 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dc05124-275e-43af-87e5-f2b9d4def851-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7dc05124-275e-43af-87e5-f2b9d4def851" (UID: "7dc05124-275e-43af-87e5-f2b9d4def851"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:34:04.966024 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:04.965994 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dc05124-275e-43af-87e5-f2b9d4def851-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7dc05124-275e-43af-87e5-f2b9d4def851" (UID: "7dc05124-275e-43af-87e5-f2b9d4def851"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:34:04.966024 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:04.966007 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7dc05124-275e-43af-87e5-f2b9d4def851" (UID: "7dc05124-275e-43af-87e5-f2b9d4def851"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:34:04.966172 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:04.966079 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7dc05124-275e-43af-87e5-f2b9d4def851" (UID: "7dc05124-275e-43af-87e5-f2b9d4def851"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:34:04.966172 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:04.966151 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-kube-api-access-8skh9" (OuterVolumeSpecName: "kube-api-access-8skh9") pod "7dc05124-275e-43af-87e5-f2b9d4def851" (UID: "7dc05124-275e-43af-87e5-f2b9d4def851"). InnerVolumeSpecName "kube-api-access-8skh9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:34:04.966266 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:04.966233 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dc05124-275e-43af-87e5-f2b9d4def851-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7dc05124-275e-43af-87e5-f2b9d4def851" (UID: "7dc05124-275e-43af-87e5-f2b9d4def851"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:34:04.972348 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:04.972324 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dc05124-275e-43af-87e5-f2b9d4def851-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7dc05124-275e-43af-87e5-f2b9d4def851" (UID: "7dc05124-275e-43af-87e5-f2b9d4def851"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:34:05.064426 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:05.064317 2551 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7dc05124-275e-43af-87e5-f2b9d4def851-trusted-ca\") on node \"ip-10-0-143-180.ec2.internal\" DevicePath \"\"" Sep 17 03:34:05.064426 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:05.064352 2551 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-registry-tls\") on node \"ip-10-0-143-180.ec2.internal\" DevicePath \"\"" Sep 17 03:34:05.064426 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:05.064364 2551 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7dc05124-275e-43af-87e5-f2b9d4def851-registry-certificates\") on node \"ip-10-0-143-180.ec2.internal\" DevicePath \"\"" Sep 17 03:34:05.064426 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:05.064375 2551 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-bound-sa-token\") on node \"ip-10-0-143-180.ec2.internal\" DevicePath \"\"" Sep 17 03:34:05.064426 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:05.064388 2551 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7dc05124-275e-43af-87e5-f2b9d4def851-installation-pull-secrets\") on node \"ip-10-0-143-180.ec2.internal\" DevicePath \"\"" Sep 17 03:34:05.064426 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:05.064415 2551 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7dc05124-275e-43af-87e5-f2b9d4def851-image-registry-private-configuration\") on node \"ip-10-0-143-180.ec2.internal\" DevicePath \"\"" Sep 17 03:34:05.064426 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:05.064431 2551 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7dc05124-275e-43af-87e5-f2b9d4def851-ca-trust-extracted\") on node \"ip-10-0-143-180.ec2.internal\" DevicePath \"\"" Sep 17 03:34:05.064738 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:05.064443 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8skh9\" (UniqueName: \"kubernetes.io/projected/7dc05124-275e-43af-87e5-f2b9d4def851-kube-api-access-8skh9\") on node \"ip-10-0-143-180.ec2.internal\" DevicePath \"\"" Sep 17 03:34:05.257646 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:05.257605 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6534aa76-c13a-44e9-aff3-0406b9a4bac1","Type":"ContainerStarted","Data":"c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35"} Sep 17 03:34:05.257816 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:05.257683 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6534aa76-c13a-44e9-aff3-0406b9a4bac1","Type":"ContainerStarted","Data":"fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa"} Sep 17 03:34:05.259010 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:05.258977 2551 generic.go:356] "Generic (PLEG): container finished" podID="7dc05124-275e-43af-87e5-f2b9d4def851" containerID="b7f4c4b8bb0ee7219fcc164620705d27e8848da40573e3a4c01d4733669b313f" exitCode=0 Sep 17 03:34:05.259155 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:05.259014 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-749b7f9657-fxq68" Sep 17 03:34:05.259155 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:05.259041 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-749b7f9657-fxq68" event={"ID":"7dc05124-275e-43af-87e5-f2b9d4def851","Type":"ContainerDied","Data":"b7f4c4b8bb0ee7219fcc164620705d27e8848da40573e3a4c01d4733669b313f"} Sep 17 03:34:05.259155 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:05.259082 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-749b7f9657-fxq68" event={"ID":"7dc05124-275e-43af-87e5-f2b9d4def851","Type":"ContainerDied","Data":"b36f1cf28e4b779198b3e08e910feefcd5b0a45d8a460500793fd64599c7f91d"} Sep 17 03:34:05.259155 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:05.259109 2551 scope.go:117] "RemoveContainer" containerID="b7f4c4b8bb0ee7219fcc164620705d27e8848da40573e3a4c01d4733669b313f" Sep 17 03:34:05.269239 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:05.269210 2551 scope.go:117] "RemoveContainer" containerID="b7f4c4b8bb0ee7219fcc164620705d27e8848da40573e3a4c01d4733669b313f" Sep 17 03:34:05.269567 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:34:05.269534 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7f4c4b8bb0ee7219fcc164620705d27e8848da40573e3a4c01d4733669b313f\": container with ID starting with b7f4c4b8bb0ee7219fcc164620705d27e8848da40573e3a4c01d4733669b313f not found: ID does not exist" containerID="b7f4c4b8bb0ee7219fcc164620705d27e8848da40573e3a4c01d4733669b313f" Sep 17 03:34:05.269681 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:05.269577 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7f4c4b8bb0ee7219fcc164620705d27e8848da40573e3a4c01d4733669b313f"} err="failed to get container status \"b7f4c4b8bb0ee7219fcc164620705d27e8848da40573e3a4c01d4733669b313f\": rpc error: code = NotFound desc = could not find container \"b7f4c4b8bb0ee7219fcc164620705d27e8848da40573e3a4c01d4733669b313f\": container with ID starting with b7f4c4b8bb0ee7219fcc164620705d27e8848da40573e3a4c01d4733669b313f not found: ID does not exist" Sep 17 03:34:05.283500 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:05.283473 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-749b7f9657-fxq68"] Sep 17 03:34:05.287218 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:05.287195 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-749b7f9657-fxq68"] Sep 17 03:34:05.598440 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:05.598389 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:05.694931 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:05.694894 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:05.879624 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:05.879559 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:06.324513 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:06.324468 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:06.424020 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:06.423984 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:06.658543 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:06.658446 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:06.757817 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:06.757783 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:06.770624 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:06.768369 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dc05124-275e-43af-87e5-f2b9d4def851" path="/var/lib/kubelet/pods/7dc05124-275e-43af-87e5-f2b9d4def851/volumes" Sep 17 03:34:07.270605 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:07.270559 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:07.272865 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:07.272842 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6534aa76-c13a-44e9-aff3-0406b9a4bac1","Type":"ContainerStarted","Data":"0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30"} Sep 17 03:34:07.272950 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:07.272900 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6534aa76-c13a-44e9-aff3-0406b9a4bac1","Type":"ContainerStarted","Data":"d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3"} Sep 17 03:34:07.272950 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:07.272927 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6534aa76-c13a-44e9-aff3-0406b9a4bac1","Type":"ContainerStarted","Data":"78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002"} Sep 17 03:34:07.478246 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:07.478214 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:07.814595 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:07.814503 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:08.279780 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:08.279747 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6534aa76-c13a-44e9-aff3-0406b9a4bac1","Type":"ContainerStarted","Data":"84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d"} Sep 17 03:34:08.288927 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:08.288904 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:08.310478 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:08.310379 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.722880848 podStartE2EDuration="10.31036316s" totalImagesPullingTime="6.562682502s" totalInitContainerRuntime="24.79981ms" isStatefulPod=false podCreationTimestamp="2026-09-17 03:33:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:34:08.307836344 +0000 UTC m=+104.035069501" watchObservedRunningTime="2026-09-17 03:34:08.31036316 +0000 UTC m=+104.037596363" Sep 17 03:34:08.350571 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:08.350546 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:08.710438 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:08.710383 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:13.158804 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:13.158767 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:13.258576 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:13.258534 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:14.928655 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:14.928612 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:15.036890 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:15.036862 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:16.733866 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:16.733826 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-57f9c58b65-vvfvb" Sep 17 03:34:16.734250 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:16.733921 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-57f9c58b65-vvfvb" Sep 17 03:34:18.871373 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:18.871342 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:20.493825 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:20.493783 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:20.550244 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:20.550216 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:22.191977 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:22.191944 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:22.247318 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:22.247286 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:24.089868 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:24.089827 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:24.144331 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:24.144303 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:25.364643 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:25.364586 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6w5pf_9c6d07b9-4073-4582-ad02-c6979ac3a0ca/serve-healthcheck-canary/0.log" Sep 17 03:34:25.853671 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:25.853635 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:25.961622 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:25.961593 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:26.062822 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:26.062782 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:27.498473 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:27.498441 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:27.560184 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:27.560154 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:28.896924 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:28.896864 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:28.953828 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:28.953797 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:32.493973 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:32.493933 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:32.550129 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:32.550069 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:33.492698 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:33.492672 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:33.549305 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:33.549253 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:36.743235 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:36.743207 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-57f9c58b65-vvfvb" Sep 17 03:34:36.747369 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:36.747344 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-57f9c58b65-vvfvb" Sep 17 03:34:37.177865 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:37.177827 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:37.277672 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:37.277629 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:40.407385 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:40.407354 2551 generic.go:356] "Generic (PLEG): container finished" podID="80df0c88-0ab2-482f-bd76-d757451830fb" containerID="b967967e62c996e967374da2378b36ed5ee86e7c8bbe242aaedd2e61e2da9628" exitCode=0 Sep 17 03:34:40.407829 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:40.407390 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-6bzcs" event={"ID":"80df0c88-0ab2-482f-bd76-d757451830fb","Type":"ContainerDied","Data":"b967967e62c996e967374da2378b36ed5ee86e7c8bbe242aaedd2e61e2da9628"} Sep 17 03:34:40.407829 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:40.407794 2551 scope.go:117] "RemoveContainer" containerID="b967967e62c996e967374da2378b36ed5ee86e7c8bbe242aaedd2e61e2da9628" Sep 17 03:34:41.413127 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:41.413096 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-6bzcs" event={"ID":"80df0c88-0ab2-482f-bd76-d757451830fb","Type":"ContainerStarted","Data":"2b5f58db55e27b7aa6cac1c6052ef08f7a411c89ea98c08aef15d2f267e0a6f6"} Sep 17 03:34:44.399601 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:44.399566 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:44.499194 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:44.499161 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:34:46.433553 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:46.433518 2551 generic.go:356] "Generic (PLEG): container finished" podID="e0116b6b-a212-4bca-9993-4b5e4c91a2bf" containerID="3f3fac08c9db3dbb27198f323cd841297f40e32ee9649ed39ed5f8f543163a5a" exitCode=0 Sep 17 03:34:46.433923 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:46.433578 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jq242" event={"ID":"e0116b6b-a212-4bca-9993-4b5e4c91a2bf","Type":"ContainerDied","Data":"3f3fac08c9db3dbb27198f323cd841297f40e32ee9649ed39ed5f8f543163a5a"} Sep 17 03:34:46.433923 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:46.433881 2551 scope.go:117] "RemoveContainer" containerID="3f3fac08c9db3dbb27198f323cd841297f40e32ee9649ed39ed5f8f543163a5a" Sep 17 03:34:47.438720 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:47.438683 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-jq242" event={"ID":"e0116b6b-a212-4bca-9993-4b5e4c91a2bf","Type":"ContainerStarted","Data":"e03906641ce740fe914106482476679a8ac9a332b003ec85a45d4b8468b0e558"} Sep 17 03:34:58.710840 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:58.710803 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:58.729824 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:58.729795 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:34:59.500619 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:34:59.500592 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:11.320369 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:11.320338 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:35:11.608784 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:11.608705 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:35:16.678766 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:16.678727 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 03:35:16.679351 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:16.678994 2551 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerName="prometheus" containerID="cri-o://fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa" gracePeriod=600 Sep 17 03:35:16.679351 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:16.679014 2551 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerName="kube-rbac-proxy" containerID="cri-o://0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30" gracePeriod=600 Sep 17 03:35:16.679351 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:16.679050 2551 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerName="config-reloader" containerID="cri-o://c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35" gracePeriod=600 Sep 17 03:35:16.679351 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:16.679068 2551 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerName="kube-rbac-proxy-web" containerID="cri-o://d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3" gracePeriod=600 Sep 17 03:35:16.679351 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:16.679028 2551 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerName="thanos-sidecar" containerID="cri-o://78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002" gracePeriod=600 Sep 17 03:35:16.679351 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:16.679171 2551 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerName="kube-rbac-proxy-thanos" containerID="cri-o://84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d" gracePeriod=600 Sep 17 03:35:16.931793 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:16.931727 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.053977 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.051389 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6534aa76-c13a-44e9-aff3-0406b9a4bac1-tls-assets\") pod \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " Sep 17 03:35:17.053977 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.051478 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6534aa76-c13a-44e9-aff3-0406b9a4bac1-prometheus-k8s-db\") pod \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " Sep 17 03:35:17.053977 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.051516 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6534aa76-c13a-44e9-aff3-0406b9a4bac1-config-out\") pod \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " Sep 17 03:35:17.053977 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.051559 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-configmap-serving-certs-ca-bundle\") pod \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " Sep 17 03:35:17.053977 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.051593 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-prometheus-k8s-rulefiles-1\") pod \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " Sep 17 03:35:17.053977 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.051621 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fhmf\" (UniqueName: \"kubernetes.io/projected/6534aa76-c13a-44e9-aff3-0406b9a4bac1-kube-api-access-6fhmf\") pod \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " Sep 17 03:35:17.053977 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.051656 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " Sep 17 03:35:17.053977 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.051693 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-grpc-tls\") pod \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " Sep 17 03:35:17.053977 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.051720 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-thanos-prometheus-http-client-file\") pod \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " Sep 17 03:35:17.053977 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.051755 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-prometheus-k8s-rulefiles-0\") pod \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " Sep 17 03:35:17.053977 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.051785 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-web-config\") pod \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " Sep 17 03:35:17.053977 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.051827 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-kube-rbac-proxy\") pod \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " Sep 17 03:35:17.053977 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.051867 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-configmap-kubelet-serving-ca-bundle\") pod \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " Sep 17 03:35:17.053977 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.051920 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-configmap-metrics-client-ca\") pod \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " Sep 17 03:35:17.053977 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.051964 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-prometheus-k8s-rulefiles-2\") pod \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " Sep 17 03:35:17.053977 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.051970 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "6534aa76-c13a-44e9-aff3-0406b9a4bac1" (UID: "6534aa76-c13a-44e9-aff3-0406b9a4bac1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:35:17.053977 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.052014 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-prometheus-trusted-ca-bundle\") pod \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " Sep 17 03:35:17.053977 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.052182 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-config\") pod \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " Sep 17 03:35:17.054973 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.052256 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-metrics-client-certs\") pod \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " Sep 17 03:35:17.054973 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.052286 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-prometheus-k8s-tls\") pod \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " Sep 17 03:35:17.054973 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.052480 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\" (UID: \"6534aa76-c13a-44e9-aff3-0406b9a4bac1\") " Sep 17 03:35:17.054973 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.052911 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6534aa76-c13a-44e9-aff3-0406b9a4bac1-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "6534aa76-c13a-44e9-aff3-0406b9a4bac1" (UID: "6534aa76-c13a-44e9-aff3-0406b9a4bac1"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:35:17.054973 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.053333 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "6534aa76-c13a-44e9-aff3-0406b9a4bac1" (UID: "6534aa76-c13a-44e9-aff3-0406b9a4bac1"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:35:17.054973 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.053334 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "6534aa76-c13a-44e9-aff3-0406b9a4bac1" (UID: "6534aa76-c13a-44e9-aff3-0406b9a4bac1"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:35:17.054973 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.054574 2551 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6534aa76-c13a-44e9-aff3-0406b9a4bac1-prometheus-k8s-db\") on node \"ip-10-0-143-180.ec2.internal\" DevicePath \"\"" Sep 17 03:35:17.054973 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.054610 2551 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-180.ec2.internal\" DevicePath \"\"" Sep 17 03:35:17.054973 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.054629 2551 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-180.ec2.internal\" DevicePath \"\"" Sep 17 03:35:17.056546 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.056192 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "6534aa76-c13a-44e9-aff3-0406b9a4bac1" (UID: "6534aa76-c13a-44e9-aff3-0406b9a4bac1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:35:17.056668 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.056539 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6534aa76-c13a-44e9-aff3-0406b9a4bac1-config-out" (OuterVolumeSpecName: "config-out") pod "6534aa76-c13a-44e9-aff3-0406b9a4bac1" (UID: "6534aa76-c13a-44e9-aff3-0406b9a4bac1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:35:17.056668 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.056599 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "6534aa76-c13a-44e9-aff3-0406b9a4bac1" (UID: "6534aa76-c13a-44e9-aff3-0406b9a4bac1"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:35:17.056668 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.056616 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "6534aa76-c13a-44e9-aff3-0406b9a4bac1" (UID: "6534aa76-c13a-44e9-aff3-0406b9a4bac1"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:35:17.056818 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.056682 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "6534aa76-c13a-44e9-aff3-0406b9a4bac1" (UID: "6534aa76-c13a-44e9-aff3-0406b9a4bac1"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:35:17.056988 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.056956 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "6534aa76-c13a-44e9-aff3-0406b9a4bac1" (UID: "6534aa76-c13a-44e9-aff3-0406b9a4bac1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:35:17.057594 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.057562 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "6534aa76-c13a-44e9-aff3-0406b9a4bac1" (UID: "6534aa76-c13a-44e9-aff3-0406b9a4bac1"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:35:17.057698 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.057602 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "6534aa76-c13a-44e9-aff3-0406b9a4bac1" (UID: "6534aa76-c13a-44e9-aff3-0406b9a4bac1"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 03:35:17.059245 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.059211 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "6534aa76-c13a-44e9-aff3-0406b9a4bac1" (UID: "6534aa76-c13a-44e9-aff3-0406b9a4bac1"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:35:17.059453 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.059424 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "6534aa76-c13a-44e9-aff3-0406b9a4bac1" (UID: "6534aa76-c13a-44e9-aff3-0406b9a4bac1"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:35:17.059542 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.059441 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6534aa76-c13a-44e9-aff3-0406b9a4bac1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6534aa76-c13a-44e9-aff3-0406b9a4bac1" (UID: "6534aa76-c13a-44e9-aff3-0406b9a4bac1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:35:17.059542 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.059471 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-config" (OuterVolumeSpecName: "config") pod "6534aa76-c13a-44e9-aff3-0406b9a4bac1" (UID: "6534aa76-c13a-44e9-aff3-0406b9a4bac1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:35:17.059542 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.059512 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "6534aa76-c13a-44e9-aff3-0406b9a4bac1" (UID: "6534aa76-c13a-44e9-aff3-0406b9a4bac1"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:35:17.061210 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.061008 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "6534aa76-c13a-44e9-aff3-0406b9a4bac1" (UID: "6534aa76-c13a-44e9-aff3-0406b9a4bac1"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:35:17.061210 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.061038 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6534aa76-c13a-44e9-aff3-0406b9a4bac1-kube-api-access-6fhmf" (OuterVolumeSpecName: "kube-api-access-6fhmf") pod "6534aa76-c13a-44e9-aff3-0406b9a4bac1" (UID: "6534aa76-c13a-44e9-aff3-0406b9a4bac1"). InnerVolumeSpecName "kube-api-access-6fhmf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:35:17.071879 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.071860 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-web-config" (OuterVolumeSpecName: "web-config") pod "6534aa76-c13a-44e9-aff3-0406b9a4bac1" (UID: "6534aa76-c13a-44e9-aff3-0406b9a4bac1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 03:35:17.155080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.155052 2551 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-kube-rbac-proxy\") on node \"ip-10-0-143-180.ec2.internal\" DevicePath \"\"" Sep 17 03:35:17.155080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.155074 2551 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-configmap-metrics-client-ca\") on node \"ip-10-0-143-180.ec2.internal\" DevicePath \"\"" Sep 17 03:35:17.155080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.155084 2551 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-180.ec2.internal\" DevicePath \"\"" Sep 17 03:35:17.155230 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.155093 2551 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-180.ec2.internal\" DevicePath \"\"" Sep 17 03:35:17.155230 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.155103 2551 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-config\") on node \"ip-10-0-143-180.ec2.internal\" DevicePath \"\"" Sep 17 03:35:17.155230 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.155111 2551 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-metrics-client-certs\") on node \"ip-10-0-143-180.ec2.internal\" DevicePath \"\"" Sep 17 03:35:17.155230 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.155120 2551 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-180.ec2.internal\" DevicePath \"\"" Sep 17 03:35:17.155230 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.155130 2551 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-180.ec2.internal\" DevicePath \"\"" Sep 17 03:35:17.155230 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.155139 2551 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6534aa76-c13a-44e9-aff3-0406b9a4bac1-tls-assets\") on node \"ip-10-0-143-180.ec2.internal\" DevicePath \"\"" Sep 17 03:35:17.155230 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.155147 2551 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6534aa76-c13a-44e9-aff3-0406b9a4bac1-config-out\") on node \"ip-10-0-143-180.ec2.internal\" DevicePath \"\"" Sep 17 03:35:17.155230 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.155155 2551 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-180.ec2.internal\" DevicePath \"\"" Sep 17 03:35:17.155230 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.155162 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fhmf\" (UniqueName: \"kubernetes.io/projected/6534aa76-c13a-44e9-aff3-0406b9a4bac1-kube-api-access-6fhmf\") on node \"ip-10-0-143-180.ec2.internal\" DevicePath \"\"" Sep 17 03:35:17.155230 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.155171 2551 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-180.ec2.internal\" DevicePath \"\"" Sep 17 03:35:17.155230 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.155179 2551 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-secret-grpc-tls\") on node \"ip-10-0-143-180.ec2.internal\" DevicePath \"\"" Sep 17 03:35:17.155230 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.155187 2551 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-180.ec2.internal\" DevicePath \"\"" Sep 17 03:35:17.155230 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.155194 2551 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6534aa76-c13a-44e9-aff3-0406b9a4bac1-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-180.ec2.internal\" DevicePath \"\"" Sep 17 03:35:17.155230 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.155202 2551 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6534aa76-c13a-44e9-aff3-0406b9a4bac1-web-config\") on node \"ip-10-0-143-180.ec2.internal\" DevicePath \"\"" Sep 17 03:35:17.557197 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.557166 2551 generic.go:356] "Generic (PLEG): container finished" podID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerID="84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d" exitCode=0 Sep 17 03:35:17.557197 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.557190 2551 generic.go:356] "Generic (PLEG): container finished" podID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerID="0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30" exitCode=0 Sep 17 03:35:17.557197 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.557196 2551 generic.go:356] "Generic (PLEG): container finished" podID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerID="d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3" exitCode=0 Sep 17 03:35:17.557197 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.557202 2551 generic.go:356] "Generic (PLEG): container finished" podID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerID="78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002" exitCode=0 Sep 17 03:35:17.557560 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.557207 2551 generic.go:356] "Generic (PLEG): container finished" podID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerID="c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35" exitCode=0 Sep 17 03:35:17.557560 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.557214 2551 generic.go:356] "Generic (PLEG): container finished" podID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerID="fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa" exitCode=0 Sep 17 03:35:17.557560 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.557246 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6534aa76-c13a-44e9-aff3-0406b9a4bac1","Type":"ContainerDied","Data":"84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d"} Sep 17 03:35:17.557560 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.557276 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.557560 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.557377 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6534aa76-c13a-44e9-aff3-0406b9a4bac1","Type":"ContainerDied","Data":"0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30"} Sep 17 03:35:17.557560 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.557419 2551 scope.go:117] "RemoveContainer" containerID="84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d" Sep 17 03:35:17.557560 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.557443 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6534aa76-c13a-44e9-aff3-0406b9a4bac1","Type":"ContainerDied","Data":"d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3"} Sep 17 03:35:17.557560 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.557487 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6534aa76-c13a-44e9-aff3-0406b9a4bac1","Type":"ContainerDied","Data":"78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002"} Sep 17 03:35:17.557560 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.557529 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6534aa76-c13a-44e9-aff3-0406b9a4bac1","Type":"ContainerDied","Data":"c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35"} Sep 17 03:35:17.557956 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.557568 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6534aa76-c13a-44e9-aff3-0406b9a4bac1","Type":"ContainerDied","Data":"fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa"} Sep 17 03:35:17.557956 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.557607 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6534aa76-c13a-44e9-aff3-0406b9a4bac1","Type":"ContainerDied","Data":"6176ebb9aae1e3a0f3260ef0d10bdeb05ac2de6368060eb300f5333b52f807ae"} Sep 17 03:35:17.566080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.566056 2551 scope.go:117] "RemoveContainer" containerID="0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30" Sep 17 03:35:17.572890 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.572875 2551 scope.go:117] "RemoveContainer" containerID="d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3" Sep 17 03:35:17.579803 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.579786 2551 scope.go:117] "RemoveContainer" containerID="78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002" Sep 17 03:35:17.582379 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.582360 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 03:35:17.587516 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.587498 2551 scope.go:117] "RemoveContainer" containerID="c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35" Sep 17 03:35:17.588173 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.588150 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 03:35:17.596313 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.596294 2551 scope.go:117] "RemoveContainer" containerID="fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa" Sep 17 03:35:17.603718 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.603698 2551 scope.go:117] "RemoveContainer" containerID="c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb" Sep 17 03:35:17.610003 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.609986 2551 scope.go:117] "RemoveContainer" containerID="84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d" Sep 17 03:35:17.610253 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:35:17.610235 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d\": container with ID starting with 84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d not found: ID does not exist" containerID="84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d" Sep 17 03:35:17.610292 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.610261 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d"} err="failed to get container status \"84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d\": rpc error: code = NotFound desc = could not find container \"84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d\": container with ID starting with 84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d not found: ID does not exist" Sep 17 03:35:17.610292 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.610280 2551 scope.go:117] "RemoveContainer" containerID="0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30" Sep 17 03:35:17.610557 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:35:17.610539 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30\": container with ID starting with 0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30 not found: ID does not exist" containerID="0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30" Sep 17 03:35:17.610613 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.610563 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30"} err="failed to get container status \"0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30\": rpc error: code = NotFound desc = could not find container \"0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30\": container with ID starting with 0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30 not found: ID does not exist" Sep 17 03:35:17.610613 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.610578 2551 scope.go:117] "RemoveContainer" containerID="d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3" Sep 17 03:35:17.610804 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:35:17.610790 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3\": container with ID starting with d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3 not found: ID does not exist" containerID="d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3" Sep 17 03:35:17.610845 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.610809 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3"} err="failed to get container status \"d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3\": rpc error: code = NotFound desc = could not find container \"d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3\": container with ID starting with d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3 not found: ID does not exist" Sep 17 03:35:17.610845 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.610821 2551 scope.go:117] "RemoveContainer" containerID="78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002" Sep 17 03:35:17.611032 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:35:17.611016 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002\": container with ID starting with 78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002 not found: ID does not exist" containerID="78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002" Sep 17 03:35:17.611073 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.611036 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002"} err="failed to get container status \"78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002\": rpc error: code = NotFound desc = could not find container \"78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002\": container with ID starting with 78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002 not found: ID does not exist" Sep 17 03:35:17.611073 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.611049 2551 scope.go:117] "RemoveContainer" containerID="c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35" Sep 17 03:35:17.611354 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:35:17.611332 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35\": container with ID starting with c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35 not found: ID does not exist" containerID="c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35" Sep 17 03:35:17.611476 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.611359 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35"} err="failed to get container status \"c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35\": rpc error: code = NotFound desc = could not find container \"c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35\": container with ID starting with c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35 not found: ID does not exist" Sep 17 03:35:17.611476 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.611377 2551 scope.go:117] "RemoveContainer" containerID="fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa" Sep 17 03:35:17.611778 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:35:17.611751 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa\": container with ID starting with fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa not found: ID does not exist" containerID="fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa" Sep 17 03:35:17.611878 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.611782 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa"} err="failed to get container status \"fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa\": rpc error: code = NotFound desc = could not find container \"fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa\": container with ID starting with fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa not found: ID does not exist" Sep 17 03:35:17.611878 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.611806 2551 scope.go:117] "RemoveContainer" containerID="c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb" Sep 17 03:35:17.612184 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:35:17.612131 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb\": container with ID starting with c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb not found: ID does not exist" containerID="c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb" Sep 17 03:35:17.612184 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.612156 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb"} err="failed to get container status \"c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb\": rpc error: code = NotFound desc = could not find container \"c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb\": container with ID starting with c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb not found: ID does not exist" Sep 17 03:35:17.612184 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.612176 2551 scope.go:117] "RemoveContainer" containerID="84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d" Sep 17 03:35:17.612513 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.612479 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d"} err="failed to get container status \"84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d\": rpc error: code = NotFound desc = could not find container \"84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d\": container with ID starting with 84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d not found: ID does not exist" Sep 17 03:35:17.612574 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.612515 2551 scope.go:117] "RemoveContainer" containerID="0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30" Sep 17 03:35:17.612784 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.612763 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30"} err="failed to get container status \"0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30\": rpc error: code = NotFound desc = could not find container \"0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30\": container with ID starting with 0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30 not found: ID does not exist" Sep 17 03:35:17.612874 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.612786 2551 scope.go:117] "RemoveContainer" containerID="d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3" Sep 17 03:35:17.613054 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613035 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3"} err="failed to get container status \"d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3\": rpc error: code = NotFound desc = could not find container \"d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3\": container with ID starting with d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3 not found: ID does not exist" Sep 17 03:35:17.613096 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613055 2551 scope.go:117] "RemoveContainer" containerID="78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002" Sep 17 03:35:17.613273 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613253 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 03:35:17.613365 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613289 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002"} err="failed to get container status \"78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002\": rpc error: code = NotFound desc = could not find container \"78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002\": container with ID starting with 78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002 not found: ID does not exist" Sep 17 03:35:17.613365 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613305 2551 scope.go:117] "RemoveContainer" containerID="c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35" Sep 17 03:35:17.613568 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613556 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerName="kube-rbac-proxy" Sep 17 03:35:17.613612 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613570 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerName="kube-rbac-proxy" Sep 17 03:35:17.613612 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613569 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35"} err="failed to get container status \"c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35\": rpc error: code = NotFound desc = could not find container \"c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35\": container with ID starting with c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35 not found: ID does not exist" Sep 17 03:35:17.613612 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613579 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerName="kube-rbac-proxy-thanos" Sep 17 03:35:17.613612 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613582 2551 scope.go:117] "RemoveContainer" containerID="fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa" Sep 17 03:35:17.613759 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613584 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerName="kube-rbac-proxy-thanos" Sep 17 03:35:17.613759 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613630 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerName="config-reloader" Sep 17 03:35:17.613759 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613638 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerName="config-reloader" Sep 17 03:35:17.613759 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613648 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dc05124-275e-43af-87e5-f2b9d4def851" containerName="registry" Sep 17 03:35:17.613759 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613654 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dc05124-275e-43af-87e5-f2b9d4def851" containerName="registry" Sep 17 03:35:17.613759 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613663 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerName="init-config-reloader" Sep 17 03:35:17.613759 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613671 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerName="init-config-reloader" Sep 17 03:35:17.613759 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613680 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerName="prometheus" Sep 17 03:35:17.613759 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613689 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerName="prometheus" Sep 17 03:35:17.613759 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613710 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerName="thanos-sidecar" Sep 17 03:35:17.613759 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613718 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerName="thanos-sidecar" Sep 17 03:35:17.613759 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613728 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerName="kube-rbac-proxy-web" Sep 17 03:35:17.613759 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613736 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerName="kube-rbac-proxy-web" Sep 17 03:35:17.614156 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613822 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerName="kube-rbac-proxy-web" Sep 17 03:35:17.614156 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613831 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerName="prometheus" Sep 17 03:35:17.614156 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613837 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dc05124-275e-43af-87e5-f2b9d4def851" containerName="registry" Sep 17 03:35:17.614156 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613844 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerName="config-reloader" Sep 17 03:35:17.614156 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613849 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerName="kube-rbac-proxy" Sep 17 03:35:17.614156 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613855 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerName="thanos-sidecar" Sep 17 03:35:17.614156 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613861 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" containerName="kube-rbac-proxy-thanos" Sep 17 03:35:17.614156 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613856 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa"} err="failed to get container status \"fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa\": rpc error: code = NotFound desc = could not find container \"fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa\": container with ID starting with fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa not found: ID does not exist" Sep 17 03:35:17.614156 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.613938 2551 scope.go:117] "RemoveContainer" containerID="c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb" Sep 17 03:35:17.614156 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.614127 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb"} err="failed to get container status \"c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb\": rpc error: code = NotFound desc = could not find container \"c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb\": container with ID starting with c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb not found: ID does not exist" Sep 17 03:35:17.614156 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.614142 2551 scope.go:117] "RemoveContainer" containerID="84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d" Sep 17 03:35:17.614517 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.614381 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d"} err="failed to get container status \"84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d\": rpc error: code = NotFound desc = could not find container \"84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d\": container with ID starting with 84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d not found: ID does not exist" Sep 17 03:35:17.614517 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.614394 2551 scope.go:117] "RemoveContainer" containerID="0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30" Sep 17 03:35:17.614616 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.614599 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30"} err="failed to get container status \"0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30\": rpc error: code = NotFound desc = could not find container \"0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30\": container with ID starting with 0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30 not found: ID does not exist" Sep 17 03:35:17.614658 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.614618 2551 scope.go:117] "RemoveContainer" containerID="d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3" Sep 17 03:35:17.614857 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.614838 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3"} err="failed to get container status \"d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3\": rpc error: code = NotFound desc = could not find container \"d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3\": container with ID starting with d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3 not found: ID does not exist" Sep 17 03:35:17.614918 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.614859 2551 scope.go:117] "RemoveContainer" containerID="78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002" Sep 17 03:35:17.615104 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.615087 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002"} err="failed to get container status \"78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002\": rpc error: code = NotFound desc = could not find container \"78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002\": container with ID starting with 78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002 not found: ID does not exist" Sep 17 03:35:17.615104 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.615104 2551 scope.go:117] "RemoveContainer" containerID="c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35" Sep 17 03:35:17.615326 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.615310 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35"} err="failed to get container status \"c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35\": rpc error: code = NotFound desc = could not find container \"c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35\": container with ID starting with c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35 not found: ID does not exist" Sep 17 03:35:17.615365 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.615327 2551 scope.go:117] "RemoveContainer" containerID="fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa" Sep 17 03:35:17.615573 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.615555 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa"} err="failed to get container status \"fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa\": rpc error: code = NotFound desc = could not find container \"fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa\": container with ID starting with fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa not found: ID does not exist" Sep 17 03:35:17.615635 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.615573 2551 scope.go:117] "RemoveContainer" containerID="c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb" Sep 17 03:35:17.615835 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.615814 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb"} err="failed to get container status \"c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb\": rpc error: code = NotFound desc = could not find container \"c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb\": container with ID starting with c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb not found: ID does not exist" Sep 17 03:35:17.615835 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.615833 2551 scope.go:117] "RemoveContainer" containerID="84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d" Sep 17 03:35:17.616118 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.616094 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d"} err="failed to get container status \"84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d\": rpc error: code = NotFound desc = could not find container \"84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d\": container with ID starting with 84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d not found: ID does not exist" Sep 17 03:35:17.616201 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.616119 2551 scope.go:117] "RemoveContainer" containerID="0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30" Sep 17 03:35:17.616439 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.616395 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30"} err="failed to get container status \"0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30\": rpc error: code = NotFound desc = could not find container \"0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30\": container with ID starting with 0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30 not found: ID does not exist" Sep 17 03:35:17.616494 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.616442 2551 scope.go:117] "RemoveContainer" containerID="d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3" Sep 17 03:35:17.616679 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.616663 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3"} err="failed to get container status \"d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3\": rpc error: code = NotFound desc = could not find container \"d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3\": container with ID starting with d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3 not found: ID does not exist" Sep 17 03:35:17.616733 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.616680 2551 scope.go:117] "RemoveContainer" containerID="78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002" Sep 17 03:35:17.616938 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.616917 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002"} err="failed to get container status \"78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002\": rpc error: code = NotFound desc = could not find container \"78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002\": container with ID starting with 78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002 not found: ID does not exist" Sep 17 03:35:17.616992 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.616940 2551 scope.go:117] "RemoveContainer" containerID="c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35" Sep 17 03:35:17.617226 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.617199 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35"} err="failed to get container status \"c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35\": rpc error: code = NotFound desc = could not find container \"c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35\": container with ID starting with c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35 not found: ID does not exist" Sep 17 03:35:17.617226 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.617221 2551 scope.go:117] "RemoveContainer" containerID="fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa" Sep 17 03:35:17.617583 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.617558 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa"} err="failed to get container status \"fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa\": rpc error: code = NotFound desc = could not find container \"fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa\": container with ID starting with fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa not found: ID does not exist" Sep 17 03:35:17.617583 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.617582 2551 scope.go:117] "RemoveContainer" containerID="c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb" Sep 17 03:35:17.617841 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.617823 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb"} err="failed to get container status \"c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb\": rpc error: code = NotFound desc = could not find container \"c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb\": container with ID starting with c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb not found: ID does not exist" Sep 17 03:35:17.617919 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.617842 2551 scope.go:117] "RemoveContainer" containerID="84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d" Sep 17 03:35:17.618089 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.618074 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d"} err="failed to get container status \"84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d\": rpc error: code = NotFound desc = could not find container \"84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d\": container with ID starting with 84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d not found: ID does not exist" Sep 17 03:35:17.618135 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.618090 2551 scope.go:117] "RemoveContainer" containerID="0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30" Sep 17 03:35:17.618309 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.618289 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30"} err="failed to get container status \"0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30\": rpc error: code = NotFound desc = could not find container \"0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30\": container with ID starting with 0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30 not found: ID does not exist" Sep 17 03:35:17.618378 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.618310 2551 scope.go:117] "RemoveContainer" containerID="d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3" Sep 17 03:35:17.618606 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.618586 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3"} err="failed to get container status \"d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3\": rpc error: code = NotFound desc = could not find container \"d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3\": container with ID starting with d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3 not found: ID does not exist" Sep 17 03:35:17.618659 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.618606 2551 scope.go:117] "RemoveContainer" containerID="78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002" Sep 17 03:35:17.618851 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.618828 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002"} err="failed to get container status \"78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002\": rpc error: code = NotFound desc = could not find container \"78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002\": container with ID starting with 78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002 not found: ID does not exist" Sep 17 03:35:17.618901 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.618852 2551 scope.go:117] "RemoveContainer" containerID="c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35" Sep 17 03:35:17.619090 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.619069 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35"} err="failed to get container status \"c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35\": rpc error: code = NotFound desc = could not find container \"c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35\": container with ID starting with c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35 not found: ID does not exist" Sep 17 03:35:17.619090 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.619089 2551 scope.go:117] "RemoveContainer" containerID="fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa" Sep 17 03:35:17.619225 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.619131 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.619338 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.619319 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa"} err="failed to get container status \"fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa\": rpc error: code = NotFound desc = could not find container \"fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa\": container with ID starting with fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa not found: ID does not exist" Sep 17 03:35:17.619338 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.619336 2551 scope.go:117] "RemoveContainer" containerID="c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb" Sep 17 03:35:17.619738 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.619718 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb"} err="failed to get container status \"c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb\": rpc error: code = NotFound desc = could not find container \"c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb\": container with ID starting with c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb not found: ID does not exist" Sep 17 03:35:17.619738 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.619739 2551 scope.go:117] "RemoveContainer" containerID="84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d" Sep 17 03:35:17.619996 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.619977 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d"} err="failed to get container status \"84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d\": rpc error: code = NotFound desc = could not find container \"84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d\": container with ID starting with 84dd2156cbb8d920404f8bcf369719c0bc51e02a557cc90a86b721a477b5f23d not found: ID does not exist" Sep 17 03:35:17.620061 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.619998 2551 scope.go:117] "RemoveContainer" containerID="0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30" Sep 17 03:35:17.620297 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.620278 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30"} err="failed to get container status \"0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30\": rpc error: code = NotFound desc = could not find container \"0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30\": container with ID starting with 0c6514fcdfa0a3d324262f7b3b21bbd6b82cbbf16791dba856c0c2df629dbc30 not found: ID does not exist" Sep 17 03:35:17.620297 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.620296 2551 scope.go:117] "RemoveContainer" containerID="d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3" Sep 17 03:35:17.620593 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.620558 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3"} err="failed to get container status \"d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3\": rpc error: code = NotFound desc = could not find container \"d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3\": container with ID starting with d343531edb68d76d5e57bbe0d5730ce6159adb2d2e96f2ee7ad885e420a10be3 not found: ID does not exist" Sep 17 03:35:17.620593 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.620592 2551 scope.go:117] "RemoveContainer" containerID="78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002" Sep 17 03:35:17.620899 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.620878 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002"} err="failed to get container status \"78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002\": rpc error: code = NotFound desc = could not find container \"78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002\": container with ID starting with 78933b1c99bd2fb67dfab181e664f85cc0fa18682f46638b28539bf622852002 not found: ID does not exist" Sep 17 03:35:17.620899 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.620898 2551 scope.go:117] "RemoveContainer" containerID="c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35" Sep 17 03:35:17.621190 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.621165 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35"} err="failed to get container status \"c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35\": rpc error: code = NotFound desc = could not find container \"c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35\": container with ID starting with c39f1da91b0930eb417d540510503f49e8db5cc01c550351025f0424433c7c35 not found: ID does not exist" Sep 17 03:35:17.621239 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.621192 2551 scope.go:117] "RemoveContainer" containerID="fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa" Sep 17 03:35:17.621532 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.621486 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa"} err="failed to get container status \"fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa\": rpc error: code = NotFound desc = could not find container \"fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa\": container with ID starting with fafcd45fed085d17a65276e14807d67056a43eae9b65079dc92dbc0a15db86aa not found: ID does not exist" Sep 17 03:35:17.621532 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.621509 2551 scope.go:117] "RemoveContainer" containerID="c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb" Sep 17 03:35:17.621780 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.621735 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 03:35:17.621780 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.621741 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 03:35:17.621780 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.621741 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 03:35:17.621973 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.621783 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 03:35:17.621973 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.621809 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 03:35:17.622067 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.622047 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb"} err="failed to get container status \"c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb\": rpc error: code = NotFound desc = could not find container \"c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb\": container with ID starting with c68318dce077a0a4c17f7a07033036991657f9ba05dbb5bc3e9ed245f83dd7fb not found: ID does not exist" Sep 17 03:35:17.622110 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.622096 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 03:35:17.622182 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.622174 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 03:35:17.622328 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.622313 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 03:35:17.622579 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.622557 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 03:35:17.622660 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.622607 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7q1hu5bs7r081\"" Sep 17 03:35:17.623084 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.623068 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 03:35:17.623145 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.623098 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hdjzm\"" Sep 17 03:35:17.623487 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.623468 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 03:35:17.623609 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.623492 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 03:35:17.627054 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.627036 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 03:35:17.656463 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.654002 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 03:35:17.656695 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.656674 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 03:35:17.661243 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.661216 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.661350 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.661255 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.661350 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.661275 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.661350 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.661292 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-config\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.661350 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.661315 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vczg7\" (UniqueName: \"kubernetes.io/projected/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-kube-api-access-vczg7\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.661350 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.661339 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.661572 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.661354 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.661572 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.661371 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.661572 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.661456 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.661572 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.661504 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.661572 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.661554 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.661790 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.661588 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-config-out\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.661790 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.661614 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.661790 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.661645 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-web-config\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.661790 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.661670 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.661790 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.661697 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.661790 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.661719 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.661790 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.661747 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.661790 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.661774 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.662046 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.661801 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.762262 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.762228 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.762262 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.762263 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.762775 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.762283 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-config\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.762775 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.762299 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vczg7\" (UniqueName: \"kubernetes.io/projected/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-kube-api-access-vczg7\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.762775 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.762317 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.762775 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.762332 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.762775 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.762360 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.762775 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.762384 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.762775 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.762445 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.762775 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.762475 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.762775 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.762505 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-config-out\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.762775 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.762533 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.762775 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.762566 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-web-config\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.762775 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.762590 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.762775 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.762615 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.762775 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.762638 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.763464 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.763157 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.763464 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.763394 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.765557 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.765530 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.765730 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.765709 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-config\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.765730 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.765722 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-web-config\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.765854 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.765755 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.766020 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.765998 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.766535 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.766389 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.766535 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.766461 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.766535 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.766466 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.766535 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.766476 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-config-out\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.766535 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.766495 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.766535 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.766530 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.766902 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.766562 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.766902 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.766586 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.766902 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.766633 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.767530 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.767477 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.767627 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.767611 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.767855 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.767834 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.768502 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.768477 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.768846 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.768821 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.769258 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.769241 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.769537 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.769520 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.770779 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.770760 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vczg7\" (UniqueName: \"kubernetes.io/projected/5318f7f5-edae-4db2-a86c-d3b6c4b8b33c-kube-api-access-vczg7\") pod \"prometheus-k8s-0\" (UID: \"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:17.928628 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:17.928595 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:18.210111 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:18.210082 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 03:35:18.210724 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:35:18.210699 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5318f7f5_edae_4db2_a86c_d3b6c4b8b33c.slice/crio-7a75c5dba61f14543f7c73ab06fa5a26139b14a27b253104bcf71d99c234def5 WatchSource:0}: Error finding container 7a75c5dba61f14543f7c73ab06fa5a26139b14a27b253104bcf71d99c234def5: Status 404 returned error can't find the container with id 7a75c5dba61f14543f7c73ab06fa5a26139b14a27b253104bcf71d99c234def5 Sep 17 03:35:18.563163 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:18.563070 2551 generic.go:356] "Generic (PLEG): container finished" podID="5318f7f5-edae-4db2-a86c-d3b6c4b8b33c" containerID="c797dcfe92f82ab8f70f5292a5d7bfe3730242e69fab942383a64f996ceec9dd" exitCode=0 Sep 17 03:35:18.563163 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:18.563126 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c","Type":"ContainerDied","Data":"c797dcfe92f82ab8f70f5292a5d7bfe3730242e69fab942383a64f996ceec9dd"} Sep 17 03:35:18.563390 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:18.563192 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c","Type":"ContainerStarted","Data":"7a75c5dba61f14543f7c73ab06fa5a26139b14a27b253104bcf71d99c234def5"} Sep 17 03:35:18.777488 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:18.777454 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6534aa76-c13a-44e9-aff3-0406b9a4bac1" path="/var/lib/kubelet/pods/6534aa76-c13a-44e9-aff3-0406b9a4bac1/volumes" Sep 17 03:35:19.570754 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:19.570720 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c","Type":"ContainerStarted","Data":"fc8484efe6db09654308241a2a3a477e6e625ae23fd9ddef7500f518910a2f0a"} Sep 17 03:35:19.570919 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:19.570786 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c","Type":"ContainerStarted","Data":"063d3ae6ec5f1eaa1044a25d3669a262f8cdf86ee3d2980532f6bef46b8c69b7"} Sep 17 03:35:19.570919 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:19.570818 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c","Type":"ContainerStarted","Data":"7a8eaef20b5b5632faa863a15cb10ad7801644b9f6418e83414dc66b15419030"} Sep 17 03:35:19.570919 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:19.570844 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c","Type":"ContainerStarted","Data":"73ab43b9cd7e0787d730121c32d65da4bee2ea796d28bd96c43118c24af4edf7"} Sep 17 03:35:19.570919 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:19.570876 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c","Type":"ContainerStarted","Data":"c767c07e928bf82c41b29ef46244653a429990a989968e6bd8c50bb84ab6f7b2"} Sep 17 03:35:19.570919 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:19.570900 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5318f7f5-edae-4db2-a86c-d3b6c4b8b33c","Type":"ContainerStarted","Data":"764eeaa0d74f62213ec92c4ae33c7c70dfa198f40ddb64c5621edea1ea67521b"} Sep 17 03:35:19.599266 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:19.599217 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.580390955 podStartE2EDuration="2.599196298s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.805343ms" isStatefulPod=false podCreationTimestamp="2026-09-17 03:35:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:35:19.598319085 +0000 UTC m=+175.325552284" watchObservedRunningTime="2026-09-17 03:35:19.599196298 +0000 UTC m=+175.326429452" Sep 17 03:35:19.953489 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:19.953448 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:35:20.109854 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:20.109818 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:35:20.166516 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:20.166488 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:35:20.752584 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:20.752540 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:35:20.813530 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:20.813484 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:35:20.981033 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:20.981002 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:35:21.039661 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:21.039564 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:35:22.929414 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:22.929377 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:35:30.991924 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:30.991880 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:35:31.049064 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:31.049017 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:35:31.105665 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:31.105629 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:35:37.142085 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:37.142052 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:35:55.509224 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:55.509194 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:35:55.579603 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:35:55.579555 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:36:17.929243 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:36:17.929187 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:36:17.944703 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:36:17.944678 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:36:18.809639 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:36:18.809609 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 03:36:26.570148 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:36:26.570120 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:36:26.625918 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:36:26.625885 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:36:30.034380 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:36:30.034347 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:36:30.106536 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:36:30.106508 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:36:30.176071 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:36:30.176047 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:36:30.235096 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:36:30.235072 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:36:30.777189 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:36:30.777161 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:36:30.880553 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:36:30.880524 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:36:38.636506 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:36:38.636471 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:36:38.693783 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:36:38.693759 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:36:41.282936 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:36:41.282908 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:36:41.393769 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:36:41.393740 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:36:41.449394 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:36:41.449364 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:36:52.188659 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:36:52.188573 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:36:52.289593 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:36:52.289557 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:37:24.703472 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:37:24.703448 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c8wtl_228ee255-c87b-42f0-b012-56cf65fa77db/ovn-acl-logging/0.log" Sep 17 03:37:24.706777 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:37:24.706752 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c8wtl_228ee255-c87b-42f0-b012-56cf65fa77db/ovn-acl-logging/0.log" Sep 17 03:37:24.711282 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:37:24.711263 2551 kubelet.go:1648] "Image garbage collection succeeded" Sep 17 03:39:06.967330 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:39:06.967296 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:39:08.124117 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:39:08.124086 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:39:13.813328 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:39:13.813300 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:39:13.870805 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:39:13.870779 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:39:13.958025 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:39:13.957997 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:39:14.596806 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:39:14.596772 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:39:14.653339 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:39:14.653307 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:39:19.431328 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:39:19.431293 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:39:19.487281 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:39:19.487257 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:39:24.955719 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:39:24.955684 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:39:25.007920 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:39:25.007893 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:39:25.063630 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:39:25.063602 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:39:48.044881 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:39:48.044795 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:39:48.143352 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:39:48.143317 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:40:10.018442 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:10.018394 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:40:10.780261 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:10.780229 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:40:14.175952 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:14.175921 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:40:14.286025 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:14.285995 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:40:16.225824 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:16.225789 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:40:16.370003 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:16.369966 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:40:18.481984 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:18.481954 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:40:18.824538 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:18.824469 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:40:18.965540 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:18.965508 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:40:19.033897 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:19.033864 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:40:26.428828 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:26.428802 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:40:30.158021 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:30.157986 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:40:30.259268 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:30.259233 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:40:40.310691 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:40.310639 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:40:40.368305 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:40.368275 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:40:41.784239 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:41.784206 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:40:41.883865 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:41.883838 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:40:43.816137 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:43.816108 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-mnpmg"] Sep 17 03:40:43.819232 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:43.819215 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-mnpmg" Sep 17 03:40:43.822016 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:43.821998 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Sep 17 03:40:43.823122 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:43.823105 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Sep 17 03:40:43.823177 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:43.823128 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-jlq6f\"" Sep 17 03:40:43.829044 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:43.829025 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-mnpmg"] Sep 17 03:40:43.977115 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:43.977089 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5fc5b5f-45a7-4072-b3de-f1a7867fdeba-tmp\") pod \"jobset-operator-5bc45f897-mnpmg\" (UID: \"d5fc5b5f-45a7-4072-b3de-f1a7867fdeba\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-mnpmg" Sep 17 03:40:43.977255 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:43.977144 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7knnk\" (UniqueName: \"kubernetes.io/projected/d5fc5b5f-45a7-4072-b3de-f1a7867fdeba-kube-api-access-7knnk\") pod \"jobset-operator-5bc45f897-mnpmg\" (UID: \"d5fc5b5f-45a7-4072-b3de-f1a7867fdeba\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-mnpmg" Sep 17 03:40:44.077727 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:44.077660 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7knnk\" (UniqueName: \"kubernetes.io/projected/d5fc5b5f-45a7-4072-b3de-f1a7867fdeba-kube-api-access-7knnk\") pod \"jobset-operator-5bc45f897-mnpmg\" (UID: \"d5fc5b5f-45a7-4072-b3de-f1a7867fdeba\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-mnpmg" Sep 17 03:40:44.077727 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:44.077701 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5fc5b5f-45a7-4072-b3de-f1a7867fdeba-tmp\") pod \"jobset-operator-5bc45f897-mnpmg\" (UID: \"d5fc5b5f-45a7-4072-b3de-f1a7867fdeba\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-mnpmg" Sep 17 03:40:44.078022 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:44.078008 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5fc5b5f-45a7-4072-b3de-f1a7867fdeba-tmp\") pod \"jobset-operator-5bc45f897-mnpmg\" (UID: \"d5fc5b5f-45a7-4072-b3de-f1a7867fdeba\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-mnpmg" Sep 17 03:40:44.085323 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:44.085304 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7knnk\" (UniqueName: \"kubernetes.io/projected/d5fc5b5f-45a7-4072-b3de-f1a7867fdeba-kube-api-access-7knnk\") pod \"jobset-operator-5bc45f897-mnpmg\" (UID: \"d5fc5b5f-45a7-4072-b3de-f1a7867fdeba\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-mnpmg" Sep 17 03:40:44.148925 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:44.148901 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-mnpmg" Sep 17 03:40:44.417552 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:44.417484 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-mnpmg"] Sep 17 03:40:44.420436 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:40:44.420374 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd5fc5b5f_45a7_4072_b3de_f1a7867fdeba.slice/crio-6d7cf57a7291331363bb0c88279423ef71bbcf93dfa462b0a6c613cfea5fde45 WatchSource:0}: Error finding container 6d7cf57a7291331363bb0c88279423ef71bbcf93dfa462b0a6c613cfea5fde45: Status 404 returned error can't find the container with id 6d7cf57a7291331363bb0c88279423ef71bbcf93dfa462b0a6c613cfea5fde45 Sep 17 03:40:44.421926 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:44.421909 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 03:40:44.780519 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:44.780486 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-mnpmg" event={"ID":"d5fc5b5f-45a7-4072-b3de-f1a7867fdeba","Type":"ContainerStarted","Data":"6d7cf57a7291331363bb0c88279423ef71bbcf93dfa462b0a6c613cfea5fde45"} Sep 17 03:40:47.794715 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:47.794681 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-mnpmg" event={"ID":"d5fc5b5f-45a7-4072-b3de-f1a7867fdeba","Type":"ContainerStarted","Data":"a1b4897eb3c44f1f277df94ca8024c7a52a9e9e9d081899dfc721ff7b0947658"} Sep 17 03:40:47.811740 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:47.811695 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-mnpmg" podStartSLOduration=2.224204222 podStartE2EDuration="4.811682268s" totalImagesPullingTime="2.587478046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:40:47.811561359 +0000 UTC m=+503.538794513" watchObservedRunningTime="2026-09-17 03:40:47.811682268 +0000 UTC m=+503.538915422" Sep 17 03:40:51.338451 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:51.338421 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:40:51.760782 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:51.760744 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:40:51.820279 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:51.820247 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:40:53.703245 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:40:53.703217 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:41:48.335445 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:41:48.335375 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:41:57.032670 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:41:57.032640 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:41:57.134722 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:41:57.134690 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:41:57.426061 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:41:57.426028 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:41:57.643298 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:41:57.643265 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:42:13.176956 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:42:13.176923 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:42:13.278264 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:42:13.278234 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:42:24.733591 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:42:24.733563 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c8wtl_228ee255-c87b-42f0-b012-56cf65fa77db/ovn-acl-logging/0.log" Sep 17 03:42:24.734056 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:42:24.733610 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c8wtl_228ee255-c87b-42f0-b012-56cf65fa77db/ovn-acl-logging/0.log" Sep 17 03:42:55.466128 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:42:55.466055 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:42:55.566860 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:42:55.566832 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:42:57.904500 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:42:57.904468 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-z6l92"] Sep 17 03:42:57.907842 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:42:57.907822 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-z6l92" Sep 17 03:42:57.910383 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:42:57.910357 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 17 03:42:57.910503 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:42:57.910378 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 17 03:42:57.910503 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:42:57.910454 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Sep 17 03:42:57.910600 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:42:57.910501 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:42:57.911394 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:42:57.911379 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-2d4xj\"" Sep 17 03:42:57.911487 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:42:57.911469 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Sep 17 03:42:57.917865 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:42:57.917846 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-z6l92"] Sep 17 03:42:58.090622 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:42:58.090598 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6zdk\" (UniqueName: \"kubernetes.io/projected/52a98965-2307-4112-887e-d4600a25063a-kube-api-access-g6zdk\") pod \"kubeflow-trainer-controller-manager-7f9b886978-z6l92\" (UID: \"52a98965-2307-4112-887e-d4600a25063a\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-z6l92" Sep 17 03:42:58.090752 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:42:58.090655 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/52a98965-2307-4112-887e-d4600a25063a-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7f9b886978-z6l92\" (UID: \"52a98965-2307-4112-887e-d4600a25063a\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-z6l92" Sep 17 03:42:58.090752 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:42:58.090704 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52a98965-2307-4112-887e-d4600a25063a-cert\") pod \"kubeflow-trainer-controller-manager-7f9b886978-z6l92\" (UID: \"52a98965-2307-4112-887e-d4600a25063a\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-z6l92" Sep 17 03:42:58.191830 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:42:58.191807 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6zdk\" (UniqueName: \"kubernetes.io/projected/52a98965-2307-4112-887e-d4600a25063a-kube-api-access-g6zdk\") pod \"kubeflow-trainer-controller-manager-7f9b886978-z6l92\" (UID: \"52a98965-2307-4112-887e-d4600a25063a\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-z6l92" Sep 17 03:42:58.191946 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:42:58.191861 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/52a98965-2307-4112-887e-d4600a25063a-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7f9b886978-z6l92\" (UID: \"52a98965-2307-4112-887e-d4600a25063a\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-z6l92" Sep 17 03:42:58.191946 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:42:58.191892 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52a98965-2307-4112-887e-d4600a25063a-cert\") pod \"kubeflow-trainer-controller-manager-7f9b886978-z6l92\" (UID: \"52a98965-2307-4112-887e-d4600a25063a\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-z6l92" Sep 17 03:42:58.192550 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:42:58.192524 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/52a98965-2307-4112-887e-d4600a25063a-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7f9b886978-z6l92\" (UID: \"52a98965-2307-4112-887e-d4600a25063a\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-z6l92" Sep 17 03:42:58.194127 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:42:58.194106 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52a98965-2307-4112-887e-d4600a25063a-cert\") pod \"kubeflow-trainer-controller-manager-7f9b886978-z6l92\" (UID: \"52a98965-2307-4112-887e-d4600a25063a\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-z6l92" Sep 17 03:42:58.199498 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:42:58.199472 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6zdk\" (UniqueName: \"kubernetes.io/projected/52a98965-2307-4112-887e-d4600a25063a-kube-api-access-g6zdk\") pod \"kubeflow-trainer-controller-manager-7f9b886978-z6l92\" (UID: \"52a98965-2307-4112-887e-d4600a25063a\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-z6l92" Sep 17 03:42:58.217286 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:42:58.217266 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-z6l92" Sep 17 03:42:58.232036 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:42:58.231975 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:42:58.286901 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:42:58.286876 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:42:58.487748 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:42:58.487723 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-z6l92"] Sep 17 03:42:58.490548 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:42:58.490521 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod52a98965_2307_4112_887e_d4600a25063a.slice/crio-a61980e2b0d348703bdc16c8b4caa1e481afe69d948d3f9c643b4aba80b93b6f WatchSource:0}: Error finding container a61980e2b0d348703bdc16c8b4caa1e481afe69d948d3f9c643b4aba80b93b6f: Status 404 returned error can't find the container with id a61980e2b0d348703bdc16c8b4caa1e481afe69d948d3f9c643b4aba80b93b6f Sep 17 03:42:59.278586 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:42:59.278545 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-z6l92" event={"ID":"52a98965-2307-4112-887e-d4600a25063a","Type":"ContainerStarted","Data":"a61980e2b0d348703bdc16c8b4caa1e481afe69d948d3f9c643b4aba80b93b6f"} Sep 17 03:43:01.288845 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:43:01.288810 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-z6l92" event={"ID":"52a98965-2307-4112-887e-d4600a25063a","Type":"ContainerStarted","Data":"8926982a2da885820d8a36fc471b0346b83dac51612ed0ec3b5e6d98427e2184"} Sep 17 03:43:01.289243 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:43:01.288865 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-z6l92" Sep 17 03:43:01.305370 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:43:01.305320 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-z6l92" podStartSLOduration=2.175188055 podStartE2EDuration="4.305305205s" totalImagesPullingTime="2.13011715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:42:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:43:01.304343828 +0000 UTC m=+637.031576983" watchObservedRunningTime="2026-09-17 03:43:01.305305205 +0000 UTC m=+637.032538412" Sep 17 03:43:01.364231 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:43:01.364203 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:43:01.416009 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:43:01.415981 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:43:17.298864 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:43:17.298831 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-z6l92" Sep 17 03:43:17.554375 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:43:17.554298 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:43:17.655625 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:43:17.655597 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:43:59.643746 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:43:59.643712 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2ptfl/must-gather-9wtxw"] Sep 17 03:43:59.646981 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:43:59.646961 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2ptfl/must-gather-9wtxw" Sep 17 03:43:59.649864 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:43:59.649841 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2ptfl\"/\"default-dockercfg-7mpvw\"" Sep 17 03:43:59.649864 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:43:59.649858 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2ptfl\"/\"kube-root-ca.crt\"" Sep 17 03:43:59.649996 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:43:59.649893 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2ptfl\"/\"openshift-service-ca.crt\"" Sep 17 03:43:59.655612 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:43:59.655589 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2ptfl/must-gather-9wtxw"] Sep 17 03:43:59.668191 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:43:59.668168 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:43:59.727262 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:43:59.727236 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:43:59.744379 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:43:59.744354 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85ckv\" (UniqueName: \"kubernetes.io/projected/fc3a9da2-f56d-4be0-bbe4-9acc9712551c-kube-api-access-85ckv\") pod \"must-gather-9wtxw\" (UID: \"fc3a9da2-f56d-4be0-bbe4-9acc9712551c\") " pod="openshift-must-gather-2ptfl/must-gather-9wtxw" Sep 17 03:43:59.744480 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:43:59.744426 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fc3a9da2-f56d-4be0-bbe4-9acc9712551c-must-gather-output\") pod \"must-gather-9wtxw\" (UID: \"fc3a9da2-f56d-4be0-bbe4-9acc9712551c\") " pod="openshift-must-gather-2ptfl/must-gather-9wtxw" Sep 17 03:43:59.845557 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:43:59.845514 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fc3a9da2-f56d-4be0-bbe4-9acc9712551c-must-gather-output\") pod \"must-gather-9wtxw\" (UID: \"fc3a9da2-f56d-4be0-bbe4-9acc9712551c\") " pod="openshift-must-gather-2ptfl/must-gather-9wtxw" Sep 17 03:43:59.845695 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:43:59.845617 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85ckv\" (UniqueName: \"kubernetes.io/projected/fc3a9da2-f56d-4be0-bbe4-9acc9712551c-kube-api-access-85ckv\") pod \"must-gather-9wtxw\" (UID: \"fc3a9da2-f56d-4be0-bbe4-9acc9712551c\") " pod="openshift-must-gather-2ptfl/must-gather-9wtxw" Sep 17 03:43:59.845913 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:43:59.845889 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fc3a9da2-f56d-4be0-bbe4-9acc9712551c-must-gather-output\") pod \"must-gather-9wtxw\" (UID: \"fc3a9da2-f56d-4be0-bbe4-9acc9712551c\") " pod="openshift-must-gather-2ptfl/must-gather-9wtxw" Sep 17 03:43:59.853779 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:43:59.853749 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85ckv\" (UniqueName: \"kubernetes.io/projected/fc3a9da2-f56d-4be0-bbe4-9acc9712551c-kube-api-access-85ckv\") pod \"must-gather-9wtxw\" (UID: \"fc3a9da2-f56d-4be0-bbe4-9acc9712551c\") " pod="openshift-must-gather-2ptfl/must-gather-9wtxw" Sep 17 03:43:59.956924 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:43:59.956904 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2ptfl/must-gather-9wtxw" Sep 17 03:44:00.226461 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:00.226437 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2ptfl/must-gather-9wtxw"] Sep 17 03:44:00.228862 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:44:00.228831 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc3a9da2_f56d_4be0_bbe4_9acc9712551c.slice/crio-cb2c96d2637815e4a9cd05660a3b966c0001d6269b428f1affc71d09c47bcb76 WatchSource:0}: Error finding container cb2c96d2637815e4a9cd05660a3b966c0001d6269b428f1affc71d09c47bcb76: Status 404 returned error can't find the container with id cb2c96d2637815e4a9cd05660a3b966c0001d6269b428f1affc71d09c47bcb76 Sep 17 03:44:00.522388 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:00.522309 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2ptfl/must-gather-9wtxw" event={"ID":"fc3a9da2-f56d-4be0-bbe4-9acc9712551c","Type":"ContainerStarted","Data":"cb2c96d2637815e4a9cd05660a3b966c0001d6269b428f1affc71d09c47bcb76"} Sep 17 03:44:06.555327 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:06.555292 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2ptfl/must-gather-9wtxw" event={"ID":"fc3a9da2-f56d-4be0-bbe4-9acc9712551c","Type":"ContainerStarted","Data":"69d1dc6e5d1713af7eb77e5be0d7b93b7c64fcee4ef27a629d44ac55d32e0842"} Sep 17 03:44:06.555734 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:06.555340 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2ptfl/must-gather-9wtxw" event={"ID":"fc3a9da2-f56d-4be0-bbe4-9acc9712551c","Type":"ContainerStarted","Data":"166e87f3e9c4cb65154fe801400c7015dd0a1e01e08db541fd735f2c86f6e906"} Sep 17 03:44:06.572458 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:06.572376 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2ptfl/must-gather-9wtxw" podStartSLOduration=1.5555127359999998 podStartE2EDuration="7.572356646s" totalImagesPullingTime="6.01684391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 03:43:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:44:06.570474369 +0000 UTC m=+702.297707524" watchObservedRunningTime="2026-09-17 03:44:06.572356646 +0000 UTC m=+702.299589800" Sep 17 03:44:15.815132 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:15.815101 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-7f9b886978-z6l92_52a98965-2307-4112-887e-d4600a25063a/manager/0.log" Sep 17 03:44:16.264447 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:16.264397 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-7f9b886978-z6l92_52a98965-2307-4112-887e-d4600a25063a/manager/0.log" Sep 17 03:44:16.723307 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:16.723277 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-7f9b886978-z6l92_52a98965-2307-4112-887e-d4600a25063a/manager/0.log" Sep 17 03:44:51.757240 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:51.757206 2551 generic.go:356] "Generic (PLEG): container finished" podID="fc3a9da2-f56d-4be0-bbe4-9acc9712551c" containerID="166e87f3e9c4cb65154fe801400c7015dd0a1e01e08db541fd735f2c86f6e906" exitCode=0 Sep 17 03:44:51.757659 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:51.757280 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2ptfl/must-gather-9wtxw" event={"ID":"fc3a9da2-f56d-4be0-bbe4-9acc9712551c","Type":"ContainerDied","Data":"166e87f3e9c4cb65154fe801400c7015dd0a1e01e08db541fd735f2c86f6e906"} Sep 17 03:44:51.757659 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:51.757636 2551 scope.go:117] "RemoveContainer" containerID="166e87f3e9c4cb65154fe801400c7015dd0a1e01e08db541fd735f2c86f6e906" Sep 17 03:44:52.207550 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:52.207525 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-2ptfl_must-gather-9wtxw_fc3a9da2-f56d-4be0-bbe4-9acc9712551c/gather/0.log" Sep 17 03:44:52.543251 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:52.543183 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:44:53.634380 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:53.634347 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:44:55.326904 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:55.326877 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k5lh2_7f67c23a-21e7-465e-a87c-29c1e5a3eadd/global-pull-secret-syncer/0.log" Sep 17 03:44:55.363879 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:55.363857 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" Sep 17 03:44:55.488548 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:55.488516 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-180.ec2.internal_ae5517c1a906653611f35437758c68a1/haproxy/0.log" Sep 17 03:44:57.521911 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:57.521877 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-2ptfl/must-gather-9wtxw"] Sep 17 03:44:57.522294 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:57.522059 2551 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-2ptfl/must-gather-9wtxw" podUID="fc3a9da2-f56d-4be0-bbe4-9acc9712551c" containerName="copy" containerID="cri-o://69d1dc6e5d1713af7eb77e5be0d7b93b7c64fcee4ef27a629d44ac55d32e0842" gracePeriod=2 Sep 17 03:44:57.524362 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:44:57.524328 2551 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-9wtxw\" is forbidden: User \"system:node:ip-10-0-143-180.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-2ptfl\": no relationship found between node 'ip-10-0-143-180.ec2.internal' and this object" podUID="fc3a9da2-f56d-4be0-bbe4-9acc9712551c" pod="openshift-must-gather-2ptfl/must-gather-9wtxw" Sep 17 03:44:57.526316 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:57.525951 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-2ptfl/must-gather-9wtxw"] Sep 17 03:44:57.752674 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:57.752648 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-2ptfl_must-gather-9wtxw_fc3a9da2-f56d-4be0-bbe4-9acc9712551c/copy/0.log" Sep 17 03:44:57.755133 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:57.755118 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2ptfl/must-gather-9wtxw" Sep 17 03:44:57.757108 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:44:57.757085 2551 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-9wtxw\" is forbidden: User \"system:node:ip-10-0-143-180.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-2ptfl\": no relationship found between node 'ip-10-0-143-180.ec2.internal' and this object" podUID="fc3a9da2-f56d-4be0-bbe4-9acc9712551c" pod="openshift-must-gather-2ptfl/must-gather-9wtxw" Sep 17 03:44:57.779763 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:57.779720 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-2ptfl_must-gather-9wtxw_fc3a9da2-f56d-4be0-bbe4-9acc9712551c/copy/0.log" Sep 17 03:44:57.780068 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:57.780047 2551 generic.go:356] "Generic (PLEG): container finished" podID="fc3a9da2-f56d-4be0-bbe4-9acc9712551c" containerID="69d1dc6e5d1713af7eb77e5be0d7b93b7c64fcee4ef27a629d44ac55d32e0842" exitCode=143 Sep 17 03:44:57.780159 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:57.780083 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2ptfl/must-gather-9wtxw" Sep 17 03:44:57.780159 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:57.780116 2551 scope.go:117] "RemoveContainer" containerID="69d1dc6e5d1713af7eb77e5be0d7b93b7c64fcee4ef27a629d44ac55d32e0842" Sep 17 03:44:57.782246 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:44:57.782222 2551 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-9wtxw\" is forbidden: User \"system:node:ip-10-0-143-180.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-2ptfl\": no relationship found between node 'ip-10-0-143-180.ec2.internal' and this object" podUID="fc3a9da2-f56d-4be0-bbe4-9acc9712551c" pod="openshift-must-gather-2ptfl/must-gather-9wtxw" Sep 17 03:44:57.787315 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:57.787296 2551 scope.go:117] "RemoveContainer" containerID="166e87f3e9c4cb65154fe801400c7015dd0a1e01e08db541fd735f2c86f6e906" Sep 17 03:44:57.799243 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:57.799224 2551 scope.go:117] "RemoveContainer" containerID="69d1dc6e5d1713af7eb77e5be0d7b93b7c64fcee4ef27a629d44ac55d32e0842" Sep 17 03:44:57.799513 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:44:57.799495 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69d1dc6e5d1713af7eb77e5be0d7b93b7c64fcee4ef27a629d44ac55d32e0842\": container with ID starting with 69d1dc6e5d1713af7eb77e5be0d7b93b7c64fcee4ef27a629d44ac55d32e0842 not found: ID does not exist" containerID="69d1dc6e5d1713af7eb77e5be0d7b93b7c64fcee4ef27a629d44ac55d32e0842" Sep 17 03:44:57.799570 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:57.799522 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69d1dc6e5d1713af7eb77e5be0d7b93b7c64fcee4ef27a629d44ac55d32e0842"} err="failed to get container status \"69d1dc6e5d1713af7eb77e5be0d7b93b7c64fcee4ef27a629d44ac55d32e0842\": rpc error: code = NotFound desc = could not find container \"69d1dc6e5d1713af7eb77e5be0d7b93b7c64fcee4ef27a629d44ac55d32e0842\": container with ID starting with 69d1dc6e5d1713af7eb77e5be0d7b93b7c64fcee4ef27a629d44ac55d32e0842 not found: ID does not exist" Sep 17 03:44:57.799570 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:57.799542 2551 scope.go:117] "RemoveContainer" containerID="166e87f3e9c4cb65154fe801400c7015dd0a1e01e08db541fd735f2c86f6e906" Sep 17 03:44:57.799795 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:44:57.799780 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"166e87f3e9c4cb65154fe801400c7015dd0a1e01e08db541fd735f2c86f6e906\": container with ID starting with 166e87f3e9c4cb65154fe801400c7015dd0a1e01e08db541fd735f2c86f6e906 not found: ID does not exist" containerID="166e87f3e9c4cb65154fe801400c7015dd0a1e01e08db541fd735f2c86f6e906" Sep 17 03:44:57.799844 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:57.799796 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"166e87f3e9c4cb65154fe801400c7015dd0a1e01e08db541fd735f2c86f6e906"} err="failed to get container status \"166e87f3e9c4cb65154fe801400c7015dd0a1e01e08db541fd735f2c86f6e906\": rpc error: code = NotFound desc = could not find container \"166e87f3e9c4cb65154fe801400c7015dd0a1e01e08db541fd735f2c86f6e906\": container with ID starting with 166e87f3e9c4cb65154fe801400c7015dd0a1e01e08db541fd735f2c86f6e906 not found: ID does not exist" Sep 17 03:44:57.842096 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:57.842075 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85ckv\" (UniqueName: \"kubernetes.io/projected/fc3a9da2-f56d-4be0-bbe4-9acc9712551c-kube-api-access-85ckv\") pod \"fc3a9da2-f56d-4be0-bbe4-9acc9712551c\" (UID: \"fc3a9da2-f56d-4be0-bbe4-9acc9712551c\") " Sep 17 03:44:57.842161 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:57.842135 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fc3a9da2-f56d-4be0-bbe4-9acc9712551c-must-gather-output\") pod \"fc3a9da2-f56d-4be0-bbe4-9acc9712551c\" (UID: \"fc3a9da2-f56d-4be0-bbe4-9acc9712551c\") " Sep 17 03:44:57.844157 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:57.844123 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc3a9da2-f56d-4be0-bbe4-9acc9712551c-kube-api-access-85ckv" (OuterVolumeSpecName: "kube-api-access-85ckv") pod "fc3a9da2-f56d-4be0-bbe4-9acc9712551c" (UID: "fc3a9da2-f56d-4be0-bbe4-9acc9712551c"). InnerVolumeSpecName "kube-api-access-85ckv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 03:44:57.844286 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:57.844267 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc3a9da2-f56d-4be0-bbe4-9acc9712551c-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "fc3a9da2-f56d-4be0-bbe4-9acc9712551c" (UID: "fc3a9da2-f56d-4be0-bbe4-9acc9712551c"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 03:44:57.943224 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:57.943202 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85ckv\" (UniqueName: \"kubernetes.io/projected/fc3a9da2-f56d-4be0-bbe4-9acc9712551c-kube-api-access-85ckv\") on node \"ip-10-0-143-180.ec2.internal\" DevicePath \"\"" Sep 17 03:44:57.943224 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:57.943224 2551 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fc3a9da2-f56d-4be0-bbe4-9acc9712551c-must-gather-output\") on node \"ip-10-0-143-180.ec2.internal\" DevicePath \"\"" Sep 17 03:44:57.958151 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:57.958130 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:44:58.015642 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:58.015621 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7rvl5_79c78cce-a88d-4dc5-965a-6b69880e9bfa/konnectivity-agent/0.log" limit=1024 Sep 17 03:44:58.090157 ip-10-0-143-180 kubenswrapper[2551]: E0917 03:44:58.090135 2551 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-9wtxw\" is forbidden: User \"system:node:ip-10-0-143-180.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-2ptfl\": no relationship found between node 'ip-10-0-143-180.ec2.internal' and this object" podUID="fc3a9da2-f56d-4be0-bbe4-9acc9712551c" pod="openshift-must-gather-2ptfl/must-gather-9wtxw" Sep 17 03:44:58.768213 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:58.768180 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc3a9da2-f56d-4be0-bbe4-9acc9712551c" path="/var/lib/kubelet/pods/fc3a9da2-f56d-4be0-bbe4-9acc9712551c/volumes" Sep 17 03:44:59.584339 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:59.584315 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-57f9c58b65-vvfvb_25cb9b60-5a00-4a31-a6b7-da269a99ab21/metrics-server/0.log" Sep 17 03:44:59.616903 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:59.616868 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-s9llc_1a3eb32a-d5f3-4792-aa43-d212b31b94f6/monitoring-plugin/0.log" Sep 17 03:44:59.737857 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:59.737816 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7kdrs_6d727817-920b-41ee-990b-fa0d8db48e9a/node-exporter/0.log" Sep 17 03:44:59.760572 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:59.758358 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7kdrs_6d727817-920b-41ee-990b-fa0d8db48e9a/kube-rbac-proxy/0.log" Sep 17 03:44:59.785380 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:59.785358 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7kdrs_6d727817-920b-41ee-990b-fa0d8db48e9a/init-textfile/0.log" Sep 17 03:44:59.972712 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:59.972689 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5318f7f5-edae-4db2-a86c-d3b6c4b8b33c/prometheus/0.log" Sep 17 03:44:59.998097 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:44:59.998074 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5318f7f5-edae-4db2-a86c-d3b6c4b8b33c/config-reloader/0.log" Sep 17 03:45:00.023246 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:00.023220 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5318f7f5-edae-4db2-a86c-d3b6c4b8b33c/thanos-sidecar/0.log" Sep 17 03:45:00.051242 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:00.051221 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5318f7f5-edae-4db2-a86c-d3b6c4b8b33c/kube-rbac-proxy-web/0.log" Sep 17 03:45:00.074571 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:00.074549 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5318f7f5-edae-4db2-a86c-d3b6c4b8b33c/kube-rbac-proxy/0.log" Sep 17 03:45:00.102766 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:00.102742 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5318f7f5-edae-4db2-a86c-d3b6c4b8b33c/kube-rbac-proxy-thanos/0.log" Sep 17 03:45:00.124685 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:00.124664 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5318f7f5-edae-4db2-a86c-d3b6c4b8b33c/init-config-reloader/0.log" Sep 17 03:45:00.153549 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:00.153528 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-cgd2f_6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8/prometheus-operator/0.log" Sep 17 03:45:00.178068 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:00.178049 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-cgd2f_6c8ab701-ddd2-481e-8c34-ba4ec0c7c6d8/kube-rbac-proxy/0.log" Sep 17 03:45:00.203940 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:00.203921 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-z6f88_b228daf5-ad55-403c-9d2e-2673af53e57b/prometheus-operator-admission-webhook/0.log" Sep 17 03:45:02.692477 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:02.692441 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5n9xs/perf-node-gather-daemonset-j54fp"] Sep 17 03:45:02.692889 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:02.692778 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc3a9da2-f56d-4be0-bbe4-9acc9712551c" containerName="gather" Sep 17 03:45:02.692889 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:02.692793 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc3a9da2-f56d-4be0-bbe4-9acc9712551c" containerName="gather" Sep 17 03:45:02.692889 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:02.692811 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc3a9da2-f56d-4be0-bbe4-9acc9712551c" containerName="copy" Sep 17 03:45:02.692889 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:02.692816 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc3a9da2-f56d-4be0-bbe4-9acc9712551c" containerName="copy" Sep 17 03:45:02.692889 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:02.692873 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc3a9da2-f56d-4be0-bbe4-9acc9712551c" containerName="gather" Sep 17 03:45:02.692889 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:02.692882 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc3a9da2-f56d-4be0-bbe4-9acc9712551c" containerName="copy" Sep 17 03:45:02.697966 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:02.697944 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5n9xs/perf-node-gather-daemonset-j54fp" Sep 17 03:45:02.700660 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:02.700638 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5n9xs\"/\"openshift-service-ca.crt\"" Sep 17 03:45:02.700752 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:02.700638 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5n9xs\"/\"kube-root-ca.crt\"" Sep 17 03:45:02.701778 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:02.701760 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5n9xs\"/\"default-dockercfg-h8z7z\"" Sep 17 03:45:02.706755 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:02.706735 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5n9xs/perf-node-gather-daemonset-j54fp"] Sep 17 03:45:02.781783 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:02.781751 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0493d730-b121-485d-a671-b3d225565fa8-sys\") pod \"perf-node-gather-daemonset-j54fp\" (UID: \"0493d730-b121-485d-a671-b3d225565fa8\") " pod="openshift-must-gather-5n9xs/perf-node-gather-daemonset-j54fp" Sep 17 03:45:02.781930 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:02.781811 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llqw8\" (UniqueName: \"kubernetes.io/projected/0493d730-b121-485d-a671-b3d225565fa8-kube-api-access-llqw8\") pod \"perf-node-gather-daemonset-j54fp\" (UID: \"0493d730-b121-485d-a671-b3d225565fa8\") " pod="openshift-must-gather-5n9xs/perf-node-gather-daemonset-j54fp" Sep 17 03:45:02.781930 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:02.781869 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0493d730-b121-485d-a671-b3d225565fa8-proc\") pod \"perf-node-gather-daemonset-j54fp\" (UID: \"0493d730-b121-485d-a671-b3d225565fa8\") " pod="openshift-must-gather-5n9xs/perf-node-gather-daemonset-j54fp" Sep 17 03:45:02.781930 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:02.781893 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0493d730-b121-485d-a671-b3d225565fa8-podres\") pod \"perf-node-gather-daemonset-j54fp\" (UID: \"0493d730-b121-485d-a671-b3d225565fa8\") " pod="openshift-must-gather-5n9xs/perf-node-gather-daemonset-j54fp" Sep 17 03:45:02.781930 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:02.781922 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0493d730-b121-485d-a671-b3d225565fa8-lib-modules\") pod \"perf-node-gather-daemonset-j54fp\" (UID: \"0493d730-b121-485d-a671-b3d225565fa8\") " pod="openshift-must-gather-5n9xs/perf-node-gather-daemonset-j54fp" Sep 17 03:45:02.883128 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:02.883091 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llqw8\" (UniqueName: \"kubernetes.io/projected/0493d730-b121-485d-a671-b3d225565fa8-kube-api-access-llqw8\") pod \"perf-node-gather-daemonset-j54fp\" (UID: \"0493d730-b121-485d-a671-b3d225565fa8\") " pod="openshift-must-gather-5n9xs/perf-node-gather-daemonset-j54fp" Sep 17 03:45:02.883282 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:02.883152 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0493d730-b121-485d-a671-b3d225565fa8-proc\") pod \"perf-node-gather-daemonset-j54fp\" (UID: \"0493d730-b121-485d-a671-b3d225565fa8\") " pod="openshift-must-gather-5n9xs/perf-node-gather-daemonset-j54fp" Sep 17 03:45:02.883282 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:02.883226 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0493d730-b121-485d-a671-b3d225565fa8-proc\") pod \"perf-node-gather-daemonset-j54fp\" (UID: \"0493d730-b121-485d-a671-b3d225565fa8\") " pod="openshift-must-gather-5n9xs/perf-node-gather-daemonset-j54fp" Sep 17 03:45:02.883282 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:02.883262 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0493d730-b121-485d-a671-b3d225565fa8-podres\") pod \"perf-node-gather-daemonset-j54fp\" (UID: \"0493d730-b121-485d-a671-b3d225565fa8\") " pod="openshift-must-gather-5n9xs/perf-node-gather-daemonset-j54fp" Sep 17 03:45:02.883388 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:02.883300 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0493d730-b121-485d-a671-b3d225565fa8-lib-modules\") pod \"perf-node-gather-daemonset-j54fp\" (UID: \"0493d730-b121-485d-a671-b3d225565fa8\") " pod="openshift-must-gather-5n9xs/perf-node-gather-daemonset-j54fp" Sep 17 03:45:02.883388 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:02.883334 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0493d730-b121-485d-a671-b3d225565fa8-sys\") pod \"perf-node-gather-daemonset-j54fp\" (UID: \"0493d730-b121-485d-a671-b3d225565fa8\") " pod="openshift-must-gather-5n9xs/perf-node-gather-daemonset-j54fp" Sep 17 03:45:02.883489 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:02.883397 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0493d730-b121-485d-a671-b3d225565fa8-podres\") pod \"perf-node-gather-daemonset-j54fp\" (UID: \"0493d730-b121-485d-a671-b3d225565fa8\") " pod="openshift-must-gather-5n9xs/perf-node-gather-daemonset-j54fp" Sep 17 03:45:02.883489 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:02.883434 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0493d730-b121-485d-a671-b3d225565fa8-sys\") pod \"perf-node-gather-daemonset-j54fp\" (UID: \"0493d730-b121-485d-a671-b3d225565fa8\") " pod="openshift-must-gather-5n9xs/perf-node-gather-daemonset-j54fp" Sep 17 03:45:02.883554 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:02.883512 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0493d730-b121-485d-a671-b3d225565fa8-lib-modules\") pod \"perf-node-gather-daemonset-j54fp\" (UID: \"0493d730-b121-485d-a671-b3d225565fa8\") " pod="openshift-must-gather-5n9xs/perf-node-gather-daemonset-j54fp" Sep 17 03:45:02.891126 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:02.891109 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llqw8\" (UniqueName: \"kubernetes.io/projected/0493d730-b121-485d-a671-b3d225565fa8-kube-api-access-llqw8\") pod \"perf-node-gather-daemonset-j54fp\" (UID: \"0493d730-b121-485d-a671-b3d225565fa8\") " pod="openshift-must-gather-5n9xs/perf-node-gather-daemonset-j54fp" Sep 17 03:45:02.977032 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:02.976943 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-ltcvj_8e1a5081-a762-4ca0-ad24-6555253ffa92/volume-data-source-validator/0.log" Sep 17 03:45:03.007812 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:03.007786 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5n9xs/perf-node-gather-daemonset-j54fp" Sep 17 03:45:03.276606 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:03.276581 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5n9xs/perf-node-gather-daemonset-j54fp"] Sep 17 03:45:03.279105 ip-10-0-143-180 kubenswrapper[2551]: W0917 03:45:03.279071 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0493d730_b121_485d_a671_b3d225565fa8.slice/crio-9e03e56df6d17f7494429905807cae5776905283ba9ca86d292f858d96f46706 WatchSource:0}: Error finding container 9e03e56df6d17f7494429905807cae5776905283ba9ca86d292f858d96f46706: Status 404 returned error can't find the container with id 9e03e56df6d17f7494429905807cae5776905283ba9ca86d292f858d96f46706 Sep 17 03:45:03.774884 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:03.774861 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9kgwj_231922a7-9b04-43e5-ae55-e3a0247da747/dns/0.log" Sep 17 03:45:03.797442 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:03.797398 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9kgwj_231922a7-9b04-43e5-ae55-e3a0247da747/kube-rbac-proxy/0.log" Sep 17 03:45:03.805266 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:03.805240 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5n9xs/perf-node-gather-daemonset-j54fp" event={"ID":"0493d730-b121-485d-a671-b3d225565fa8","Type":"ContainerStarted","Data":"e52454ef650f39191521e4fca087fddd1c7630b46c61ed80b21c0ed6d9bfe9ef"} Sep 17 03:45:03.805496 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:03.805296 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5n9xs/perf-node-gather-daemonset-j54fp" event={"ID":"0493d730-b121-485d-a671-b3d225565fa8","Type":"ContainerStarted","Data":"9e03e56df6d17f7494429905807cae5776905283ba9ca86d292f858d96f46706"} Sep 17 03:45:03.805496 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:03.805324 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5n9xs/perf-node-gather-daemonset-j54fp" Sep 17 03:45:03.822219 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:03.822175 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5n9xs/perf-node-gather-daemonset-j54fp" podStartSLOduration=1.822161392 podStartE2EDuration="1.822161392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 03:45:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 03:45:03.821083728 +0000 UTC m=+759.548316878" watchObservedRunningTime="2026-09-17 03:45:03.822161392 +0000 UTC m=+759.549394546" Sep 17 03:45:03.919060 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:03.919033 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-59x2n_1db844ea-66f3-4982-b510-b488327b00ed/dns-node-resolver/0.log" Sep 17 03:45:04.404248 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:04.404222 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vwzf5_0e65d15d-2cdc-43a5-8b87-11aec8eaa83a/node-ca/0.log" Sep 17 03:45:05.486178 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:05.486150 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6w5pf_9c6d07b9-4073-4582-ad02-c6979ac3a0ca/serve-healthcheck-canary/0.log" Sep 17 03:45:05.867618 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:05.867545 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pbcm5_72fedd4c-6ffe-4536-b22b-a220953eaf81/kube-rbac-proxy/0.log" Sep 17 03:45:05.887471 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:05.887449 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pbcm5_72fedd4c-6ffe-4536-b22b-a220953eaf81/exporter/0.log" Sep 17 03:45:05.906657 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:05.906635 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pbcm5_72fedd4c-6ffe-4536-b22b-a220953eaf81/extractor/0.log" Sep 17 03:45:07.651789 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:07.651763 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-mnpmg_d5fc5b5f-45a7-4072-b3de-f1a7867fdeba/jobset-operator/0.log" Sep 17 03:45:09.819447 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:09.819421 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5n9xs/perf-node-gather-daemonset-j54fp" Sep 17 03:45:10.748592 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:10.748565 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-wmvnm_fc3c2b75-9c32-495c-b427-9d1fbdcc0b4f/migrator/0.log" Sep 17 03:45:10.769503 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:10.769480 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-wmvnm_fc3c2b75-9c32-495c-b427-9d1fbdcc0b4f/graceful-termination/0.log" Sep 17 03:45:11.103999 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:11.103923 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-6bzcs_80df0c88-0ab2-482f-bd76-d757451830fb/kube-storage-version-migrator-operator/1.log" Sep 17 03:45:11.104764 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:11.104745 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-6bzcs_80df0c88-0ab2-482f-bd76-d757451830fb/kube-storage-version-migrator-operator/0.log" Sep 17 03:45:12.446526 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:12.446494 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qffv4_3d48289c-a388-4c7e-b67d-98b2471cc4ec/kube-multus-additional-cni-plugins/0.log" Sep 17 03:45:12.466854 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:12.466829 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qffv4_3d48289c-a388-4c7e-b67d-98b2471cc4ec/egress-router-binary-copy/0.log" Sep 17 03:45:12.486833 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:12.486814 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qffv4_3d48289c-a388-4c7e-b67d-98b2471cc4ec/cni-plugins/0.log" Sep 17 03:45:12.506352 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:12.506330 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qffv4_3d48289c-a388-4c7e-b67d-98b2471cc4ec/bond-cni-plugin/0.log" Sep 17 03:45:12.525914 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:12.525898 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qffv4_3d48289c-a388-4c7e-b67d-98b2471cc4ec/routeoverride-cni/0.log" Sep 17 03:45:12.545927 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:12.545908 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qffv4_3d48289c-a388-4c7e-b67d-98b2471cc4ec/whereabouts-cni-bincopy/0.log" Sep 17 03:45:12.566152 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:12.566102 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qffv4_3d48289c-a388-4c7e-b67d-98b2471cc4ec/whereabouts-cni/0.log" Sep 17 03:45:12.605774 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:12.605756 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hqg86_d016862b-e142-4a1e-a9e2-6610f3f75c78/kube-multus/0.log" Sep 17 03:45:12.675669 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:12.675643 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4qjvl_7f900dc7-747d-47b8-8834-51afc05d4bac/network-metrics-daemon/0.log" Sep 17 03:45:12.694456 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:12.694434 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4qjvl_7f900dc7-747d-47b8-8834-51afc05d4bac/kube-rbac-proxy/0.log" Sep 17 03:45:13.525282 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:13.525254 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c8wtl_228ee255-c87b-42f0-b012-56cf65fa77db/ovn-controller/0.log" Sep 17 03:45:13.545970 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:13.545944 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c8wtl_228ee255-c87b-42f0-b012-56cf65fa77db/ovn-acl-logging/0.log" Sep 17 03:45:13.546080 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:13.545978 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c8wtl_228ee255-c87b-42f0-b012-56cf65fa77db/ovn-acl-logging/1.log" Sep 17 03:45:13.563947 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:13.563927 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c8wtl_228ee255-c87b-42f0-b012-56cf65fa77db/kube-rbac-proxy-node/0.log" Sep 17 03:45:13.584707 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:13.584684 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c8wtl_228ee255-c87b-42f0-b012-56cf65fa77db/kube-rbac-proxy-ovn-metrics/0.log" Sep 17 03:45:13.603946 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:13.603927 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c8wtl_228ee255-c87b-42f0-b012-56cf65fa77db/northd/0.log" Sep 17 03:45:13.623387 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:13.623369 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c8wtl_228ee255-c87b-42f0-b012-56cf65fa77db/nbdb/0.log" Sep 17 03:45:13.645207 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:13.645185 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c8wtl_228ee255-c87b-42f0-b012-56cf65fa77db/sbdb/0.log" Sep 17 03:45:13.681240 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:13.681219 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c8wtl_228ee255-c87b-42f0-b012-56cf65fa77db/ovnkube-controller/0.log" Sep 17 03:45:14.938603 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:14.938574 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-6f8b768455-7vmjw_aa32bfc4-d4ad-4713-84f1-551123c26489/check-endpoints/0.log" Sep 17 03:45:15.007193 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:15.007165 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-t9lsl_6f01992d-cdf0-47be-ab65-9714e39d371d/network-check-target-container/0.log" Sep 17 03:45:15.918635 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:15.918605 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-n98w6_336341fa-ffd3-45fa-98fd-bba7ab551273/iptables-alerter/0.log" Sep 17 03:45:16.623942 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:16.623916 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-pf7zm_84e7e42d-c122-4884-9239-baa4d830034a/tuned/0.log" Sep 17 03:45:18.193444 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:18.193417 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-86499c89c4-8pnxl_41d488f5-5a66-4e5d-a85f-db3dc2bad818/cluster-samples-operator/0.log" Sep 17 03:45:18.210201 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:18.210174 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-86499c89c4-8pnxl_41d488f5-5a66-4e5d-a85f-db3dc2bad818/cluster-samples-operator-watch/0.log" Sep 17 03:45:19.104382 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:19.104354 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-cf7c776b7-jq242_e0116b6b-a212-4bca-9993-4b5e4c91a2bf/service-ca-operator/1.log" Sep 17 03:45:19.105339 ip-10-0-143-180 kubenswrapper[2551]: I0917 03:45:19.105320 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-cf7c776b7-jq242_e0116b6b-a212-4bca-9993-4b5e4c91a2bf/service-ca-operator/0.log"