Sep 17 16:29:50.814715 ip-10-0-129-101 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 17 16:29:50.814733 ip-10-0-129-101 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 17 16:29:50.814745 ip-10-0-129-101 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 17 16:29:50.814985 ip-10-0-129-101 systemd[1]: Failed to start Kubernetes Kubelet. Sep 17 16:30:00.840514 ip-10-0-129-101 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 17 16:30:00.840538 ip-10-0-129-101 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 52b44eca0ccb4c2ba8e81b0c3d43c035 -- Sep 17 16:32:13.581762 ip-10-0-129-101 systemd[1]: Starting Kubernetes Kubelet... Sep 17 16:32:17.185751 ip-10-0-129-101 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 16:32:17.185751 ip-10-0-129-101 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 17 16:32:17.185751 ip-10-0-129-101 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 16:32:17.185751 ip-10-0-129-101 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 17 16:32:17.185751 ip-10-0-129-101 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 16:32:17.186566 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.185830 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 17 16:32:17.190344 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190323 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 16:32:17.190344 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190342 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 16:32:17.190344 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190347 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 16:32:17.190344 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190352 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 16:32:17.190623 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190356 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 16:32:17.190623 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190360 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 16:32:17.190623 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190365 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 16:32:17.190623 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190368 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 16:32:17.190623 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190372 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 16:32:17.190623 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190376 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 16:32:17.190623 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190380 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 16:32:17.190623 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190383 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 16:32:17.190623 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190387 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 16:32:17.190623 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190391 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 16:32:17.190623 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190401 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 16:32:17.190623 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190405 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 16:32:17.190623 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190408 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 16:32:17.190623 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190412 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 16:32:17.190623 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190416 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 16:32:17.190623 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190420 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 16:32:17.190623 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190423 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 17 16:32:17.190623 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190451 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 16:32:17.190623 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190455 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 16:32:17.190623 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190459 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 16:32:17.191462 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190462 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 16:32:17.191462 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190466 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 16:32:17.191462 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190470 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 16:32:17.191462 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190473 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 16:32:17.191462 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190480 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 16:32:17.191462 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190485 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 16:32:17.191462 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190489 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 16:32:17.191462 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190493 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 16:32:17.191462 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190498 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 16:32:17.191462 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190502 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 16:32:17.191462 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190509 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 16:32:17.191462 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190515 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 16:32:17.191462 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190521 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 16:32:17.191462 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190526 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 16:32:17.191462 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190531 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 16:32:17.191462 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190535 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 16:32:17.191462 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190549 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 16:32:17.191462 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190554 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 16:32:17.191911 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190559 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 16:32:17.191911 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190563 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 16:32:17.191911 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190568 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 16:32:17.191911 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190573 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 16:32:17.191911 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190578 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 16:32:17.191911 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190583 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 16:32:17.191911 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190587 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 16:32:17.191911 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190591 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 16:32:17.191911 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190595 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 16:32:17.191911 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190599 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 16:32:17.191911 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190604 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 16:32:17.191911 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190608 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 16:32:17.191911 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190612 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 16:32:17.191911 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190616 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 16:32:17.191911 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190619 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 16:32:17.191911 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190623 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 16:32:17.191911 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190627 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 16:32:17.191911 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190630 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 16:32:17.191911 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190635 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 16:32:17.191911 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190640 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 16:32:17.192543 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190646 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 16:32:17.192543 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190651 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 16:32:17.192543 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190656 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 16:32:17.192543 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190660 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 16:32:17.192543 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190665 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 16:32:17.192543 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190669 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 16:32:17.192543 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190673 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 16:32:17.192543 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190679 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 16:32:17.192543 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190684 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 16:32:17.192543 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190688 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 16:32:17.192543 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190692 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 16:32:17.192543 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190697 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 16:32:17.192543 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190703 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 16:32:17.192543 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190707 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 16:32:17.192543 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190711 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 16:32:17.192543 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190715 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 16:32:17.192543 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190719 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 16:32:17.192543 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190723 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 16:32:17.192543 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190728 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 16:32:17.193332 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190733 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 16:32:17.193332 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190737 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 16:32:17.193332 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190741 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 16:32:17.193332 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190745 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 16:32:17.193332 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190750 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 16:32:17.193332 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190754 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 16:32:17.193332 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190758 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 16:32:17.193332 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190762 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 16:32:17.193332 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190766 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 16:32:17.193332 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190770 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 16:32:17.193332 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190774 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 16:32:17.193332 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190779 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 16:32:17.193332 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190783 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 16:32:17.193332 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190787 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 16:32:17.193332 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190792 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 16:32:17.193332 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190796 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 16:32:17.193332 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190800 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 16:32:17.193332 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.190804 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 16:32:17.193332 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192846 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 16:32:17.193332 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192856 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 16:32:17.194180 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192862 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 16:32:17.194180 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192866 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 16:32:17.194180 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192871 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 16:32:17.194180 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192875 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 16:32:17.194180 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192882 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 16:32:17.194180 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192888 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 16:32:17.194180 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192893 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 16:32:17.194180 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192898 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 16:32:17.194180 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192902 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 16:32:17.194180 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192907 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 16:32:17.194180 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192911 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 16:32:17.194180 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192915 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 16:32:17.194180 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192920 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 16:32:17.194180 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192926 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 16:32:17.194180 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192930 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 16:32:17.194180 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192934 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 16:32:17.194180 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192939 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 16:32:17.194180 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192943 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 16:32:17.194180 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192948 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 16:32:17.195074 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192952 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 16:32:17.195074 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192956 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 16:32:17.195074 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192960 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 16:32:17.195074 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192964 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 16:32:17.195074 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192968 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 16:32:17.195074 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192973 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 16:32:17.195074 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192977 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 16:32:17.195074 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192982 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 16:32:17.195074 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192986 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 16:32:17.195074 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192990 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 16:32:17.195074 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192994 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 16:32:17.195074 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.192998 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 16:32:17.195074 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193002 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 16:32:17.195074 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193007 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 16:32:17.195074 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193011 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 16:32:17.195074 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193016 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 16:32:17.195074 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193020 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 16:32:17.195074 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193024 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 16:32:17.195074 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193028 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 16:32:17.195935 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193032 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 16:32:17.195935 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193037 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 16:32:17.195935 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193041 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 16:32:17.195935 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193045 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 16:32:17.195935 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193050 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 16:32:17.195935 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193054 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 16:32:17.195935 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193058 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 16:32:17.195935 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193063 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 16:32:17.195935 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193077 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 16:32:17.195935 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193081 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 16:32:17.195935 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193085 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 16:32:17.195935 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193089 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 16:32:17.195935 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193093 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 16:32:17.195935 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193097 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 16:32:17.195935 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193101 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 16:32:17.195935 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193105 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 16:32:17.195935 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193109 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 16:32:17.195935 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193113 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 16:32:17.195935 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193118 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 16:32:17.195935 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193122 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 16:32:17.196627 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193126 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 16:32:17.196627 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193130 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 16:32:17.196627 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193134 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 16:32:17.196627 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193138 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 16:32:17.196627 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193142 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 16:32:17.196627 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193146 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 16:32:17.196627 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193150 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 16:32:17.196627 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193158 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 16:32:17.196627 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193164 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 17 16:32:17.196627 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193172 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 16:32:17.196627 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193178 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 16:32:17.196627 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193183 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 16:32:17.196627 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193187 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 16:32:17.196627 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193192 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 16:32:17.196627 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193196 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 16:32:17.196627 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193201 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 16:32:17.196627 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193205 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 16:32:17.196627 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193209 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 16:32:17.196627 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193213 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 16:32:17.197141 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193217 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 16:32:17.197141 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193222 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 16:32:17.197141 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193226 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 16:32:17.197141 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193230 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 16:32:17.197141 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193234 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 16:32:17.197141 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193239 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 16:32:17.197141 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193243 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 16:32:17.197141 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193250 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 16:32:17.197141 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193254 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 16:32:17.197141 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193258 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 16:32:17.197141 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193263 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 16:32:17.197141 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193268 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 16:32:17.197141 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193272 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 16:32:17.197141 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193277 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 16:32:17.197141 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193281 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 16:32:17.197141 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193285 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 16:32:17.197141 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193289 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 16:32:17.197141 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193293 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 16:32:17.197141 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193297 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 16:32:17.197141 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193301 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 16:32:17.197757 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193909 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 16:32:17.197757 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193919 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 16:32:17.197757 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193923 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 16:32:17.197757 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193928 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 16:32:17.197757 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193932 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 16:32:17.197757 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193936 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 16:32:17.197757 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193940 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 16:32:17.197757 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193944 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 16:32:17.197757 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193948 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 16:32:17.197757 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193952 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 16:32:17.197757 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193956 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 16:32:17.197757 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193961 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 16:32:17.197757 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193964 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 16:32:17.197757 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193982 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 16:32:17.197757 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193988 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 16:32:17.197757 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193993 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 16:32:17.197757 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.193998 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 16:32:17.197757 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194002 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 16:32:17.197757 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194006 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 16:32:17.198386 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194010 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 16:32:17.198386 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194014 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 16:32:17.198386 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194018 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 16:32:17.198386 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194026 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 16:32:17.198386 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194030 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 16:32:17.198386 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194035 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 16:32:17.198386 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194039 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 16:32:17.198386 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194044 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 16:32:17.198386 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194048 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 16:32:17.198386 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194052 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 16:32:17.198386 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194056 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 16:32:17.198386 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194061 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 16:32:17.198386 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194065 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 16:32:17.198386 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194069 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 16:32:17.198386 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194073 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 16:32:17.198386 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194077 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 16:32:17.198386 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194081 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 16:32:17.198386 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194085 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 16:32:17.198386 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194089 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 16:32:17.198386 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194093 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 16:32:17.198897 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194097 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 16:32:17.198897 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194101 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 16:32:17.198897 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194106 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 16:32:17.198897 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194110 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 16:32:17.198897 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194114 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 16:32:17.198897 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194118 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 16:32:17.198897 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194122 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 16:32:17.198897 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194133 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 16:32:17.198897 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194137 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 16:32:17.198897 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194141 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 16:32:17.198897 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194145 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 16:32:17.198897 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194149 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 16:32:17.198897 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194154 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 16:32:17.198897 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194158 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 16:32:17.198897 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194162 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 16:32:17.198897 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194168 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 16:32:17.198897 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194172 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 16:32:17.198897 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194176 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 16:32:17.198897 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194180 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 16:32:17.198897 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194184 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 16:32:17.198897 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194188 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 16:32:17.199510 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194191 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 16:32:17.199510 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194196 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 16:32:17.199510 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194200 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 16:32:17.199510 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194204 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 16:32:17.199510 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194208 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 16:32:17.199510 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194212 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 16:32:17.199510 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194216 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 16:32:17.199510 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194221 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 16:32:17.199510 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194225 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 16:32:17.199510 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194233 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 16:32:17.199510 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194238 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 16:32:17.199510 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194242 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 16:32:17.199510 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194247 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 16:32:17.199510 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194252 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 16:32:17.199510 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194256 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 16:32:17.199510 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194260 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 16:32:17.199510 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194264 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 16:32:17.199510 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194268 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 16:32:17.199510 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194273 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 16:32:17.199975 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194289 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 16:32:17.199975 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194296 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 16:32:17.199975 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194301 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 16:32:17.199975 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194307 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 16:32:17.199975 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194312 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 16:32:17.199975 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194317 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 16:32:17.199975 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194322 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 16:32:17.199975 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194328 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 16:32:17.199975 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194332 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 16:32:17.199975 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194336 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 16:32:17.199975 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194341 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 16:32:17.199975 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194345 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 16:32:17.199975 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194349 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 17 16:32:17.199975 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194353 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 16:32:17.199975 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194357 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 16:32:17.199975 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194361 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 16:32:17.199975 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194365 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 16:32:17.199975 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194369 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 16:32:17.199975 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194373 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 16:32:17.200417 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.194377 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 16:32:17.200417 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194505 2581 flags.go:64] FLAG: --address="0.0.0.0" Sep 17 16:32:17.200417 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194552 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 17 16:32:17.200417 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194566 2581 flags.go:64] FLAG: --anonymous-auth="true" Sep 17 16:32:17.200417 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194572 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 17 16:32:17.200417 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194578 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 17 16:32:17.200417 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194583 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 17 16:32:17.200417 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194590 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 17 16:32:17.200417 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194595 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 17 16:32:17.200417 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194600 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 17 16:32:17.200417 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194605 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 17 16:32:17.200417 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194610 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 17 16:32:17.200417 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194615 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 17 16:32:17.200417 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194620 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 17 16:32:17.200417 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194633 2581 flags.go:64] FLAG: --cgroup-root="" Sep 17 16:32:17.200417 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194638 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 17 16:32:17.200417 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194643 2581 flags.go:64] FLAG: --client-ca-file="" Sep 17 16:32:17.200417 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194648 2581 flags.go:64] FLAG: --cloud-provider="external" Sep 17 16:32:17.200417 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194653 2581 flags.go:64] FLAG: --cluster-dns="[]" Sep 17 16:32:17.200417 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194662 2581 flags.go:64] FLAG: --cluster-domain="" Sep 17 16:32:17.200417 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194668 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 17 16:32:17.200417 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194673 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 17 16:32:17.200417 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194678 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 17 16:32:17.200417 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194683 2581 flags.go:64] FLAG: --container-log-max-files="5" Sep 17 16:32:17.201010 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194689 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 17 16:32:17.201010 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194693 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 17 16:32:17.201010 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194698 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 17 16:32:17.201010 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194704 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 17 16:32:17.201010 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194708 2581 flags.go:64] FLAG: --contention-profiling="false" Sep 17 16:32:17.201010 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194713 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 17 16:32:17.201010 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194725 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 17 16:32:17.201010 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194730 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 17 16:32:17.201010 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194735 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 17 16:32:17.201010 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194742 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 17 16:32:17.201010 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194746 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 17 16:32:17.201010 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194751 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 17 16:32:17.201010 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194755 2581 flags.go:64] FLAG: --enable-load-reader="false" Sep 17 16:32:17.201010 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194760 2581 flags.go:64] FLAG: --enable-server="true" Sep 17 16:32:17.201010 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194765 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 17 16:32:17.201010 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194775 2581 flags.go:64] FLAG: --event-burst="100" Sep 17 16:32:17.201010 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194779 2581 flags.go:64] FLAG: --event-qps="50" Sep 17 16:32:17.201010 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194783 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 17 16:32:17.201010 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194788 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 17 16:32:17.201010 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194793 2581 flags.go:64] FLAG: --eviction-hard="" Sep 17 16:32:17.201010 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194798 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 17 16:32:17.201010 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194803 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 17 16:32:17.201010 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194807 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 17 16:32:17.201010 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194819 2581 flags.go:64] FLAG: --eviction-soft="" Sep 17 16:32:17.201010 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194824 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 17 16:32:17.201662 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194828 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 17 16:32:17.201662 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194833 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 17 16:32:17.201662 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194837 2581 flags.go:64] FLAG: --experimental-mounter-path="" Sep 17 16:32:17.201662 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194844 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 17 16:32:17.201662 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194848 2581 flags.go:64] FLAG: --fail-swap-on="true" Sep 17 16:32:17.201662 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194853 2581 flags.go:64] FLAG: --feature-gates="" Sep 17 16:32:17.201662 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194858 2581 flags.go:64] FLAG: --file-check-frequency="20s" Sep 17 16:32:17.201662 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194863 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 17 16:32:17.201662 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194867 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 17 16:32:17.201662 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194873 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 17 16:32:17.201662 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194878 2581 flags.go:64] FLAG: --healthz-port="10248" Sep 17 16:32:17.201662 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194883 2581 flags.go:64] FLAG: --help="false" Sep 17 16:32:17.201662 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194887 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-129-101.ec2.internal" Sep 17 16:32:17.201662 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194892 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 17 16:32:17.201662 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194897 2581 flags.go:64] FLAG: --http-check-frequency="20s" Sep 17 16:32:17.201662 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194901 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 17 16:32:17.201662 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194906 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 17 16:32:17.201662 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194912 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 17 16:32:17.201662 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194916 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 17 16:32:17.201662 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194921 2581 flags.go:64] FLAG: --image-service-endpoint="" Sep 17 16:32:17.201662 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194925 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 17 16:32:17.201662 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194930 2581 flags.go:64] FLAG: --kube-api-burst="100" Sep 17 16:32:17.201662 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194934 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 17 16:32:17.202275 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194939 2581 flags.go:64] FLAG: --kube-api-qps="50" Sep 17 16:32:17.202275 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194944 2581 flags.go:64] FLAG: --kube-reserved="" Sep 17 16:32:17.202275 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194949 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 17 16:32:17.202275 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194953 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 17 16:32:17.202275 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194958 2581 flags.go:64] FLAG: --kubelet-cgroups="" Sep 17 16:32:17.202275 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194962 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 17 16:32:17.202275 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194967 2581 flags.go:64] FLAG: --lock-file="" Sep 17 16:32:17.202275 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194971 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 17 16:32:17.202275 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194983 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 17 16:32:17.202275 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194988 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 17 16:32:17.202275 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.194996 2581 flags.go:64] FLAG: --log-json-split-stream="false" Sep 17 16:32:17.202275 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195001 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 17 16:32:17.202275 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195007 2581 flags.go:64] FLAG: --log-text-split-stream="false" Sep 17 16:32:17.202275 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195011 2581 flags.go:64] FLAG: --logging-format="text" Sep 17 16:32:17.202275 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195015 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 17 16:32:17.202275 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195021 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 17 16:32:17.202275 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195025 2581 flags.go:64] FLAG: --manifest-url="" Sep 17 16:32:17.202275 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195029 2581 flags.go:64] FLAG: --manifest-url-header="" Sep 17 16:32:17.202275 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195035 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 17 16:32:17.202275 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195044 2581 flags.go:64] FLAG: --max-open-files="1000000" Sep 17 16:32:17.202275 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195050 2581 flags.go:64] FLAG: --max-pods="110" Sep 17 16:32:17.202275 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195055 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 17 16:32:17.202275 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195060 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 17 16:32:17.202275 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195064 2581 flags.go:64] FLAG: --memory-manager-policy="None" Sep 17 16:32:17.202275 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195069 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 17 16:32:17.203301 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195073 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 17 16:32:17.203301 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195077 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 17 16:32:17.203301 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195081 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 17 16:32:17.203301 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195091 2581 flags.go:64] FLAG: --node-status-max-images="50" Sep 17 16:32:17.203301 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195096 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 17 16:32:17.203301 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195100 2581 flags.go:64] FLAG: --oom-score-adj="-999" Sep 17 16:32:17.203301 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195105 2581 flags.go:64] FLAG: --pod-cidr="" Sep 17 16:32:17.203301 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195109 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 17 16:32:17.203301 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195117 2581 flags.go:64] FLAG: --pod-manifest-path="" Sep 17 16:32:17.203301 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195121 2581 flags.go:64] FLAG: --pod-max-pids="-1" Sep 17 16:32:17.203301 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195126 2581 flags.go:64] FLAG: --pods-per-core="0" Sep 17 16:32:17.203301 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195130 2581 flags.go:64] FLAG: --port="10250" Sep 17 16:32:17.203301 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195135 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 17 16:32:17.203301 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195140 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f8d3a7913b3f3589" Sep 17 16:32:17.203301 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195145 2581 flags.go:64] FLAG: --qos-reserved="" Sep 17 16:32:17.203301 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195149 2581 flags.go:64] FLAG: --read-only-port="10255" Sep 17 16:32:17.203301 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195162 2581 flags.go:64] FLAG: --register-node="true" Sep 17 16:32:17.203301 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195167 2581 flags.go:64] FLAG: --register-with-taints="" Sep 17 16:32:17.203301 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195172 2581 flags.go:64] FLAG: --registry-burst="10" Sep 17 16:32:17.203301 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195177 2581 flags.go:64] FLAG: --registry-qps="5" Sep 17 16:32:17.203301 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195182 2581 flags.go:64] FLAG: --reserved-cpus="" Sep 17 16:32:17.203301 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195186 2581 flags.go:64] FLAG: --reserved-memory="" Sep 17 16:32:17.203301 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195192 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 17 16:32:17.203301 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195197 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 17 16:32:17.203301 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195201 2581 flags.go:64] FLAG: --rotate-certificates="false" Sep 17 16:32:17.204313 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195206 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 17 16:32:17.204313 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195210 2581 flags.go:64] FLAG: --runonce="false" Sep 17 16:32:17.204313 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195217 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 17 16:32:17.204313 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195222 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 17 16:32:17.204313 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195226 2581 flags.go:64] FLAG: --seccomp-default="false" Sep 17 16:32:17.204313 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195231 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 17 16:32:17.204313 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195235 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 17 16:32:17.204313 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195240 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 17 16:32:17.204313 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195256 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 17 16:32:17.204313 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195261 2581 flags.go:64] FLAG: --storage-driver-password="root" Sep 17 16:32:17.204313 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195266 2581 flags.go:64] FLAG: --storage-driver-secure="false" Sep 17 16:32:17.204313 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195270 2581 flags.go:64] FLAG: --storage-driver-table="stats" Sep 17 16:32:17.204313 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195274 2581 flags.go:64] FLAG: --storage-driver-user="root" Sep 17 16:32:17.204313 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195279 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 17 16:32:17.204313 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195284 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 17 16:32:17.204313 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195289 2581 flags.go:64] FLAG: --system-cgroups="" Sep 17 16:32:17.204313 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195304 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 17 16:32:17.204313 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195313 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 17 16:32:17.204313 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195317 2581 flags.go:64] FLAG: --tls-cert-file="" Sep 17 16:32:17.204313 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195322 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 17 16:32:17.204313 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195330 2581 flags.go:64] FLAG: --tls-min-version="" Sep 17 16:32:17.204313 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195335 2581 flags.go:64] FLAG: --tls-private-key-file="" Sep 17 16:32:17.204313 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195339 2581 flags.go:64] FLAG: --topology-manager-policy="none" Sep 17 16:32:17.204313 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195344 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 17 16:32:17.204313 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195356 2581 flags.go:64] FLAG: --topology-manager-scope="container" Sep 17 16:32:17.205338 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195361 2581 flags.go:64] FLAG: --v="2" Sep 17 16:32:17.205338 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195367 2581 flags.go:64] FLAG: --version="false" Sep 17 16:32:17.205338 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195373 2581 flags.go:64] FLAG: --vmodule="" Sep 17 16:32:17.205338 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195379 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 17 16:32:17.205338 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.195384 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 17 16:32:17.205338 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195611 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 16:32:17.205338 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195619 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 16:32:17.205338 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195623 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 16:32:17.205338 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195628 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 16:32:17.205338 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195637 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 16:32:17.205338 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195643 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 16:32:17.205338 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195648 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 16:32:17.205338 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195653 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 16:32:17.205338 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195657 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 16:32:17.205338 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195661 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 16:32:17.205338 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195665 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 16:32:17.205338 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195670 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 16:32:17.205338 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195674 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 16:32:17.205338 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195678 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 16:32:17.205338 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195682 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 16:32:17.206179 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195686 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 16:32:17.206179 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195691 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 16:32:17.206179 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195695 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 16:32:17.206179 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195699 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 16:32:17.206179 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195703 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 16:32:17.206179 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195707 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 16:32:17.206179 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195711 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 16:32:17.206179 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195715 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 16:32:17.206179 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195719 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 16:32:17.206179 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195723 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 16:32:17.206179 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195727 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 16:32:17.206179 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195731 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 16:32:17.206179 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195742 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 16:32:17.206179 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195747 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 16:32:17.206179 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195751 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 16:32:17.206179 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195756 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 16:32:17.206179 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195760 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 16:32:17.206179 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195764 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 16:32:17.206179 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195770 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 16:32:17.206179 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195776 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 16:32:17.207047 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195781 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 16:32:17.207047 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195787 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 16:32:17.207047 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195791 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 16:32:17.207047 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195795 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 16:32:17.207047 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195799 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 16:32:17.207047 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195803 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 16:32:17.207047 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195807 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 16:32:17.207047 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195811 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 16:32:17.207047 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195815 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 16:32:17.207047 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195819 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 16:32:17.207047 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195826 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 16:32:17.207047 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195831 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 16:32:17.207047 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195835 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 16:32:17.207047 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195840 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 16:32:17.207047 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195844 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 16:32:17.207047 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195848 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 16:32:17.207047 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195852 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 16:32:17.207047 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195856 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 16:32:17.207047 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195860 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 16:32:17.207903 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195864 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 16:32:17.207903 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195868 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 16:32:17.207903 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195872 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 16:32:17.207903 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195876 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 16:32:17.207903 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195881 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 16:32:17.207903 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195884 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 16:32:17.207903 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195897 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 16:32:17.207903 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195902 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 16:32:17.207903 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195907 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 16:32:17.207903 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195911 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 16:32:17.207903 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195915 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 16:32:17.207903 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195918 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 16:32:17.207903 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195922 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 16:32:17.207903 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195926 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 16:32:17.207903 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195932 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 16:32:17.207903 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195935 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 16:32:17.207903 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195939 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 16:32:17.207903 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195943 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 16:32:17.207903 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195947 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 16:32:17.207903 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195951 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 16:32:17.208566 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195955 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 16:32:17.208566 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195959 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 16:32:17.208566 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195963 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 16:32:17.208566 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195967 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 16:32:17.208566 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195971 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 16:32:17.208566 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195975 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 16:32:17.208566 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195979 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 16:32:17.208566 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195983 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 16:32:17.208566 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195987 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 16:32:17.208566 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195991 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 16:32:17.208566 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.195997 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 16:32:17.208566 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.196000 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 16:32:17.208566 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.196004 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 16:32:17.208566 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.196009 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 16:32:17.208566 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.196013 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 16:32:17.208566 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.196017 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 16:32:17.208566 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.196021 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 16:32:17.208566 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.196025 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 16:32:17.208566 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.196029 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 16:32:17.208566 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.196048 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 16:32:17.209126 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.196053 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 16:32:17.209126 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.196057 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 16:32:17.209126 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.196061 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 17 16:32:17.209126 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.196065 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 16:32:17.209126 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.196069 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 16:32:17.209126 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.196077 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 16:32:17.209126 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.206775 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 17 16:32:17.209126 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.206794 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 17 16:32:17.209126 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.206821 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 17 16:32:17.209126 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.206834 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 17 16:32:17.209126 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.206916 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 16:32:17.209126 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.206922 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 16:32:17.209126 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.206927 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 16:32:17.209126 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.206933 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 16:32:17.209126 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.206937 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 16:32:17.209732 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.206941 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 16:32:17.209732 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.206945 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 16:32:17.209732 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.206949 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 16:32:17.209732 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.206954 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 16:32:17.209732 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.206958 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 16:32:17.209732 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.206962 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 16:32:17.209732 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.206966 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 16:32:17.209732 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.206971 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 17 16:32:17.209732 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.206975 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 16:32:17.209732 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.206979 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 16:32:17.209732 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.206983 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 16:32:17.209732 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.206987 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 16:32:17.209732 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.206992 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 16:32:17.209732 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.206996 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 16:32:17.209732 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207001 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 16:32:17.209732 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207004 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 16:32:17.209732 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207008 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 16:32:17.209732 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207013 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 16:32:17.209732 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207017 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 16:32:17.209732 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207021 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 16:32:17.210230 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207025 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 16:32:17.210230 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207029 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 16:32:17.210230 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207035 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 16:32:17.210230 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207039 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 16:32:17.210230 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207043 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 16:32:17.210230 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207047 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 16:32:17.210230 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207050 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 16:32:17.210230 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207054 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 16:32:17.210230 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207058 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 16:32:17.210230 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207062 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 16:32:17.210230 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207066 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 16:32:17.210230 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207069 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 16:32:17.210230 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207074 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 16:32:17.210230 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207078 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 16:32:17.210230 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207082 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 16:32:17.210230 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207087 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 16:32:17.210230 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207091 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 16:32:17.210230 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207095 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 16:32:17.210230 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207102 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 16:32:17.211086 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207108 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 16:32:17.211086 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207113 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 16:32:17.211086 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207117 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 16:32:17.211086 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207122 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 16:32:17.211086 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207127 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 16:32:17.211086 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207131 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 16:32:17.211086 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207135 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 16:32:17.211086 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207139 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 16:32:17.211086 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207143 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 16:32:17.211086 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207148 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 16:32:17.211086 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207152 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 16:32:17.211086 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207157 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 16:32:17.211086 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207161 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 16:32:17.211086 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207165 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 16:32:17.211086 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207169 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 16:32:17.211086 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207173 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 16:32:17.211086 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207177 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 16:32:17.211086 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207181 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 16:32:17.211086 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207185 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 16:32:17.211086 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207189 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 16:32:17.211761 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207196 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 16:32:17.211761 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207201 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 16:32:17.211761 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207206 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 16:32:17.211761 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207211 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 16:32:17.211761 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207216 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 16:32:17.211761 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207220 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 16:32:17.211761 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207225 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 16:32:17.211761 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207229 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 16:32:17.211761 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207233 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 16:32:17.211761 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207238 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 16:32:17.211761 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207242 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 16:32:17.211761 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207246 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 16:32:17.211761 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207249 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 16:32:17.211761 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207254 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 16:32:17.211761 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207259 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 16:32:17.211761 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207274 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 16:32:17.211761 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207280 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 16:32:17.211761 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207285 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 16:32:17.211761 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207289 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 16:32:17.212362 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207293 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 16:32:17.212362 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207297 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 16:32:17.212362 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207302 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 16:32:17.212362 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207306 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 16:32:17.212362 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207311 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 16:32:17.212362 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207315 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 16:32:17.212362 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207319 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 16:32:17.212362 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207323 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 16:32:17.212362 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207327 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 16:32:17.212362 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207331 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 16:32:17.212362 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207335 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 16:32:17.212362 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207339 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 16:32:17.212362 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207343 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 16:32:17.212362 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207347 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 16:32:17.212362 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207351 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 16:32:17.212362 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207355 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 16:32:17.212827 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.207363 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 16:32:17.212827 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207560 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 16:32:17.212827 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207569 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 16:32:17.212827 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207575 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 16:32:17.212827 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207579 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 16:32:17.212827 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207584 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 16:32:17.212827 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207589 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 16:32:17.212827 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207595 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 16:32:17.212827 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207601 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 16:32:17.212827 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207606 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 16:32:17.212827 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207610 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 16:32:17.212827 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207615 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 16:32:17.212827 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207619 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 16:32:17.212827 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207625 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 16:32:17.212827 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207629 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 16:32:17.213217 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207633 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 16:32:17.213217 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207638 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 16:32:17.213217 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207642 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 16:32:17.213217 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207646 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 16:32:17.213217 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207649 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 16:32:17.213217 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207654 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 16:32:17.213217 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207658 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 16:32:17.213217 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207662 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 16:32:17.213217 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207666 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 16:32:17.213217 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207670 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 16:32:17.213217 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207674 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 17 16:32:17.213217 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207678 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 16:32:17.213217 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207683 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 16:32:17.213217 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207686 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 16:32:17.213217 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207690 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 16:32:17.213217 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207694 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 16:32:17.213217 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207698 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 16:32:17.213217 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207703 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 16:32:17.213217 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207707 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 16:32:17.213217 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207711 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 16:32:17.213766 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207714 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 16:32:17.213766 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207718 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 16:32:17.213766 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207723 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 16:32:17.213766 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207730 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 16:32:17.213766 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207734 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 16:32:17.213766 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207741 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 16:32:17.213766 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207747 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 16:32:17.213766 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207752 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 16:32:17.213766 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207757 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 16:32:17.213766 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207760 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 16:32:17.213766 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207765 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 16:32:17.213766 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207770 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 16:32:17.213766 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207773 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 16:32:17.213766 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207778 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 16:32:17.213766 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207782 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 16:32:17.213766 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207786 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 16:32:17.213766 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207790 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 16:32:17.213766 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207794 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 16:32:17.213766 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207799 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 16:32:17.214238 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207802 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 16:32:17.214238 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207806 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 16:32:17.214238 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207810 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 16:32:17.214238 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207815 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 16:32:17.214238 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207819 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 16:32:17.214238 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207823 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 16:32:17.214238 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207827 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 16:32:17.214238 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207831 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 16:32:17.214238 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207835 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 16:32:17.214238 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207839 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 16:32:17.214238 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207843 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 16:32:17.214238 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207847 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 16:32:17.214238 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207851 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 16:32:17.214238 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207855 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 16:32:17.214238 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207859 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 16:32:17.214238 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207863 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 16:32:17.214238 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207867 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 16:32:17.214238 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207871 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 16:32:17.214238 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207875 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 16:32:17.214238 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207879 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 16:32:17.214870 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207884 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 16:32:17.214870 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207888 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 16:32:17.214870 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207894 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 16:32:17.214870 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207898 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 16:32:17.214870 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207902 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 16:32:17.214870 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207907 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 16:32:17.214870 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207911 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 16:32:17.214870 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207915 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 16:32:17.214870 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207919 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 16:32:17.214870 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207923 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 16:32:17.214870 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207927 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 16:32:17.214870 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207931 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 16:32:17.214870 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207935 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 16:32:17.214870 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207940 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 16:32:17.214870 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207944 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 16:32:17.214870 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207948 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 16:32:17.214870 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207952 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 16:32:17.214870 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207956 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 16:32:17.214870 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207960 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 16:32:17.215649 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207964 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 16:32:17.215649 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207968 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 16:32:17.215649 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207972 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 16:32:17.215649 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207976 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 16:32:17.215649 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207980 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 16:32:17.215649 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207985 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 16:32:17.215649 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:17.207988 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 16:32:17.215649 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.207996 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 16:32:17.215649 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.208137 2581 server.go:962] "Client rotation is on, will bootstrap in background" Sep 17 16:32:17.215649 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.211854 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 17 16:32:17.215649 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.212648 2581 server.go:1019] "Starting client certificate rotation" Sep 17 16:32:17.215649 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.212753 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 16:32:17.215649 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.212787 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 16:32:17.216189 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.215527 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 16:32:17.216974 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.216950 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 16:32:17.230351 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.230329 2581 log.go:25] "Validated CRI v1 runtime API" Sep 17 16:32:17.232114 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.232100 2581 log.go:25] "Validated CRI v1 image API" Sep 17 16:32:17.232998 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.232983 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 17 16:32:17.237203 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.237182 2581 fs.go:135] Filesystem UUIDs: map[6c333be6-91f2-45ce-980e-987772a11168:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7db32dbc-d032-4439-98b0-1135e36dd0f4:/dev/nvme0n1p4] Sep 17 16:32:17.237275 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.237199 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 17 16:32:17.241139 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.241031 2581 manager.go:216] Machine: {Timestamp:2026-09-17 16:32:17.240580375 +0000 UTC m=+1.973047944 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103541 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bfcfa0e610039d6e5b6322e29cd41 SystemUUID:ec2bfcfa-0e61-0039-d6e5-b6322e29cd41 BootID:52b44eca-0ccb-4c2b-a8e8-1b0c3d43c035 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d2:ea:84:d1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d2:ea:84:d1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1e:e6:3e:ce:87:a2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 17 16:32:17.241139 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.241133 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 17 16:32:17.241226 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.241203 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 17 16:32:17.243033 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.243000 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 17 16:32:17.243272 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.243031 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-101.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 17 16:32:17.244379 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.244358 2581 topology_manager.go:138] "Creating topology manager with none policy" Sep 17 16:32:17.244481 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.244385 2581 container_manager_linux.go:309] "Creating device plugin manager" Sep 17 16:32:17.244481 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.244396 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 16:32:17.244481 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.244413 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 16:32:17.244611 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.244513 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 17 16:32:17.248143 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.248130 2581 state_mem.go:36] "Initialized new in-memory state store" Sep 17 16:32:17.248246 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.248236 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 17 16:32:17.248290 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.248264 2581 kubelet.go:486] "Attempting to sync node with API server" Sep 17 16:32:17.248290 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.248274 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 17 16:32:17.248290 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.248287 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 17 16:32:17.248411 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.248296 2581 kubelet.go:398] "Adding apiserver pod source" Sep 17 16:32:17.248411 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.248304 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 17 16:32:17.248526 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.248507 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 16:32:17.248624 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.248613 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 16:32:17.248665 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.248631 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 16:32:17.255213 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.255191 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 17 16:32:17.257806 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.257792 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 17 16:32:17.257858 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.257822 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 17 16:32:17.258886 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.258876 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 17 16:32:17.258921 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.258891 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 17 16:32:17.258921 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.258897 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 17 16:32:17.258921 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.258902 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 17 16:32:17.258921 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.258910 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 17 16:32:17.258921 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.258915 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 17 16:32:17.259054 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.258928 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 17 16:32:17.259054 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.258934 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 17 16:32:17.259054 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.258940 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 17 16:32:17.259054 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.258945 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 17 16:32:17.259054 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.258953 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 17 16:32:17.259054 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.258958 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 17 16:32:17.259054 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.258980 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 17 16:32:17.259054 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.258985 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 17 16:32:17.261993 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.261967 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-101.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 17 16:32:17.262645 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:17.262628 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 17 16:32:17.262694 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:17.262628 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-101.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 17 16:32:17.262694 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.262651 2581 server.go:1268] "Started kubelet" Sep 17 16:32:17.262765 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.262717 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 17 16:32:17.262921 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.262870 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 17 16:32:17.262996 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.262944 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 17 16:32:17.264258 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.264241 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 17 16:32:17.265851 ip-10-0-129-101 systemd[1]: Started Kubernetes Kubelet. Sep 17 16:32:17.267658 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.267524 2581 server.go:310] "Adding debug handlers to kubelet server" Sep 17 16:32:17.269676 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:17.269650 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 17 16:32:17.272682 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.272668 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 17 16:32:17.272761 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.272685 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 17 16:32:17.272868 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:17.272802 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-101.ec2.internal\" not found" Sep 17 16:32:17.273294 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.273278 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 17 16:32:17.273294 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.273281 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 17 16:32:17.273424 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.273304 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 17 16:32:17.273424 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.273393 2581 reconstruct.go:97] "Volume reconstruction finished" Sep 17 16:32:17.273424 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.273403 2581 reconciler.go:29] "Reconciler: start to sync state" Sep 17 16:32:17.274111 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.274094 2581 factory.go:55] Registering systemd factory Sep 17 16:32:17.274166 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.274116 2581 factory.go:223] Registration of the systemd container factory successfully Sep 17 16:32:17.274363 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.274350 2581 factory.go:153] Registering CRI-O factory Sep 17 16:32:17.274396 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.274368 2581 factory.go:223] Registration of the crio container factory successfully Sep 17 16:32:17.274444 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.274417 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 17 16:32:17.274497 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.274454 2581 factory.go:103] Registering Raw factory Sep 17 16:32:17.274497 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.274472 2581 manager.go:1196] Started watching for new ooms in manager Sep 17 16:32:17.275032 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.274892 2581 manager.go:349] Starting recovery of all containers Sep 17 16:32:17.275811 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:17.275788 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 17 16:32:17.275919 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:17.275896 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-101.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 17 16:32:17.298455 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.298420 2581 manager.go:354] Recovery completed Sep 17 16:32:17.302574 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.302562 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 16:32:17.304801 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.304781 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-101.ec2.internal" event="NodeHasSufficientMemory" Sep 17 16:32:17.304858 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.304814 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-101.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 16:32:17.304858 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.304824 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-101.ec2.internal" event="NodeHasSufficientPID" Sep 17 16:32:17.305325 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.305309 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 17 16:32:17.305325 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.305324 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 17 16:32:17.305325 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.305325 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 16:32:17.305501 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.305338 2581 state_mem.go:36] "Initialized new in-memory state store" Sep 17 16:32:17.306019 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.306001 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-101.ec2.internal" event="NodeHasSufficientMemory" Sep 17 16:32:17.306060 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.306031 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-101.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 16:32:17.306060 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.306045 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-101.ec2.internal" event="NodeHasSufficientPID" Sep 17 16:32:17.306555 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:17.305612 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-101.ec2.internal.18d628c70a4ad7b2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-101.ec2.internal,UID:ip-10-0-129-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-101.ec2.internal,},FirstTimestamp:2026-09-17 16:32:17.262630834 +0000 UTC m=+1.995098403,LastTimestamp:2026-09-17 16:32:17.262630834 +0000 UTC m=+1.995098403,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-101.ec2.internal,}" Sep 17 16:32:17.306697 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.306684 2581 policy_none.go:49] "None policy: Start" Sep 17 16:32:17.306732 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.306711 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 17 16:32:17.306732 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.306723 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 17 16:32:17.307871 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.307861 2581 policy_none.go:47] "Start" Sep 17 16:32:17.315588 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:17.315447 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-101.ec2.internal.18d628c70cce5089 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-101.ec2.internal,UID:ip-10-0-129-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-101.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-101.ec2.internal,},FirstTimestamp:2026-09-17 16:32:17.304801417 +0000 UTC m=+2.037268988,LastTimestamp:2026-09-17 16:32:17.304801417 +0000 UTC m=+2.037268988,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-101.ec2.internal,}" Sep 17 16:32:17.324937 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:17.324856 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-101.ec2.internal.18d628c70cce9605 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-101.ec2.internal,UID:ip-10-0-129-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-101.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-101.ec2.internal,},FirstTimestamp:2026-09-17 16:32:17.304819205 +0000 UTC m=+2.037286774,LastTimestamp:2026-09-17 16:32:17.304819205 +0000 UTC m=+2.037286774,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-101.ec2.internal,}" Sep 17 16:32:17.333793 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:17.333729 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-101.ec2.internal.18d628c70cceb8f3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-101.ec2.internal,UID:ip-10-0-129-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-101.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-101.ec2.internal,},FirstTimestamp:2026-09-17 16:32:17.304828147 +0000 UTC m=+2.037295717,LastTimestamp:2026-09-17 16:32:17.304828147 +0000 UTC m=+2.037295717,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-101.ec2.internal,}" Sep 17 16:32:17.340594 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.340499 2581 manager.go:337] "Starting Device Plugin manager" Sep 17 16:32:17.340594 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:17.340535 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 17 16:32:17.340594 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.340548 2581 server.go:87] "Starting device plugin registration server" Sep 17 16:32:17.373937 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.340788 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 17 16:32:17.373937 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.340800 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 17 16:32:17.373937 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.340925 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 17 16:32:17.373937 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.340990 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 17 16:32:17.373937 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.340999 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 17 16:32:17.373937 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:17.341807 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 17 16:32:17.373937 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:17.341869 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-101.ec2.internal\" not found" Sep 17 16:32:17.373937 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:17.343691 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-101.ec2.internal.18d628c70cce5089\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-101.ec2.internal.18d628c70cce5089 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-101.ec2.internal,UID:ip-10-0-129-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-101.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-101.ec2.internal,},FirstTimestamp:2026-09-17 16:32:17.304801417 +0000 UTC m=+2.037268988,LastTimestamp:2026-09-17 16:32:17.306017307 +0000 UTC m=+2.038484876,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-101.ec2.internal,}" Sep 17 16:32:17.373937 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:17.352007 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-101.ec2.internal.18d628c70cce9605\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-101.ec2.internal.18d628c70cce9605 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-101.ec2.internal,UID:ip-10-0-129-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-101.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-101.ec2.internal,},FirstTimestamp:2026-09-17 16:32:17.304819205 +0000 UTC m=+2.037286774,LastTimestamp:2026-09-17 16:32:17.306038052 +0000 UTC m=+2.038505622,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-101.ec2.internal,}" Sep 17 16:32:17.373937 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:17.363331 2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-101.ec2.internal.18d628c70cceb8f3\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-101.ec2.internal.18d628c70cceb8f3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-101.ec2.internal,UID:ip-10-0-129-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-101.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-101.ec2.internal,},FirstTimestamp:2026-09-17 16:32:17.304828147 +0000 UTC m=+2.037295717,LastTimestamp:2026-09-17 16:32:17.306048928 +0000 UTC m=+2.038516498,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-101.ec2.internal,}" Sep 17 16:32:17.373937 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.365000 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4c9bc" Sep 17 16:32:17.373937 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:17.372604 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-101.ec2.internal.18d628c70ff6f915 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-101.ec2.internal,UID:ip-10-0-129-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-129-101.ec2.internal,},FirstTimestamp:2026-09-17 16:32:17.357797653 +0000 UTC m=+2.090265210,LastTimestamp:2026-09-17 16:32:17.357797653 +0000 UTC m=+2.090265210,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-101.ec2.internal,}" Sep 17 16:32:17.373937 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.373889 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4c9bc" Sep 17 16:32:17.413307 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.413282 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 17 16:32:17.414501 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.414484 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 17 16:32:17.414582 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.414531 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 17 16:32:17.414582 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.414549 2581 kubelet.go:2448] "Starting kubelet main sync loop" Sep 17 16:32:17.414677 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:17.414587 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 17 16:32:17.424994 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.424975 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 16:32:17.440897 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.440859 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 16:32:17.441558 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.441546 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-101.ec2.internal" event="NodeHasSufficientMemory" Sep 17 16:32:17.441625 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.441571 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-101.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 16:32:17.441625 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.441580 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-101.ec2.internal" event="NodeHasSufficientPID" Sep 17 16:32:17.441625 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.441603 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-101.ec2.internal" Sep 17 16:32:17.483442 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.483412 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-101.ec2.internal" Sep 17 16:32:17.483510 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:17.483448 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-101.ec2.internal\": node \"ip-10-0-129-101.ec2.internal\" not found" Sep 17 16:32:17.498642 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:17.498622 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-101.ec2.internal\" not found" Sep 17 16:32:17.514972 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.514951 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-101.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-101.ec2.internal"] Sep 17 16:32:17.515024 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.515006 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 16:32:17.517045 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.517030 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-101.ec2.internal" event="NodeHasSufficientMemory" Sep 17 16:32:17.517132 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.517059 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-101.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 16:32:17.517132 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.517080 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-101.ec2.internal" event="NodeHasSufficientPID" Sep 17 16:32:17.518395 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.518381 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 16:32:17.518499 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.518485 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-101.ec2.internal" Sep 17 16:32:17.518555 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.518513 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 16:32:17.519128 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.519111 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-101.ec2.internal" event="NodeHasSufficientMemory" Sep 17 16:32:17.519209 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.519141 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-101.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 16:32:17.519209 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.519153 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-101.ec2.internal" event="NodeHasSufficientPID" Sep 17 16:32:17.519278 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.519113 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-101.ec2.internal" event="NodeHasSufficientMemory" Sep 17 16:32:17.519278 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.519232 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-101.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 16:32:17.519278 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.519242 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-101.ec2.internal" event="NodeHasSufficientPID" Sep 17 16:32:17.520387 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.520375 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-101.ec2.internal" Sep 17 16:32:17.520448 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.520399 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 16:32:17.521153 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.521138 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-101.ec2.internal" event="NodeHasSufficientMemory" Sep 17 16:32:17.521197 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.521169 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-101.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 16:32:17.521197 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.521182 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-101.ec2.internal" event="NodeHasSufficientPID" Sep 17 16:32:17.548042 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:17.548019 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-101.ec2.internal\" not found" node="ip-10-0-129-101.ec2.internal" Sep 17 16:32:17.552355 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:17.552342 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-101.ec2.internal\" not found" node="ip-10-0-129-101.ec2.internal" Sep 17 16:32:17.574990 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.574970 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2dbfbe7a689d503359e41305ddae0708-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-101.ec2.internal\" (UID: \"2dbfbe7a689d503359e41305ddae0708\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-101.ec2.internal" Sep 17 16:32:17.575047 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.574994 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dbfbe7a689d503359e41305ddae0708-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-101.ec2.internal\" (UID: \"2dbfbe7a689d503359e41305ddae0708\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-101.ec2.internal" Sep 17 16:32:17.575047 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.575010 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f9b2c501adb92de6a6b87fdccf169cbd-config\") pod \"kube-apiserver-proxy-ip-10-0-129-101.ec2.internal\" (UID: \"f9b2c501adb92de6a6b87fdccf169cbd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-101.ec2.internal" Sep 17 16:32:17.599374 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:17.599355 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-101.ec2.internal\" not found" Sep 17 16:32:17.676093 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.676075 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2dbfbe7a689d503359e41305ddae0708-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-101.ec2.internal\" (UID: \"2dbfbe7a689d503359e41305ddae0708\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-101.ec2.internal" Sep 17 16:32:17.676156 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.676097 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dbfbe7a689d503359e41305ddae0708-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-101.ec2.internal\" (UID: \"2dbfbe7a689d503359e41305ddae0708\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-101.ec2.internal" Sep 17 16:32:17.676156 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.676113 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f9b2c501adb92de6a6b87fdccf169cbd-config\") pod \"kube-apiserver-proxy-ip-10-0-129-101.ec2.internal\" (UID: \"f9b2c501adb92de6a6b87fdccf169cbd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-101.ec2.internal" Sep 17 16:32:17.676156 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.676137 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f9b2c501adb92de6a6b87fdccf169cbd-config\") pod \"kube-apiserver-proxy-ip-10-0-129-101.ec2.internal\" (UID: \"f9b2c501adb92de6a6b87fdccf169cbd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-101.ec2.internal" Sep 17 16:32:17.676156 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.676153 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dbfbe7a689d503359e41305ddae0708-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-101.ec2.internal\" (UID: \"2dbfbe7a689d503359e41305ddae0708\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-101.ec2.internal" Sep 17 16:32:17.676286 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.676170 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2dbfbe7a689d503359e41305ddae0708-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-101.ec2.internal\" (UID: \"2dbfbe7a689d503359e41305ddae0708\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-101.ec2.internal" Sep 17 16:32:17.700233 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:17.700185 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-101.ec2.internal\" not found" Sep 17 16:32:17.800908 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:17.800882 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-101.ec2.internal\" not found" Sep 17 16:32:17.852027 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.851997 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-101.ec2.internal" Sep 17 16:32:17.857397 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:17.857296 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-101.ec2.internal" Sep 17 16:32:17.901486 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:17.901462 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-101.ec2.internal\" not found" Sep 17 16:32:18.001917 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:18.001855 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-101.ec2.internal\" not found" Sep 17 16:32:18.102392 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:18.102363 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-101.ec2.internal\" not found" Sep 17 16:32:18.202987 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:18.202959 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-101.ec2.internal\" not found" Sep 17 16:32:18.213104 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:18.213084 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 17 16:32:18.213232 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:18.213216 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 16:32:18.274105 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:18.274053 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 16:32:18.313321 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:18.313295 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 16:32:18.372841 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:18.372817 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-101.ec2.internal" Sep 17 16:32:18.379054 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:18.379026 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 16:27:17 +0000 UTC" deadline="2028-03-05 03:13:46.411271142 +0000 UTC" Sep 17 16:32:18.379054 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:18.379050 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12826h41m28.03222384s" Sep 17 16:32:18.386921 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:18.386906 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 16:32:18.387731 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:18.387719 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-101.ec2.internal" Sep 17 16:32:18.396506 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:18.396490 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 16:32:18.555688 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:18.555632 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dbfbe7a689d503359e41305ddae0708.slice/crio-277f0c129850e0311e4556b80f0e47f9939a1da683e04885d6e72249f53b3b9e WatchSource:0}: Error finding container 277f0c129850e0311e4556b80f0e47f9939a1da683e04885d6e72249f53b3b9e: Status 404 returned error can't find the container with id 277f0c129850e0311e4556b80f0e47f9939a1da683e04885d6e72249f53b3b9e Sep 17 16:32:18.560695 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:18.560679 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 16:32:18.562942 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:18.562923 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 16:32:18.637819 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:18.637801 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9b2c501adb92de6a6b87fdccf169cbd.slice/crio-8f6d143631f8a0b53d1d3691929fe063968bfa5b68cde49c42bb32a6be7645c9 WatchSource:0}: Error finding container 8f6d143631f8a0b53d1d3691929fe063968bfa5b68cde49c42bb32a6be7645c9: Status 404 returned error can't find the container with id 8f6d143631f8a0b53d1d3691929fe063968bfa5b68cde49c42bb32a6be7645c9 Sep 17 16:32:19.250183 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.250103 2581 apiserver.go:52] "Watching apiserver" Sep 17 16:32:19.256796 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.256768 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 17 16:32:19.257217 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.257194 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-66zvl","openshift-network-diagnostics/network-check-target-wzqtc","openshift-network-operator/iptables-alerter-4nkdh","openshift-ovn-kubernetes/ovnkube-node-jflqj","kube-system/global-pull-secret-syncer-cdn7r","openshift-dns/node-resolver-btzx7","openshift-image-registry/node-ca-zqkgf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-101.ec2.internal","openshift-multus/multus-additional-cni-plugins-zbgjd","openshift-multus/multus-q4ccz","kube-system/konnectivity-agent-gvdpj","kube-system/kube-apiserver-proxy-ip-10-0-129-101.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh7hj","openshift-cluster-node-tuning-operator/tuned-2mlrm"] Sep 17 16:32:19.258874 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.258850 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zqkgf" Sep 17 16:32:19.261164 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.261142 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 17 16:32:19.261249 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.261161 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 17 16:32:19.261249 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.261204 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 17 16:32:19.261313 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.261165 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mkxjh\"" Sep 17 16:32:19.261989 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.261965 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh7hj" Sep 17 16:32:19.265343 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.264849 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 17 16:32:19.265343 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.265001 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kvgc8\"" Sep 17 16:32:19.265343 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.265129 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 17 16:32:19.265343 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.265248 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 17 16:32:19.266515 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.266494 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4nkdh" Sep 17 16:32:19.267785 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.267767 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.270071 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.269534 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:19.270071 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:19.269595 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cdn7r" podUID="71c447a9-be09-4350-841c-a054f2e33b6b" Sep 17 16:32:19.270362 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.270288 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-btzx7" Sep 17 16:32:19.270822 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.270807 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 17 16:32:19.270953 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.270935 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 17 16:32:19.271111 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.271094 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zcb2k\"" Sep 17 16:32:19.271190 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.270862 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 17 16:32:19.271397 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.271382 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 17 16:32:19.271656 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.271630 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 17 16:32:19.271892 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.271875 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 17 16:32:19.272052 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.272038 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2tfxv\"" Sep 17 16:32:19.272442 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.272412 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zbgjd" Sep 17 16:32:19.273496 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.273476 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 17 16:32:19.274069 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.274050 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 17 16:32:19.274069 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.274067 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 17 16:32:19.274307 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.274284 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-49zw4\"" Sep 17 16:32:19.274565 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.274548 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 17 16:32:19.274638 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.274620 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 17 16:32:19.274694 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.274289 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 17 16:32:19.274741 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.274549 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 17 16:32:19.275005 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.274984 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 17 16:32:19.275084 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.275003 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 17 16:32:19.275084 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.275016 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 17 16:32:19.275366 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.275325 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 17 16:32:19.275366 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.275357 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-42zh4\"" Sep 17 16:32:19.278104 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.278081 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:19.278238 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:19.278214 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66zvl" podUID="07690c0a-a396-4f6c-9248-41722d757b2f" Sep 17 16:32:19.282191 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.282171 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/71c447a9-be09-4350-841c-a054f2e33b6b-kubelet-config\") pod \"global-pull-secret-syncer-cdn7r\" (UID: \"71c447a9-be09-4350-841c-a054f2e33b6b\") " pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:19.282311 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.282297 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/062048ed-07c1-4c34-af9b-bb44392c07d2-cni-binary-copy\") pod \"multus-additional-cni-plugins-zbgjd\" (UID: \"062048ed-07c1-4c34-af9b-bb44392c07d2\") " pod="openshift-multus/multus-additional-cni-plugins-zbgjd" Sep 17 16:32:19.282413 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.282398 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/062048ed-07c1-4c34-af9b-bb44392c07d2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zbgjd\" (UID: \"062048ed-07c1-4c34-af9b-bb44392c07d2\") " pod="openshift-multus/multus-additional-cni-plugins-zbgjd" Sep 17 16:32:19.282594 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.282570 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.282673 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.282622 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-var-lib-openvswitch\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.282673 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.282649 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/db3f664b-5aa4-44d1-a348-bb66582adcf9-socket-dir\") pod \"aws-ebs-csi-driver-node-rh7hj\" (UID: \"db3f664b-5aa4-44d1-a348-bb66582adcf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh7hj" Sep 17 16:32:19.282766 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.282690 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/71c447a9-be09-4350-841c-a054f2e33b6b-dbus\") pod \"global-pull-secret-syncer-cdn7r\" (UID: \"71c447a9-be09-4350-841c-a054f2e33b6b\") " pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:19.282766 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.282744 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/062048ed-07c1-4c34-af9b-bb44392c07d2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zbgjd\" (UID: \"062048ed-07c1-4c34-af9b-bb44392c07d2\") " pod="openshift-multus/multus-additional-cni-plugins-zbgjd" Sep 17 16:32:19.282860 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.282775 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/062048ed-07c1-4c34-af9b-bb44392c07d2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zbgjd\" (UID: \"062048ed-07c1-4c34-af9b-bb44392c07d2\") " pod="openshift-multus/multus-additional-cni-plugins-zbgjd" Sep 17 16:32:19.282860 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.282818 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm2s4\" (UniqueName: \"kubernetes.io/projected/41945b34-0d55-4343-9389-7c3431091fdd-kube-api-access-qm2s4\") pod \"iptables-alerter-4nkdh\" (UID: \"41945b34-0d55-4343-9389-7c3431091fdd\") " pod="openshift-network-operator/iptables-alerter-4nkdh" Sep 17 16:32:19.282860 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.282844 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-host-cni-netd\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.282991 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.282882 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d6b66e55-13f3-43a0-9c6f-ed705c42995d-env-overrides\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.282991 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.282932 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzvjh\" (UniqueName: \"kubernetes.io/projected/d6b66e55-13f3-43a0-9c6f-ed705c42995d-kube-api-access-nzvjh\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.283082 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.282981 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nfs8\" (UniqueName: \"kubernetes.io/projected/e7d9d424-72bd-454a-af3a-2334a1ba3891-kube-api-access-4nfs8\") pod \"node-resolver-btzx7\" (UID: \"e7d9d424-72bd-454a-af3a-2334a1ba3891\") " pod="openshift-dns/node-resolver-btzx7" Sep 17 16:32:19.283082 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.283049 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-systemd-units\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.283082 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.283074 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-run-ovn\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.283212 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.283103 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5d65b63e-ceb1-4912-aeea-36e3285e6070-host\") pod \"node-ca-zqkgf\" (UID: \"5d65b63e-ceb1-4912-aeea-36e3285e6070\") " pod="openshift-image-registry/node-ca-zqkgf" Sep 17 16:32:19.283212 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.283130 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-host-kubelet\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.283309 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.283236 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6b66e55-13f3-43a0-9c6f-ed705c42995d-ovn-node-metrics-cert\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.283361 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.283309 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d6b66e55-13f3-43a0-9c6f-ed705c42995d-ovnkube-script-lib\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.283415 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.283358 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/db3f664b-5aa4-44d1-a348-bb66582adcf9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rh7hj\" (UID: \"db3f664b-5aa4-44d1-a348-bb66582adcf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh7hj" Sep 17 16:32:19.283415 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.283394 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71c447a9-be09-4350-841c-a054f2e33b6b-original-pull-secret\") pod \"global-pull-secret-syncer-cdn7r\" (UID: \"71c447a9-be09-4350-841c-a054f2e33b6b\") " pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:19.283537 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.283470 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-host-run-ovn-kubernetes\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.283537 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.283502 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d6b66e55-13f3-43a0-9c6f-ed705c42995d-ovnkube-config\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.283537 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.283529 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5d65b63e-ceb1-4912-aeea-36e3285e6070-serviceca\") pod \"node-ca-zqkgf\" (UID: \"5d65b63e-ceb1-4912-aeea-36e3285e6070\") " pod="openshift-image-registry/node-ca-zqkgf" Sep 17 16:32:19.283680 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.283562 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgwpj\" (UniqueName: \"kubernetes.io/projected/5d65b63e-ceb1-4912-aeea-36e3285e6070-kube-api-access-bgwpj\") pod \"node-ca-zqkgf\" (UID: \"5d65b63e-ceb1-4912-aeea-36e3285e6070\") " pod="openshift-image-registry/node-ca-zqkgf" Sep 17 16:32:19.283847 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.283826 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41945b34-0d55-4343-9389-7c3431091fdd-host-slash\") pod \"iptables-alerter-4nkdh\" (UID: \"41945b34-0d55-4343-9389-7c3431091fdd\") " pod="openshift-network-operator/iptables-alerter-4nkdh" Sep 17 16:32:19.284202 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.283984 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-etc-openvswitch\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.284202 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.284037 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-log-socket\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.284202 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.284070 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e7d9d424-72bd-454a-af3a-2334a1ba3891-hosts-file\") pod \"node-resolver-btzx7\" (UID: \"e7d9d424-72bd-454a-af3a-2334a1ba3891\") " pod="openshift-dns/node-resolver-btzx7" Sep 17 16:32:19.284202 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.284101 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-host-run-netns\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.284202 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.284138 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-node-log\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.284202 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.284168 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7d9d424-72bd-454a-af3a-2334a1ba3891-tmp-dir\") pod \"node-resolver-btzx7\" (UID: \"e7d9d424-72bd-454a-af3a-2334a1ba3891\") " pod="openshift-dns/node-resolver-btzx7" Sep 17 16:32:19.284574 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.284223 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07690c0a-a396-4f6c-9248-41722d757b2f-metrics-certs\") pod \"network-metrics-daemon-66zvl\" (UID: \"07690c0a-a396-4f6c-9248-41722d757b2f\") " pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:19.284574 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.284280 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b75q\" (UniqueName: \"kubernetes.io/projected/07690c0a-a396-4f6c-9248-41722d757b2f-kube-api-access-9b75q\") pod \"network-metrics-daemon-66zvl\" (UID: \"07690c0a-a396-4f6c-9248-41722d757b2f\") " pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:19.284574 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.284333 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/db3f664b-5aa4-44d1-a348-bb66582adcf9-registration-dir\") pod \"aws-ebs-csi-driver-node-rh7hj\" (UID: \"db3f664b-5aa4-44d1-a348-bb66582adcf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh7hj" Sep 17 16:32:19.284574 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.284448 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/db3f664b-5aa4-44d1-a348-bb66582adcf9-device-dir\") pod \"aws-ebs-csi-driver-node-rh7hj\" (UID: \"db3f664b-5aa4-44d1-a348-bb66582adcf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh7hj" Sep 17 16:32:19.284574 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.284480 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/db3f664b-5aa4-44d1-a348-bb66582adcf9-etc-selinux\") pod \"aws-ebs-csi-driver-node-rh7hj\" (UID: \"db3f664b-5aa4-44d1-a348-bb66582adcf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh7hj" Sep 17 16:32:19.284574 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.284528 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-run-systemd\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.284574 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.284559 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzdn9\" (UniqueName: \"kubernetes.io/projected/db3f664b-5aa4-44d1-a348-bb66582adcf9-kube-api-access-nzdn9\") pod \"aws-ebs-csi-driver-node-rh7hj\" (UID: \"db3f664b-5aa4-44d1-a348-bb66582adcf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh7hj" Sep 17 16:32:19.284901 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.284611 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/062048ed-07c1-4c34-af9b-bb44392c07d2-system-cni-dir\") pod \"multus-additional-cni-plugins-zbgjd\" (UID: \"062048ed-07c1-4c34-af9b-bb44392c07d2\") " pod="openshift-multus/multus-additional-cni-plugins-zbgjd" Sep 17 16:32:19.284901 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.284637 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/062048ed-07c1-4c34-af9b-bb44392c07d2-cnibin\") pod \"multus-additional-cni-plugins-zbgjd\" (UID: \"062048ed-07c1-4c34-af9b-bb44392c07d2\") " pod="openshift-multus/multus-additional-cni-plugins-zbgjd" Sep 17 16:32:19.284901 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.284667 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk8wj\" (UniqueName: \"kubernetes.io/projected/062048ed-07c1-4c34-af9b-bb44392c07d2-kube-api-access-bk8wj\") pod \"multus-additional-cni-plugins-zbgjd\" (UID: \"062048ed-07c1-4c34-af9b-bb44392c07d2\") " pod="openshift-multus/multus-additional-cni-plugins-zbgjd" Sep 17 16:32:19.284901 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.284696 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/41945b34-0d55-4343-9389-7c3431091fdd-iptables-alerter-script\") pod \"iptables-alerter-4nkdh\" (UID: \"41945b34-0d55-4343-9389-7c3431091fdd\") " pod="openshift-network-operator/iptables-alerter-4nkdh" Sep 17 16:32:19.284901 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.284726 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-host-slash\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.284901 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.284752 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-run-openvswitch\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.284901 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.284771 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-host-cni-bin\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.284901 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.284798 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/db3f664b-5aa4-44d1-a348-bb66582adcf9-sys-fs\") pod \"aws-ebs-csi-driver-node-rh7hj\" (UID: \"db3f664b-5aa4-44d1-a348-bb66582adcf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh7hj" Sep 17 16:32:19.286012 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.285944 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:32:19.286178 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:19.286149 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzqtc" podUID="694d53e2-8503-4fcf-a313-744e81e30d5e" Sep 17 16:32:19.288088 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.288065 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 16:32:19.290174 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.289924 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.291721 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.291700 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 17 16:32:19.291942 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.291926 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-klzxd\"" Sep 17 16:32:19.292982 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.292966 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gvdpj" Sep 17 16:32:19.294247 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.294228 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.294869 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.294848 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 17 16:32:19.295061 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.295047 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vjrfb\"" Sep 17 16:32:19.295188 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.295172 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 17 16:32:19.296173 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.296154 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 17 16:32:19.296412 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.296398 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wxlvk\"" Sep 17 16:32:19.296721 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.296704 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 17 16:32:19.309935 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.309904 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-56v5s" Sep 17 16:32:19.318531 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.318511 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-56v5s" Sep 17 16:32:19.374444 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.374414 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 17 16:32:19.385778 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.385733 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5d65b63e-ceb1-4912-aeea-36e3285e6070-host\") pod \"node-ca-zqkgf\" (UID: \"5d65b63e-ceb1-4912-aeea-36e3285e6070\") " pod="openshift-image-registry/node-ca-zqkgf" Sep 17 16:32:19.385877 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.385794 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-host-kubelet\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.385877 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.385822 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6b66e55-13f3-43a0-9c6f-ed705c42995d-ovn-node-metrics-cert\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.385877 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.385859 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5d65b63e-ceb1-4912-aeea-36e3285e6070-host\") pod \"node-ca-zqkgf\" (UID: \"5d65b63e-ceb1-4912-aeea-36e3285e6070\") " pod="openshift-image-registry/node-ca-zqkgf" Sep 17 16:32:19.386038 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.385846 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d6b66e55-13f3-43a0-9c6f-ed705c42995d-ovnkube-script-lib\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.386038 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.385901 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/db3f664b-5aa4-44d1-a348-bb66582adcf9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rh7hj\" (UID: \"db3f664b-5aa4-44d1-a348-bb66582adcf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh7hj" Sep 17 16:32:19.386038 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.385920 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71c447a9-be09-4350-841c-a054f2e33b6b-original-pull-secret\") pod \"global-pull-secret-syncer-cdn7r\" (UID: \"71c447a9-be09-4350-841c-a054f2e33b6b\") " pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:19.386038 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.385944 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-multus-cni-dir\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.386038 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.385976 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkbxm\" (UniqueName: \"kubernetes.io/projected/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-kube-api-access-zkbxm\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.386038 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.386030 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/db3f664b-5aa4-44d1-a348-bb66582adcf9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rh7hj\" (UID: \"db3f664b-5aa4-44d1-a348-bb66582adcf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh7hj" Sep 17 16:32:19.386404 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.386041 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-host-run-ovn-kubernetes\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.386404 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.385872 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-host-kubelet\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.386404 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.386090 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d6b66e55-13f3-43a0-9c6f-ed705c42995d-ovnkube-config\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.386404 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.386138 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-host-run-ovn-kubernetes\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.386404 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.386164 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5d65b63e-ceb1-4912-aeea-36e3285e6070-serviceca\") pod \"node-ca-zqkgf\" (UID: \"5d65b63e-ceb1-4912-aeea-36e3285e6070\") " pod="openshift-image-registry/node-ca-zqkgf" Sep 17 16:32:19.386404 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:19.386172 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 16:32:19.386404 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.386197 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 17 16:32:19.386404 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.386211 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgwpj\" (UniqueName: \"kubernetes.io/projected/5d65b63e-ceb1-4912-aeea-36e3285e6070-kube-api-access-bgwpj\") pod \"node-ca-zqkgf\" (UID: \"5d65b63e-ceb1-4912-aeea-36e3285e6070\") " pod="openshift-image-registry/node-ca-zqkgf" Sep 17 16:32:19.386404 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:19.386253 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71c447a9-be09-4350-841c-a054f2e33b6b-original-pull-secret podName:71c447a9-be09-4350-841c-a054f2e33b6b nodeName:}" failed. No retries permitted until 2026-09-17 16:32:19.886220647 +0000 UTC m=+4.618688208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71c447a9-be09-4350-841c-a054f2e33b6b-original-pull-secret") pod "global-pull-secret-syncer-cdn7r" (UID: "71c447a9-be09-4350-841c-a054f2e33b6b") : object "kube-system"/"original-pull-secret" not registered Sep 17 16:32:19.386404 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.386278 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41945b34-0d55-4343-9389-7c3431091fdd-host-slash\") pod \"iptables-alerter-4nkdh\" (UID: \"41945b34-0d55-4343-9389-7c3431091fdd\") " pod="openshift-network-operator/iptables-alerter-4nkdh" Sep 17 16:32:19.386404 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.386391 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-etc-openvswitch\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.386960 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.386417 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e7d9d424-72bd-454a-af3a-2334a1ba3891-hosts-file\") pod \"node-resolver-btzx7\" (UID: \"e7d9d424-72bd-454a-af3a-2334a1ba3891\") " pod="openshift-dns/node-resolver-btzx7" Sep 17 16:32:19.386960 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.386465 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b75q\" (UniqueName: \"kubernetes.io/projected/07690c0a-a396-4f6c-9248-41722d757b2f-kube-api-access-9b75q\") pod \"network-metrics-daemon-66zvl\" (UID: \"07690c0a-a396-4f6c-9248-41722d757b2f\") " pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:19.386960 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.386532 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7d9d424-72bd-454a-af3a-2334a1ba3891-tmp-dir\") pod \"node-resolver-btzx7\" (UID: \"e7d9d424-72bd-454a-af3a-2334a1ba3891\") " pod="openshift-dns/node-resolver-btzx7" Sep 17 16:32:19.386960 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.386585 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d6b66e55-13f3-43a0-9c6f-ed705c42995d-ovnkube-script-lib\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.386960 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.386607 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/db3f664b-5aa4-44d1-a348-bb66582adcf9-registration-dir\") pod \"aws-ebs-csi-driver-node-rh7hj\" (UID: \"db3f664b-5aa4-44d1-a348-bb66582adcf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh7hj" Sep 17 16:32:19.386960 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.386618 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e7d9d424-72bd-454a-af3a-2334a1ba3891-hosts-file\") pod \"node-resolver-btzx7\" (UID: \"e7d9d424-72bd-454a-af3a-2334a1ba3891\") " pod="openshift-dns/node-resolver-btzx7" Sep 17 16:32:19.386960 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.386650 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk8wj\" (UniqueName: \"kubernetes.io/projected/062048ed-07c1-4c34-af9b-bb44392c07d2-kube-api-access-bk8wj\") pod \"multus-additional-cni-plugins-zbgjd\" (UID: \"062048ed-07c1-4c34-af9b-bb44392c07d2\") " pod="openshift-multus/multus-additional-cni-plugins-zbgjd" Sep 17 16:32:19.386960 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.386678 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/062048ed-07c1-4c34-af9b-bb44392c07d2-cni-binary-copy\") pod \"multus-additional-cni-plugins-zbgjd\" (UID: \"062048ed-07c1-4c34-af9b-bb44392c07d2\") " pod="openshift-multus/multus-additional-cni-plugins-zbgjd" Sep 17 16:32:19.386960 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.386709 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-etc-sysctl-conf\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.386960 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.386778 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzdn9\" (UniqueName: \"kubernetes.io/projected/db3f664b-5aa4-44d1-a348-bb66582adcf9-kube-api-access-nzdn9\") pod \"aws-ebs-csi-driver-node-rh7hj\" (UID: \"db3f664b-5aa4-44d1-a348-bb66582adcf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh7hj" Sep 17 16:32:19.386960 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.386803 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-etc-sysconfig\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.386960 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.386826 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/41945b34-0d55-4343-9389-7c3431091fdd-iptables-alerter-script\") pod \"iptables-alerter-4nkdh\" (UID: \"41945b34-0d55-4343-9389-7c3431091fdd\") " pod="openshift-network-operator/iptables-alerter-4nkdh" Sep 17 16:32:19.386960 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.386877 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41945b34-0d55-4343-9389-7c3431091fdd-host-slash\") pod \"iptables-alerter-4nkdh\" (UID: \"41945b34-0d55-4343-9389-7c3431091fdd\") " pod="openshift-network-operator/iptables-alerter-4nkdh" Sep 17 16:32:19.386960 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.386885 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/db3f664b-5aa4-44d1-a348-bb66582adcf9-sys-fs\") pod \"aws-ebs-csi-driver-node-rh7hj\" (UID: \"db3f664b-5aa4-44d1-a348-bb66582adcf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh7hj" Sep 17 16:32:19.386960 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.386942 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-etc-systemd\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.387706 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.386989 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-cnibin\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.387706 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387038 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5d65b63e-ceb1-4912-aeea-36e3285e6070-serviceca\") pod \"node-ca-zqkgf\" (UID: \"5d65b63e-ceb1-4912-aeea-36e3285e6070\") " pod="openshift-image-registry/node-ca-zqkgf" Sep 17 16:32:19.387706 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387076 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.387706 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387083 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d6b66e55-13f3-43a0-9c6f-ed705c42995d-ovnkube-config\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.387706 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387087 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-etc-openvswitch\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.387706 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387108 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-var-lib-openvswitch\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.387706 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387123 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/db3f664b-5aa4-44d1-a348-bb66582adcf9-registration-dir\") pod \"aws-ebs-csi-driver-node-rh7hj\" (UID: \"db3f664b-5aa4-44d1-a348-bb66582adcf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh7hj" Sep 17 16:32:19.387706 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387132 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/db3f664b-5aa4-44d1-a348-bb66582adcf9-socket-dir\") pod \"aws-ebs-csi-driver-node-rh7hj\" (UID: \"db3f664b-5aa4-44d1-a348-bb66582adcf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh7hj" Sep 17 16:32:19.387706 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387231 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/71c447a9-be09-4350-841c-a054f2e33b6b-dbus\") pod \"global-pull-secret-syncer-cdn7r\" (UID: \"71c447a9-be09-4350-841c-a054f2e33b6b\") " pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:19.387706 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387263 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d6b66e55-13f3-43a0-9c6f-ed705c42995d-env-overrides\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.387706 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387270 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7d9d424-72bd-454a-af3a-2334a1ba3891-tmp-dir\") pod \"node-resolver-btzx7\" (UID: \"e7d9d424-72bd-454a-af3a-2334a1ba3891\") " pod="openshift-dns/node-resolver-btzx7" Sep 17 16:32:19.387706 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387290 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nfs8\" (UniqueName: \"kubernetes.io/projected/e7d9d424-72bd-454a-af3a-2334a1ba3891-kube-api-access-4nfs8\") pod \"node-resolver-btzx7\" (UID: \"e7d9d424-72bd-454a-af3a-2334a1ba3891\") " pod="openshift-dns/node-resolver-btzx7" Sep 17 16:32:19.387706 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387322 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-host-run-k8s-cni-cncf-io\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.387706 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387348 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-etc-sysctl-d\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.387706 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387264 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/db3f664b-5aa4-44d1-a348-bb66582adcf9-sys-fs\") pod \"aws-ebs-csi-driver-node-rh7hj\" (UID: \"db3f664b-5aa4-44d1-a348-bb66582adcf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh7hj" Sep 17 16:32:19.387706 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387413 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-var-lib-kubelet\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.387706 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387453 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b0bb659-a91c-4d72-a848-cad273fd3f67-tmp\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.388532 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387480 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnrks\" (UniqueName: \"kubernetes.io/projected/5b0bb659-a91c-4d72-a848-cad273fd3f67-kube-api-access-qnrks\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.388532 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387506 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-systemd-units\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.388532 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387528 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-run-ovn\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.388532 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387535 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/71c447a9-be09-4350-841c-a054f2e33b6b-dbus\") pod \"global-pull-secret-syncer-cdn7r\" (UID: \"71c447a9-be09-4350-841c-a054f2e33b6b\") " pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:19.388532 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387549 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-run\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.388532 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387595 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-host-run-netns\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.388532 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387617 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-hostroot\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.388532 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387641 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-etc-modprobe-d\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.388532 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387639 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/062048ed-07c1-4c34-af9b-bb44392c07d2-cni-binary-copy\") pod \"multus-additional-cni-plugins-zbgjd\" (UID: \"062048ed-07c1-4c34-af9b-bb44392c07d2\") " pod="openshift-multus/multus-additional-cni-plugins-zbgjd" Sep 17 16:32:19.388532 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387664 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-cni-binary-copy\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.388532 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387686 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-log-socket\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.388532 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387707 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07690c0a-a396-4f6c-9248-41722d757b2f-metrics-certs\") pod \"network-metrics-daemon-66zvl\" (UID: \"07690c0a-a396-4f6c-9248-41722d757b2f\") " pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:19.388532 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387712 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.388532 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387727 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/db3f664b-5aa4-44d1-a348-bb66582adcf9-device-dir\") pod \"aws-ebs-csi-driver-node-rh7hj\" (UID: \"db3f664b-5aa4-44d1-a348-bb66582adcf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh7hj" Sep 17 16:32:19.388532 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387768 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-host-var-lib-cni-multus\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.388532 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387789 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-host-run-multus-certs\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.388532 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387803 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d6b66e55-13f3-43a0-9c6f-ed705c42995d-env-overrides\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.389117 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387825 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/db3f664b-5aa4-44d1-a348-bb66582adcf9-socket-dir\") pod \"aws-ebs-csi-driver-node-rh7hj\" (UID: \"db3f664b-5aa4-44d1-a348-bb66582adcf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh7hj" Sep 17 16:32:19.389117 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387853 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-run-ovn\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.389117 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387871 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-var-lib-openvswitch\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.389117 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387879 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-systemd-units\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.389117 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387807 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-etc-kubernetes\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.389117 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387914 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-sys\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.389117 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.387994 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/db3f664b-5aa4-44d1-a348-bb66582adcf9-device-dir\") pod \"aws-ebs-csi-driver-node-rh7hj\" (UID: \"db3f664b-5aa4-44d1-a348-bb66582adcf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh7hj" Sep 17 16:32:19.389117 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388036 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-log-socket\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.389117 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388059 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-host-run-netns\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.389117 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388131 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-host-run-netns\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.389117 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:19.388102 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:32:19.389117 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388093 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/41945b34-0d55-4343-9389-7c3431091fdd-iptables-alerter-script\") pod \"iptables-alerter-4nkdh\" (UID: \"41945b34-0d55-4343-9389-7c3431091fdd\") " pod="openshift-network-operator/iptables-alerter-4nkdh" Sep 17 16:32:19.389117 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:19.388236 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07690c0a-a396-4f6c-9248-41722d757b2f-metrics-certs podName:07690c0a-a396-4f6c-9248-41722d757b2f nodeName:}" failed. No retries permitted until 2026-09-17 16:32:19.888206543 +0000 UTC m=+4.620674099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07690c0a-a396-4f6c-9248-41722d757b2f-metrics-certs") pod "network-metrics-daemon-66zvl" (UID: "07690c0a-a396-4f6c-9248-41722d757b2f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:32:19.389117 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388259 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-node-log\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.389117 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388289 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-node-log\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.389117 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388287 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/db3f664b-5aa4-44d1-a348-bb66582adcf9-etc-selinux\") pod \"aws-ebs-csi-driver-node-rh7hj\" (UID: \"db3f664b-5aa4-44d1-a348-bb66582adcf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh7hj" Sep 17 16:32:19.389117 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388325 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-system-cni-dir\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.389795 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388347 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0b91d9e7-b505-4f06-96a9-615c27c19983-agent-certs\") pod \"konnectivity-agent-gvdpj\" (UID: \"0b91d9e7-b505-4f06-96a9-615c27c19983\") " pod="kube-system/konnectivity-agent-gvdpj" Sep 17 16:32:19.389795 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388365 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-lib-modules\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.389795 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388384 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-host\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.389795 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388404 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/db3f664b-5aa4-44d1-a348-bb66582adcf9-etc-selinux\") pod \"aws-ebs-csi-driver-node-rh7hj\" (UID: \"db3f664b-5aa4-44d1-a348-bb66582adcf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh7hj" Sep 17 16:32:19.389795 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388423 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-run-systemd\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.389795 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388479 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/062048ed-07c1-4c34-af9b-bb44392c07d2-system-cni-dir\") pod \"multus-additional-cni-plugins-zbgjd\" (UID: \"062048ed-07c1-4c34-af9b-bb44392c07d2\") " pod="openshift-multus/multus-additional-cni-plugins-zbgjd" Sep 17 16:32:19.389795 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388490 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-run-systemd\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.389795 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388507 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/062048ed-07c1-4c34-af9b-bb44392c07d2-cnibin\") pod \"multus-additional-cni-plugins-zbgjd\" (UID: \"062048ed-07c1-4c34-af9b-bb44392c07d2\") " pod="openshift-multus/multus-additional-cni-plugins-zbgjd" Sep 17 16:32:19.389795 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388533 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-multus-daemon-config\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.389795 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388559 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0b91d9e7-b505-4f06-96a9-615c27c19983-konnectivity-ca\") pod \"konnectivity-agent-gvdpj\" (UID: \"0b91d9e7-b505-4f06-96a9-615c27c19983\") " pod="kube-system/konnectivity-agent-gvdpj" Sep 17 16:32:19.389795 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388566 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/062048ed-07c1-4c34-af9b-bb44392c07d2-cnibin\") pod \"multus-additional-cni-plugins-zbgjd\" (UID: \"062048ed-07c1-4c34-af9b-bb44392c07d2\") " pod="openshift-multus/multus-additional-cni-plugins-zbgjd" Sep 17 16:32:19.389795 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388531 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/062048ed-07c1-4c34-af9b-bb44392c07d2-system-cni-dir\") pod \"multus-additional-cni-plugins-zbgjd\" (UID: \"062048ed-07c1-4c34-af9b-bb44392c07d2\") " pod="openshift-multus/multus-additional-cni-plugins-zbgjd" Sep 17 16:32:19.389795 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388582 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5b0bb659-a91c-4d72-a848-cad273fd3f67-etc-tuned\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.389795 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388621 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-host-slash\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.389795 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388646 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-run-openvswitch\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.389795 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388651 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-host-slash\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.389795 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388687 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-host-cni-bin\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.390573 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388701 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-run-openvswitch\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.390573 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388715 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/71c447a9-be09-4350-841c-a054f2e33b6b-kubelet-config\") pod \"global-pull-secret-syncer-cdn7r\" (UID: \"71c447a9-be09-4350-841c-a054f2e33b6b\") " pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:19.390573 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388740 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/062048ed-07c1-4c34-af9b-bb44392c07d2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zbgjd\" (UID: \"062048ed-07c1-4c34-af9b-bb44392c07d2\") " pod="openshift-multus/multus-additional-cni-plugins-zbgjd" Sep 17 16:32:19.390573 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388758 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-host-cni-bin\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.390573 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388769 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/062048ed-07c1-4c34-af9b-bb44392c07d2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zbgjd\" (UID: \"062048ed-07c1-4c34-af9b-bb44392c07d2\") " pod="openshift-multus/multus-additional-cni-plugins-zbgjd" Sep 17 16:32:19.390573 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388795 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/062048ed-07c1-4c34-af9b-bb44392c07d2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zbgjd\" (UID: \"062048ed-07c1-4c34-af9b-bb44392c07d2\") " pod="openshift-multus/multus-additional-cni-plugins-zbgjd" Sep 17 16:32:19.390573 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388812 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/71c447a9-be09-4350-841c-a054f2e33b6b-kubelet-config\") pod \"global-pull-secret-syncer-cdn7r\" (UID: \"71c447a9-be09-4350-841c-a054f2e33b6b\") " pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:19.390573 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388844 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-host-var-lib-kubelet\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.390573 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388871 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm2s4\" (UniqueName: \"kubernetes.io/projected/41945b34-0d55-4343-9389-7c3431091fdd-kube-api-access-qm2s4\") pod \"iptables-alerter-4nkdh\" (UID: \"41945b34-0d55-4343-9389-7c3431091fdd\") " pod="openshift-network-operator/iptables-alerter-4nkdh" Sep 17 16:32:19.390573 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388896 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-host-cni-netd\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.390573 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388920 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzvjh\" (UniqueName: \"kubernetes.io/projected/d6b66e55-13f3-43a0-9c6f-ed705c42995d-kube-api-access-nzvjh\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.390573 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388936 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/062048ed-07c1-4c34-af9b-bb44392c07d2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zbgjd\" (UID: \"062048ed-07c1-4c34-af9b-bb44392c07d2\") " pod="openshift-multus/multus-additional-cni-plugins-zbgjd" Sep 17 16:32:19.390573 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388946 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fknk\" (UniqueName: \"kubernetes.io/projected/694d53e2-8503-4fcf-a313-744e81e30d5e-kube-api-access-7fknk\") pod \"network-check-target-wzqtc\" (UID: \"694d53e2-8503-4fcf-a313-744e81e30d5e\") " pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:32:19.390573 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388971 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-etc-kubernetes\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.390573 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.388994 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-multus-socket-dir-parent\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.390573 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.389015 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-host-var-lib-cni-bin\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.391117 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.389037 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-multus-conf-dir\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.391117 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.389157 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d6b66e55-13f3-43a0-9c6f-ed705c42995d-host-cni-netd\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.391117 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.389228 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/062048ed-07c1-4c34-af9b-bb44392c07d2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zbgjd\" (UID: \"062048ed-07c1-4c34-af9b-bb44392c07d2\") " pod="openshift-multus/multus-additional-cni-plugins-zbgjd" Sep 17 16:32:19.391117 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.389573 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/062048ed-07c1-4c34-af9b-bb44392c07d2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zbgjd\" (UID: \"062048ed-07c1-4c34-af9b-bb44392c07d2\") " pod="openshift-multus/multus-additional-cni-plugins-zbgjd" Sep 17 16:32:19.392749 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.391957 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6b66e55-13f3-43a0-9c6f-ed705c42995d-ovn-node-metrics-cert\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.400022 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.399993 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b75q\" (UniqueName: \"kubernetes.io/projected/07690c0a-a396-4f6c-9248-41722d757b2f-kube-api-access-9b75q\") pod \"network-metrics-daemon-66zvl\" (UID: \"07690c0a-a396-4f6c-9248-41722d757b2f\") " pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:19.400895 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.400873 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nfs8\" (UniqueName: \"kubernetes.io/projected/e7d9d424-72bd-454a-af3a-2334a1ba3891-kube-api-access-4nfs8\") pod \"node-resolver-btzx7\" (UID: \"e7d9d424-72bd-454a-af3a-2334a1ba3891\") " pod="openshift-dns/node-resolver-btzx7" Sep 17 16:32:19.401465 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.401442 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk8wj\" (UniqueName: \"kubernetes.io/projected/062048ed-07c1-4c34-af9b-bb44392c07d2-kube-api-access-bk8wj\") pod \"multus-additional-cni-plugins-zbgjd\" (UID: \"062048ed-07c1-4c34-af9b-bb44392c07d2\") " pod="openshift-multus/multus-additional-cni-plugins-zbgjd" Sep 17 16:32:19.401656 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.401598 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgwpj\" (UniqueName: \"kubernetes.io/projected/5d65b63e-ceb1-4912-aeea-36e3285e6070-kube-api-access-bgwpj\") pod \"node-ca-zqkgf\" (UID: \"5d65b63e-ceb1-4912-aeea-36e3285e6070\") " pod="openshift-image-registry/node-ca-zqkgf" Sep 17 16:32:19.402519 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.402477 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzdn9\" (UniqueName: \"kubernetes.io/projected/db3f664b-5aa4-44d1-a348-bb66582adcf9-kube-api-access-nzdn9\") pod \"aws-ebs-csi-driver-node-rh7hj\" (UID: \"db3f664b-5aa4-44d1-a348-bb66582adcf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh7hj" Sep 17 16:32:19.403089 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.403068 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzvjh\" (UniqueName: \"kubernetes.io/projected/d6b66e55-13f3-43a0-9c6f-ed705c42995d-kube-api-access-nzvjh\") pod \"ovnkube-node-jflqj\" (UID: \"d6b66e55-13f3-43a0-9c6f-ed705c42995d\") " pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.403659 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.403638 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm2s4\" (UniqueName: \"kubernetes.io/projected/41945b34-0d55-4343-9389-7c3431091fdd-kube-api-access-qm2s4\") pod \"iptables-alerter-4nkdh\" (UID: \"41945b34-0d55-4343-9389-7c3431091fdd\") " pod="openshift-network-operator/iptables-alerter-4nkdh" Sep 17 16:32:19.425262 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.425216 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-101.ec2.internal" event={"ID":"2dbfbe7a689d503359e41305ddae0708","Type":"ContainerStarted","Data":"277f0c129850e0311e4556b80f0e47f9939a1da683e04885d6e72249f53b3b9e"} Sep 17 16:32:19.428752 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.428729 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-101.ec2.internal" event={"ID":"f9b2c501adb92de6a6b87fdccf169cbd","Type":"ContainerStarted","Data":"8f6d143631f8a0b53d1d3691929fe063968bfa5b68cde49c42bb32a6be7645c9"} Sep 17 16:32:19.489932 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.489906 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-cni-binary-copy\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.490051 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.489950 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-host-var-lib-cni-multus\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.490051 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.489968 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-host-run-multus-certs\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.490051 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490018 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-etc-kubernetes\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.490051 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490034 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-host-var-lib-cni-multus\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.490251 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490055 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-sys\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.490251 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490082 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-system-cni-dir\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.490251 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490107 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0b91d9e7-b505-4f06-96a9-615c27c19983-agent-certs\") pod \"konnectivity-agent-gvdpj\" (UID: \"0b91d9e7-b505-4f06-96a9-615c27c19983\") " pod="kube-system/konnectivity-agent-gvdpj" Sep 17 16:32:19.490251 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490129 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-lib-modules\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.490251 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490181 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-host-run-multus-certs\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.490251 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490228 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-host\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.490251 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490245 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-lib-modules\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.490608 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490260 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-multus-daemon-config\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.490608 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490288 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0b91d9e7-b505-4f06-96a9-615c27c19983-konnectivity-ca\") pod \"konnectivity-agent-gvdpj\" (UID: \"0b91d9e7-b505-4f06-96a9-615c27c19983\") " pod="kube-system/konnectivity-agent-gvdpj" Sep 17 16:32:19.490608 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490312 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5b0bb659-a91c-4d72-a848-cad273fd3f67-etc-tuned\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.490608 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490326 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-sys\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.490608 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490343 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-host-var-lib-kubelet\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.490608 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490370 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fknk\" (UniqueName: \"kubernetes.io/projected/694d53e2-8503-4fcf-a313-744e81e30d5e-kube-api-access-7fknk\") pod \"network-check-target-wzqtc\" (UID: \"694d53e2-8503-4fcf-a313-744e81e30d5e\") " pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:32:19.490608 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490394 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-etc-kubernetes\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.490608 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490416 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-multus-socket-dir-parent\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.490608 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490457 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-host-var-lib-cni-bin\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.490608 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490480 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-multus-conf-dir\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.490608 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490520 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-multus-cni-dir\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.490608 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490543 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkbxm\" (UniqueName: \"kubernetes.io/projected/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-kube-api-access-zkbxm\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.490608 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490578 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-etc-sysctl-conf\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.490608 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490602 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-etc-sysconfig\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.491459 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490626 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-etc-systemd\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.491459 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490648 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-cnibin\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.491459 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490711 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-cni-binary-copy\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.491459 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490722 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-cnibin\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.491459 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490733 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-etc-kubernetes\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.491459 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490770 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-multus-socket-dir-parent\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.491459 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490788 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-host-var-lib-cni-bin\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.491459 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490831 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-multus-conf-dir\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.491459 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490891 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-multus-cni-dir\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.491459 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490928 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-etc-sysctl-conf\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.491459 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490942 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-etc-sysconfig\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.491459 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490981 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-etc-systemd\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.491459 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490992 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-host\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.491459 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.491039 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-host-var-lib-kubelet\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.491459 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490371 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-system-cni-dir\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.491459 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.491214 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-host-run-k8s-cni-cncf-io\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.491459 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.490290 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-etc-kubernetes\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.491459 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.491231 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-etc-sysctl-d\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.492282 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.491246 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-var-lib-kubelet\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.492282 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.491259 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b0bb659-a91c-4d72-a848-cad273fd3f67-tmp\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.492282 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.491277 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnrks\" (UniqueName: \"kubernetes.io/projected/5b0bb659-a91c-4d72-a848-cad273fd3f67-kube-api-access-qnrks\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.492282 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.491304 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-run\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.492282 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.491326 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-host-run-netns\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.492282 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.491347 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-hostroot\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.492282 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.491371 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-etc-modprobe-d\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.492282 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.491507 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-etc-modprobe-d\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.492282 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.491515 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0b91d9e7-b505-4f06-96a9-615c27c19983-konnectivity-ca\") pod \"konnectivity-agent-gvdpj\" (UID: \"0b91d9e7-b505-4f06-96a9-615c27c19983\") " pod="kube-system/konnectivity-agent-gvdpj" Sep 17 16:32:19.492282 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.491549 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-host-run-k8s-cni-cncf-io\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.492282 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.491599 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-run\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.492282 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.491640 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-host-run-netns\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.492282 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.491645 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-multus-daemon-config\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.492282 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.491682 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-hostroot\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.492282 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.491715 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-var-lib-kubelet\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.492282 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.491804 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5b0bb659-a91c-4d72-a848-cad273fd3f67-etc-sysctl-d\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.493771 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.493730 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0b91d9e7-b505-4f06-96a9-615c27c19983-agent-certs\") pod \"konnectivity-agent-gvdpj\" (UID: \"0b91d9e7-b505-4f06-96a9-615c27c19983\") " pod="kube-system/konnectivity-agent-gvdpj" Sep 17 16:32:19.493898 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.493859 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5b0bb659-a91c-4d72-a848-cad273fd3f67-etc-tuned\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.494745 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.494722 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b0bb659-a91c-4d72-a848-cad273fd3f67-tmp\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.501983 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:19.501924 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 16:32:19.501983 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:19.501946 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 16:32:19.501983 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:19.501959 2581 projected.go:196] Error preparing data for projected volume kube-api-access-7fknk for pod openshift-network-diagnostics/network-check-target-wzqtc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:32:19.502190 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:19.502050 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/694d53e2-8503-4fcf-a313-744e81e30d5e-kube-api-access-7fknk podName:694d53e2-8503-4fcf-a313-744e81e30d5e nodeName:}" failed. No retries permitted until 2026-09-17 16:32:20.002031175 +0000 UTC m=+4.734498748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7fknk" (UniqueName: "kubernetes.io/projected/694d53e2-8503-4fcf-a313-744e81e30d5e-kube-api-access-7fknk") pod "network-check-target-wzqtc" (UID: "694d53e2-8503-4fcf-a313-744e81e30d5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:32:19.504461 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.504442 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkbxm\" (UniqueName: \"kubernetes.io/projected/3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20-kube-api-access-zkbxm\") pod \"multus-q4ccz\" (UID: \"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20\") " pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.504567 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.504548 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnrks\" (UniqueName: \"kubernetes.io/projected/5b0bb659-a91c-4d72-a848-cad273fd3f67-kube-api-access-qnrks\") pod \"tuned-2mlrm\" (UID: \"5b0bb659-a91c-4d72-a848-cad273fd3f67\") " pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.576115 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.576084 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zqkgf" Sep 17 16:32:19.582189 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.582168 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh7hj" Sep 17 16:32:19.596047 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.596031 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4nkdh" Sep 17 16:32:19.604004 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.603987 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:19.610643 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.610625 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-btzx7" Sep 17 16:32:19.619232 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.619213 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zbgjd" Sep 17 16:32:19.626377 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.626362 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q4ccz" Sep 17 16:32:19.632956 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.632936 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gvdpj" Sep 17 16:32:19.639383 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.639365 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" Sep 17 16:32:19.688224 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.688199 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 16:32:19.895101 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.895020 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07690c0a-a396-4f6c-9248-41722d757b2f-metrics-certs\") pod \"network-metrics-daemon-66zvl\" (UID: \"07690c0a-a396-4f6c-9248-41722d757b2f\") " pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:19.895101 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:19.895091 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71c447a9-be09-4350-841c-a054f2e33b6b-original-pull-secret\") pod \"global-pull-secret-syncer-cdn7r\" (UID: \"71c447a9-be09-4350-841c-a054f2e33b6b\") " pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:19.895292 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:19.895197 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 16:32:19.895292 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:19.895200 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:32:19.895292 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:19.895261 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71c447a9-be09-4350-841c-a054f2e33b6b-original-pull-secret podName:71c447a9-be09-4350-841c-a054f2e33b6b nodeName:}" failed. No retries permitted until 2026-09-17 16:32:20.895246598 +0000 UTC m=+5.627714160 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71c447a9-be09-4350-841c-a054f2e33b6b-original-pull-secret") pod "global-pull-secret-syncer-cdn7r" (UID: "71c447a9-be09-4350-841c-a054f2e33b6b") : object "kube-system"/"original-pull-secret" not registered Sep 17 16:32:19.895292 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:19.895275 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07690c0a-a396-4f6c-9248-41722d757b2f-metrics-certs podName:07690c0a-a396-4f6c-9248-41722d757b2f nodeName:}" failed. No retries permitted until 2026-09-17 16:32:20.895269133 +0000 UTC m=+5.627736690 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07690c0a-a396-4f6c-9248-41722d757b2f-metrics-certs") pod "network-metrics-daemon-66zvl" (UID: "07690c0a-a396-4f6c-9248-41722d757b2f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:32:20.096694 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:20.096658 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fknk\" (UniqueName: \"kubernetes.io/projected/694d53e2-8503-4fcf-a313-744e81e30d5e-kube-api-access-7fknk\") pod \"network-check-target-wzqtc\" (UID: \"694d53e2-8503-4fcf-a313-744e81e30d5e\") " pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:32:20.096875 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:20.096853 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 16:32:20.096934 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:20.096883 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 16:32:20.096934 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:20.096896 2581 projected.go:196] Error preparing data for projected volume kube-api-access-7fknk for pod openshift-network-diagnostics/network-check-target-wzqtc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:32:20.096997 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:20.096956 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/694d53e2-8503-4fcf-a313-744e81e30d5e-kube-api-access-7fknk podName:694d53e2-8503-4fcf-a313-744e81e30d5e nodeName:}" failed. No retries permitted until 2026-09-17 16:32:21.09694247 +0000 UTC m=+5.829410027 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7fknk" (UniqueName: "kubernetes.io/projected/694d53e2-8503-4fcf-a313-744e81e30d5e-kube-api-access-7fknk") pod "network-check-target-wzqtc" (UID: "694d53e2-8503-4fcf-a313-744e81e30d5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:32:20.321487 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:20.321368 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 16:27:19 +0000 UTC" deadline="2028-04-22 17:40:28.966811575 +0000 UTC" Sep 17 16:32:20.321487 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:20.321412 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13993h8m8.64540436s" Sep 17 16:32:20.414993 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:20.414966 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:32:20.415141 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:20.415077 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzqtc" podUID="694d53e2-8503-4fcf-a313-744e81e30d5e" Sep 17 16:32:20.491927 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:20.491904 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod062048ed_07c1_4c34_af9b_bb44392c07d2.slice/crio-4c6cd29548d8cfee7d53300ba6caac4b2fe60876fb8bd6ec39b8a71323e3d93a WatchSource:0}: Error finding container 4c6cd29548d8cfee7d53300ba6caac4b2fe60876fb8bd6ec39b8a71323e3d93a: Status 404 returned error can't find the container with id 4c6cd29548d8cfee7d53300ba6caac4b2fe60876fb8bd6ec39b8a71323e3d93a Sep 17 16:32:20.493986 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:20.493965 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b0bb659_a91c_4d72_a848_cad273fd3f67.slice/crio-c357da39e7cb596c6fc9103042673803192713c4030c113f567d9b8ffbea4579 WatchSource:0}: Error finding container c357da39e7cb596c6fc9103042673803192713c4030c113f567d9b8ffbea4579: Status 404 returned error can't find the container with id c357da39e7cb596c6fc9103042673803192713c4030c113f567d9b8ffbea4579 Sep 17 16:32:20.500097 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:20.499691 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb3f664b_5aa4_44d1_a348_bb66582adcf9.slice/crio-74ff1e40c10d0253b5d43fc180be3c7d85359adcce658ff4aae7dbe69efce8b8 WatchSource:0}: Error finding container 74ff1e40c10d0253b5d43fc180be3c7d85359adcce658ff4aae7dbe69efce8b8: Status 404 returned error can't find the container with id 74ff1e40c10d0253b5d43fc180be3c7d85359adcce658ff4aae7dbe69efce8b8 Sep 17 16:32:20.503897 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:20.501268 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fe9cdb3_d0f8_4133_99ec_8ac1dfa34b20.slice/crio-1d6424dfa5f8b293f08ab73e9f7c6bfbb0e28a2a1254ee0ef2d4a26d016d0101 WatchSource:0}: Error finding container 1d6424dfa5f8b293f08ab73e9f7c6bfbb0e28a2a1254ee0ef2d4a26d016d0101: Status 404 returned error can't find the container with id 1d6424dfa5f8b293f08ab73e9f7c6bfbb0e28a2a1254ee0ef2d4a26d016d0101 Sep 17 16:32:20.504603 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:32:20.504581 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6b66e55_13f3_43a0_9c6f_ed705c42995d.slice/crio-5035a294277cd7722eac431d2444bf02aac1426a3f7b6d4dad9c65609aca1c18 WatchSource:0}: Error finding container 5035a294277cd7722eac431d2444bf02aac1426a3f7b6d4dad9c65609aca1c18: Status 404 returned error can't find the container with id 5035a294277cd7722eac431d2444bf02aac1426a3f7b6d4dad9c65609aca1c18 Sep 17 16:32:20.903150 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:20.903121 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07690c0a-a396-4f6c-9248-41722d757b2f-metrics-certs\") pod \"network-metrics-daemon-66zvl\" (UID: \"07690c0a-a396-4f6c-9248-41722d757b2f\") " pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:20.903318 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:20.903297 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71c447a9-be09-4350-841c-a054f2e33b6b-original-pull-secret\") pod \"global-pull-secret-syncer-cdn7r\" (UID: \"71c447a9-be09-4350-841c-a054f2e33b6b\") " pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:20.903454 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:20.903391 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 16:32:20.903517 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:20.903465 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71c447a9-be09-4350-841c-a054f2e33b6b-original-pull-secret podName:71c447a9-be09-4350-841c-a054f2e33b6b nodeName:}" failed. No retries permitted until 2026-09-17 16:32:22.903445769 +0000 UTC m=+7.635913345 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71c447a9-be09-4350-841c-a054f2e33b6b-original-pull-secret") pod "global-pull-secret-syncer-cdn7r" (UID: "71c447a9-be09-4350-841c-a054f2e33b6b") : object "kube-system"/"original-pull-secret" not registered Sep 17 16:32:20.903517 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:20.903246 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:32:20.903627 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:20.903548 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07690c0a-a396-4f6c-9248-41722d757b2f-metrics-certs podName:07690c0a-a396-4f6c-9248-41722d757b2f nodeName:}" failed. No retries permitted until 2026-09-17 16:32:22.903519268 +0000 UTC m=+7.635986840 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07690c0a-a396-4f6c-9248-41722d757b2f-metrics-certs") pod "network-metrics-daemon-66zvl" (UID: "07690c0a-a396-4f6c-9248-41722d757b2f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:32:21.104626 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:21.104508 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fknk\" (UniqueName: \"kubernetes.io/projected/694d53e2-8503-4fcf-a313-744e81e30d5e-kube-api-access-7fknk\") pod \"network-check-target-wzqtc\" (UID: \"694d53e2-8503-4fcf-a313-744e81e30d5e\") " pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:32:21.104783 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:21.104749 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 16:32:21.104783 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:21.104769 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 16:32:21.104783 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:21.104781 2581 projected.go:196] Error preparing data for projected volume kube-api-access-7fknk for pod openshift-network-diagnostics/network-check-target-wzqtc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:32:21.104946 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:21.104838 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/694d53e2-8503-4fcf-a313-744e81e30d5e-kube-api-access-7fknk podName:694d53e2-8503-4fcf-a313-744e81e30d5e nodeName:}" failed. No retries permitted until 2026-09-17 16:32:23.104821777 +0000 UTC m=+7.837289338 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7fknk" (UniqueName: "kubernetes.io/projected/694d53e2-8503-4fcf-a313-744e81e30d5e-kube-api-access-7fknk") pod "network-check-target-wzqtc" (UID: "694d53e2-8503-4fcf-a313-744e81e30d5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:32:21.322219 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:21.322059 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 16:27:19 +0000 UTC" deadline="2028-05-24 16:28:09.880499333 +0000 UTC" Sep 17 16:32:21.322219 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:21.322117 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14759h55m48.558386569s" Sep 17 16:32:21.416058 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:21.415546 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:21.416058 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:21.415565 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:21.416058 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:21.415681 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66zvl" podUID="07690c0a-a396-4f6c-9248-41722d757b2f" Sep 17 16:32:21.416058 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:21.415815 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cdn7r" podUID="71c447a9-be09-4350-841c-a054f2e33b6b" Sep 17 16:32:21.456702 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:21.456538 2581 generic.go:356] "Generic (PLEG): container finished" podID="2dbfbe7a689d503359e41305ddae0708" containerID="84d299952f669cdcd6eebdd9294b360aab6a40ee8beb2d2ee155b7360ed7a911" exitCode=0 Sep 17 16:32:21.457248 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:21.457222 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-101.ec2.internal" event={"ID":"2dbfbe7a689d503359e41305ddae0708","Type":"ContainerDied","Data":"84d299952f669cdcd6eebdd9294b360aab6a40ee8beb2d2ee155b7360ed7a911"} Sep 17 16:32:21.491090 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:21.491012 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4nkdh" event={"ID":"41945b34-0d55-4343-9389-7c3431091fdd","Type":"ContainerStarted","Data":"801860e66fc7d6c4ac98f4042587d1cb7be1c4f0237a8a29b6eb8f826457b57e"} Sep 17 16:32:21.497237 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:21.497207 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-btzx7" event={"ID":"e7d9d424-72bd-454a-af3a-2334a1ba3891","Type":"ContainerStarted","Data":"ddefe66aab75783c80cd269ec5a6e1f31cb21173b9e6e8c938712c4fd3352ca0"} Sep 17 16:32:21.512200 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:21.512133 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q4ccz" event={"ID":"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20","Type":"ContainerStarted","Data":"1d6424dfa5f8b293f08ab73e9f7c6bfbb0e28a2a1254ee0ef2d4a26d016d0101"} Sep 17 16:32:21.531108 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:21.530976 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh7hj" event={"ID":"db3f664b-5aa4-44d1-a348-bb66582adcf9","Type":"ContainerStarted","Data":"74ff1e40c10d0253b5d43fc180be3c7d85359adcce658ff4aae7dbe69efce8b8"} Sep 17 16:32:21.542538 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:21.542477 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zqkgf" event={"ID":"5d65b63e-ceb1-4912-aeea-36e3285e6070","Type":"ContainerStarted","Data":"36fbc3bff053e2e25e1fd789da49b97b06d31f83e221f26779d743ac0b8aac10"} Sep 17 16:32:21.554606 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:21.554571 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" event={"ID":"d6b66e55-13f3-43a0-9c6f-ed705c42995d","Type":"ContainerStarted","Data":"5035a294277cd7722eac431d2444bf02aac1426a3f7b6d4dad9c65609aca1c18"} Sep 17 16:32:21.563196 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:21.563168 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" event={"ID":"5b0bb659-a91c-4d72-a848-cad273fd3f67","Type":"ContainerStarted","Data":"c357da39e7cb596c6fc9103042673803192713c4030c113f567d9b8ffbea4579"} Sep 17 16:32:21.579950 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:21.579926 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-101.ec2.internal" event={"ID":"f9b2c501adb92de6a6b87fdccf169cbd","Type":"ContainerStarted","Data":"5b0a56f0e727f2e4a349a7233b983679ebd2c6ed8fec327b59b86cda129584a0"} Sep 17 16:32:21.596497 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:21.596414 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gvdpj" event={"ID":"0b91d9e7-b505-4f06-96a9-615c27c19983","Type":"ContainerStarted","Data":"9702560678f569b267b0270ca2cffd75366df9a351f9b47cb7ac0b449c5b85c4"} Sep 17 16:32:21.599708 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:21.599683 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbgjd" event={"ID":"062048ed-07c1-4c34-af9b-bb44392c07d2","Type":"ContainerStarted","Data":"4c6cd29548d8cfee7d53300ba6caac4b2fe60876fb8bd6ec39b8a71323e3d93a"} Sep 17 16:32:22.415394 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:22.415360 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:32:22.415854 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:22.415510 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzqtc" podUID="694d53e2-8503-4fcf-a313-744e81e30d5e" Sep 17 16:32:22.607136 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:22.607071 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-101.ec2.internal" event={"ID":"2dbfbe7a689d503359e41305ddae0708","Type":"ContainerStarted","Data":"7674bef447bcf1f0f53842b437ea1a4b56d6118070eca56e281f0a22e3df5301"} Sep 17 16:32:22.622867 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:22.622288 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-101.ec2.internal" podStartSLOduration=4.622269192 podStartE2EDuration="4.622269192s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:32:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:32:21.595665067 +0000 UTC m=+6.328132646" watchObservedRunningTime="2026-09-17 16:32:22.622269192 +0000 UTC m=+7.354736773" Sep 17 16:32:22.919678 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:22.918800 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71c447a9-be09-4350-841c-a054f2e33b6b-original-pull-secret\") pod \"global-pull-secret-syncer-cdn7r\" (UID: \"71c447a9-be09-4350-841c-a054f2e33b6b\") " pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:22.919678 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:22.918868 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07690c0a-a396-4f6c-9248-41722d757b2f-metrics-certs\") pod \"network-metrics-daemon-66zvl\" (UID: \"07690c0a-a396-4f6c-9248-41722d757b2f\") " pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:22.919678 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:22.919018 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:32:22.919678 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:22.919080 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07690c0a-a396-4f6c-9248-41722d757b2f-metrics-certs podName:07690c0a-a396-4f6c-9248-41722d757b2f nodeName:}" failed. No retries permitted until 2026-09-17 16:32:26.919061487 +0000 UTC m=+11.651529065 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07690c0a-a396-4f6c-9248-41722d757b2f-metrics-certs") pod "network-metrics-daemon-66zvl" (UID: "07690c0a-a396-4f6c-9248-41722d757b2f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:32:22.919678 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:22.919458 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 16:32:22.919678 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:22.919507 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71c447a9-be09-4350-841c-a054f2e33b6b-original-pull-secret podName:71c447a9-be09-4350-841c-a054f2e33b6b nodeName:}" failed. No retries permitted until 2026-09-17 16:32:26.919492043 +0000 UTC m=+11.651959603 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71c447a9-be09-4350-841c-a054f2e33b6b-original-pull-secret") pod "global-pull-secret-syncer-cdn7r" (UID: "71c447a9-be09-4350-841c-a054f2e33b6b") : object "kube-system"/"original-pull-secret" not registered Sep 17 16:32:23.120703 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:23.120665 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fknk\" (UniqueName: \"kubernetes.io/projected/694d53e2-8503-4fcf-a313-744e81e30d5e-kube-api-access-7fknk\") pod \"network-check-target-wzqtc\" (UID: \"694d53e2-8503-4fcf-a313-744e81e30d5e\") " pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:32:23.120887 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:23.120868 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 16:32:23.120942 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:23.120899 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 16:32:23.120942 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:23.120911 2581 projected.go:196] Error preparing data for projected volume kube-api-access-7fknk for pod openshift-network-diagnostics/network-check-target-wzqtc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:32:23.121056 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:23.120971 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/694d53e2-8503-4fcf-a313-744e81e30d5e-kube-api-access-7fknk podName:694d53e2-8503-4fcf-a313-744e81e30d5e nodeName:}" failed. No retries permitted until 2026-09-17 16:32:27.120952171 +0000 UTC m=+11.853419748 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7fknk" (UniqueName: "kubernetes.io/projected/694d53e2-8503-4fcf-a313-744e81e30d5e-kube-api-access-7fknk") pod "network-check-target-wzqtc" (UID: "694d53e2-8503-4fcf-a313-744e81e30d5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:32:23.417317 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:23.417245 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:23.417777 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:23.417376 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66zvl" podUID="07690c0a-a396-4f6c-9248-41722d757b2f" Sep 17 16:32:23.417777 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:23.417505 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:23.417777 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:23.417594 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cdn7r" podUID="71c447a9-be09-4350-841c-a054f2e33b6b" Sep 17 16:32:24.415098 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:24.415062 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:32:24.415274 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:24.415245 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzqtc" podUID="694d53e2-8503-4fcf-a313-744e81e30d5e" Sep 17 16:32:25.420172 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:25.419530 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:25.420172 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:25.419648 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cdn7r" podUID="71c447a9-be09-4350-841c-a054f2e33b6b" Sep 17 16:32:25.420172 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:25.420028 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:25.420172 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:25.420127 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66zvl" podUID="07690c0a-a396-4f6c-9248-41722d757b2f" Sep 17 16:32:26.415449 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:26.414981 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:32:26.415449 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:26.415099 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzqtc" podUID="694d53e2-8503-4fcf-a313-744e81e30d5e" Sep 17 16:32:26.951293 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:26.951254 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71c447a9-be09-4350-841c-a054f2e33b6b-original-pull-secret\") pod \"global-pull-secret-syncer-cdn7r\" (UID: \"71c447a9-be09-4350-841c-a054f2e33b6b\") " pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:26.951789 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:26.951339 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07690c0a-a396-4f6c-9248-41722d757b2f-metrics-certs\") pod \"network-metrics-daemon-66zvl\" (UID: \"07690c0a-a396-4f6c-9248-41722d757b2f\") " pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:26.951789 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:26.951417 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 16:32:26.951789 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:26.951452 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:32:26.951789 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:26.951507 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71c447a9-be09-4350-841c-a054f2e33b6b-original-pull-secret podName:71c447a9-be09-4350-841c-a054f2e33b6b nodeName:}" failed. No retries permitted until 2026-09-17 16:32:34.951489052 +0000 UTC m=+19.683956628 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71c447a9-be09-4350-841c-a054f2e33b6b-original-pull-secret") pod "global-pull-secret-syncer-cdn7r" (UID: "71c447a9-be09-4350-841c-a054f2e33b6b") : object "kube-system"/"original-pull-secret" not registered Sep 17 16:32:26.951789 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:26.951523 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07690c0a-a396-4f6c-9248-41722d757b2f-metrics-certs podName:07690c0a-a396-4f6c-9248-41722d757b2f nodeName:}" failed. No retries permitted until 2026-09-17 16:32:34.951516415 +0000 UTC m=+19.683983972 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07690c0a-a396-4f6c-9248-41722d757b2f-metrics-certs") pod "network-metrics-daemon-66zvl" (UID: "07690c0a-a396-4f6c-9248-41722d757b2f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:32:27.153567 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:27.153471 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fknk\" (UniqueName: \"kubernetes.io/projected/694d53e2-8503-4fcf-a313-744e81e30d5e-kube-api-access-7fknk\") pod \"network-check-target-wzqtc\" (UID: \"694d53e2-8503-4fcf-a313-744e81e30d5e\") " pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:32:27.153740 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:27.153665 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 16:32:27.153740 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:27.153689 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 16:32:27.153740 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:27.153701 2581 projected.go:196] Error preparing data for projected volume kube-api-access-7fknk for pod openshift-network-diagnostics/network-check-target-wzqtc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:32:27.153888 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:27.153746 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/694d53e2-8503-4fcf-a313-744e81e30d5e-kube-api-access-7fknk podName:694d53e2-8503-4fcf-a313-744e81e30d5e nodeName:}" failed. No retries permitted until 2026-09-17 16:32:35.153733267 +0000 UTC m=+19.886200836 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7fknk" (UniqueName: "kubernetes.io/projected/694d53e2-8503-4fcf-a313-744e81e30d5e-kube-api-access-7fknk") pod "network-check-target-wzqtc" (UID: "694d53e2-8503-4fcf-a313-744e81e30d5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:32:27.416015 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:27.415935 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:27.416179 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:27.416069 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66zvl" podUID="07690c0a-a396-4f6c-9248-41722d757b2f" Sep 17 16:32:27.416179 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:27.416116 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:27.416266 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:27.416227 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cdn7r" podUID="71c447a9-be09-4350-841c-a054f2e33b6b" Sep 17 16:32:28.415546 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:28.415515 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:32:28.416126 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:28.415630 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzqtc" podUID="694d53e2-8503-4fcf-a313-744e81e30d5e" Sep 17 16:32:29.415776 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:29.415742 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:29.416212 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:29.415877 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66zvl" podUID="07690c0a-a396-4f6c-9248-41722d757b2f" Sep 17 16:32:29.416212 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:29.416186 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:29.416316 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:29.416281 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cdn7r" podUID="71c447a9-be09-4350-841c-a054f2e33b6b" Sep 17 16:32:30.415609 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:30.415571 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:32:30.415800 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:30.415688 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzqtc" podUID="694d53e2-8503-4fcf-a313-744e81e30d5e" Sep 17 16:32:31.414821 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:31.414789 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:31.414998 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:31.414789 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:31.414998 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:31.414935 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66zvl" podUID="07690c0a-a396-4f6c-9248-41722d757b2f" Sep 17 16:32:31.414998 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:31.414968 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cdn7r" podUID="71c447a9-be09-4350-841c-a054f2e33b6b" Sep 17 16:32:32.415209 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:32.415179 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:32:32.415638 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:32.415285 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzqtc" podUID="694d53e2-8503-4fcf-a313-744e81e30d5e" Sep 17 16:32:33.415544 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:33.415517 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:33.415928 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:33.415517 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:33.415928 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:33.415652 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66zvl" podUID="07690c0a-a396-4f6c-9248-41722d757b2f" Sep 17 16:32:33.415928 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:33.415695 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cdn7r" podUID="71c447a9-be09-4350-841c-a054f2e33b6b" Sep 17 16:32:34.414928 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:34.414898 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:32:34.415094 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:34.414999 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzqtc" podUID="694d53e2-8503-4fcf-a313-744e81e30d5e" Sep 17 16:32:35.009722 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:35.009687 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71c447a9-be09-4350-841c-a054f2e33b6b-original-pull-secret\") pod \"global-pull-secret-syncer-cdn7r\" (UID: \"71c447a9-be09-4350-841c-a054f2e33b6b\") " pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:35.010209 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:35.009753 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07690c0a-a396-4f6c-9248-41722d757b2f-metrics-certs\") pod \"network-metrics-daemon-66zvl\" (UID: \"07690c0a-a396-4f6c-9248-41722d757b2f\") " pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:35.010209 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:35.009859 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 16:32:35.010209 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:35.009883 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:32:35.010209 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:35.009944 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71c447a9-be09-4350-841c-a054f2e33b6b-original-pull-secret podName:71c447a9-be09-4350-841c-a054f2e33b6b nodeName:}" failed. No retries permitted until 2026-09-17 16:32:51.009921396 +0000 UTC m=+35.742388957 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71c447a9-be09-4350-841c-a054f2e33b6b-original-pull-secret") pod "global-pull-secret-syncer-cdn7r" (UID: "71c447a9-be09-4350-841c-a054f2e33b6b") : object "kube-system"/"original-pull-secret" not registered Sep 17 16:32:35.010209 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:35.009966 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07690c0a-a396-4f6c-9248-41722d757b2f-metrics-certs podName:07690c0a-a396-4f6c-9248-41722d757b2f nodeName:}" failed. No retries permitted until 2026-09-17 16:32:51.009953543 +0000 UTC m=+35.742421104 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07690c0a-a396-4f6c-9248-41722d757b2f-metrics-certs") pod "network-metrics-daemon-66zvl" (UID: "07690c0a-a396-4f6c-9248-41722d757b2f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:32:35.211657 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:35.211620 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fknk\" (UniqueName: \"kubernetes.io/projected/694d53e2-8503-4fcf-a313-744e81e30d5e-kube-api-access-7fknk\") pod \"network-check-target-wzqtc\" (UID: \"694d53e2-8503-4fcf-a313-744e81e30d5e\") " pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:32:35.211811 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:35.211763 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 16:32:35.211811 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:35.211781 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 16:32:35.211811 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:35.211795 2581 projected.go:196] Error preparing data for projected volume kube-api-access-7fknk for pod openshift-network-diagnostics/network-check-target-wzqtc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:32:35.211939 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:35.211860 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/694d53e2-8503-4fcf-a313-744e81e30d5e-kube-api-access-7fknk podName:694d53e2-8503-4fcf-a313-744e81e30d5e nodeName:}" failed. No retries permitted until 2026-09-17 16:32:51.211843449 +0000 UTC m=+35.944311012 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7fknk" (UniqueName: "kubernetes.io/projected/694d53e2-8503-4fcf-a313-744e81e30d5e-kube-api-access-7fknk") pod "network-check-target-wzqtc" (UID: "694d53e2-8503-4fcf-a313-744e81e30d5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:32:35.415178 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:35.415064 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:35.415419 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:35.415204 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cdn7r" podUID="71c447a9-be09-4350-841c-a054f2e33b6b" Sep 17 16:32:35.415419 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:35.415260 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:35.415419 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:35.415377 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66zvl" podUID="07690c0a-a396-4f6c-9248-41722d757b2f" Sep 17 16:32:36.414881 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:36.414850 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:32:36.415291 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:36.414982 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzqtc" podUID="694d53e2-8503-4fcf-a313-744e81e30d5e" Sep 17 16:32:37.415657 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:37.415624 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:37.416022 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:37.415714 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66zvl" podUID="07690c0a-a396-4f6c-9248-41722d757b2f" Sep 17 16:32:37.416022 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:37.415796 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:37.416022 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:37.415881 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cdn7r" podUID="71c447a9-be09-4350-841c-a054f2e33b6b" Sep 17 16:32:38.415940 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:38.415477 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:32:38.415940 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:38.415610 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzqtc" podUID="694d53e2-8503-4fcf-a313-744e81e30d5e" Sep 17 16:32:38.640294 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:38.640068 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q4ccz" event={"ID":"3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20","Type":"ContainerStarted","Data":"8693697a8b364f857500ed7d5897fbd734c40f446415742a3469856a9cb5e5d3"} Sep 17 16:32:38.641898 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:38.641855 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh7hj" event={"ID":"db3f664b-5aa4-44d1-a348-bb66582adcf9","Type":"ContainerStarted","Data":"cc29e51d74e91efebc657666a355b227c58338cd52ccc0a75ed1eaab13dc687f"} Sep 17 16:32:38.643782 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:38.643756 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zqkgf" event={"ID":"5d65b63e-ceb1-4912-aeea-36e3285e6070","Type":"ContainerStarted","Data":"d258c2f3949ac7b8feaa0d508b6cb170166edb4fa6349f51bf586a2f82c9ecf9"} Sep 17 16:32:38.646048 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:38.645986 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" event={"ID":"d6b66e55-13f3-43a0-9c6f-ed705c42995d","Type":"ContainerStarted","Data":"663558ba7ac3f5e66e29aef47e3168dd31f6c588884bf16900fc3e5e38a08567"} Sep 17 16:32:38.652480 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:38.652445 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" event={"ID":"5b0bb659-a91c-4d72-a848-cad273fd3f67","Type":"ContainerStarted","Data":"748d5eccf189efe0e67b2bf006673320ed86a65f71e7289642234abd27a780b5"} Sep 17 16:32:38.654966 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:38.654940 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gvdpj" event={"ID":"0b91d9e7-b505-4f06-96a9-615c27c19983","Type":"ContainerStarted","Data":"50fab560099a798ab10e81220a701620fccb7457a4849bde1c6e600cf5260814"} Sep 17 16:32:38.656639 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:38.656605 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbgjd" event={"ID":"062048ed-07c1-4c34-af9b-bb44392c07d2","Type":"ContainerStarted","Data":"8061f20cda8a3649c7ec100ba95058293c2697651700a22bcce28e1ab3e2c351"} Sep 17 16:32:38.658180 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:38.658157 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-btzx7" event={"ID":"e7d9d424-72bd-454a-af3a-2334a1ba3891","Type":"ContainerStarted","Data":"cc8c70523340012425ecc5ef39666c4a428eebc6caccd1b11a02007e79c7b2d9"} Sep 17 16:32:38.660266 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:38.660226 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-101.ec2.internal" podStartSLOduration=20.660212846 podStartE2EDuration="20.660212846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:32:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:32:22.622851354 +0000 UTC m=+7.355318934" watchObservedRunningTime="2026-09-17 16:32:38.660212846 +0000 UTC m=+23.392680425" Sep 17 16:32:38.660365 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:38.660347 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-q4ccz" podStartSLOduration=3.853734136 podStartE2EDuration="21.660343059s" totalImagesPullingTime="17.806608923s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:32:38.659704314 +0000 UTC m=+23.392171893" watchObservedRunningTime="2026-09-17 16:32:38.660343059 +0000 UTC m=+23.392810638" Sep 17 16:32:38.675517 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:38.675479 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gvdpj" podStartSLOduration=3.910506168 podStartE2EDuration="21.675465277s" totalImagesPullingTime="17.764959109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:32:38.675182089 +0000 UTC m=+23.407649665" watchObservedRunningTime="2026-09-17 16:32:38.675465277 +0000 UTC m=+23.407932856" Sep 17 16:32:38.693544 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:38.693496 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2mlrm" podStartSLOduration=3.880133742 podStartE2EDuration="21.693476254s" totalImagesPullingTime="17.813342512s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:32:38.693464732 +0000 UTC m=+23.425932309" watchObservedRunningTime="2026-09-17 16:32:38.693476254 +0000 UTC m=+23.425943834" Sep 17 16:32:38.712143 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:38.712022 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-btzx7" podStartSLOduration=3.970683819 podStartE2EDuration="21.712004022s" totalImagesPullingTime="17.741320203s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:32:38.711680199 +0000 UTC m=+23.444147783" watchObservedRunningTime="2026-09-17 16:32:38.712004022 +0000 UTC m=+23.444471605" Sep 17 16:32:38.729765 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:38.729713 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zqkgf" podStartSLOduration=3.9171877520000002 podStartE2EDuration="21.729699536s" totalImagesPullingTime="17.812511784s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:32:38.729053489 +0000 UTC m=+23.461521067" watchObservedRunningTime="2026-09-17 16:32:38.729699536 +0000 UTC m=+23.462167118" Sep 17 16:32:38.807099 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:38.806724 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:38.883382 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:38.883315 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:39.079989 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:39.079867 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gvdpj" Sep 17 16:32:39.080465 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:39.080444 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gvdpj" Sep 17 16:32:39.201525 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:39.201498 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gvdpj" Sep 17 16:32:39.202057 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:39.202038 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gvdpj" Sep 17 16:32:39.285407 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:39.285371 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:39.415357 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:39.415280 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:39.415553 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:39.415418 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66zvl" podUID="07690c0a-a396-4f6c-9248-41722d757b2f" Sep 17 16:32:39.415553 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:39.415460 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:39.415553 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:39.415543 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cdn7r" podUID="71c447a9-be09-4350-841c-a054f2e33b6b" Sep 17 16:32:39.625965 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:39.625923 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:39.661770 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:39.661746 2581 generic.go:356] "Generic (PLEG): container finished" podID="062048ed-07c1-4c34-af9b-bb44392c07d2" containerID="8061f20cda8a3649c7ec100ba95058293c2697651700a22bcce28e1ab3e2c351" exitCode=0 Sep 17 16:32:39.661903 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:39.661815 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbgjd" event={"ID":"062048ed-07c1-4c34-af9b-bb44392c07d2","Type":"ContainerDied","Data":"8061f20cda8a3649c7ec100ba95058293c2697651700a22bcce28e1ab3e2c351"} Sep 17 16:32:39.664612 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:39.664596 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jflqj_d6b66e55-13f3-43a0-9c6f-ed705c42995d/ovn-acl-logging/0.log" Sep 17 16:32:39.664924 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:39.664909 2581 generic.go:356] "Generic (PLEG): container finished" podID="d6b66e55-13f3-43a0-9c6f-ed705c42995d" containerID="3aeb487fb9f51e2c674f09d7369ecd059628ea998468da1c51562c139416b6a4" exitCode=1 Sep 17 16:32:39.665019 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:39.664999 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" event={"ID":"d6b66e55-13f3-43a0-9c6f-ed705c42995d","Type":"ContainerStarted","Data":"adf36aea03eba562ded239effd9e856aa620b8f3e98e9ff5c7b1431f26900da6"} Sep 17 16:32:39.665070 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:39.665057 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" event={"ID":"d6b66e55-13f3-43a0-9c6f-ed705c42995d","Type":"ContainerStarted","Data":"4cbc765b31608cc47bf990a5ca486261f19adb4d5426d6dd19ae6de9824dedc8"} Sep 17 16:32:39.665113 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:39.665090 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" event={"ID":"d6b66e55-13f3-43a0-9c6f-ed705c42995d","Type":"ContainerStarted","Data":"d55ee8802257763a00a50ed1409ca4227ec0f72a6a115573947bfb3af5d4d145"} Sep 17 16:32:39.665148 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:39.665117 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" event={"ID":"d6b66e55-13f3-43a0-9c6f-ed705c42995d","Type":"ContainerStarted","Data":"04bc669cf9067f207a35a05715deccc860b69f287b8c90dc43918a8ff0ec1b14"} Sep 17 16:32:39.665148 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:39.665145 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" event={"ID":"d6b66e55-13f3-43a0-9c6f-ed705c42995d","Type":"ContainerDied","Data":"3aeb487fb9f51e2c674f09d7369ecd059628ea998468da1c51562c139416b6a4"} Sep 17 16:32:39.719345 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:39.719286 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:39.792882 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:39.792853 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:39.890240 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:39.890216 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 17 16:32:40.353344 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:40.353231 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T16:32:39.890237307Z","UUID":"d121727d-580c-4930-ac48-7f9f5f683d19","Handler":null,"Name":"","Endpoint":""} Sep 17 16:32:40.354705 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:40.354684 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 17 16:32:40.354834 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:40.354720 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 17 16:32:40.415695 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:40.415666 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:32:40.415847 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:40.415791 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzqtc" podUID="694d53e2-8503-4fcf-a313-744e81e30d5e" Sep 17 16:32:40.669188 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:40.669105 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4nkdh" event={"ID":"41945b34-0d55-4343-9389-7c3431091fdd","Type":"ContainerStarted","Data":"de2b96d7598911c08d91a58726f67276e603a5607a079d6a1f9960a3b88a2d8c"} Sep 17 16:32:40.671354 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:40.671323 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh7hj" event={"ID":"db3f664b-5aa4-44d1-a348-bb66582adcf9","Type":"ContainerStarted","Data":"7d03b4a8504b29e166ded67c5b029d5970ce5d54a4e3fbb36c3bb644eaa4f713"} Sep 17 16:32:40.685149 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:40.685101 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4nkdh" podStartSLOduration=5.876117053 podStartE2EDuration="23.685084766s" totalImagesPullingTime="17.808967713s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:32:40.685028379 +0000 UTC m=+25.417495958" watchObservedRunningTime="2026-09-17 16:32:40.685084766 +0000 UTC m=+25.417552348" Sep 17 16:32:40.811494 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:40.811391 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:40.894283 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:40.894252 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:41.414984 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:41.414912 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:41.415115 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:41.415027 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66zvl" podUID="07690c0a-a396-4f6c-9248-41722d757b2f" Sep 17 16:32:41.415115 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:41.415056 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:41.415183 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:41.415115 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cdn7r" podUID="71c447a9-be09-4350-841c-a054f2e33b6b" Sep 17 16:32:41.540606 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:41.540568 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:41.642152 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:41.642118 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:41.676197 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:41.676115 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh7hj" event={"ID":"db3f664b-5aa4-44d1-a348-bb66582adcf9","Type":"ContainerStarted","Data":"1f7e78af600e8f37964874b4b757b48f4c6dcb3114699cf14ab751730c604304"} Sep 17 16:32:41.679729 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:41.679705 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jflqj_d6b66e55-13f3-43a0-9c6f-ed705c42995d/ovn-acl-logging/0.log" Sep 17 16:32:41.680172 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:41.680132 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" event={"ID":"d6b66e55-13f3-43a0-9c6f-ed705c42995d","Type":"ContainerStarted","Data":"0e12dea45df137645270ce6f97004f4254bb471f42f05b07bb4cb9bdb3488354"} Sep 17 16:32:41.697367 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:41.697322 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rh7hj" podStartSLOduration=4.564913108 podStartE2EDuration="24.697309483s" totalImagesPullingTime="20.132396375s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:32:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:32:41.69653836 +0000 UTC m=+26.429005941" watchObservedRunningTime="2026-09-17 16:32:41.697309483 +0000 UTC m=+26.429777061" Sep 17 16:32:41.945868 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:41.945771 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:42.002633 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:42.002608 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:42.219896 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:42.219804 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:42.320290 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:42.320256 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:42.415503 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:42.415473 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:32:42.415650 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:42.415574 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzqtc" podUID="694d53e2-8503-4fcf-a313-744e81e30d5e" Sep 17 16:32:43.172130 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:43.171931 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:43.237388 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:43.237358 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-btzx7_e7d9d424-72bd-454a-af3a-2334a1ba3891/dns-node-resolver/0.log" Sep 17 16:32:43.263023 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:43.262990 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:43.363206 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:43.363157 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:43.415308 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:43.415279 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:43.415508 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:43.415392 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cdn7r" podUID="71c447a9-be09-4350-841c-a054f2e33b6b" Sep 17 16:32:43.415593 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:43.415514 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:43.415662 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:43.415638 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66zvl" podUID="07690c0a-a396-4f6c-9248-41722d757b2f" Sep 17 16:32:43.892812 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:43.892753 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:43.982006 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:43.981968 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:44.097991 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:44.097956 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:44.414815 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:44.414789 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:32:44.415378 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:44.414882 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzqtc" podUID="694d53e2-8503-4fcf-a313-744e81e30d5e" Sep 17 16:32:44.434905 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:44.434882 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zqkgf_5d65b63e-ceb1-4912-aeea-36e3285e6070/node-ca/0.log" Sep 17 16:32:44.689220 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:44.689144 2581 generic.go:356] "Generic (PLEG): container finished" podID="062048ed-07c1-4c34-af9b-bb44392c07d2" containerID="4d536eb6a4d24808e7dfb005d601b32f2e7e65c6936b795c21a313e768359de5" exitCode=0 Sep 17 16:32:44.689368 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:44.689242 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbgjd" event={"ID":"062048ed-07c1-4c34-af9b-bb44392c07d2","Type":"ContainerDied","Data":"4d536eb6a4d24808e7dfb005d601b32f2e7e65c6936b795c21a313e768359de5"} Sep 17 16:32:44.692911 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:44.692898 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jflqj_d6b66e55-13f3-43a0-9c6f-ed705c42995d/ovn-acl-logging/0.log" Sep 17 16:32:44.693277 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:44.693260 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" event={"ID":"d6b66e55-13f3-43a0-9c6f-ed705c42995d","Type":"ContainerStarted","Data":"dd262b75cb2489f82f8fc43de6249b494a3e0900ec0275c4536bbdf2a46a405e"} Sep 17 16:32:44.693535 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:44.693517 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:44.693620 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:44.693562 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:44.693754 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:44.693737 2581 scope.go:117] "RemoveContainer" containerID="3aeb487fb9f51e2c674f09d7369ecd059628ea998468da1c51562c139416b6a4" Sep 17 16:32:44.710592 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:44.710568 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:45.419461 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:45.419189 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:45.419461 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:45.419301 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cdn7r" podUID="71c447a9-be09-4350-841c-a054f2e33b6b" Sep 17 16:32:45.419914 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:45.419516 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:45.419914 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:45.419638 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66zvl" podUID="07690c0a-a396-4f6c-9248-41722d757b2f" Sep 17 16:32:45.697786 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:45.697683 2581 generic.go:356] "Generic (PLEG): container finished" podID="062048ed-07c1-4c34-af9b-bb44392c07d2" containerID="f707406461c72de49f24c0d5a64fbb4c529c4cd183b487393186cd685955b9f5" exitCode=0 Sep 17 16:32:45.697895 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:45.697773 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbgjd" event={"ID":"062048ed-07c1-4c34-af9b-bb44392c07d2","Type":"ContainerDied","Data":"f707406461c72de49f24c0d5a64fbb4c529c4cd183b487393186cd685955b9f5"} Sep 17 16:32:45.701797 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:45.701779 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jflqj_d6b66e55-13f3-43a0-9c6f-ed705c42995d/ovn-acl-logging/0.log" Sep 17 16:32:45.702112 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:45.702094 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" event={"ID":"d6b66e55-13f3-43a0-9c6f-ed705c42995d","Type":"ContainerStarted","Data":"7950fb2b464587775d608efe8854cfe4350fd3bb4367df869c360a4dda1f98a6"} Sep 17 16:32:45.702294 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:45.702272 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:45.717572 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:45.717549 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:32:45.727369 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:45.727337 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:45.751643 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:45.751597 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" podStartSLOduration=10.930151402 podStartE2EDuration="28.751578286s" totalImagesPullingTime="17.821426884s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:32:45.751102581 +0000 UTC m=+30.483570162" watchObservedRunningTime="2026-09-17 16:32:45.751578286 +0000 UTC m=+30.484045866" Sep 17 16:32:45.830764 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:45.830739 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:45.986881 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:45.986822 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:46.108785 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:46.108757 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:46.160582 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:46.160555 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-66zvl"] Sep 17 16:32:46.160697 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:46.160656 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:46.160768 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:46.160750 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66zvl" podUID="07690c0a-a396-4f6c-9248-41722d757b2f" Sep 17 16:32:46.175926 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:46.175900 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wzqtc"] Sep 17 16:32:46.176042 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:46.175993 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:32:46.176089 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:46.176066 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzqtc" podUID="694d53e2-8503-4fcf-a313-744e81e30d5e" Sep 17 16:32:46.192604 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:46.192579 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cdn7r"] Sep 17 16:32:46.192703 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:46.192656 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:46.192759 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:46.192742 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cdn7r" podUID="71c447a9-be09-4350-841c-a054f2e33b6b" Sep 17 16:32:46.232856 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:46.232833 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:46.333965 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:46.333892 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:46.433406 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:46.433378 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:46.534304 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:46.534274 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:46.709491 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:46.709390 2581 generic.go:356] "Generic (PLEG): container finished" podID="062048ed-07c1-4c34-af9b-bb44392c07d2" containerID="49a79e931a59c314ae6ce6ccdf7ee81efefa8b99db62af9f8dc5e8ac4b6b18ad" exitCode=0 Sep 17 16:32:46.709491 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:46.709479 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbgjd" event={"ID":"062048ed-07c1-4c34-af9b-bb44392c07d2","Type":"ContainerDied","Data":"49a79e931a59c314ae6ce6ccdf7ee81efefa8b99db62af9f8dc5e8ac4b6b18ad"} Sep 17 16:32:47.415450 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:47.415401 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:47.415615 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:47.415499 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66zvl" podUID="07690c0a-a396-4f6c-9248-41722d757b2f" Sep 17 16:32:47.415615 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:47.415553 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:32:47.415725 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:47.415639 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzqtc" podUID="694d53e2-8503-4fcf-a313-744e81e30d5e" Sep 17 16:32:47.417644 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:47.417620 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:47.612323 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:47.612265 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:47.829603 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:47.829574 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:48.415798 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:48.415726 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:48.415935 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:48.415831 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cdn7r" podUID="71c447a9-be09-4350-841c-a054f2e33b6b" Sep 17 16:32:49.066322 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:49.066280 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:49.127524 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:49.127482 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:49.415536 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:49.415446 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:49.418322 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:49.418293 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:32:49.418450 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:49.418410 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzqtc" podUID="694d53e2-8503-4fcf-a313-744e81e30d5e" Sep 17 16:32:49.418518 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:49.418466 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:49.418657 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:49.418614 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66zvl" podUID="07690c0a-a396-4f6c-9248-41722d757b2f" Sep 17 16:32:49.516290 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:49.516258 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:49.616206 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:49.616034 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:49.818284 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:49.818256 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:50.222258 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:50.222217 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:50.318982 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:50.318944 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:50.415448 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:50.415399 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:50.415587 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:50.415537 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cdn7r" podUID="71c447a9-be09-4350-841c-a054f2e33b6b" Sep 17 16:32:50.816808 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:50.816776 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:51.033117 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:51.033084 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71c447a9-be09-4350-841c-a054f2e33b6b-original-pull-secret\") pod \"global-pull-secret-syncer-cdn7r\" (UID: \"71c447a9-be09-4350-841c-a054f2e33b6b\") " pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:51.033309 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:51.033157 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07690c0a-a396-4f6c-9248-41722d757b2f-metrics-certs\") pod \"network-metrics-daemon-66zvl\" (UID: \"07690c0a-a396-4f6c-9248-41722d757b2f\") " pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:51.033309 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:51.033188 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 16:32:51.033309 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:51.033260 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71c447a9-be09-4350-841c-a054f2e33b6b-original-pull-secret podName:71c447a9-be09-4350-841c-a054f2e33b6b nodeName:}" failed. No retries permitted until 2026-09-17 16:33:23.033240975 +0000 UTC m=+67.765708532 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71c447a9-be09-4350-841c-a054f2e33b6b-original-pull-secret") pod "global-pull-secret-syncer-cdn7r" (UID: "71c447a9-be09-4350-841c-a054f2e33b6b") : object "kube-system"/"original-pull-secret" not registered Sep 17 16:32:51.033309 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:51.033268 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:32:51.033506 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:51.033316 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07690c0a-a396-4f6c-9248-41722d757b2f-metrics-certs podName:07690c0a-a396-4f6c-9248-41722d757b2f nodeName:}" failed. No retries permitted until 2026-09-17 16:33:23.033300506 +0000 UTC m=+67.765768065 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07690c0a-a396-4f6c-9248-41722d757b2f-metrics-certs") pod "network-metrics-daemon-66zvl" (UID: "07690c0a-a396-4f6c-9248-41722d757b2f") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 16:32:51.235425 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:51.235392 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fknk\" (UniqueName: \"kubernetes.io/projected/694d53e2-8503-4fcf-a313-744e81e30d5e-kube-api-access-7fknk\") pod \"network-check-target-wzqtc\" (UID: \"694d53e2-8503-4fcf-a313-744e81e30d5e\") " pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:32:51.235902 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:51.235584 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 16:32:51.235902 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:51.235610 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 16:32:51.235902 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:51.235623 2581 projected.go:196] Error preparing data for projected volume kube-api-access-7fknk for pod openshift-network-diagnostics/network-check-target-wzqtc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:32:51.235902 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:51.235686 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/694d53e2-8503-4fcf-a313-744e81e30d5e-kube-api-access-7fknk podName:694d53e2-8503-4fcf-a313-744e81e30d5e nodeName:}" failed. No retries permitted until 2026-09-17 16:33:23.235668457 +0000 UTC m=+67.968136032 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7fknk" (UniqueName: "kubernetes.io/projected/694d53e2-8503-4fcf-a313-744e81e30d5e-kube-api-access-7fknk") pod "network-check-target-wzqtc" (UID: "694d53e2-8503-4fcf-a313-744e81e30d5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 16:32:51.258241 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:51.258181 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:51.415363 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:51.415328 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:32:51.415629 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:51.415483 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzqtc" podUID="694d53e2-8503-4fcf-a313-744e81e30d5e" Sep 17 16:32:51.415629 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:51.415539 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:51.415761 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:51.415631 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66zvl" podUID="07690c0a-a396-4f6c-9248-41722d757b2f" Sep 17 16:32:51.431220 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:51.431176 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:52.008846 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:52.008812 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:52.087815 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:52.087792 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:52.217913 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:52.217887 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:52.415530 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:52.415509 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:52.415810 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:52.415601 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cdn7r" podUID="71c447a9-be09-4350-841c-a054f2e33b6b" Sep 17 16:32:52.619922 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:52.619862 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:52.725134 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:52.725110 2581 generic.go:356] "Generic (PLEG): container finished" podID="062048ed-07c1-4c34-af9b-bb44392c07d2" containerID="639d0eb34b1ea7049826b9e13405ac07a38c034ce39c9e8913cd89055bb44e2e" exitCode=0 Sep 17 16:32:52.725239 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:52.725189 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbgjd" event={"ID":"062048ed-07c1-4c34-af9b-bb44392c07d2","Type":"ContainerDied","Data":"639d0eb34b1ea7049826b9e13405ac07a38c034ce39c9e8913cd89055bb44e2e"} Sep 17 16:32:52.751946 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:52.751921 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:53.217912 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:53.217885 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:53.415652 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:53.415622 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:32:53.416189 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:53.415709 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzqtc" podUID="694d53e2-8503-4fcf-a313-744e81e30d5e" Sep 17 16:32:53.416189 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:53.415805 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:53.416189 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:53.415895 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66zvl" podUID="07690c0a-a396-4f6c-9248-41722d757b2f" Sep 17 16:32:53.612640 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:53.612583 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:53.730999 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:53.730972 2581 generic.go:356] "Generic (PLEG): container finished" podID="062048ed-07c1-4c34-af9b-bb44392c07d2" containerID="b8c6b809225b5408f390995de58f9904260e2b62cde993f84f9128a926a633e6" exitCode=0 Sep 17 16:32:53.731106 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:53.731005 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbgjd" event={"ID":"062048ed-07c1-4c34-af9b-bb44392c07d2","Type":"ContainerDied","Data":"b8c6b809225b5408f390995de58f9904260e2b62cde993f84f9128a926a633e6"} Sep 17 16:32:54.199072 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:54.199042 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:54.257680 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:54.257645 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:54.414932 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:54.414903 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:54.415103 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:54.415015 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cdn7r" podUID="71c447a9-be09-4350-841c-a054f2e33b6b" Sep 17 16:32:54.597716 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:54.597686 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:54.698150 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:54.698124 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:54.736811 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:54.736785 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbgjd" event={"ID":"062048ed-07c1-4c34-af9b-bb44392c07d2","Type":"ContainerStarted","Data":"42312454e874552d938414876cb5737a9de2858b2f00bc843ee3375abc0e0408"} Sep 17 16:32:54.760210 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:54.760157 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zbgjd" podStartSLOduration=8.45741668 podStartE2EDuration="37.760138264s" totalImagesPullingTime="29.302721584s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:32:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:32:54.758732513 +0000 UTC m=+39.491200092" watchObservedRunningTime="2026-09-17 16:32:54.760138264 +0000 UTC m=+39.492605844" Sep 17 16:32:54.768864 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:54.768837 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:55.414924 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:55.414890 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:55.415083 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:55.414999 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66zvl" podUID="07690c0a-a396-4f6c-9248-41722d757b2f" Sep 17 16:32:55.415083 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:55.415055 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:32:55.415195 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:55.415165 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzqtc" podUID="694d53e2-8503-4fcf-a313-744e81e30d5e" Sep 17 16:32:55.420481 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:55.420452 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:55.613014 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:55.612986 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:55.833891 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:55.833838 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:56.415209 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:56.415176 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:56.415380 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:56.415278 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cdn7r" podUID="71c447a9-be09-4350-841c-a054f2e33b6b" Sep 17 16:32:56.914324 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:56.914294 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:57.014407 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:57.014383 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:32:57.416210 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:57.416183 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:32:57.416339 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:57.416274 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzqtc" podUID="694d53e2-8503-4fcf-a313-744e81e30d5e" Sep 17 16:32:57.416374 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:57.416351 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:57.416476 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:57.416460 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66zvl" podUID="07690c0a-a396-4f6c-9248-41722d757b2f" Sep 17 16:32:58.415645 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:58.415607 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:32:58.416145 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:58.415710 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cdn7r" podUID="71c447a9-be09-4350-841c-a054f2e33b6b" Sep 17 16:32:59.415547 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:59.415515 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:32:59.415710 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:59.415636 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzqtc" podUID="694d53e2-8503-4fcf-a313-744e81e30d5e" Sep 17 16:32:59.415710 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:32:59.415673 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:32:59.415995 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:32:59.415761 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66zvl" podUID="07690c0a-a396-4f6c-9248-41722d757b2f" Sep 17 16:33:00.414690 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:00.414659 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:33:00.414854 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:33:00.414771 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cdn7r" podUID="71c447a9-be09-4350-841c-a054f2e33b6b" Sep 17 16:33:01.415464 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:01.415422 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:33:01.415822 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:33:01.415535 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzqtc" podUID="694d53e2-8503-4fcf-a313-744e81e30d5e" Sep 17 16:33:01.415822 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:01.415619 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:33:01.415822 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:33:01.415736 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66zvl" podUID="07690c0a-a396-4f6c-9248-41722d757b2f" Sep 17 16:33:01.657174 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:01.657122 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:01.759904 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:01.759874 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:01.946702 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:01.946667 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:02.327580 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:02.327545 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:02.415294 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:02.415258 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:33:02.415486 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:33:02.415361 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cdn7r" podUID="71c447a9-be09-4350-841c-a054f2e33b6b" Sep 17 16:33:02.425824 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:02.425797 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:02.723091 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:02.723063 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:02.824706 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:02.824671 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:03.415673 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:03.415632 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:33:03.416137 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:03.415683 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:33:03.416137 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:33:03.415776 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66zvl" podUID="07690c0a-a396-4f6c-9248-41722d757b2f" Sep 17 16:33:03.416137 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:33:03.415889 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzqtc" podUID="694d53e2-8503-4fcf-a313-744e81e30d5e" Sep 17 16:33:03.536608 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:03.536537 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:03.740565 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:03.740532 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:03.807044 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:03.806971 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:04.039802 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:04.039772 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:04.415644 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:04.415619 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:33:04.415793 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:33:04.415708 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cdn7r" podUID="71c447a9-be09-4350-841c-a054f2e33b6b" Sep 17 16:33:05.415527 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:05.415490 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:33:05.415527 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:05.415510 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:33:05.415785 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:33:05.415595 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzqtc" podUID="694d53e2-8503-4fcf-a313-744e81e30d5e" Sep 17 16:33:05.415785 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:33:05.415717 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66zvl" podUID="07690c0a-a396-4f6c-9248-41722d757b2f" Sep 17 16:33:06.415233 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:06.415204 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:33:06.415402 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:33:06.415328 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cdn7r" podUID="71c447a9-be09-4350-841c-a054f2e33b6b" Sep 17 16:33:07.150128 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:07.150098 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:07.209389 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:07.209369 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:07.415583 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:07.415523 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:33:07.415693 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:33:07.415612 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66zvl" podUID="07690c0a-a396-4f6c-9248-41722d757b2f" Sep 17 16:33:07.415739 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:07.415692 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:33:07.415806 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:33:07.415787 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzqtc" podUID="694d53e2-8503-4fcf-a313-744e81e30d5e" Sep 17 16:33:08.415085 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:08.415052 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:33:08.415547 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:33:08.415143 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cdn7r" podUID="71c447a9-be09-4350-841c-a054f2e33b6b" Sep 17 16:33:09.009422 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:09.009387 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:09.112181 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:09.112153 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:09.216465 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:09.216419 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:09.386378 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:09.386320 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:09.414741 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:09.414717 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:33:09.414741 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:09.414738 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:33:09.414916 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:33:09.414839 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66zvl" podUID="07690c0a-a396-4f6c-9248-41722d757b2f" Sep 17 16:33:09.414979 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:33:09.414941 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzqtc" podUID="694d53e2-8503-4fcf-a313-744e81e30d5e" Sep 17 16:33:10.415447 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.415404 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:33:10.415792 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:33:10.415513 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cdn7r" podUID="71c447a9-be09-4350-841c-a054f2e33b6b" Sep 17 16:33:10.427043 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.427018 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-101.ec2.internal" event="NodeReady" Sep 17 16:33:10.427172 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.427124 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 17 16:33:10.479604 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.479576 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gmcnc"] Sep 17 16:33:10.496266 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.496244 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tzn87"] Sep 17 16:33:10.496380 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.496362 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gmcnc" Sep 17 16:33:10.500457 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.500044 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jpbf9\"" Sep 17 16:33:10.500457 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.500334 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 17 16:33:10.500850 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.500737 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 17 16:33:10.524083 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.524065 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gmcnc"] Sep 17 16:33:10.524171 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.524094 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tzn87"] Sep 17 16:33:10.524171 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.524151 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tzn87" Sep 17 16:33:10.526218 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.526199 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 17 16:33:10.526359 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.526342 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 17 16:33:10.526424 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.526369 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mwv9h\"" Sep 17 16:33:10.526424 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.526408 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 17 16:33:10.574378 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.574356 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acda35d5-1e08-4d58-a6c7-d6b0f9999771-cert\") pod \"ingress-canary-tzn87\" (UID: \"acda35d5-1e08-4d58-a6c7-d6b0f9999771\") " pod="openshift-ingress-canary/ingress-canary-tzn87" Sep 17 16:33:10.574519 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.574413 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6664218-0b50-402a-ba5b-dd5632ac696e-metrics-tls\") pod \"dns-default-gmcnc\" (UID: \"c6664218-0b50-402a-ba5b-dd5632ac696e\") " pod="openshift-dns/dns-default-gmcnc" Sep 17 16:33:10.574519 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.574462 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr4gw\" (UniqueName: \"kubernetes.io/projected/acda35d5-1e08-4d58-a6c7-d6b0f9999771-kube-api-access-dr4gw\") pod \"ingress-canary-tzn87\" (UID: \"acda35d5-1e08-4d58-a6c7-d6b0f9999771\") " pod="openshift-ingress-canary/ingress-canary-tzn87" Sep 17 16:33:10.574519 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.574501 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6664218-0b50-402a-ba5b-dd5632ac696e-tmp-dir\") pod \"dns-default-gmcnc\" (UID: \"c6664218-0b50-402a-ba5b-dd5632ac696e\") " pod="openshift-dns/dns-default-gmcnc" Sep 17 16:33:10.574628 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.574553 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c6664218-0b50-402a-ba5b-dd5632ac696e-config-volume\") pod \"dns-default-gmcnc\" (UID: \"c6664218-0b50-402a-ba5b-dd5632ac696e\") " pod="openshift-dns/dns-default-gmcnc" Sep 17 16:33:10.574628 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.574574 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mznf9\" (UniqueName: \"kubernetes.io/projected/c6664218-0b50-402a-ba5b-dd5632ac696e-kube-api-access-mznf9\") pod \"dns-default-gmcnc\" (UID: \"c6664218-0b50-402a-ba5b-dd5632ac696e\") " pod="openshift-dns/dns-default-gmcnc" Sep 17 16:33:10.583253 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.583226 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zzh9n"] Sep 17 16:33:10.596398 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.596379 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zzh9n" Sep 17 16:33:10.597347 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.597327 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zzh9n"] Sep 17 16:33:10.598708 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.598692 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 17 16:33:10.598919 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.598890 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 17 16:33:10.598919 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.598904 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 17 16:33:10.599080 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.598967 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 17 16:33:10.599080 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.598973 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6hsts\"" Sep 17 16:33:10.650119 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.650102 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:10.675348 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.675306 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e74c429-ee05-4ff3-bd0c-88faca9c3f26-data-volume\") pod \"insights-runtime-extractor-zzh9n\" (UID: \"3e74c429-ee05-4ff3-bd0c-88faca9c3f26\") " pod="openshift-insights/insights-runtime-extractor-zzh9n" Sep 17 16:33:10.675410 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.675349 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6664218-0b50-402a-ba5b-dd5632ac696e-metrics-tls\") pod \"dns-default-gmcnc\" (UID: \"c6664218-0b50-402a-ba5b-dd5632ac696e\") " pod="openshift-dns/dns-default-gmcnc" Sep 17 16:33:10.675410 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.675373 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e74c429-ee05-4ff3-bd0c-88faca9c3f26-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zzh9n\" (UID: \"3e74c429-ee05-4ff3-bd0c-88faca9c3f26\") " pod="openshift-insights/insights-runtime-extractor-zzh9n" Sep 17 16:33:10.675410 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.675392 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e74c429-ee05-4ff3-bd0c-88faca9c3f26-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zzh9n\" (UID: \"3e74c429-ee05-4ff3-bd0c-88faca9c3f26\") " pod="openshift-insights/insights-runtime-extractor-zzh9n" Sep 17 16:33:10.675526 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.675425 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-682c9\" (UniqueName: \"kubernetes.io/projected/3e74c429-ee05-4ff3-bd0c-88faca9c3f26-kube-api-access-682c9\") pod \"insights-runtime-extractor-zzh9n\" (UID: \"3e74c429-ee05-4ff3-bd0c-88faca9c3f26\") " pod="openshift-insights/insights-runtime-extractor-zzh9n" Sep 17 16:33:10.675526 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.675482 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr4gw\" (UniqueName: \"kubernetes.io/projected/acda35d5-1e08-4d58-a6c7-d6b0f9999771-kube-api-access-dr4gw\") pod \"ingress-canary-tzn87\" (UID: \"acda35d5-1e08-4d58-a6c7-d6b0f9999771\") " pod="openshift-ingress-canary/ingress-canary-tzn87" Sep 17 16:33:10.675526 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.675500 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3e74c429-ee05-4ff3-bd0c-88faca9c3f26-crio-socket\") pod \"insights-runtime-extractor-zzh9n\" (UID: \"3e74c429-ee05-4ff3-bd0c-88faca9c3f26\") " pod="openshift-insights/insights-runtime-extractor-zzh9n" Sep 17 16:33:10.675612 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.675537 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6664218-0b50-402a-ba5b-dd5632ac696e-tmp-dir\") pod \"dns-default-gmcnc\" (UID: \"c6664218-0b50-402a-ba5b-dd5632ac696e\") " pod="openshift-dns/dns-default-gmcnc" Sep 17 16:33:10.675612 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.675582 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c6664218-0b50-402a-ba5b-dd5632ac696e-config-volume\") pod \"dns-default-gmcnc\" (UID: \"c6664218-0b50-402a-ba5b-dd5632ac696e\") " pod="openshift-dns/dns-default-gmcnc" Sep 17 16:33:10.675612 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.675605 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mznf9\" (UniqueName: \"kubernetes.io/projected/c6664218-0b50-402a-ba5b-dd5632ac696e-kube-api-access-mznf9\") pod \"dns-default-gmcnc\" (UID: \"c6664218-0b50-402a-ba5b-dd5632ac696e\") " pod="openshift-dns/dns-default-gmcnc" Sep 17 16:33:10.675751 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.675638 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acda35d5-1e08-4d58-a6c7-d6b0f9999771-cert\") pod \"ingress-canary-tzn87\" (UID: \"acda35d5-1e08-4d58-a6c7-d6b0f9999771\") " pod="openshift-ingress-canary/ingress-canary-tzn87" Sep 17 16:33:10.675864 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.675848 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6664218-0b50-402a-ba5b-dd5632ac696e-tmp-dir\") pod \"dns-default-gmcnc\" (UID: \"c6664218-0b50-402a-ba5b-dd5632ac696e\") " pod="openshift-dns/dns-default-gmcnc" Sep 17 16:33:10.676139 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.676116 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c6664218-0b50-402a-ba5b-dd5632ac696e-config-volume\") pod \"dns-default-gmcnc\" (UID: \"c6664218-0b50-402a-ba5b-dd5632ac696e\") " pod="openshift-dns/dns-default-gmcnc" Sep 17 16:33:10.679417 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.679396 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acda35d5-1e08-4d58-a6c7-d6b0f9999771-cert\") pod \"ingress-canary-tzn87\" (UID: \"acda35d5-1e08-4d58-a6c7-d6b0f9999771\") " pod="openshift-ingress-canary/ingress-canary-tzn87" Sep 17 16:33:10.679417 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.679405 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6664218-0b50-402a-ba5b-dd5632ac696e-metrics-tls\") pod \"dns-default-gmcnc\" (UID: \"c6664218-0b50-402a-ba5b-dd5632ac696e\") " pod="openshift-dns/dns-default-gmcnc" Sep 17 16:33:10.686261 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.686240 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mznf9\" (UniqueName: \"kubernetes.io/projected/c6664218-0b50-402a-ba5b-dd5632ac696e-kube-api-access-mznf9\") pod \"dns-default-gmcnc\" (UID: \"c6664218-0b50-402a-ba5b-dd5632ac696e\") " pod="openshift-dns/dns-default-gmcnc" Sep 17 16:33:10.687751 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.687729 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr4gw\" (UniqueName: \"kubernetes.io/projected/acda35d5-1e08-4d58-a6c7-d6b0f9999771-kube-api-access-dr4gw\") pod \"ingress-canary-tzn87\" (UID: \"acda35d5-1e08-4d58-a6c7-d6b0f9999771\") " pod="openshift-ingress-canary/ingress-canary-tzn87" Sep 17 16:33:10.750088 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.750067 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:10.776474 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.776454 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e74c429-ee05-4ff3-bd0c-88faca9c3f26-data-volume\") pod \"insights-runtime-extractor-zzh9n\" (UID: \"3e74c429-ee05-4ff3-bd0c-88faca9c3f26\") " pod="openshift-insights/insights-runtime-extractor-zzh9n" Sep 17 16:33:10.776549 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.776496 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e74c429-ee05-4ff3-bd0c-88faca9c3f26-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zzh9n\" (UID: \"3e74c429-ee05-4ff3-bd0c-88faca9c3f26\") " pod="openshift-insights/insights-runtime-extractor-zzh9n" Sep 17 16:33:10.776549 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.776524 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e74c429-ee05-4ff3-bd0c-88faca9c3f26-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zzh9n\" (UID: \"3e74c429-ee05-4ff3-bd0c-88faca9c3f26\") " pod="openshift-insights/insights-runtime-extractor-zzh9n" Sep 17 16:33:10.776618 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.776547 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-682c9\" (UniqueName: \"kubernetes.io/projected/3e74c429-ee05-4ff3-bd0c-88faca9c3f26-kube-api-access-682c9\") pod \"insights-runtime-extractor-zzh9n\" (UID: \"3e74c429-ee05-4ff3-bd0c-88faca9c3f26\") " pod="openshift-insights/insights-runtime-extractor-zzh9n" Sep 17 16:33:10.776618 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.776572 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3e74c429-ee05-4ff3-bd0c-88faca9c3f26-crio-socket\") pod \"insights-runtime-extractor-zzh9n\" (UID: \"3e74c429-ee05-4ff3-bd0c-88faca9c3f26\") " pod="openshift-insights/insights-runtime-extractor-zzh9n" Sep 17 16:33:10.776689 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.776674 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3e74c429-ee05-4ff3-bd0c-88faca9c3f26-crio-socket\") pod \"insights-runtime-extractor-zzh9n\" (UID: \"3e74c429-ee05-4ff3-bd0c-88faca9c3f26\") " pod="openshift-insights/insights-runtime-extractor-zzh9n" Sep 17 16:33:10.776775 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.776764 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e74c429-ee05-4ff3-bd0c-88faca9c3f26-data-volume\") pod \"insights-runtime-extractor-zzh9n\" (UID: \"3e74c429-ee05-4ff3-bd0c-88faca9c3f26\") " pod="openshift-insights/insights-runtime-extractor-zzh9n" Sep 17 16:33:10.776980 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.776949 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e74c429-ee05-4ff3-bd0c-88faca9c3f26-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zzh9n\" (UID: \"3e74c429-ee05-4ff3-bd0c-88faca9c3f26\") " pod="openshift-insights/insights-runtime-extractor-zzh9n" Sep 17 16:33:10.778579 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.778555 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e74c429-ee05-4ff3-bd0c-88faca9c3f26-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zzh9n\" (UID: \"3e74c429-ee05-4ff3-bd0c-88faca9c3f26\") " pod="openshift-insights/insights-runtime-extractor-zzh9n" Sep 17 16:33:10.784995 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.784976 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-682c9\" (UniqueName: \"kubernetes.io/projected/3e74c429-ee05-4ff3-bd0c-88faca9c3f26-kube-api-access-682c9\") pod \"insights-runtime-extractor-zzh9n\" (UID: \"3e74c429-ee05-4ff3-bd0c-88faca9c3f26\") " pod="openshift-insights/insights-runtime-extractor-zzh9n" Sep 17 16:33:10.808903 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.808883 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gmcnc" Sep 17 16:33:10.831274 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.831257 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tzn87" Sep 17 16:33:10.904784 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.904748 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zzh9n" Sep 17 16:33:10.995518 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:10.995487 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:11.158344 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:11.158314 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tzn87"] Sep 17 16:33:11.161277 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:11.161255 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gmcnc"] Sep 17 16:33:11.162749 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:33:11.162722 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacda35d5_1e08_4d58_a6c7_d6b0f9999771.slice/crio-0befd9baeb0fb491a9e3262e178bf1fafda282d510084fbf8b09e9f4086b158c WatchSource:0}: Error finding container 0befd9baeb0fb491a9e3262e178bf1fafda282d510084fbf8b09e9f4086b158c: Status 404 returned error can't find the container with id 0befd9baeb0fb491a9e3262e178bf1fafda282d510084fbf8b09e9f4086b158c Sep 17 16:33:11.164540 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:33:11.164519 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6664218_0b50_402a_ba5b_dd5632ac696e.slice/crio-919ef2d3b549459acc819a7ab0963c16b5e9e23926b50749a290302a985a2516 WatchSource:0}: Error finding container 919ef2d3b549459acc819a7ab0963c16b5e9e23926b50749a290302a985a2516: Status 404 returned error can't find the container with id 919ef2d3b549459acc819a7ab0963c16b5e9e23926b50749a290302a985a2516 Sep 17 16:33:11.209567 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:11.209545 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zzh9n"] Sep 17 16:33:11.211597 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:11.211576 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:11.212559 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:33:11.212540 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e74c429_ee05_4ff3_bd0c_88faca9c3f26.slice/crio-73f0b7e3a93784d3c1192e5a1fa14ece605152ed9f899efdeb440b9a8522eaba WatchSource:0}: Error finding container 73f0b7e3a93784d3c1192e5a1fa14ece605152ed9f899efdeb440b9a8522eaba: Status 404 returned error can't find the container with id 73f0b7e3a93784d3c1192e5a1fa14ece605152ed9f899efdeb440b9a8522eaba Sep 17 16:33:11.217708 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:11.217688 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-8qp2s"] Sep 17 16:33:11.237575 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:11.237556 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-8qp2s"] Sep 17 16:33:11.237666 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:11.237647 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-8qp2s" Sep 17 16:33:11.239995 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:11.239945 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-4m4tp\"" Sep 17 16:33:11.239995 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:11.239960 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 17 16:33:11.281044 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:11.281021 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5e2cfac3-f193-4a4b-acdf-02c6ee4dcbc4-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-8qp2s\" (UID: \"5e2cfac3-f193-4a4b-acdf-02c6ee4dcbc4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-8qp2s" Sep 17 16:33:11.334696 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:11.331999 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:11.381627 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:11.381605 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5e2cfac3-f193-4a4b-acdf-02c6ee4dcbc4-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-8qp2s\" (UID: \"5e2cfac3-f193-4a4b-acdf-02c6ee4dcbc4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-8qp2s" Sep 17 16:33:11.381737 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:33:11.381723 2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 17 16:33:11.381818 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:33:11.381809 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e2cfac3-f193-4a4b-acdf-02c6ee4dcbc4-tls-certificates podName:5e2cfac3-f193-4a4b-acdf-02c6ee4dcbc4 nodeName:}" failed. No retries permitted until 2026-09-17 16:33:11.881791344 +0000 UTC m=+56.614258904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/5e2cfac3-f193-4a4b-acdf-02c6ee4dcbc4-tls-certificates") pod "prometheus-operator-admission-webhook-5c6747dc7b-8qp2s" (UID: "5e2cfac3-f193-4a4b-acdf-02c6ee4dcbc4") : secret "prometheus-operator-admission-webhook-tls" not found Sep 17 16:33:11.415475 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:11.415443 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:33:11.415813 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:11.415453 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:33:11.418117 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:11.418093 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 16:33:11.418492 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:11.418475 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 16:33:11.418597 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:11.418504 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 16:33:11.418597 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:11.418513 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g84bv\"" Sep 17 16:33:11.418597 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:11.418515 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bnd9b\"" Sep 17 16:33:11.436138 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:11.436118 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:11.538036 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:11.537954 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:11.775288 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:11.775254 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zzh9n" event={"ID":"3e74c429-ee05-4ff3-bd0c-88faca9c3f26","Type":"ContainerStarted","Data":"68bc7ee456e9e4a793542de05144d4cfc9444321f3ebfc5d50dbba911e1181c1"} Sep 17 16:33:11.775453 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:11.775320 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zzh9n" event={"ID":"3e74c429-ee05-4ff3-bd0c-88faca9c3f26","Type":"ContainerStarted","Data":"73f0b7e3a93784d3c1192e5a1fa14ece605152ed9f899efdeb440b9a8522eaba"} Sep 17 16:33:11.776600 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:11.776572 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tzn87" event={"ID":"acda35d5-1e08-4d58-a6c7-d6b0f9999771","Type":"ContainerStarted","Data":"0befd9baeb0fb491a9e3262e178bf1fafda282d510084fbf8b09e9f4086b158c"} Sep 17 16:33:11.777777 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:11.777758 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gmcnc" event={"ID":"c6664218-0b50-402a-ba5b-dd5632ac696e","Type":"ContainerStarted","Data":"919ef2d3b549459acc819a7ab0963c16b5e9e23926b50749a290302a985a2516"} Sep 17 16:33:11.886059 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:11.885998 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5e2cfac3-f193-4a4b-acdf-02c6ee4dcbc4-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-8qp2s\" (UID: \"5e2cfac3-f193-4a4b-acdf-02c6ee4dcbc4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-8qp2s" Sep 17 16:33:11.888657 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:11.888633 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5e2cfac3-f193-4a4b-acdf-02c6ee4dcbc4-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-8qp2s\" (UID: \"5e2cfac3-f193-4a4b-acdf-02c6ee4dcbc4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-8qp2s" Sep 17 16:33:11.907407 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:11.907381 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-8qp2s" Sep 17 16:33:12.204126 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:12.204040 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-8qp2s"] Sep 17 16:33:12.208316 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:33:12.208288 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e2cfac3_f193_4a4b_acdf_02c6ee4dcbc4.slice/crio-a4be36ff2c248ba92430a8ee8ac317fd3cec00b541c63529699a2457361e2765 WatchSource:0}: Error finding container a4be36ff2c248ba92430a8ee8ac317fd3cec00b541c63529699a2457361e2765: Status 404 returned error can't find the container with id a4be36ff2c248ba92430a8ee8ac317fd3cec00b541c63529699a2457361e2765 Sep 17 16:33:12.415362 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:12.415006 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:33:12.417845 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:12.417821 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 16:33:12.781448 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:12.781401 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-8qp2s" event={"ID":"5e2cfac3-f193-4a4b-acdf-02c6ee4dcbc4","Type":"ContainerStarted","Data":"a4be36ff2c248ba92430a8ee8ac317fd3cec00b541c63529699a2457361e2765"} Sep 17 16:33:12.784412 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:12.784372 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zzh9n" event={"ID":"3e74c429-ee05-4ff3-bd0c-88faca9c3f26","Type":"ContainerStarted","Data":"f0cab84a30f7f4b0897e2c04051853cea0e7d5f229d1daad13459b6d74e14db4"} Sep 17 16:33:13.175713 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:13.175613 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:13.274785 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:13.274748 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:13.789245 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:13.789204 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gmcnc" event={"ID":"c6664218-0b50-402a-ba5b-dd5632ac696e","Type":"ContainerStarted","Data":"f74d3f29ccd33c087fa1f9f7e2693893aa38a9df7be360a2e64a068e7d991ec2"} Sep 17 16:33:13.789748 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:13.789292 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gmcnc" event={"ID":"c6664218-0b50-402a-ba5b-dd5632ac696e","Type":"ContainerStarted","Data":"6b6fdeb774fc71ea618ac284efd538e3cf64da87dac5bb8307eb7d49531360c9"} Sep 17 16:33:13.789748 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:13.789396 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gmcnc" Sep 17 16:33:13.811263 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:13.811221 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gmcnc" podStartSLOduration=2.18637637 podStartE2EDuration="3.811207397s" totalImagesPullingTime="1.624831027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:33:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:33:13.810830467 +0000 UTC m=+58.543298047" watchObservedRunningTime="2026-09-17 16:33:13.811207397 +0000 UTC m=+58.543674972" Sep 17 16:33:14.261445 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:14.261399 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:14.362280 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:14.362249 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:14.794572 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:14.794532 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tzn87" event={"ID":"acda35d5-1e08-4d58-a6c7-d6b0f9999771","Type":"ContainerStarted","Data":"15df3ba48d29df9ec04aacff56b431194eee0a1d2ed0634d216a77709a03b4a6"} Sep 17 16:33:14.796199 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:14.796175 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-8qp2s" event={"ID":"5e2cfac3-f193-4a4b-acdf-02c6ee4dcbc4","Type":"ContainerStarted","Data":"db91c9ac33defdaed213b57f9f1acf71ea038da377f4b7c9d06263d783ff1d01"} Sep 17 16:33:14.796406 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:14.796389 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-8qp2s" Sep 17 16:33:14.798619 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:14.798592 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zzh9n" event={"ID":"3e74c429-ee05-4ff3-bd0c-88faca9c3f26","Type":"ContainerStarted","Data":"a818faeb73f11d27bf4390efa59d99f94b0576f9aad984dfc9e0c2644f398d18"} Sep 17 16:33:14.801366 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:14.801330 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-8qp2s" Sep 17 16:33:14.812856 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:14.812815 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tzn87" podStartSLOduration=1.289689614 podStartE2EDuration="4.812803182s" totalImagesPullingTime="3.523113568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:33:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:33:14.811891929 +0000 UTC m=+59.544359510" watchObservedRunningTime="2026-09-17 16:33:14.812803182 +0000 UTC m=+59.545270761" Sep 17 16:33:14.848193 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:14.848152 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zzh9n" podStartSLOduration=1.630867999 podStartE2EDuration="4.848136617s" totalImagesPullingTime="3.217268618s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:33:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:33:14.831918676 +0000 UTC m=+59.564386254" watchObservedRunningTime="2026-09-17 16:33:14.848136617 +0000 UTC m=+59.580604197" Sep 17 16:33:14.848400 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:14.848370 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-8qp2s" podStartSLOduration=1.3685846019999999 podStartE2EDuration="3.848357965s" totalImagesPullingTime="2.479773363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:33:14.847838896 +0000 UTC m=+59.580306476" watchObservedRunningTime="2026-09-17 16:33:14.848357965 +0000 UTC m=+59.580825545" Sep 17 16:33:15.206983 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.206955 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:15.315680 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.315655 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:15.366327 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.366304 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-lmlmf"] Sep 17 16:33:15.368265 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.368252 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lmlmf" Sep 17 16:33:15.372664 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.372644 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 17 16:33:15.374740 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.374719 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vs9r9\"" Sep 17 16:33:15.374836 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.374719 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 17 16:33:15.375048 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.374978 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 17 16:33:15.375048 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.374999 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 17 16:33:15.375162 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.375008 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 17 16:33:15.381984 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.381960 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-lmlmf"] Sep 17 16:33:15.411545 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.411516 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f36bd22-9905-40f8-be73-a1b1781f4599-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-lmlmf\" (UID: \"4f36bd22-9905-40f8-be73-a1b1781f4599\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lmlmf" Sep 17 16:33:15.411661 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.411551 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gszpf\" (UniqueName: \"kubernetes.io/projected/4f36bd22-9905-40f8-be73-a1b1781f4599-kube-api-access-gszpf\") pod \"prometheus-operator-7bd5d56d6-lmlmf\" (UID: \"4f36bd22-9905-40f8-be73-a1b1781f4599\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lmlmf" Sep 17 16:33:15.411721 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.411662 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f36bd22-9905-40f8-be73-a1b1781f4599-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-lmlmf\" (UID: \"4f36bd22-9905-40f8-be73-a1b1781f4599\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lmlmf" Sep 17 16:33:15.411721 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.411687 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f36bd22-9905-40f8-be73-a1b1781f4599-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-lmlmf\" (UID: \"4f36bd22-9905-40f8-be73-a1b1781f4599\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lmlmf" Sep 17 16:33:15.511959 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.511891 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f36bd22-9905-40f8-be73-a1b1781f4599-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-lmlmf\" (UID: \"4f36bd22-9905-40f8-be73-a1b1781f4599\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lmlmf" Sep 17 16:33:15.511959 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.511918 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f36bd22-9905-40f8-be73-a1b1781f4599-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-lmlmf\" (UID: \"4f36bd22-9905-40f8-be73-a1b1781f4599\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lmlmf" Sep 17 16:33:15.511959 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.511944 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f36bd22-9905-40f8-be73-a1b1781f4599-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-lmlmf\" (UID: \"4f36bd22-9905-40f8-be73-a1b1781f4599\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lmlmf" Sep 17 16:33:15.512177 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.511961 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gszpf\" (UniqueName: \"kubernetes.io/projected/4f36bd22-9905-40f8-be73-a1b1781f4599-kube-api-access-gszpf\") pod \"prometheus-operator-7bd5d56d6-lmlmf\" (UID: \"4f36bd22-9905-40f8-be73-a1b1781f4599\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lmlmf" Sep 17 16:33:15.512666 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.512649 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f36bd22-9905-40f8-be73-a1b1781f4599-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-lmlmf\" (UID: \"4f36bd22-9905-40f8-be73-a1b1781f4599\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lmlmf" Sep 17 16:33:15.514412 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.514394 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f36bd22-9905-40f8-be73-a1b1781f4599-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-lmlmf\" (UID: \"4f36bd22-9905-40f8-be73-a1b1781f4599\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lmlmf" Sep 17 16:33:15.514529 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.514511 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f36bd22-9905-40f8-be73-a1b1781f4599-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-lmlmf\" (UID: \"4f36bd22-9905-40f8-be73-a1b1781f4599\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lmlmf" Sep 17 16:33:15.521189 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.521170 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gszpf\" (UniqueName: \"kubernetes.io/projected/4f36bd22-9905-40f8-be73-a1b1781f4599-kube-api-access-gszpf\") pod \"prometheus-operator-7bd5d56d6-lmlmf\" (UID: \"4f36bd22-9905-40f8-be73-a1b1781f4599\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lmlmf" Sep 17 16:33:15.678010 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.677982 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lmlmf" Sep 17 16:33:15.772857 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.772788 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bfc76b967-kbsxt"] Sep 17 16:33:15.774734 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.774719 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bfc76b967-kbsxt" Sep 17 16:33:15.777326 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.777302 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 17 16:33:15.778338 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.778300 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 17 16:33:15.778338 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.778314 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 17 16:33:15.778338 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.778328 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 17 16:33:15.778569 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.778311 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 17 16:33:15.778641 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.778624 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 17 16:33:15.778704 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.778690 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kgcfp\"" Sep 17 16:33:15.778744 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.778700 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 17 16:33:15.793909 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.793861 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bfc76b967-kbsxt"] Sep 17 16:33:15.814367 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.814344 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-console-serving-cert\") pod \"console-5bfc76b967-kbsxt\" (UID: \"5d0dd23e-ddba-4506-84a1-5dba2680fd0c\") " pod="openshift-console/console-5bfc76b967-kbsxt" Sep 17 16:33:15.814712 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.814386 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-service-ca\") pod \"console-5bfc76b967-kbsxt\" (UID: \"5d0dd23e-ddba-4506-84a1-5dba2680fd0c\") " pod="openshift-console/console-5bfc76b967-kbsxt" Sep 17 16:33:15.814712 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.814405 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-oauth-serving-cert\") pod \"console-5bfc76b967-kbsxt\" (UID: \"5d0dd23e-ddba-4506-84a1-5dba2680fd0c\") " pod="openshift-console/console-5bfc76b967-kbsxt" Sep 17 16:33:15.814712 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.814491 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-console-oauth-config\") pod \"console-5bfc76b967-kbsxt\" (UID: \"5d0dd23e-ddba-4506-84a1-5dba2680fd0c\") " pod="openshift-console/console-5bfc76b967-kbsxt" Sep 17 16:33:15.814712 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.814515 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-console-config\") pod \"console-5bfc76b967-kbsxt\" (UID: \"5d0dd23e-ddba-4506-84a1-5dba2680fd0c\") " pod="openshift-console/console-5bfc76b967-kbsxt" Sep 17 16:33:15.814712 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.814533 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k48g4\" (UniqueName: \"kubernetes.io/projected/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-kube-api-access-k48g4\") pod \"console-5bfc76b967-kbsxt\" (UID: \"5d0dd23e-ddba-4506-84a1-5dba2680fd0c\") " pod="openshift-console/console-5bfc76b967-kbsxt" Sep 17 16:33:15.915802 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.915770 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k48g4\" (UniqueName: \"kubernetes.io/projected/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-kube-api-access-k48g4\") pod \"console-5bfc76b967-kbsxt\" (UID: \"5d0dd23e-ddba-4506-84a1-5dba2680fd0c\") " pod="openshift-console/console-5bfc76b967-kbsxt" Sep 17 16:33:15.916144 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.916035 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-console-serving-cert\") pod \"console-5bfc76b967-kbsxt\" (UID: \"5d0dd23e-ddba-4506-84a1-5dba2680fd0c\") " pod="openshift-console/console-5bfc76b967-kbsxt" Sep 17 16:33:15.916144 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.916113 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-service-ca\") pod \"console-5bfc76b967-kbsxt\" (UID: \"5d0dd23e-ddba-4506-84a1-5dba2680fd0c\") " pod="openshift-console/console-5bfc76b967-kbsxt" Sep 17 16:33:15.916144 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.916137 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-oauth-serving-cert\") pod \"console-5bfc76b967-kbsxt\" (UID: \"5d0dd23e-ddba-4506-84a1-5dba2680fd0c\") " pod="openshift-console/console-5bfc76b967-kbsxt" Sep 17 16:33:15.916367 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.916179 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-console-oauth-config\") pod \"console-5bfc76b967-kbsxt\" (UID: \"5d0dd23e-ddba-4506-84a1-5dba2680fd0c\") " pod="openshift-console/console-5bfc76b967-kbsxt" Sep 17 16:33:15.916367 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.916202 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-console-config\") pod \"console-5bfc76b967-kbsxt\" (UID: \"5d0dd23e-ddba-4506-84a1-5dba2680fd0c\") " pod="openshift-console/console-5bfc76b967-kbsxt" Sep 17 16:33:15.916901 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.916880 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-console-config\") pod \"console-5bfc76b967-kbsxt\" (UID: \"5d0dd23e-ddba-4506-84a1-5dba2680fd0c\") " pod="openshift-console/console-5bfc76b967-kbsxt" Sep 17 16:33:15.916901 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.916894 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-service-ca\") pod \"console-5bfc76b967-kbsxt\" (UID: \"5d0dd23e-ddba-4506-84a1-5dba2680fd0c\") " pod="openshift-console/console-5bfc76b967-kbsxt" Sep 17 16:33:15.917086 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.916935 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-oauth-serving-cert\") pod \"console-5bfc76b967-kbsxt\" (UID: \"5d0dd23e-ddba-4506-84a1-5dba2680fd0c\") " pod="openshift-console/console-5bfc76b967-kbsxt" Sep 17 16:33:15.918613 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.918586 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-console-oauth-config\") pod \"console-5bfc76b967-kbsxt\" (UID: \"5d0dd23e-ddba-4506-84a1-5dba2680fd0c\") " pod="openshift-console/console-5bfc76b967-kbsxt" Sep 17 16:33:15.918726 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.918674 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-console-serving-cert\") pod \"console-5bfc76b967-kbsxt\" (UID: \"5d0dd23e-ddba-4506-84a1-5dba2680fd0c\") " pod="openshift-console/console-5bfc76b967-kbsxt" Sep 17 16:33:15.933635 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.933605 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k48g4\" (UniqueName: \"kubernetes.io/projected/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-kube-api-access-k48g4\") pod \"console-5bfc76b967-kbsxt\" (UID: \"5d0dd23e-ddba-4506-84a1-5dba2680fd0c\") " pod="openshift-console/console-5bfc76b967-kbsxt" Sep 17 16:33:15.949385 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:15.949358 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-lmlmf"] Sep 17 16:33:15.951858 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:33:15.951834 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f36bd22_9905_40f8_be73_a1b1781f4599.slice/crio-feba09ad8ee088efd70b2e5708749dcf315fe3e93d260e00a77708a080a646d2 WatchSource:0}: Error finding container feba09ad8ee088efd70b2e5708749dcf315fe3e93d260e00a77708a080a646d2: Status 404 returned error can't find the container with id feba09ad8ee088efd70b2e5708749dcf315fe3e93d260e00a77708a080a646d2 Sep 17 16:33:16.084143 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:16.084057 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bfc76b967-kbsxt" Sep 17 16:33:16.322895 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:16.322862 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:16.353389 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:16.353310 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bfc76b967-kbsxt"] Sep 17 16:33:16.356023 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:33:16.356001 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d0dd23e_ddba_4506_84a1_5dba2680fd0c.slice/crio-9c5cd98a923873f0ced612373900789234bcbbd662bd0cfb3281ad606bd6f547 WatchSource:0}: Error finding container 9c5cd98a923873f0ced612373900789234bcbbd662bd0cfb3281ad606bd6f547: Status 404 returned error can't find the container with id 9c5cd98a923873f0ced612373900789234bcbbd662bd0cfb3281ad606bd6f547 Sep 17 16:33:16.426177 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:16.426119 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:16.810064 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:16.810020 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lmlmf" event={"ID":"4f36bd22-9905-40f8-be73-a1b1781f4599","Type":"ContainerStarted","Data":"feba09ad8ee088efd70b2e5708749dcf315fe3e93d260e00a77708a080a646d2"} Sep 17 16:33:16.811421 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:16.811388 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bfc76b967-kbsxt" event={"ID":"5d0dd23e-ddba-4506-84a1-5dba2680fd0c","Type":"ContainerStarted","Data":"9c5cd98a923873f0ced612373900789234bcbbd662bd0cfb3281ad606bd6f547"} Sep 17 16:33:16.956617 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:16.956581 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:17.022393 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:17.022356 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:17.738279 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:17.738249 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jflqj" Sep 17 16:33:17.921188 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:17.921132 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:18.022155 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:18.022056 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:18.122423 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:18.122388 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:18.820860 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:18.820828 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lmlmf" event={"ID":"4f36bd22-9905-40f8-be73-a1b1781f4599","Type":"ContainerStarted","Data":"9545bfab989399a4135729abb9a02d9aa636a309d386b2eaa976c84d10348d7b"} Sep 17 16:33:19.921124 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:19.921091 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:20.022364 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:20.022328 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:20.572233 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:20.572205 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:20.637175 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:20.637145 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:20.828109 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:20.828075 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lmlmf" event={"ID":"4f36bd22-9905-40f8-be73-a1b1781f4599","Type":"ContainerStarted","Data":"8a7532350fabd7310dba1f4147929ecacbefbfa7f5f0580864ddc18e3876cddd"} Sep 17 16:33:20.829603 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:20.829571 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bfc76b967-kbsxt" event={"ID":"5d0dd23e-ddba-4506-84a1-5dba2680fd0c","Type":"ContainerStarted","Data":"25a628ead1f4f3b2dd1c18216fd57c786395b1f66b9b888e9f2dbacd0ace5350"} Sep 17 16:33:20.846687 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:20.846639 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lmlmf" podStartSLOduration=4.015433784 podStartE2EDuration="5.84662595s" totalImagesPullingTime="1.831192166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:33:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:33:20.845210277 +0000 UTC m=+65.577677858" watchObservedRunningTime="2026-09-17 16:33:20.84662595 +0000 UTC m=+65.579093528" Sep 17 16:33:20.862489 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:20.862452 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bfc76b967-kbsxt" podStartSLOduration=1.76955783 podStartE2EDuration="5.862422991s" totalImagesPullingTime="4.092865161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:33:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:33:20.861941072 +0000 UTC m=+65.594408653" watchObservedRunningTime="2026-09-17 16:33:20.862422991 +0000 UTC m=+65.594890570" Sep 17 16:33:22.510182 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.510150 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:22.590473 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.590422 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74549fcb54-mqcms"] Sep 17 16:33:22.595451 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.595407 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74549fcb54-mqcms" Sep 17 16:33:22.603271 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.603247 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 17 16:33:22.608776 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.608755 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74549fcb54-mqcms"] Sep 17 16:33:22.613192 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.613173 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:22.672259 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.672240 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wftng\" (UniqueName: \"kubernetes.io/projected/2ed6e089-ba41-4c13-9746-1eef08c0eb82-kube-api-access-wftng\") pod \"console-74549fcb54-mqcms\" (UID: \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\") " pod="openshift-console/console-74549fcb54-mqcms" Sep 17 16:33:22.672350 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.672267 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ed6e089-ba41-4c13-9746-1eef08c0eb82-console-serving-cert\") pod \"console-74549fcb54-mqcms\" (UID: \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\") " pod="openshift-console/console-74549fcb54-mqcms" Sep 17 16:33:22.672350 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.672287 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ed6e089-ba41-4c13-9746-1eef08c0eb82-oauth-serving-cert\") pod \"console-74549fcb54-mqcms\" (UID: \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\") " pod="openshift-console/console-74549fcb54-mqcms" Sep 17 16:33:22.672350 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.672311 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ed6e089-ba41-4c13-9746-1eef08c0eb82-console-config\") pod \"console-74549fcb54-mqcms\" (UID: \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\") " pod="openshift-console/console-74549fcb54-mqcms" Sep 17 16:33:22.672494 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.672395 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ed6e089-ba41-4c13-9746-1eef08c0eb82-console-oauth-config\") pod \"console-74549fcb54-mqcms\" (UID: \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\") " pod="openshift-console/console-74549fcb54-mqcms" Sep 17 16:33:22.672494 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.672422 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ed6e089-ba41-4c13-9746-1eef08c0eb82-service-ca\") pod \"console-74549fcb54-mqcms\" (UID: \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\") " pod="openshift-console/console-74549fcb54-mqcms" Sep 17 16:33:22.672494 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.672459 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ed6e089-ba41-4c13-9746-1eef08c0eb82-trusted-ca-bundle\") pod \"console-74549fcb54-mqcms\" (UID: \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\") " pod="openshift-console/console-74549fcb54-mqcms" Sep 17 16:33:22.729057 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.729032 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:22.737295 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.737269 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-rw6dm"] Sep 17 16:33:22.752257 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.752235 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rw6dm" Sep 17 16:33:22.754064 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.754040 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-426dn"] Sep 17 16:33:22.754396 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.754377 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 17 16:33:22.754643 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.754628 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 17 16:33:22.754869 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.754854 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-fgr4q\"" Sep 17 16:33:22.773190 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.773139 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ed6e089-ba41-4c13-9746-1eef08c0eb82-console-oauth-config\") pod \"console-74549fcb54-mqcms\" (UID: \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\") " pod="openshift-console/console-74549fcb54-mqcms" Sep 17 16:33:22.773190 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.773180 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ed6e089-ba41-4c13-9746-1eef08c0eb82-service-ca\") pod \"console-74549fcb54-mqcms\" (UID: \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\") " pod="openshift-console/console-74549fcb54-mqcms" Sep 17 16:33:22.773306 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.773204 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ed6e089-ba41-4c13-9746-1eef08c0eb82-trusted-ca-bundle\") pod \"console-74549fcb54-mqcms\" (UID: \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\") " pod="openshift-console/console-74549fcb54-mqcms" Sep 17 16:33:22.773306 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.773237 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wftng\" (UniqueName: \"kubernetes.io/projected/2ed6e089-ba41-4c13-9746-1eef08c0eb82-kube-api-access-wftng\") pod \"console-74549fcb54-mqcms\" (UID: \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\") " pod="openshift-console/console-74549fcb54-mqcms" Sep 17 16:33:22.773306 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.773263 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ed6e089-ba41-4c13-9746-1eef08c0eb82-console-serving-cert\") pod \"console-74549fcb54-mqcms\" (UID: \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\") " pod="openshift-console/console-74549fcb54-mqcms" Sep 17 16:33:22.773306 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.773290 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ed6e089-ba41-4c13-9746-1eef08c0eb82-oauth-serving-cert\") pod \"console-74549fcb54-mqcms\" (UID: \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\") " pod="openshift-console/console-74549fcb54-mqcms" Sep 17 16:33:22.773596 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.773575 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ed6e089-ba41-4c13-9746-1eef08c0eb82-console-config\") pod \"console-74549fcb54-mqcms\" (UID: \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\") " pod="openshift-console/console-74549fcb54-mqcms" Sep 17 16:33:22.774058 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.774033 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ed6e089-ba41-4c13-9746-1eef08c0eb82-service-ca\") pod \"console-74549fcb54-mqcms\" (UID: \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\") " pod="openshift-console/console-74549fcb54-mqcms" Sep 17 16:33:22.774161 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.774124 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ed6e089-ba41-4c13-9746-1eef08c0eb82-oauth-serving-cert\") pod \"console-74549fcb54-mqcms\" (UID: \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\") " pod="openshift-console/console-74549fcb54-mqcms" Sep 17 16:33:22.774242 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.774213 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ed6e089-ba41-4c13-9746-1eef08c0eb82-console-config\") pod \"console-74549fcb54-mqcms\" (UID: \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\") " pod="openshift-console/console-74549fcb54-mqcms" Sep 17 16:33:22.774335 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.774248 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ed6e089-ba41-4c13-9746-1eef08c0eb82-trusted-ca-bundle\") pod \"console-74549fcb54-mqcms\" (UID: \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\") " pod="openshift-console/console-74549fcb54-mqcms" Sep 17 16:33:22.776304 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.776287 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ed6e089-ba41-4c13-9746-1eef08c0eb82-console-serving-cert\") pod \"console-74549fcb54-mqcms\" (UID: \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\") " pod="openshift-console/console-74549fcb54-mqcms" Sep 17 16:33:22.776408 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.776308 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ed6e089-ba41-4c13-9746-1eef08c0eb82-console-oauth-config\") pod \"console-74549fcb54-mqcms\" (UID: \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\") " pod="openshift-console/console-74549fcb54-mqcms" Sep 17 16:33:22.780199 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.780166 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-rw6dm"] Sep 17 16:33:22.780304 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.780220 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2wlx9"] Sep 17 16:33:22.780304 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.780262 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-426dn" Sep 17 16:33:22.782363 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.782310 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 17 16:33:22.782363 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.782343 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wftng\" (UniqueName: \"kubernetes.io/projected/2ed6e089-ba41-4c13-9746-1eef08c0eb82-kube-api-access-wftng\") pod \"console-74549fcb54-mqcms\" (UID: \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\") " pod="openshift-console/console-74549fcb54-mqcms" Sep 17 16:33:22.782544 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.782395 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-h4n7w\"" Sep 17 16:33:22.782745 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.782726 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 17 16:33:22.782807 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.782776 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 17 16:33:22.804405 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.804386 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-426dn"] Sep 17 16:33:22.804526 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.804511 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2wlx9" Sep 17 16:33:22.806747 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.806728 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-b6p5g\"" Sep 17 16:33:22.806835 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.806745 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 17 16:33:22.806835 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.806754 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 17 16:33:22.806835 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.806728 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 17 16:33:22.818878 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.818858 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:22.874728 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.874709 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde-root\") pod \"node-exporter-2wlx9\" (UID: \"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde\") " pod="openshift-monitoring/node-exporter-2wlx9" Sep 17 16:33:22.874841 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.874736 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e0877f57-28be-44ae-b2fd-cda40918eff2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-426dn\" (UID: \"e0877f57-28be-44ae-b2fd-cda40918eff2\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-426dn" Sep 17 16:33:22.874841 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.874757 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca11a3ac-e5ba-4970-8dcb-a81efc81038e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-rw6dm\" (UID: \"ca11a3ac-e5ba-4970-8dcb-a81efc81038e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rw6dm" Sep 17 16:33:22.874918 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.874839 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e0877f57-28be-44ae-b2fd-cda40918eff2-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-426dn\" (UID: \"e0877f57-28be-44ae-b2fd-cda40918eff2\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-426dn" Sep 17 16:33:22.874918 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.874860 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0877f57-28be-44ae-b2fd-cda40918eff2-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-426dn\" (UID: \"e0877f57-28be-44ae-b2fd-cda40918eff2\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-426dn" Sep 17 16:33:22.874918 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.874881 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca11a3ac-e5ba-4970-8dcb-a81efc81038e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-rw6dm\" (UID: \"ca11a3ac-e5ba-4970-8dcb-a81efc81038e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rw6dm" Sep 17 16:33:22.874918 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.874898 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde-node-exporter-tls\") pod \"node-exporter-2wlx9\" (UID: \"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde\") " pod="openshift-monitoring/node-exporter-2wlx9" Sep 17 16:33:22.875055 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.874932 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde-metrics-client-ca\") pod \"node-exporter-2wlx9\" (UID: \"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde\") " pod="openshift-monitoring/node-exporter-2wlx9" Sep 17 16:33:22.875055 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.874960 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde-node-exporter-accelerators-collector-config\") pod \"node-exporter-2wlx9\" (UID: \"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde\") " pod="openshift-monitoring/node-exporter-2wlx9" Sep 17 16:33:22.875055 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.875009 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4552m\" (UniqueName: \"kubernetes.io/projected/e0877f57-28be-44ae-b2fd-cda40918eff2-kube-api-access-4552m\") pod \"kube-state-metrics-84c885658c-426dn\" (UID: \"e0877f57-28be-44ae-b2fd-cda40918eff2\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-426dn" Sep 17 16:33:22.875055 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.875044 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0877f57-28be-44ae-b2fd-cda40918eff2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-426dn\" (UID: \"e0877f57-28be-44ae-b2fd-cda40918eff2\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-426dn" Sep 17 16:33:22.875234 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.875063 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde-node-exporter-wtmp\") pod \"node-exporter-2wlx9\" (UID: \"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde\") " pod="openshift-monitoring/node-exporter-2wlx9" Sep 17 16:33:22.875234 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.875079 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0877f57-28be-44ae-b2fd-cda40918eff2-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-426dn\" (UID: \"e0877f57-28be-44ae-b2fd-cda40918eff2\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-426dn" Sep 17 16:33:22.875234 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.875104 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde-sys\") pod \"node-exporter-2wlx9\" (UID: \"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde\") " pod="openshift-monitoring/node-exporter-2wlx9" Sep 17 16:33:22.875234 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.875119 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde-node-exporter-textfile\") pod \"node-exporter-2wlx9\" (UID: \"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde\") " pod="openshift-monitoring/node-exporter-2wlx9" Sep 17 16:33:22.875234 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.875137 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2wlx9\" (UID: \"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde\") " pod="openshift-monitoring/node-exporter-2wlx9" Sep 17 16:33:22.875234 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.875207 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vdf9\" (UniqueName: \"kubernetes.io/projected/0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde-kube-api-access-9vdf9\") pod \"node-exporter-2wlx9\" (UID: \"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde\") " pod="openshift-monitoring/node-exporter-2wlx9" Sep 17 16:33:22.875485 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.875245 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca11a3ac-e5ba-4970-8dcb-a81efc81038e-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-rw6dm\" (UID: \"ca11a3ac-e5ba-4970-8dcb-a81efc81038e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rw6dm" Sep 17 16:33:22.875485 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.875276 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65x95\" (UniqueName: \"kubernetes.io/projected/ca11a3ac-e5ba-4970-8dcb-a81efc81038e-kube-api-access-65x95\") pod \"openshift-state-metrics-86c5bc79d6-rw6dm\" (UID: \"ca11a3ac-e5ba-4970-8dcb-a81efc81038e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rw6dm" Sep 17 16:33:22.904273 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.904251 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74549fcb54-mqcms" Sep 17 16:33:22.978255 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.976288 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde-node-exporter-wtmp\") pod \"node-exporter-2wlx9\" (UID: \"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde\") " pod="openshift-monitoring/node-exporter-2wlx9" Sep 17 16:33:22.978255 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.976347 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0877f57-28be-44ae-b2fd-cda40918eff2-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-426dn\" (UID: \"e0877f57-28be-44ae-b2fd-cda40918eff2\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-426dn" Sep 17 16:33:22.978255 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.976386 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde-sys\") pod \"node-exporter-2wlx9\" (UID: \"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde\") " pod="openshift-monitoring/node-exporter-2wlx9" Sep 17 16:33:22.978255 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.976417 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde-node-exporter-textfile\") pod \"node-exporter-2wlx9\" (UID: \"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde\") " pod="openshift-monitoring/node-exporter-2wlx9" Sep 17 16:33:22.978255 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.976500 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2wlx9\" (UID: \"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde\") " pod="openshift-monitoring/node-exporter-2wlx9" Sep 17 16:33:22.978255 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.976546 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vdf9\" (UniqueName: \"kubernetes.io/projected/0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde-kube-api-access-9vdf9\") pod \"node-exporter-2wlx9\" (UID: \"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde\") " pod="openshift-monitoring/node-exporter-2wlx9" Sep 17 16:33:22.978255 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.976578 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca11a3ac-e5ba-4970-8dcb-a81efc81038e-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-rw6dm\" (UID: \"ca11a3ac-e5ba-4970-8dcb-a81efc81038e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rw6dm" Sep 17 16:33:22.978255 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.976613 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65x95\" (UniqueName: \"kubernetes.io/projected/ca11a3ac-e5ba-4970-8dcb-a81efc81038e-kube-api-access-65x95\") pod \"openshift-state-metrics-86c5bc79d6-rw6dm\" (UID: \"ca11a3ac-e5ba-4970-8dcb-a81efc81038e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rw6dm" Sep 17 16:33:22.978255 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.976663 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde-root\") pod \"node-exporter-2wlx9\" (UID: \"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde\") " pod="openshift-monitoring/node-exporter-2wlx9" Sep 17 16:33:22.978255 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.976695 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e0877f57-28be-44ae-b2fd-cda40918eff2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-426dn\" (UID: \"e0877f57-28be-44ae-b2fd-cda40918eff2\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-426dn" Sep 17 16:33:22.978255 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.976729 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca11a3ac-e5ba-4970-8dcb-a81efc81038e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-rw6dm\" (UID: \"ca11a3ac-e5ba-4970-8dcb-a81efc81038e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rw6dm" Sep 17 16:33:22.978255 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.976816 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e0877f57-28be-44ae-b2fd-cda40918eff2-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-426dn\" (UID: \"e0877f57-28be-44ae-b2fd-cda40918eff2\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-426dn" Sep 17 16:33:22.978255 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.976848 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0877f57-28be-44ae-b2fd-cda40918eff2-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-426dn\" (UID: \"e0877f57-28be-44ae-b2fd-cda40918eff2\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-426dn" Sep 17 16:33:22.978255 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.976885 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca11a3ac-e5ba-4970-8dcb-a81efc81038e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-rw6dm\" (UID: \"ca11a3ac-e5ba-4970-8dcb-a81efc81038e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rw6dm" Sep 17 16:33:22.978255 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.976919 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde-node-exporter-tls\") pod \"node-exporter-2wlx9\" (UID: \"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde\") " pod="openshift-monitoring/node-exporter-2wlx9" Sep 17 16:33:22.978255 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.976942 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde-metrics-client-ca\") pod \"node-exporter-2wlx9\" (UID: \"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde\") " pod="openshift-monitoring/node-exporter-2wlx9" Sep 17 16:33:22.979104 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.976988 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde-node-exporter-accelerators-collector-config\") pod \"node-exporter-2wlx9\" (UID: \"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde\") " pod="openshift-monitoring/node-exporter-2wlx9" Sep 17 16:33:22.979104 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.977068 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4552m\" (UniqueName: \"kubernetes.io/projected/e0877f57-28be-44ae-b2fd-cda40918eff2-kube-api-access-4552m\") pod \"kube-state-metrics-84c885658c-426dn\" (UID: \"e0877f57-28be-44ae-b2fd-cda40918eff2\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-426dn" Sep 17 16:33:22.979104 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.977110 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0877f57-28be-44ae-b2fd-cda40918eff2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-426dn\" (UID: \"e0877f57-28be-44ae-b2fd-cda40918eff2\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-426dn" Sep 17 16:33:22.981113 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.981079 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde-root\") pod \"node-exporter-2wlx9\" (UID: \"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde\") " pod="openshift-monitoring/node-exporter-2wlx9" Sep 17 16:33:22.981223 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:33:22.981195 2581 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 17 16:33:22.981283 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:33:22.981262 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0877f57-28be-44ae-b2fd-cda40918eff2-kube-state-metrics-tls podName:e0877f57-28be-44ae-b2fd-cda40918eff2 nodeName:}" failed. No retries permitted until 2026-09-17 16:33:23.481241227 +0000 UTC m=+68.213708784 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e0877f57-28be-44ae-b2fd-cda40918eff2-kube-state-metrics-tls") pod "kube-state-metrics-84c885658c-426dn" (UID: "e0877f57-28be-44ae-b2fd-cda40918eff2") : secret "kube-state-metrics-tls" not found Sep 17 16:33:22.982762 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.981990 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca11a3ac-e5ba-4970-8dcb-a81efc81038e-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-rw6dm\" (UID: \"ca11a3ac-e5ba-4970-8dcb-a81efc81038e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rw6dm" Sep 17 16:33:22.982762 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.982256 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0877f57-28be-44ae-b2fd-cda40918eff2-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-426dn\" (UID: \"e0877f57-28be-44ae-b2fd-cda40918eff2\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-426dn" Sep 17 16:33:22.982762 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.982305 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde-node-exporter-textfile\") pod \"node-exporter-2wlx9\" (UID: \"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde\") " pod="openshift-monitoring/node-exporter-2wlx9" Sep 17 16:33:22.982762 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:33:22.982393 2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 17 16:33:22.982762 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.982409 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde-node-exporter-wtmp\") pod \"node-exporter-2wlx9\" (UID: \"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde\") " pod="openshift-monitoring/node-exporter-2wlx9" Sep 17 16:33:22.982762 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.982476 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0877f57-28be-44ae-b2fd-cda40918eff2-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-426dn\" (UID: \"e0877f57-28be-44ae-b2fd-cda40918eff2\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-426dn" Sep 17 16:33:22.982762 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:33:22.982504 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde-node-exporter-tls podName:0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde nodeName:}" failed. No retries permitted until 2026-09-17 16:33:23.482482932 +0000 UTC m=+68.214950500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde-node-exporter-tls") pod "node-exporter-2wlx9" (UID: "0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde") : secret "node-exporter-tls" not found Sep 17 16:33:22.983207 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.982916 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e0877f57-28be-44ae-b2fd-cda40918eff2-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-426dn\" (UID: \"e0877f57-28be-44ae-b2fd-cda40918eff2\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-426dn" Sep 17 16:33:22.983207 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.982973 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde-sys\") pod \"node-exporter-2wlx9\" (UID: \"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde\") " pod="openshift-monitoring/node-exporter-2wlx9" Sep 17 16:33:22.984165 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.983373 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e0877f57-28be-44ae-b2fd-cda40918eff2-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-426dn\" (UID: \"e0877f57-28be-44ae-b2fd-cda40918eff2\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-426dn" Sep 17 16:33:22.984165 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.983748 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde-metrics-client-ca\") pod \"node-exporter-2wlx9\" (UID: \"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde\") " pod="openshift-monitoring/node-exporter-2wlx9" Sep 17 16:33:22.984165 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.983792 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde-node-exporter-accelerators-collector-config\") pod \"node-exporter-2wlx9\" (UID: \"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde\") " pod="openshift-monitoring/node-exporter-2wlx9" Sep 17 16:33:22.986082 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.986060 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca11a3ac-e5ba-4970-8dcb-a81efc81038e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-rw6dm\" (UID: \"ca11a3ac-e5ba-4970-8dcb-a81efc81038e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rw6dm" Sep 17 16:33:22.987293 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.987267 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca11a3ac-e5ba-4970-8dcb-a81efc81038e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-rw6dm\" (UID: \"ca11a3ac-e5ba-4970-8dcb-a81efc81038e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rw6dm" Sep 17 16:33:22.987548 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.987528 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2wlx9\" (UID: \"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde\") " pod="openshift-monitoring/node-exporter-2wlx9" Sep 17 16:33:22.993897 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.993618 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65x95\" (UniqueName: \"kubernetes.io/projected/ca11a3ac-e5ba-4970-8dcb-a81efc81038e-kube-api-access-65x95\") pod \"openshift-state-metrics-86c5bc79d6-rw6dm\" (UID: \"ca11a3ac-e5ba-4970-8dcb-a81efc81038e\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rw6dm" Sep 17 16:33:22.995084 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.995046 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4552m\" (UniqueName: \"kubernetes.io/projected/e0877f57-28be-44ae-b2fd-cda40918eff2-kube-api-access-4552m\") pod \"kube-state-metrics-84c885658c-426dn\" (UID: \"e0877f57-28be-44ae-b2fd-cda40918eff2\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-426dn" Sep 17 16:33:22.996357 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:22.996337 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vdf9\" (UniqueName: \"kubernetes.io/projected/0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde-kube-api-access-9vdf9\") pod \"node-exporter-2wlx9\" (UID: \"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde\") " pod="openshift-monitoring/node-exporter-2wlx9" Sep 17 16:33:23.009225 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.009202 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:23.062329 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.062276 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rw6dm" Sep 17 16:33:23.077606 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.077582 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07690c0a-a396-4f6c-9248-41722d757b2f-metrics-certs\") pod \"network-metrics-daemon-66zvl\" (UID: \"07690c0a-a396-4f6c-9248-41722d757b2f\") " pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:33:23.077677 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.077663 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71c447a9-be09-4350-841c-a054f2e33b6b-original-pull-secret\") pod \"global-pull-secret-syncer-cdn7r\" (UID: \"71c447a9-be09-4350-841c-a054f2e33b6b\") " pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:33:23.079767 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.079744 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 16:33:23.079853 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.079802 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 16:33:23.090583 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.090566 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07690c0a-a396-4f6c-9248-41722d757b2f-metrics-certs\") pod \"network-metrics-daemon-66zvl\" (UID: \"07690c0a-a396-4f6c-9248-41722d757b2f\") " pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:33:23.090659 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.090616 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71c447a9-be09-4350-841c-a054f2e33b6b-original-pull-secret\") pod \"global-pull-secret-syncer-cdn7r\" (UID: \"71c447a9-be09-4350-841c-a054f2e33b6b\") " pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:33:23.110386 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.110359 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:23.143565 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.143538 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bnd9b\"" Sep 17 16:33:23.151725 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.151700 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66zvl" Sep 17 16:33:23.195706 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.195684 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74549fcb54-mqcms"] Sep 17 16:33:23.198936 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:33:23.198912 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ed6e089_ba41_4c13_9746_1eef08c0eb82.slice/crio-bdde107720fb907fbafc8c8b444210d71404f8c2ca8a00a10e3488d8cbee4e1e WatchSource:0}: Error finding container bdde107720fb907fbafc8c8b444210d71404f8c2ca8a00a10e3488d8cbee4e1e: Status 404 returned error can't find the container with id bdde107720fb907fbafc8c8b444210d71404f8c2ca8a00a10e3488d8cbee4e1e Sep 17 16:33:23.199857 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.199834 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:23.226040 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.226008 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cdn7r" Sep 17 16:33:23.270552 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.270529 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:23.279476 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.279457 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fknk\" (UniqueName: \"kubernetes.io/projected/694d53e2-8503-4fcf-a313-744e81e30d5e-kube-api-access-7fknk\") pod \"network-check-target-wzqtc\" (UID: \"694d53e2-8503-4fcf-a313-744e81e30d5e\") " pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:33:23.282129 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.282101 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 16:33:23.293308 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.293286 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 16:33:23.303047 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.303027 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fknk\" (UniqueName: \"kubernetes.io/projected/694d53e2-8503-4fcf-a313-744e81e30d5e-kube-api-access-7fknk\") pod \"network-check-target-wzqtc\" (UID: \"694d53e2-8503-4fcf-a313-744e81e30d5e\") " pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:33:23.367292 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.367268 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-rw6dm"] Sep 17 16:33:23.370845 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:33:23.370815 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca11a3ac_e5ba_4970_8dcb_a81efc81038e.slice/crio-b9d1a970de68b3f68cfb0f846e05ad76d949990975676ace6f428dea6b1870be WatchSource:0}: Error finding container b9d1a970de68b3f68cfb0f846e05ad76d949990975676ace6f428dea6b1870be: Status 404 returned error can't find the container with id b9d1a970de68b3f68cfb0f846e05ad76d949990975676ace6f428dea6b1870be Sep 17 16:33:23.426998 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.426973 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g84bv\"" Sep 17 16:33:23.435325 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.435300 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:33:23.459327 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.459305 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-66zvl"] Sep 17 16:33:23.462145 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:33:23.462122 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07690c0a_a396_4f6c_9248_41722d757b2f.slice/crio-d6b2919593fa35327af8724343c63611f723e2b70aabd1087dadb54285794d68 WatchSource:0}: Error finding container d6b2919593fa35327af8724343c63611f723e2b70aabd1087dadb54285794d68: Status 404 returned error can't find the container with id d6b2919593fa35327af8724343c63611f723e2b70aabd1087dadb54285794d68 Sep 17 16:33:23.481416 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.481365 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0877f57-28be-44ae-b2fd-cda40918eff2-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-426dn\" (UID: \"e0877f57-28be-44ae-b2fd-cda40918eff2\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-426dn" Sep 17 16:33:23.483941 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.483915 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0877f57-28be-44ae-b2fd-cda40918eff2-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-426dn\" (UID: \"e0877f57-28be-44ae-b2fd-cda40918eff2\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-426dn" Sep 17 16:33:23.514220 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.514160 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cdn7r"] Sep 17 16:33:23.518805 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:33:23.518778 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71c447a9_be09_4350_841c_a054f2e33b6b.slice/crio-aafbf439d2bc1fd17b98077c2bab1b948312e207b72cbf2f27e308bff268423d WatchSource:0}: Error finding container aafbf439d2bc1fd17b98077c2bab1b948312e207b72cbf2f27e308bff268423d: Status 404 returned error can't find the container with id aafbf439d2bc1fd17b98077c2bab1b948312e207b72cbf2f27e308bff268423d Sep 17 16:33:23.582548 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.582519 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde-node-exporter-tls\") pod \"node-exporter-2wlx9\" (UID: \"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde\") " pod="openshift-monitoring/node-exporter-2wlx9" Sep 17 16:33:23.584640 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.584620 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde-node-exporter-tls\") pod \"node-exporter-2wlx9\" (UID: \"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde\") " pod="openshift-monitoring/node-exporter-2wlx9" Sep 17 16:33:23.695736 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.695706 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-426dn" Sep 17 16:33:23.712586 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.712561 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2wlx9" Sep 17 16:33:23.738357 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.738325 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wzqtc"] Sep 17 16:33:23.741991 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:33:23.741964 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod694d53e2_8503_4fcf_a313_744e81e30d5e.slice/crio-9615c015e7640cbdd8d20b4f8aef3c5c6e70ec4a38efe2d36cadb4bc30eb7b59 WatchSource:0}: Error finding container 9615c015e7640cbdd8d20b4f8aef3c5c6e70ec4a38efe2d36cadb4bc30eb7b59: Status 404 returned error can't find the container with id 9615c015e7640cbdd8d20b4f8aef3c5c6e70ec4a38efe2d36cadb4bc30eb7b59 Sep 17 16:33:23.758620 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:33:23.758595 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fd3f4f0_fbbe_4eb8_a767_e2c4dfc5edde.slice/crio-79149c99dff3acd467ccd31dca435f939f246e5b7b7104a292cc6a439959c336 WatchSource:0}: Error finding container 79149c99dff3acd467ccd31dca435f939f246e5b7b7104a292cc6a439959c336: Status 404 returned error can't find the container with id 79149c99dff3acd467ccd31dca435f939f246e5b7b7104a292cc6a439959c336 Sep 17 16:33:23.758787 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.758767 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:23.801322 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.801298 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gmcnc" Sep 17 16:33:23.840869 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.840804 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2wlx9" event={"ID":"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde","Type":"ContainerStarted","Data":"79149c99dff3acd467ccd31dca435f939f246e5b7b7104a292cc6a439959c336"} Sep 17 16:33:23.841895 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.841873 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wzqtc" event={"ID":"694d53e2-8503-4fcf-a313-744e81e30d5e","Type":"ContainerStarted","Data":"9615c015e7640cbdd8d20b4f8aef3c5c6e70ec4a38efe2d36cadb4bc30eb7b59"} Sep 17 16:33:23.843073 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.843043 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cdn7r" event={"ID":"71c447a9-be09-4350-841c-a054f2e33b6b","Type":"ContainerStarted","Data":"aafbf439d2bc1fd17b98077c2bab1b948312e207b72cbf2f27e308bff268423d"} Sep 17 16:33:23.845251 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.845224 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rw6dm" event={"ID":"ca11a3ac-e5ba-4970-8dcb-a81efc81038e","Type":"ContainerStarted","Data":"412eb4a6388d63bd40a164266194e87d834f9dd393f6a5825f387255b1fc63d1"} Sep 17 16:33:23.845354 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.845305 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rw6dm" event={"ID":"ca11a3ac-e5ba-4970-8dcb-a81efc81038e","Type":"ContainerStarted","Data":"df2a1bdfa67ffb6a3d4baa7ce321e2bc9da820f4048fb68fa65b8f1c17c9f37f"} Sep 17 16:33:23.847982 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.845334 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rw6dm" event={"ID":"ca11a3ac-e5ba-4970-8dcb-a81efc81038e","Type":"ContainerStarted","Data":"b9d1a970de68b3f68cfb0f846e05ad76d949990975676ace6f428dea6b1870be"} Sep 17 16:33:23.847982 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.847192 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74549fcb54-mqcms" event={"ID":"2ed6e089-ba41-4c13-9746-1eef08c0eb82","Type":"ContainerStarted","Data":"95f670e7ed2b0639a16a0eb1953def12ddd62fcad2ddf8d7bfe92de49b40f493"} Sep 17 16:33:23.847982 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.847223 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74549fcb54-mqcms" event={"ID":"2ed6e089-ba41-4c13-9746-1eef08c0eb82","Type":"ContainerStarted","Data":"bdde107720fb907fbafc8c8b444210d71404f8c2ca8a00a10e3488d8cbee4e1e"} Sep 17 16:33:23.848672 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.848637 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-66zvl" event={"ID":"07690c0a-a396-4f6c-9248-41722d757b2f","Type":"ContainerStarted","Data":"d6b2919593fa35327af8724343c63611f723e2b70aabd1087dadb54285794d68"} Sep 17 16:33:23.866884 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.866818 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:23.872905 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.872870 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74549fcb54-mqcms" podStartSLOduration=1.8728573389999998 podStartE2EDuration="1.872857339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:33:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:33:23.871473704 +0000 UTC m=+68.603941283" watchObservedRunningTime="2026-09-17 16:33:23.872857339 +0000 UTC m=+68.605324918" Sep 17 16:33:23.890408 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.890386 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 16:33:23.921553 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.921518 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 16:33:23.921656 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.921640 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:23.923702 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.923680 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 17 16:33:23.923817 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.923740 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 17 16:33:23.923817 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.923680 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gq4z9\"" Sep 17 16:33:23.924220 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.924194 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 17 16:33:23.924420 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.924351 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 17 16:33:23.924868 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.924849 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 17 16:33:23.924986 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.924958 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 17 16:33:23.925231 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.925212 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 17 16:33:23.926411 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.924903 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 17 16:33:23.929394 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.928862 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 17 16:33:23.986042 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.986013 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae856dd9-9b0c-480d-b09e-713a13777da6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:23.986229 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.986201 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:23.986344 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.986231 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:23.986344 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.986259 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-web-config\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:23.986344 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.986311 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-config-volume\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:23.986344 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.986325 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae856dd9-9b0c-480d-b09e-713a13777da6-config-out\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:23.986591 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.986357 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:23.986591 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.986416 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:23.986591 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.986485 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae856dd9-9b0c-480d-b09e-713a13777da6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:23.986591 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.986511 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4zjb\" (UniqueName: \"kubernetes.io/projected/ae856dd9-9b0c-480d-b09e-713a13777da6-kube-api-access-k4zjb\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:23.986591 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.986540 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae856dd9-9b0c-480d-b09e-713a13777da6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:23.986591 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.986567 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae856dd9-9b0c-480d-b09e-713a13777da6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:23.986861 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.986600 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:23.995903 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:23.995881 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-426dn"] Sep 17 16:33:23.999970 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:33:23.999941 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0877f57_28be_44ae_b2fd_cda40918eff2.slice/crio-df2e2d4dbc8ce611cbc3f10234ad9959b571820ecc3c136f43657144b91a2269 WatchSource:0}: Error finding container df2e2d4dbc8ce611cbc3f10234ad9959b571820ecc3c136f43657144b91a2269: Status 404 returned error can't find the container with id df2e2d4dbc8ce611cbc3f10234ad9959b571820ecc3c136f43657144b91a2269 Sep 17 16:33:24.004345 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.004158 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:24.076795 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.076766 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:24.087418 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.087389 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-config-volume\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:24.087577 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.087447 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae856dd9-9b0c-480d-b09e-713a13777da6-config-out\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:24.087577 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.087492 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:24.087577 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.087523 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:24.087577 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.087553 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae856dd9-9b0c-480d-b09e-713a13777da6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:24.087786 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.087577 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4zjb\" (UniqueName: \"kubernetes.io/projected/ae856dd9-9b0c-480d-b09e-713a13777da6-kube-api-access-k4zjb\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:24.087786 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.087610 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae856dd9-9b0c-480d-b09e-713a13777da6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:24.087786 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.087634 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae856dd9-9b0c-480d-b09e-713a13777da6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:24.087786 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.087664 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:24.087786 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.087696 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae856dd9-9b0c-480d-b09e-713a13777da6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:24.087786 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.087731 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:24.087786 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.087763 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:24.088126 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.087807 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-web-config\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:24.090187 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.088708 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae856dd9-9b0c-480d-b09e-713a13777da6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:24.090187 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.090101 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae856dd9-9b0c-480d-b09e-713a13777da6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:24.090587 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.090540 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae856dd9-9b0c-480d-b09e-713a13777da6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:24.093572 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.093509 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae856dd9-9b0c-480d-b09e-713a13777da6-config-out\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:24.093754 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.093719 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:24.094028 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.094003 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:24.094174 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.094147 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-config-volume\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:24.096257 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.096213 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-web-config\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:24.096949 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.096903 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae856dd9-9b0c-480d-b09e-713a13777da6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:24.096949 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.096932 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:24.097362 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.097338 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:24.098389 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.098350 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:24.102773 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.102728 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4zjb\" (UniqueName: \"kubernetes.io/projected/ae856dd9-9b0c-480d-b09e-713a13777da6-kube-api-access-k4zjb\") pod \"alertmanager-main-0\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:24.234640 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.234605 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:33:24.526226 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.526114 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 16:33:24.690712 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:33:24.690673 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae856dd9_9b0c_480d_b09e_713a13777da6.slice/crio-694edade9c818940906578730716d7d4dcdc0a42a88b6427d8ca1c2fbf381758 WatchSource:0}: Error finding container 694edade9c818940906578730716d7d4dcdc0a42a88b6427d8ca1c2fbf381758: Status 404 returned error can't find the container with id 694edade9c818940906578730716d7d4dcdc0a42a88b6427d8ca1c2fbf381758 Sep 17 16:33:24.738037 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.738008 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:24.837216 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.837140 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:24.856607 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.856487 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae856dd9-9b0c-480d-b09e-713a13777da6","Type":"ContainerStarted","Data":"694edade9c818940906578730716d7d4dcdc0a42a88b6427d8ca1c2fbf381758"} Sep 17 16:33:24.859514 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.859450 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-426dn" event={"ID":"e0877f57-28be-44ae-b2fd-cda40918eff2","Type":"ContainerStarted","Data":"df2e2d4dbc8ce611cbc3f10234ad9959b571820ecc3c136f43657144b91a2269"} Sep 17 16:33:24.919190 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.917312 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd"] Sep 17 16:33:24.921992 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.921967 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" Sep 17 16:33:24.925413 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.925387 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 17 16:33:24.926253 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.925660 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 17 16:33:24.926253 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.925854 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 17 16:33:24.926253 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.925890 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8a8r1o5dqt8sr\"" Sep 17 16:33:24.926253 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.926074 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 17 16:33:24.926253 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.926113 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-t9nnk\"" Sep 17 16:33:24.926253 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.926157 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 17 16:33:24.937800 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.937778 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd"] Sep 17 16:33:24.995793 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.995759 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c6b9fa9f-4315-4290-97cd-b3df6fb101e1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74b6d5f87c-5wwbd\" (UID: \"c6b9fa9f-4315-4290-97cd-b3df6fb101e1\") " pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" Sep 17 16:33:24.995934 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.995809 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c6b9fa9f-4315-4290-97cd-b3df6fb101e1-secret-grpc-tls\") pod \"thanos-querier-74b6d5f87c-5wwbd\" (UID: \"c6b9fa9f-4315-4290-97cd-b3df6fb101e1\") " pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" Sep 17 16:33:24.995934 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.995845 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c6b9fa9f-4315-4290-97cd-b3df6fb101e1-secret-thanos-querier-tls\") pod \"thanos-querier-74b6d5f87c-5wwbd\" (UID: \"c6b9fa9f-4315-4290-97cd-b3df6fb101e1\") " pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" Sep 17 16:33:24.995934 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.995871 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c6b9fa9f-4315-4290-97cd-b3df6fb101e1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74b6d5f87c-5wwbd\" (UID: \"c6b9fa9f-4315-4290-97cd-b3df6fb101e1\") " pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" Sep 17 16:33:24.995934 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.995905 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c6b9fa9f-4315-4290-97cd-b3df6fb101e1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74b6d5f87c-5wwbd\" (UID: \"c6b9fa9f-4315-4290-97cd-b3df6fb101e1\") " pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" Sep 17 16:33:24.995934 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.995929 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6b9fa9f-4315-4290-97cd-b3df6fb101e1-metrics-client-ca\") pod \"thanos-querier-74b6d5f87c-5wwbd\" (UID: \"c6b9fa9f-4315-4290-97cd-b3df6fb101e1\") " pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" Sep 17 16:33:24.996215 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.995962 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c6b9fa9f-4315-4290-97cd-b3df6fb101e1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74b6d5f87c-5wwbd\" (UID: \"c6b9fa9f-4315-4290-97cd-b3df6fb101e1\") " pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" Sep 17 16:33:24.996215 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:24.996035 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg66v\" (UniqueName: \"kubernetes.io/projected/c6b9fa9f-4315-4290-97cd-b3df6fb101e1-kube-api-access-pg66v\") pod \"thanos-querier-74b6d5f87c-5wwbd\" (UID: \"c6b9fa9f-4315-4290-97cd-b3df6fb101e1\") " pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" Sep 17 16:33:25.097137 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:25.096581 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg66v\" (UniqueName: \"kubernetes.io/projected/c6b9fa9f-4315-4290-97cd-b3df6fb101e1-kube-api-access-pg66v\") pod \"thanos-querier-74b6d5f87c-5wwbd\" (UID: \"c6b9fa9f-4315-4290-97cd-b3df6fb101e1\") " pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" Sep 17 16:33:25.097137 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:25.096636 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c6b9fa9f-4315-4290-97cd-b3df6fb101e1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74b6d5f87c-5wwbd\" (UID: \"c6b9fa9f-4315-4290-97cd-b3df6fb101e1\") " pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" Sep 17 16:33:25.097137 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:25.096655 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c6b9fa9f-4315-4290-97cd-b3df6fb101e1-secret-grpc-tls\") pod \"thanos-querier-74b6d5f87c-5wwbd\" (UID: \"c6b9fa9f-4315-4290-97cd-b3df6fb101e1\") " pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" Sep 17 16:33:25.097137 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:25.096676 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c6b9fa9f-4315-4290-97cd-b3df6fb101e1-secret-thanos-querier-tls\") pod \"thanos-querier-74b6d5f87c-5wwbd\" (UID: \"c6b9fa9f-4315-4290-97cd-b3df6fb101e1\") " pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" Sep 17 16:33:25.097137 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:25.096930 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c6b9fa9f-4315-4290-97cd-b3df6fb101e1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74b6d5f87c-5wwbd\" (UID: \"c6b9fa9f-4315-4290-97cd-b3df6fb101e1\") " pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" Sep 17 16:33:25.097137 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:25.096989 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c6b9fa9f-4315-4290-97cd-b3df6fb101e1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74b6d5f87c-5wwbd\" (UID: \"c6b9fa9f-4315-4290-97cd-b3df6fb101e1\") " pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" Sep 17 16:33:25.097137 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:25.097018 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6b9fa9f-4315-4290-97cd-b3df6fb101e1-metrics-client-ca\") pod \"thanos-querier-74b6d5f87c-5wwbd\" (UID: \"c6b9fa9f-4315-4290-97cd-b3df6fb101e1\") " pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" Sep 17 16:33:25.097137 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:25.097052 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c6b9fa9f-4315-4290-97cd-b3df6fb101e1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74b6d5f87c-5wwbd\" (UID: \"c6b9fa9f-4315-4290-97cd-b3df6fb101e1\") " pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" Sep 17 16:33:25.097917 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:25.097888 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6b9fa9f-4315-4290-97cd-b3df6fb101e1-metrics-client-ca\") pod \"thanos-querier-74b6d5f87c-5wwbd\" (UID: \"c6b9fa9f-4315-4290-97cd-b3df6fb101e1\") " pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" Sep 17 16:33:25.100852 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:25.100756 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c6b9fa9f-4315-4290-97cd-b3df6fb101e1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74b6d5f87c-5wwbd\" (UID: \"c6b9fa9f-4315-4290-97cd-b3df6fb101e1\") " pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" Sep 17 16:33:25.102406 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:25.102142 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c6b9fa9f-4315-4290-97cd-b3df6fb101e1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74b6d5f87c-5wwbd\" (UID: \"c6b9fa9f-4315-4290-97cd-b3df6fb101e1\") " pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" Sep 17 16:33:25.102406 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:25.102369 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c6b9fa9f-4315-4290-97cd-b3df6fb101e1-secret-thanos-querier-tls\") pod \"thanos-querier-74b6d5f87c-5wwbd\" (UID: \"c6b9fa9f-4315-4290-97cd-b3df6fb101e1\") " pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" Sep 17 16:33:25.103563 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:25.103528 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c6b9fa9f-4315-4290-97cd-b3df6fb101e1-secret-grpc-tls\") pod \"thanos-querier-74b6d5f87c-5wwbd\" (UID: \"c6b9fa9f-4315-4290-97cd-b3df6fb101e1\") " pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" Sep 17 16:33:25.103701 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:25.103667 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c6b9fa9f-4315-4290-97cd-b3df6fb101e1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74b6d5f87c-5wwbd\" (UID: \"c6b9fa9f-4315-4290-97cd-b3df6fb101e1\") " pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" Sep 17 16:33:25.103945 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:25.103924 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c6b9fa9f-4315-4290-97cd-b3df6fb101e1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74b6d5f87c-5wwbd\" (UID: \"c6b9fa9f-4315-4290-97cd-b3df6fb101e1\") " pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" Sep 17 16:33:25.113861 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:25.113809 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg66v\" (UniqueName: \"kubernetes.io/projected/c6b9fa9f-4315-4290-97cd-b3df6fb101e1-kube-api-access-pg66v\") pod \"thanos-querier-74b6d5f87c-5wwbd\" (UID: \"c6b9fa9f-4315-4290-97cd-b3df6fb101e1\") " pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" Sep 17 16:33:25.236938 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:25.236623 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" Sep 17 16:33:25.567399 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:25.567285 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:25.667859 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:25.667777 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:25.793167 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:25.793130 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:25.892930 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:25.892901 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:25.996535 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:25.996446 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:26.086026 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:26.085509 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bfc76b967-kbsxt" Sep 17 16:33:26.086026 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:26.085986 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bfc76b967-kbsxt" Sep 17 16:33:26.096414 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:26.094384 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bfc76b967-kbsxt" Sep 17 16:33:26.096414 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:26.096381 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:26.197926 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:26.196036 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd"] Sep 17 16:33:26.872607 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:26.872549 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-66zvl" event={"ID":"07690c0a-a396-4f6c-9248-41722d757b2f","Type":"ContainerStarted","Data":"a7e0774d2fb210f0a75bed0e902af6aaf5c30b6df2eabb903da4568e63246779"} Sep 17 16:33:26.873053 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:26.872635 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-66zvl" event={"ID":"07690c0a-a396-4f6c-9248-41722d757b2f","Type":"ContainerStarted","Data":"faacc86f80ba51db54aa39ef4bcf97f4eb0590d09477e305401d8506837e2888"} Sep 17 16:33:26.875468 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:26.875419 2581 generic.go:356] "Generic (PLEG): container finished" podID="0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde" containerID="209d6ec7a5b40e3f31f723052c94b88163025a1cc024a617b23ddda8e3e37123" exitCode=0 Sep 17 16:33:26.875607 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:26.875525 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2wlx9" event={"ID":"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde","Type":"ContainerDied","Data":"209d6ec7a5b40e3f31f723052c94b88163025a1cc024a617b23ddda8e3e37123"} Sep 17 16:33:26.880202 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:26.880176 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rw6dm" event={"ID":"ca11a3ac-e5ba-4970-8dcb-a81efc81038e","Type":"ContainerStarted","Data":"574b841614f118a23857cb258e6ccee865adf851fda5029e9814be35ffca90c5"} Sep 17 16:33:26.882152 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:26.882112 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" event={"ID":"c6b9fa9f-4315-4290-97cd-b3df6fb101e1","Type":"ContainerStarted","Data":"25f66cc0b6bc9e65ba533ff657e3c4d84406dc9b3dd73dc530e7edd4830721f6"} Sep 17 16:33:26.885400 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:26.885376 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-426dn" event={"ID":"e0877f57-28be-44ae-b2fd-cda40918eff2","Type":"ContainerStarted","Data":"617a1388b92fe865df126bfe5fc21ac041f5a1260577b73cdedb8a00376e34bc"} Sep 17 16:33:26.885517 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:26.885455 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-426dn" event={"ID":"e0877f57-28be-44ae-b2fd-cda40918eff2","Type":"ContainerStarted","Data":"90593c0a2e45ff16fe7fd9f0c63932c627fe3066d7190bb2a588eecdbfc9a6a1"} Sep 17 16:33:26.885517 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:26.885484 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-426dn" event={"ID":"e0877f57-28be-44ae-b2fd-cda40918eff2","Type":"ContainerStarted","Data":"f9a7430c8eb278c94f201c83c25f0005007fa0892ca11998bbda38a406d05ffa"} Sep 17 16:33:26.890591 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:26.890551 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bfc76b967-kbsxt" Sep 17 16:33:26.895256 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:26.895193 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-66zvl" podStartSLOduration=67.453413069 podStartE2EDuration="1m9.895180005s" totalImagesPullingTime="2.441766936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:33:26.894410584 +0000 UTC m=+71.626878165" watchObservedRunningTime="2026-09-17 16:33:26.895180005 +0000 UTC m=+71.627647583" Sep 17 16:33:26.921159 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:26.921113 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-426dn" podStartSLOduration=2.967400509 podStartE2EDuration="4.921095767s" totalImagesPullingTime="1.953695258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:33:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:33:26.919808393 +0000 UTC m=+71.652275973" watchObservedRunningTime="2026-09-17 16:33:26.921095767 +0000 UTC m=+71.653563347" Sep 17 16:33:26.981790 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:26.980561 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-rw6dm" podStartSLOduration=2.7039429569999998 podStartE2EDuration="4.980539458s" totalImagesPullingTime="2.276596501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:33:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:33:26.978935079 +0000 UTC m=+71.711402660" watchObservedRunningTime="2026-09-17 16:33:26.980539458 +0000 UTC m=+71.713007038" Sep 17 16:33:27.006245 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.006214 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:27.099612 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.099574 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-69dcb7c788-lbhvh"] Sep 17 16:33:27.101335 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.101309 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:27.102849 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.102832 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-69dcb7c788-lbhvh" Sep 17 16:33:27.105781 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.105421 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 17 16:33:27.105781 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.105529 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4lophe7d5059i\"" Sep 17 16:33:27.105781 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.105543 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-979cc\"" Sep 17 16:33:27.105781 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.105665 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 17 16:33:27.106005 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.105853 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 17 16:33:27.106005 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.105926 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 17 16:33:27.114073 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.114055 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-69dcb7c788-lbhvh"] Sep 17 16:33:27.218030 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.218005 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14056693-bf8a-4c6b-843a-1bd5b2cd5095-client-ca-bundle\") pod \"metrics-server-69dcb7c788-lbhvh\" (UID: \"14056693-bf8a-4c6b-843a-1bd5b2cd5095\") " pod="openshift-monitoring/metrics-server-69dcb7c788-lbhvh" Sep 17 16:33:27.218181 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.218049 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14056693-bf8a-4c6b-843a-1bd5b2cd5095-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-69dcb7c788-lbhvh\" (UID: \"14056693-bf8a-4c6b-843a-1bd5b2cd5095\") " pod="openshift-monitoring/metrics-server-69dcb7c788-lbhvh" Sep 17 16:33:27.218181 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.218079 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/14056693-bf8a-4c6b-843a-1bd5b2cd5095-secret-metrics-server-client-certs\") pod \"metrics-server-69dcb7c788-lbhvh\" (UID: \"14056693-bf8a-4c6b-843a-1bd5b2cd5095\") " pod="openshift-monitoring/metrics-server-69dcb7c788-lbhvh" Sep 17 16:33:27.218181 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.218158 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x46n\" (UniqueName: \"kubernetes.io/projected/14056693-bf8a-4c6b-843a-1bd5b2cd5095-kube-api-access-5x46n\") pod \"metrics-server-69dcb7c788-lbhvh\" (UID: \"14056693-bf8a-4c6b-843a-1bd5b2cd5095\") " pod="openshift-monitoring/metrics-server-69dcb7c788-lbhvh" Sep 17 16:33:27.218287 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.218238 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/14056693-bf8a-4c6b-843a-1bd5b2cd5095-metrics-server-audit-profiles\") pod \"metrics-server-69dcb7c788-lbhvh\" (UID: \"14056693-bf8a-4c6b-843a-1bd5b2cd5095\") " pod="openshift-monitoring/metrics-server-69dcb7c788-lbhvh" Sep 17 16:33:27.218333 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.218283 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/14056693-bf8a-4c6b-843a-1bd5b2cd5095-secret-metrics-server-tls\") pod \"metrics-server-69dcb7c788-lbhvh\" (UID: \"14056693-bf8a-4c6b-843a-1bd5b2cd5095\") " pod="openshift-monitoring/metrics-server-69dcb7c788-lbhvh" Sep 17 16:33:27.218333 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.218310 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/14056693-bf8a-4c6b-843a-1bd5b2cd5095-audit-log\") pod \"metrics-server-69dcb7c788-lbhvh\" (UID: \"14056693-bf8a-4c6b-843a-1bd5b2cd5095\") " pod="openshift-monitoring/metrics-server-69dcb7c788-lbhvh" Sep 17 16:33:27.319267 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.319234 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14056693-bf8a-4c6b-843a-1bd5b2cd5095-client-ca-bundle\") pod \"metrics-server-69dcb7c788-lbhvh\" (UID: \"14056693-bf8a-4c6b-843a-1bd5b2cd5095\") " pod="openshift-monitoring/metrics-server-69dcb7c788-lbhvh" Sep 17 16:33:27.319400 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.319280 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14056693-bf8a-4c6b-843a-1bd5b2cd5095-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-69dcb7c788-lbhvh\" (UID: \"14056693-bf8a-4c6b-843a-1bd5b2cd5095\") " pod="openshift-monitoring/metrics-server-69dcb7c788-lbhvh" Sep 17 16:33:27.319400 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.319312 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/14056693-bf8a-4c6b-843a-1bd5b2cd5095-secret-metrics-server-client-certs\") pod \"metrics-server-69dcb7c788-lbhvh\" (UID: \"14056693-bf8a-4c6b-843a-1bd5b2cd5095\") " pod="openshift-monitoring/metrics-server-69dcb7c788-lbhvh" Sep 17 16:33:27.319400 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.319348 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x46n\" (UniqueName: \"kubernetes.io/projected/14056693-bf8a-4c6b-843a-1bd5b2cd5095-kube-api-access-5x46n\") pod \"metrics-server-69dcb7c788-lbhvh\" (UID: \"14056693-bf8a-4c6b-843a-1bd5b2cd5095\") " pod="openshift-monitoring/metrics-server-69dcb7c788-lbhvh" Sep 17 16:33:27.319400 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.319373 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/14056693-bf8a-4c6b-843a-1bd5b2cd5095-metrics-server-audit-profiles\") pod \"metrics-server-69dcb7c788-lbhvh\" (UID: \"14056693-bf8a-4c6b-843a-1bd5b2cd5095\") " pod="openshift-monitoring/metrics-server-69dcb7c788-lbhvh" Sep 17 16:33:27.319631 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.319406 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/14056693-bf8a-4c6b-843a-1bd5b2cd5095-secret-metrics-server-tls\") pod \"metrics-server-69dcb7c788-lbhvh\" (UID: \"14056693-bf8a-4c6b-843a-1bd5b2cd5095\") " pod="openshift-monitoring/metrics-server-69dcb7c788-lbhvh" Sep 17 16:33:27.319631 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.319445 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/14056693-bf8a-4c6b-843a-1bd5b2cd5095-audit-log\") pod \"metrics-server-69dcb7c788-lbhvh\" (UID: \"14056693-bf8a-4c6b-843a-1bd5b2cd5095\") " pod="openshift-monitoring/metrics-server-69dcb7c788-lbhvh" Sep 17 16:33:27.319939 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.319895 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/14056693-bf8a-4c6b-843a-1bd5b2cd5095-audit-log\") pod \"metrics-server-69dcb7c788-lbhvh\" (UID: \"14056693-bf8a-4c6b-843a-1bd5b2cd5095\") " pod="openshift-monitoring/metrics-server-69dcb7c788-lbhvh" Sep 17 16:33:27.320252 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.320202 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14056693-bf8a-4c6b-843a-1bd5b2cd5095-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-69dcb7c788-lbhvh\" (UID: \"14056693-bf8a-4c6b-843a-1bd5b2cd5095\") " pod="openshift-monitoring/metrics-server-69dcb7c788-lbhvh" Sep 17 16:33:27.320448 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.320414 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/14056693-bf8a-4c6b-843a-1bd5b2cd5095-metrics-server-audit-profiles\") pod \"metrics-server-69dcb7c788-lbhvh\" (UID: \"14056693-bf8a-4c6b-843a-1bd5b2cd5095\") " pod="openshift-monitoring/metrics-server-69dcb7c788-lbhvh" Sep 17 16:33:27.322525 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.322502 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/14056693-bf8a-4c6b-843a-1bd5b2cd5095-secret-metrics-server-tls\") pod \"metrics-server-69dcb7c788-lbhvh\" (UID: \"14056693-bf8a-4c6b-843a-1bd5b2cd5095\") " pod="openshift-monitoring/metrics-server-69dcb7c788-lbhvh" Sep 17 16:33:27.322616 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.322506 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/14056693-bf8a-4c6b-843a-1bd5b2cd5095-client-ca-bundle\") pod \"metrics-server-69dcb7c788-lbhvh\" (UID: \"14056693-bf8a-4c6b-843a-1bd5b2cd5095\") " pod="openshift-monitoring/metrics-server-69dcb7c788-lbhvh" Sep 17 16:33:27.322705 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.322684 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/14056693-bf8a-4c6b-843a-1bd5b2cd5095-secret-metrics-server-client-certs\") pod \"metrics-server-69dcb7c788-lbhvh\" (UID: \"14056693-bf8a-4c6b-843a-1bd5b2cd5095\") " pod="openshift-monitoring/metrics-server-69dcb7c788-lbhvh" Sep 17 16:33:27.328160 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.328142 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x46n\" (UniqueName: \"kubernetes.io/projected/14056693-bf8a-4c6b-843a-1bd5b2cd5095-kube-api-access-5x46n\") pod \"metrics-server-69dcb7c788-lbhvh\" (UID: \"14056693-bf8a-4c6b-843a-1bd5b2cd5095\") " pod="openshift-monitoring/metrics-server-69dcb7c788-lbhvh" Sep 17 16:33:27.414448 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.414399 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-69dcb7c788-lbhvh" Sep 17 16:33:27.516842 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.516773 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-z2tct"] Sep 17 16:33:27.520228 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.520200 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-z2tct" Sep 17 16:33:27.520339 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.520283 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:27.522543 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.522523 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 17 16:33:27.522646 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.522543 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-2hgcl\"" Sep 17 16:33:27.531988 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.531932 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-z2tct"] Sep 17 16:33:27.589924 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.589890 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:27.621485 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.621454 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtwtj\" (UniqueName: \"kubernetes.io/projected/6856c598-60bc-4bb8-a7d8-ab0d18a3b55b-kube-api-access-vtwtj\") pod \"monitoring-plugin-5984459ff8-z2tct\" (UID: \"6856c598-60bc-4bb8-a7d8-ab0d18a3b55b\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-z2tct" Sep 17 16:33:27.621649 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.621526 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6856c598-60bc-4bb8-a7d8-ab0d18a3b55b-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-z2tct\" (UID: \"6856c598-60bc-4bb8-a7d8-ab0d18a3b55b\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-z2tct" Sep 17 16:33:27.722931 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.722893 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtwtj\" (UniqueName: \"kubernetes.io/projected/6856c598-60bc-4bb8-a7d8-ab0d18a3b55b-kube-api-access-vtwtj\") pod \"monitoring-plugin-5984459ff8-z2tct\" (UID: \"6856c598-60bc-4bb8-a7d8-ab0d18a3b55b\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-z2tct" Sep 17 16:33:27.723087 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.722979 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6856c598-60bc-4bb8-a7d8-ab0d18a3b55b-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-z2tct\" (UID: \"6856c598-60bc-4bb8-a7d8-ab0d18a3b55b\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-z2tct" Sep 17 16:33:27.723143 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:33:27.723100 2581 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 17 16:33:27.723192 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:33:27.723158 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6856c598-60bc-4bb8-a7d8-ab0d18a3b55b-monitoring-plugin-cert podName:6856c598-60bc-4bb8-a7d8-ab0d18a3b55b nodeName:}" failed. No retries permitted until 2026-09-17 16:33:28.223139766 +0000 UTC m=+72.955607323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/6856c598-60bc-4bb8-a7d8-ab0d18a3b55b-monitoring-plugin-cert") pod "monitoring-plugin-5984459ff8-z2tct" (UID: "6856c598-60bc-4bb8-a7d8-ab0d18a3b55b") : secret "monitoring-plugin-cert" not found Sep 17 16:33:27.732191 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.732159 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtwtj\" (UniqueName: \"kubernetes.io/projected/6856c598-60bc-4bb8-a7d8-ab0d18a3b55b-kube-api-access-vtwtj\") pod \"monitoring-plugin-5984459ff8-z2tct\" (UID: \"6856c598-60bc-4bb8-a7d8-ab0d18a3b55b\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-z2tct" Sep 17 16:33:27.832483 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:27.832395 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:28.227577 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:28.227544 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6856c598-60bc-4bb8-a7d8-ab0d18a3b55b-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-z2tct\" (UID: \"6856c598-60bc-4bb8-a7d8-ab0d18a3b55b\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-z2tct" Sep 17 16:33:28.230542 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:28.230507 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6856c598-60bc-4bb8-a7d8-ab0d18a3b55b-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-z2tct\" (UID: \"6856c598-60bc-4bb8-a7d8-ab0d18a3b55b\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-z2tct" Sep 17 16:33:28.432028 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:28.431989 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-z2tct" Sep 17 16:33:29.027373 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.027333 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:29.187119 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.187083 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:29.248095 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.248053 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 16:33:29.252821 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.252790 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.294738 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.294655 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 16:33:29.294880 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.294720 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 16:33:29.294880 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.294788 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 16:33:29.294880 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.294720 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 16:33:29.294880 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.294829 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 16:33:29.296310 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.296259 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 16:33:29.296961 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.296940 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 16:33:29.297210 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.297189 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 16:33:29.297412 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.297392 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 16:33:29.297618 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.297600 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 16:33:29.298163 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.298143 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 16:33:29.298371 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.298353 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-88ocsv5594tlc\"" Sep 17 16:33:29.298620 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.298572 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 16:33:29.303755 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.303734 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 16:33:29.306881 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.305959 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4l4wg\"" Sep 17 16:33:29.306881 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.306392 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 16:33:29.309055 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.307952 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 16:33:29.339213 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.339180 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.339353 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.339225 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/467243c1-82c9-4d62-8645-a5abe8b2dc30-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.339353 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.339249 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.339353 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.339312 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.339475 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.339380 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.339475 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.339411 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.339475 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.339452 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-web-config\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.339624 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.339482 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/467243c1-82c9-4d62-8645-a5abe8b2dc30-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.339624 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.339522 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.339624 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.339582 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.339765 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.339633 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-config\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.339765 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.339668 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.339765 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.339698 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/467243c1-82c9-4d62-8645-a5abe8b2dc30-config-out\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.339765 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.339750 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.339986 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.339776 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.339986 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.339795 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.339986 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.339843 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.339986 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.339875 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.339986 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.339902 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.339986 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.339923 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfznn\" (UniqueName: \"kubernetes.io/projected/467243c1-82c9-4d62-8645-a5abe8b2dc30-kube-api-access-bfznn\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.423766 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.423690 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:29.440424 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.440385 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.440616 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.440452 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.440616 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.440483 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.440616 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.440507 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-web-config\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.440616 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.440536 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/467243c1-82c9-4d62-8645-a5abe8b2dc30-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.440842 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.440628 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.440842 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.440684 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.440842 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.440723 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-config\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.440842 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.440767 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.441415 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.441386 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.441581 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.440809 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/467243c1-82c9-4d62-8645-a5abe8b2dc30-config-out\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.441581 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.441510 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.441581 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.441541 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.441581 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.441561 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.441866 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.441585 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.441866 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.441617 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.441866 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.441637 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.441866 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.441651 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfznn\" (UniqueName: \"kubernetes.io/projected/467243c1-82c9-4d62-8645-a5abe8b2dc30-kube-api-access-bfznn\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.441866 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.441682 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.441866 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.441705 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/467243c1-82c9-4d62-8645-a5abe8b2dc30-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.441866 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.441712 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/467243c1-82c9-4d62-8645-a5abe8b2dc30-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.441866 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.441721 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.442142 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.441473 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.442469 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.442425 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.443015 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.442989 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.444098 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.444064 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.445557 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.445529 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.445653 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.445519 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.447759 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.447707 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-config\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.448546 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.448507 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.451538 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.448816 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.451538 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.449080 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-web-config\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.452912 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.452873 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.453498 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.453477 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.453816 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.453799 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.454493 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.454474 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.454603 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.454529 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.455539 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.455287 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/467243c1-82c9-4d62-8645-a5abe8b2dc30-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.455539 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.455492 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/467243c1-82c9-4d62-8645-a5abe8b2dc30-config-out\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.457645 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.457603 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfznn\" (UniqueName: \"kubernetes.io/projected/467243c1-82c9-4d62-8645-a5abe8b2dc30-kube-api-access-bfznn\") pod \"prometheus-k8s-0\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.565715 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.565632 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:29.903389 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.903255 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2wlx9" event={"ID":"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde","Type":"ContainerStarted","Data":"c1578bc7a47b26aec2d9746050434b24cc8ec252a95dd172a430d9f4470d142c"} Sep 17 16:33:29.905811 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.905782 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wzqtc" event={"ID":"694d53e2-8503-4fcf-a313-744e81e30d5e","Type":"ContainerStarted","Data":"60e9ea39fe7d6ee1ee18c4da9ef0cd7add2c26231def9e1c5304f01c82a2632e"} Sep 17 16:33:29.905997 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.905979 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:33:29.908019 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.907991 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cdn7r" event={"ID":"71c447a9-be09-4350-841c-a054f2e33b6b","Type":"ContainerStarted","Data":"8dfa6cb57d697fd686c7aa84ce596fde1ae750317b13adcfcfd03f398c266c7a"} Sep 17 16:33:29.910372 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.910348 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae856dd9-9b0c-480d-b09e-713a13777da6","Type":"ContainerStarted","Data":"4872cbddbce4dff8013c446cd67551852e0b09f1ec83a7b2ce9893c54da8d1f8"} Sep 17 16:33:29.949148 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.949100 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wzqtc" podStartSLOduration=67.006887579 podStartE2EDuration="1m12.949079603s" totalImagesPullingTime="5.942192024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:33:29.94855256 +0000 UTC m=+74.681020140" watchObservedRunningTime="2026-09-17 16:33:29.949079603 +0000 UTC m=+74.681547186" Sep 17 16:33:29.992017 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:29.991987 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-z2tct"] Sep 17 16:33:30.004250 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:30.004225 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-69dcb7c788-lbhvh"] Sep 17 16:33:30.015331 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:30.015276 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cdn7r" podStartSLOduration=66.842967207 podStartE2EDuration="1m13.015255112s" totalImagesPullingTime="6.172287905s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:33:30.008576657 +0000 UTC m=+74.741044231" watchObservedRunningTime="2026-09-17 16:33:30.015255112 +0000 UTC m=+74.747722693" Sep 17 16:33:30.018497 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:30.018476 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 16:33:30.022365 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:30.022344 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:30.143193 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:30.143109 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:30.526675 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:33:30.526636 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod467243c1_82c9_4d62_8645_a5abe8b2dc30.slice/crio-41c3146320b0aecde74d670300e31e3a785b3197bac51ff9a4fe0333c4f8b2d1 WatchSource:0}: Error finding container 41c3146320b0aecde74d670300e31e3a785b3197bac51ff9a4fe0333c4f8b2d1: Status 404 returned error can't find the container with id 41c3146320b0aecde74d670300e31e3a785b3197bac51ff9a4fe0333c4f8b2d1 Sep 17 16:33:30.527158 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:33:30.527135 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6856c598_60bc_4bb8_a7d8_ab0d18a3b55b.slice/crio-9ca4d972cad21366f307612ceb41b5b9e804fb57cef81a4f72ccc763aacb1be2 WatchSource:0}: Error finding container 9ca4d972cad21366f307612ceb41b5b9e804fb57cef81a4f72ccc763aacb1be2: Status 404 returned error can't find the container with id 9ca4d972cad21366f307612ceb41b5b9e804fb57cef81a4f72ccc763aacb1be2 Sep 17 16:33:30.527941 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:33:30.527855 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14056693_bf8a_4c6b_843a_1bd5b2cd5095.slice/crio-471ccbf0350af3c1648a03fa6fb7efcdf554333a675aa3831d956f1bea570e8b WatchSource:0}: Error finding container 471ccbf0350af3c1648a03fa6fb7efcdf554333a675aa3831d956f1bea570e8b: Status 404 returned error can't find the container with id 471ccbf0350af3c1648a03fa6fb7efcdf554333a675aa3831d956f1bea570e8b Sep 17 16:33:30.917829 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:30.917795 2581 generic.go:356] "Generic (PLEG): container finished" podID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerID="4872cbddbce4dff8013c446cd67551852e0b09f1ec83a7b2ce9893c54da8d1f8" exitCode=0 Sep 17 16:33:30.917987 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:30.917873 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae856dd9-9b0c-480d-b09e-713a13777da6","Type":"ContainerDied","Data":"4872cbddbce4dff8013c446cd67551852e0b09f1ec83a7b2ce9893c54da8d1f8"} Sep 17 16:33:30.919446 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:30.919403 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-69dcb7c788-lbhvh" event={"ID":"14056693-bf8a-4c6b-843a-1bd5b2cd5095","Type":"ContainerStarted","Data":"471ccbf0350af3c1648a03fa6fb7efcdf554333a675aa3831d956f1bea570e8b"} Sep 17 16:33:30.922073 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:30.922048 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2wlx9" event={"ID":"0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde","Type":"ContainerStarted","Data":"e4ba5c9c8382761ca4280398207f38b22e2dbdf01280de35f41115ab54fcd320"} Sep 17 16:33:30.923800 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:30.923780 2581 generic.go:356] "Generic (PLEG): container finished" podID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerID="15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676" exitCode=0 Sep 17 16:33:30.923800 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:30.923805 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"467243c1-82c9-4d62-8645-a5abe8b2dc30","Type":"ContainerDied","Data":"15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676"} Sep 17 16:33:30.923997 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:30.923869 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"467243c1-82c9-4d62-8645-a5abe8b2dc30","Type":"ContainerStarted","Data":"41c3146320b0aecde74d670300e31e3a785b3197bac51ff9a4fe0333c4f8b2d1"} Sep 17 16:33:30.925637 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:30.925617 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-z2tct" event={"ID":"6856c598-60bc-4bb8-a7d8-ab0d18a3b55b","Type":"ContainerStarted","Data":"9ca4d972cad21366f307612ceb41b5b9e804fb57cef81a4f72ccc763aacb1be2"} Sep 17 16:33:30.928240 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:30.928219 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" event={"ID":"c6b9fa9f-4315-4290-97cd-b3df6fb101e1","Type":"ContainerStarted","Data":"5a1c100c0b2a298d8c2e109e3d099f4bcf6e61cc3083435e1447b44fb4592165"} Sep 17 16:33:30.928338 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:30.928285 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" event={"ID":"c6b9fa9f-4315-4290-97cd-b3df6fb101e1","Type":"ContainerStarted","Data":"2b7a05609106be08858f350006bc0ceb4e136eea8c8b76f05078c16aa2f119f7"} Sep 17 16:33:30.928338 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:30.928328 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" event={"ID":"c6b9fa9f-4315-4290-97cd-b3df6fb101e1","Type":"ContainerStarted","Data":"c51f8983633a85363be8e67d27d97436c4c27e657e3ee0a2b4d787342a9921a2"} Sep 17 16:33:30.958837 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:30.958800 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2wlx9" podStartSLOduration=6.662798033 podStartE2EDuration="8.958786791s" totalImagesPullingTime="2.14468868s" totalInitContainerRuntime="151.300078ms" isStatefulPod=true podCreationTimestamp="2026-09-17 16:33:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:33:30.957679553 +0000 UTC m=+75.690147147" watchObservedRunningTime="2026-09-17 16:33:30.958786791 +0000 UTC m=+75.691254360" Sep 17 16:33:31.256542 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:31.256466 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:31.351562 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:31.351495 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:31.420109 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:31.420076 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:31.659808 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:31.659729 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:31.765228 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:31.765196 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:31.792145 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:31.792118 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74549fcb54-mqcms"] Sep 17 16:33:32.905191 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:32.905159 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74549fcb54-mqcms" Sep 17 16:33:32.992356 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:32.992335 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:33.428730 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:33.428648 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:33.531367 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:33.531335 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:33.949324 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:33.949285 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae856dd9-9b0c-480d-b09e-713a13777da6","Type":"ContainerStarted","Data":"85bdd2d47a5a72832dc117a34c471b4be2dec0d82fd4ba3e8799bd2d984310c6"} Sep 17 16:33:33.949791 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:33.949401 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae856dd9-9b0c-480d-b09e-713a13777da6","Type":"ContainerStarted","Data":"7c60932f6590f77ef22f5e2a36e948aa5eb892906217b8f9d31aedf2bddbca7d"} Sep 17 16:33:33.949791 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:33.949472 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae856dd9-9b0c-480d-b09e-713a13777da6","Type":"ContainerStarted","Data":"95d91743c67fa13b5a1521e074fb94d82ca3b9e0fac741c9f1c809960fe971ce"} Sep 17 16:33:33.949791 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:33.949509 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae856dd9-9b0c-480d-b09e-713a13777da6","Type":"ContainerStarted","Data":"2ced5b05954603dbf0ec9c2dc28aa63bea08c929f84975afdd687862e0ceb3a9"} Sep 17 16:33:33.949791 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:33.949545 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae856dd9-9b0c-480d-b09e-713a13777da6","Type":"ContainerStarted","Data":"4e9a8c75b426ea719c48528ae88ec314d1e98bd729098f14b50ad8600531252e"} Sep 17 16:33:33.949791 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:33.949586 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae856dd9-9b0c-480d-b09e-713a13777da6","Type":"ContainerStarted","Data":"c83364b2286d56ecec3d6c1eecc99d98e701c1acc0579e81010d5a3ea5c711c0"} Sep 17 16:33:33.951503 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:33.951473 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-69dcb7c788-lbhvh" event={"ID":"14056693-bf8a-4c6b-843a-1bd5b2cd5095","Type":"ContainerStarted","Data":"8080587260bdf5eae00bdf151219213e721b0ce7af1012251ca59d3bbba51c32"} Sep 17 16:33:33.953154 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:33.953106 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-z2tct" event={"ID":"6856c598-60bc-4bb8-a7d8-ab0d18a3b55b","Type":"ContainerStarted","Data":"5f3d4a83e7152c0f4f04aaa100eb9a59aa66ce596924f7af9beb49c64db51394"} Sep 17 16:33:33.953306 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:33.953284 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-z2tct" Sep 17 16:33:33.957716 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:33.957698 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" event={"ID":"c6b9fa9f-4315-4290-97cd-b3df6fb101e1","Type":"ContainerStarted","Data":"383250d55ab7255e30b052c9243da36bbe35537326933a992cfb73e5c30c09b8"} Sep 17 16:33:33.957816 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:33.957753 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" event={"ID":"c6b9fa9f-4315-4290-97cd-b3df6fb101e1","Type":"ContainerStarted","Data":"fdb842366d7c8e9e58423a623b9a7e21aed4eb74104c094c0d3593ef543a52a9"} Sep 17 16:33:33.957816 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:33.957781 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" event={"ID":"c6b9fa9f-4315-4290-97cd-b3df6fb101e1","Type":"ContainerStarted","Data":"0a6e590d270fa800ee9e49df4e4b447b653dcf71b4ea1df95eca04dc6b8fdebc"} Sep 17 16:33:33.957921 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:33.957843 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" Sep 17 16:33:33.959265 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:33.959243 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-z2tct" Sep 17 16:33:33.981155 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:33.981100 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.026818129 podStartE2EDuration="10.981087062s" totalImagesPullingTime="7.927119022s" totalInitContainerRuntime="27.149911ms" isStatefulPod=false podCreationTimestamp="2026-09-17 16:33:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:33:33.979142582 +0000 UTC m=+78.711610166" watchObservedRunningTime="2026-09-17 16:33:33.981087062 +0000 UTC m=+78.713554641" Sep 17 16:33:34.002138 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:34.002088 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-69dcb7c788-lbhvh" podStartSLOduration=4.6812673799999995 podStartE2EDuration="7.002074544s" totalImagesPullingTime="2.320807164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:33:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:33:34.001383699 +0000 UTC m=+78.733851327" watchObservedRunningTime="2026-09-17 16:33:34.002074544 +0000 UTC m=+78.734542123" Sep 17 16:33:34.018145 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:34.018107 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-z2tct" podStartSLOduration=4.700076298 podStartE2EDuration="7.018093462s" totalImagesPullingTime="2.318017164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:33:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:33:34.016783898 +0000 UTC m=+78.749251481" watchObservedRunningTime="2026-09-17 16:33:34.018093462 +0000 UTC m=+78.750561040" Sep 17 16:33:34.042494 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:34.042425 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" podStartSLOduration=3.621161464 podStartE2EDuration="10.042408175s" totalImagesPullingTime="6.421246711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:33:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:33:34.040327238 +0000 UTC m=+78.772794817" watchObservedRunningTime="2026-09-17 16:33:34.042408175 +0000 UTC m=+78.774875759" Sep 17 16:33:34.965852 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:34.965508 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"467243c1-82c9-4d62-8645-a5abe8b2dc30","Type":"ContainerStarted","Data":"18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56"} Sep 17 16:33:34.965852 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:34.965583 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"467243c1-82c9-4d62-8645-a5abe8b2dc30","Type":"ContainerStarted","Data":"6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b"} Sep 17 16:33:34.965852 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:34.965611 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"467243c1-82c9-4d62-8645-a5abe8b2dc30","Type":"ContainerStarted","Data":"6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b"} Sep 17 16:33:34.965852 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:34.965635 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"467243c1-82c9-4d62-8645-a5abe8b2dc30","Type":"ContainerStarted","Data":"c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562"} Sep 17 16:33:34.965852 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:34.965658 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"467243c1-82c9-4d62-8645-a5abe8b2dc30","Type":"ContainerStarted","Data":"90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd"} Sep 17 16:33:34.965852 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:34.965679 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"467243c1-82c9-4d62-8645-a5abe8b2dc30","Type":"ContainerStarted","Data":"92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798"} Sep 17 16:33:35.002621 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:35.002504 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.346794978 podStartE2EDuration="6.002483504s" totalImagesPullingTime="3.636061807s" totalInitContainerRuntime="19.626719ms" isStatefulPod=false podCreationTimestamp="2026-09-17 16:33:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:33:34.99963467 +0000 UTC m=+79.732102248" watchObservedRunningTime="2026-09-17 16:33:35.002483504 +0000 UTC m=+79.734951084" Sep 17 16:33:39.085362 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:39.085320 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:39.222719 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:39.222682 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:39.324636 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:39.324606 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:39.565928 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:39.565902 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:33:39.684612 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:39.684588 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:39.753296 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:39.753249 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:39.972587 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:39.972557 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-74b6d5f87c-5wwbd" Sep 17 16:33:41.989580 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:41.989547 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:42.054084 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:42.054055 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:43.253829 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:43.253794 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bfc76b967-kbsxt"] Sep 17 16:33:43.337761 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:43.337727 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:43.430530 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:43.430503 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:43.530764 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:43.530678 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:47.419793 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:47.419763 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-69dcb7c788-lbhvh" Sep 17 16:33:47.420128 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:47.419806 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-69dcb7c788-lbhvh" Sep 17 16:33:54.523233 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:54.523195 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:54.614098 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:54.614062 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:54.733717 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:54.733693 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:55.018053 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:55.018023 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:33:56.815717 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:56.815658 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-74549fcb54-mqcms" podUID="2ed6e089-ba41-4c13-9746-1eef08c0eb82" containerName="console" containerID="cri-o://95f670e7ed2b0639a16a0eb1953def12ddd62fcad2ddf8d7bfe92de49b40f493" gracePeriod=15 Sep 17 16:33:57.060896 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:57.060868 2581 generic.go:356] "Generic (PLEG): container finished" podID="2ed6e089-ba41-4c13-9746-1eef08c0eb82" containerID="95f670e7ed2b0639a16a0eb1953def12ddd62fcad2ddf8d7bfe92de49b40f493" exitCode=0 Sep 17 16:33:57.061007 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:57.060918 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74549fcb54-mqcms" event={"ID":"2ed6e089-ba41-4c13-9746-1eef08c0eb82","Type":"ContainerDied","Data":"95f670e7ed2b0639a16a0eb1953def12ddd62fcad2ddf8d7bfe92de49b40f493"} Sep 17 16:33:57.061007 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:57.060994 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74549fcb54-mqcms" event={"ID":"2ed6e089-ba41-4c13-9746-1eef08c0eb82","Type":"ContainerDied","Data":"bdde107720fb907fbafc8c8b444210d71404f8c2ca8a00a10e3488d8cbee4e1e"} Sep 17 16:33:57.061086 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:57.061008 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bdde107720fb907fbafc8c8b444210d71404f8c2ca8a00a10e3488d8cbee4e1e" Sep 17 16:33:57.072543 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:57.072499 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74549fcb54-mqcms" Sep 17 16:33:57.268008 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:57.267976 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wftng\" (UniqueName: \"kubernetes.io/projected/2ed6e089-ba41-4c13-9746-1eef08c0eb82-kube-api-access-wftng\") pod \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\" (UID: \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\") " Sep 17 16:33:57.268136 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:57.268040 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ed6e089-ba41-4c13-9746-1eef08c0eb82-trusted-ca-bundle\") pod \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\" (UID: \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\") " Sep 17 16:33:57.268136 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:57.268061 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ed6e089-ba41-4c13-9746-1eef08c0eb82-console-serving-cert\") pod \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\" (UID: \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\") " Sep 17 16:33:57.268136 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:57.268076 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ed6e089-ba41-4c13-9746-1eef08c0eb82-console-oauth-config\") pod \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\" (UID: \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\") " Sep 17 16:33:57.268136 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:57.268106 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ed6e089-ba41-4c13-9746-1eef08c0eb82-service-ca\") pod \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\" (UID: \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\") " Sep 17 16:33:57.268136 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:57.268127 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ed6e089-ba41-4c13-9746-1eef08c0eb82-oauth-serving-cert\") pod \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\" (UID: \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\") " Sep 17 16:33:57.268366 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:57.268160 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ed6e089-ba41-4c13-9746-1eef08c0eb82-console-config\") pod \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\" (UID: \"2ed6e089-ba41-4c13-9746-1eef08c0eb82\") " Sep 17 16:33:57.268624 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:57.268591 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ed6e089-ba41-4c13-9746-1eef08c0eb82-service-ca" (OuterVolumeSpecName: "service-ca") pod "2ed6e089-ba41-4c13-9746-1eef08c0eb82" (UID: "2ed6e089-ba41-4c13-9746-1eef08c0eb82"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:33:57.268624 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:57.268614 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ed6e089-ba41-4c13-9746-1eef08c0eb82-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2ed6e089-ba41-4c13-9746-1eef08c0eb82" (UID: "2ed6e089-ba41-4c13-9746-1eef08c0eb82"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:33:57.268987 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:57.268851 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ed6e089-ba41-4c13-9746-1eef08c0eb82-console-config" (OuterVolumeSpecName: "console-config") pod "2ed6e089-ba41-4c13-9746-1eef08c0eb82" (UID: "2ed6e089-ba41-4c13-9746-1eef08c0eb82"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:33:57.269194 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:57.269167 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ed6e089-ba41-4c13-9746-1eef08c0eb82-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2ed6e089-ba41-4c13-9746-1eef08c0eb82" (UID: "2ed6e089-ba41-4c13-9746-1eef08c0eb82"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:33:57.270613 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:57.270589 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ed6e089-ba41-4c13-9746-1eef08c0eb82-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2ed6e089-ba41-4c13-9746-1eef08c0eb82" (UID: "2ed6e089-ba41-4c13-9746-1eef08c0eb82"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:33:57.270715 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:57.270629 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ed6e089-ba41-4c13-9746-1eef08c0eb82-kube-api-access-wftng" (OuterVolumeSpecName: "kube-api-access-wftng") pod "2ed6e089-ba41-4c13-9746-1eef08c0eb82" (UID: "2ed6e089-ba41-4c13-9746-1eef08c0eb82"). InnerVolumeSpecName "kube-api-access-wftng". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 16:33:57.270715 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:57.270652 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ed6e089-ba41-4c13-9746-1eef08c0eb82-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2ed6e089-ba41-4c13-9746-1eef08c0eb82" (UID: "2ed6e089-ba41-4c13-9746-1eef08c0eb82"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:33:57.368856 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:57.368799 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wftng\" (UniqueName: \"kubernetes.io/projected/2ed6e089-ba41-4c13-9746-1eef08c0eb82-kube-api-access-wftng\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:33:57.368856 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:57.368820 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ed6e089-ba41-4c13-9746-1eef08c0eb82-trusted-ca-bundle\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:33:57.368856 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:57.368832 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ed6e089-ba41-4c13-9746-1eef08c0eb82-console-serving-cert\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:33:57.368856 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:57.368847 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ed6e089-ba41-4c13-9746-1eef08c0eb82-console-oauth-config\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:33:57.369120 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:57.368860 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ed6e089-ba41-4c13-9746-1eef08c0eb82-service-ca\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:33:57.369120 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:57.368873 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ed6e089-ba41-4c13-9746-1eef08c0eb82-oauth-serving-cert\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:33:57.369120 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:57.368885 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ed6e089-ba41-4c13-9746-1eef08c0eb82-console-config\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:33:58.064776 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:58.064749 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74549fcb54-mqcms" Sep 17 16:33:58.092751 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:58.092732 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74549fcb54-mqcms"] Sep 17 16:33:58.095989 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:58.095967 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74549fcb54-mqcms"] Sep 17 16:33:59.420550 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:33:59.420513 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ed6e089-ba41-4c13-9746-1eef08c0eb82" path="/var/lib/kubelet/pods/2ed6e089-ba41-4c13-9746-1eef08c0eb82/volumes" Sep 17 16:34:00.931024 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:00.930995 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wzqtc" Sep 17 16:34:07.421202 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:07.421174 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-69dcb7c788-lbhvh" Sep 17 16:34:07.424835 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:07.424811 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-69dcb7c788-lbhvh" Sep 17 16:34:08.273779 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:08.273734 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5bfc76b967-kbsxt" podUID="5d0dd23e-ddba-4506-84a1-5dba2680fd0c" containerName="console" containerID="cri-o://25a628ead1f4f3b2dd1c18216fd57c786395b1f66b9b888e9f2dbacd0ace5350" gracePeriod=15 Sep 17 16:34:08.514747 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:08.514723 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bfc76b967-kbsxt" Sep 17 16:34:08.516764 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:08.516741 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:34:08.560026 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:08.559965 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k48g4\" (UniqueName: \"kubernetes.io/projected/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-kube-api-access-k48g4\") pod \"5d0dd23e-ddba-4506-84a1-5dba2680fd0c\" (UID: \"5d0dd23e-ddba-4506-84a1-5dba2680fd0c\") " Sep 17 16:34:08.560161 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:08.560032 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-service-ca\") pod \"5d0dd23e-ddba-4506-84a1-5dba2680fd0c\" (UID: \"5d0dd23e-ddba-4506-84a1-5dba2680fd0c\") " Sep 17 16:34:08.560161 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:08.560092 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-console-config\") pod \"5d0dd23e-ddba-4506-84a1-5dba2680fd0c\" (UID: \"5d0dd23e-ddba-4506-84a1-5dba2680fd0c\") " Sep 17 16:34:08.560161 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:08.560141 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-oauth-serving-cert\") pod \"5d0dd23e-ddba-4506-84a1-5dba2680fd0c\" (UID: \"5d0dd23e-ddba-4506-84a1-5dba2680fd0c\") " Sep 17 16:34:08.560313 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:08.560167 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-console-serving-cert\") pod \"5d0dd23e-ddba-4506-84a1-5dba2680fd0c\" (UID: \"5d0dd23e-ddba-4506-84a1-5dba2680fd0c\") " Sep 17 16:34:08.560313 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:08.560183 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-console-oauth-config\") pod \"5d0dd23e-ddba-4506-84a1-5dba2680fd0c\" (UID: \"5d0dd23e-ddba-4506-84a1-5dba2680fd0c\") " Sep 17 16:34:08.560550 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:08.560525 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-service-ca" (OuterVolumeSpecName: "service-ca") pod "5d0dd23e-ddba-4506-84a1-5dba2680fd0c" (UID: "5d0dd23e-ddba-4506-84a1-5dba2680fd0c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:34:08.560629 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:08.560546 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-console-config" (OuterVolumeSpecName: "console-config") pod "5d0dd23e-ddba-4506-84a1-5dba2680fd0c" (UID: "5d0dd23e-ddba-4506-84a1-5dba2680fd0c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:34:08.560629 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:08.560567 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5d0dd23e-ddba-4506-84a1-5dba2680fd0c" (UID: "5d0dd23e-ddba-4506-84a1-5dba2680fd0c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:34:08.562381 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:08.562355 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-kube-api-access-k48g4" (OuterVolumeSpecName: "kube-api-access-k48g4") pod "5d0dd23e-ddba-4506-84a1-5dba2680fd0c" (UID: "5d0dd23e-ddba-4506-84a1-5dba2680fd0c"). InnerVolumeSpecName "kube-api-access-k48g4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 16:34:08.562490 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:08.562374 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5d0dd23e-ddba-4506-84a1-5dba2680fd0c" (UID: "5d0dd23e-ddba-4506-84a1-5dba2680fd0c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:34:08.562490 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:08.562464 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5d0dd23e-ddba-4506-84a1-5dba2680fd0c" (UID: "5d0dd23e-ddba-4506-84a1-5dba2680fd0c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:34:08.661195 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:08.661172 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-service-ca\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:08.661195 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:08.661193 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-console-config\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:08.661320 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:08.661201 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-oauth-serving-cert\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:08.661320 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:08.661211 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-console-serving-cert\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:08.661320 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:08.661219 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-console-oauth-config\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:08.661320 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:08.661228 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k48g4\" (UniqueName: \"kubernetes.io/projected/5d0dd23e-ddba-4506-84a1-5dba2680fd0c-kube-api-access-k48g4\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:09.118056 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:09.118024 2581 generic.go:356] "Generic (PLEG): container finished" podID="5d0dd23e-ddba-4506-84a1-5dba2680fd0c" containerID="25a628ead1f4f3b2dd1c18216fd57c786395b1f66b9b888e9f2dbacd0ace5350" exitCode=0 Sep 17 16:34:09.118203 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:09.118073 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bfc76b967-kbsxt" Sep 17 16:34:09.118203 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:09.118073 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bfc76b967-kbsxt" event={"ID":"5d0dd23e-ddba-4506-84a1-5dba2680fd0c","Type":"ContainerDied","Data":"25a628ead1f4f3b2dd1c18216fd57c786395b1f66b9b888e9f2dbacd0ace5350"} Sep 17 16:34:09.118281 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:09.118201 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bfc76b967-kbsxt" event={"ID":"5d0dd23e-ddba-4506-84a1-5dba2680fd0c","Type":"ContainerDied","Data":"9c5cd98a923873f0ced612373900789234bcbbd662bd0cfb3281ad606bd6f547"} Sep 17 16:34:09.118281 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:09.118235 2581 scope.go:117] "RemoveContainer" containerID="25a628ead1f4f3b2dd1c18216fd57c786395b1f66b9b888e9f2dbacd0ace5350" Sep 17 16:34:09.127624 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:09.127606 2581 scope.go:117] "RemoveContainer" containerID="25a628ead1f4f3b2dd1c18216fd57c786395b1f66b9b888e9f2dbacd0ace5350" Sep 17 16:34:09.127862 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:34:09.127840 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25a628ead1f4f3b2dd1c18216fd57c786395b1f66b9b888e9f2dbacd0ace5350\": container with ID starting with 25a628ead1f4f3b2dd1c18216fd57c786395b1f66b9b888e9f2dbacd0ace5350 not found: ID does not exist" containerID="25a628ead1f4f3b2dd1c18216fd57c786395b1f66b9b888e9f2dbacd0ace5350" Sep 17 16:34:09.127931 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:09.127873 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25a628ead1f4f3b2dd1c18216fd57c786395b1f66b9b888e9f2dbacd0ace5350"} err="failed to get container status \"25a628ead1f4f3b2dd1c18216fd57c786395b1f66b9b888e9f2dbacd0ace5350\": rpc error: code = NotFound desc = could not find container \"25a628ead1f4f3b2dd1c18216fd57c786395b1f66b9b888e9f2dbacd0ace5350\": container with ID starting with 25a628ead1f4f3b2dd1c18216fd57c786395b1f66b9b888e9f2dbacd0ace5350 not found: ID does not exist" Sep 17 16:34:09.141045 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:09.141009 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bfc76b967-kbsxt"] Sep 17 16:34:09.143189 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:09.143169 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bfc76b967-kbsxt"] Sep 17 16:34:09.422465 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:09.422367 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d0dd23e-ddba-4506-84a1-5dba2680fd0c" path="/var/lib/kubelet/pods/5d0dd23e-ddba-4506-84a1-5dba2680fd0c/volumes" Sep 17 16:34:09.709066 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:09.709031 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:34:09.785717 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:09.785688 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:34:17.406171 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:17.406135 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:34:17.471923 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:17.471891 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:34:29.566854 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:29.566801 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:29.586736 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:29.586708 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:30.216836 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:30.216809 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:42.113628 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:42.113591 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:34:42.412598 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:42.412504 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:34:43.181294 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:43.181262 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 16:34:43.181698 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:43.181561 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerName="alertmanager" containerID="cri-o://c83364b2286d56ecec3d6c1eecc99d98e701c1acc0579e81010d5a3ea5c711c0" gracePeriod=120 Sep 17 16:34:43.181698 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:43.181609 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerName="kube-rbac-proxy-metric" containerID="cri-o://7c60932f6590f77ef22f5e2a36e948aa5eb892906217b8f9d31aedf2bddbca7d" gracePeriod=120 Sep 17 16:34:43.181698 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:43.181647 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerName="prom-label-proxy" containerID="cri-o://85bdd2d47a5a72832dc117a34c471b4be2dec0d82fd4ba3e8799bd2d984310c6" gracePeriod=120 Sep 17 16:34:43.181925 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:43.181670 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerName="kube-rbac-proxy-web" containerID="cri-o://2ced5b05954603dbf0ec9c2dc28aa63bea08c929f84975afdd687862e0ceb3a9" gracePeriod=120 Sep 17 16:34:43.181925 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:43.181704 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerName="kube-rbac-proxy" containerID="cri-o://95d91743c67fa13b5a1521e074fb94d82ca3b9e0fac741c9f1c809960fe971ce" gracePeriod=120 Sep 17 16:34:43.181925 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:43.181733 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerName="config-reloader" containerID="cri-o://4e9a8c75b426ea719c48528ae88ec314d1e98bd729098f14b50ad8600531252e" gracePeriod=120 Sep 17 16:34:44.260669 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.260637 2581 generic.go:356] "Generic (PLEG): container finished" podID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerID="85bdd2d47a5a72832dc117a34c471b4be2dec0d82fd4ba3e8799bd2d984310c6" exitCode=0 Sep 17 16:34:44.260669 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.260662 2581 generic.go:356] "Generic (PLEG): container finished" podID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerID="7c60932f6590f77ef22f5e2a36e948aa5eb892906217b8f9d31aedf2bddbca7d" exitCode=0 Sep 17 16:34:44.260669 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.260669 2581 generic.go:356] "Generic (PLEG): container finished" podID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerID="95d91743c67fa13b5a1521e074fb94d82ca3b9e0fac741c9f1c809960fe971ce" exitCode=0 Sep 17 16:34:44.260669 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.260675 2581 generic.go:356] "Generic (PLEG): container finished" podID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerID="4e9a8c75b426ea719c48528ae88ec314d1e98bd729098f14b50ad8600531252e" exitCode=0 Sep 17 16:34:44.260669 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.260680 2581 generic.go:356] "Generic (PLEG): container finished" podID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerID="c83364b2286d56ecec3d6c1eecc99d98e701c1acc0579e81010d5a3ea5c711c0" exitCode=0 Sep 17 16:34:44.261147 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.260705 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae856dd9-9b0c-480d-b09e-713a13777da6","Type":"ContainerDied","Data":"85bdd2d47a5a72832dc117a34c471b4be2dec0d82fd4ba3e8799bd2d984310c6"} Sep 17 16:34:44.261147 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.260764 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae856dd9-9b0c-480d-b09e-713a13777da6","Type":"ContainerDied","Data":"7c60932f6590f77ef22f5e2a36e948aa5eb892906217b8f9d31aedf2bddbca7d"} Sep 17 16:34:44.261147 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.260790 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae856dd9-9b0c-480d-b09e-713a13777da6","Type":"ContainerDied","Data":"95d91743c67fa13b5a1521e074fb94d82ca3b9e0fac741c9f1c809960fe971ce"} Sep 17 16:34:44.261147 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.260813 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae856dd9-9b0c-480d-b09e-713a13777da6","Type":"ContainerDied","Data":"4e9a8c75b426ea719c48528ae88ec314d1e98bd729098f14b50ad8600531252e"} Sep 17 16:34:44.261147 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.260836 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae856dd9-9b0c-480d-b09e-713a13777da6","Type":"ContainerDied","Data":"c83364b2286d56ecec3d6c1eecc99d98e701c1acc0579e81010d5a3ea5c711c0"} Sep 17 16:34:44.418862 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.418839 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:44.535400 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.535325 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-cluster-tls-config\") pod \"ae856dd9-9b0c-480d-b09e-713a13777da6\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " Sep 17 16:34:44.535400 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.535382 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae856dd9-9b0c-480d-b09e-713a13777da6-alertmanager-main-db\") pod \"ae856dd9-9b0c-480d-b09e-713a13777da6\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " Sep 17 16:34:44.535624 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.535410 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-web-config\") pod \"ae856dd9-9b0c-480d-b09e-713a13777da6\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " Sep 17 16:34:44.535624 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.535464 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-secret-alertmanager-main-tls\") pod \"ae856dd9-9b0c-480d-b09e-713a13777da6\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " Sep 17 16:34:44.535624 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.535493 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae856dd9-9b0c-480d-b09e-713a13777da6-alertmanager-trusted-ca-bundle\") pod \"ae856dd9-9b0c-480d-b09e-713a13777da6\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " Sep 17 16:34:44.535624 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.535524 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-secret-alertmanager-kube-rbac-proxy-web\") pod \"ae856dd9-9b0c-480d-b09e-713a13777da6\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " Sep 17 16:34:44.535624 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.535549 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae856dd9-9b0c-480d-b09e-713a13777da6-config-out\") pod \"ae856dd9-9b0c-480d-b09e-713a13777da6\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " Sep 17 16:34:44.535624 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.535578 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-config-volume\") pod \"ae856dd9-9b0c-480d-b09e-713a13777da6\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " Sep 17 16:34:44.535624 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.535618 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae856dd9-9b0c-480d-b09e-713a13777da6-tls-assets\") pod \"ae856dd9-9b0c-480d-b09e-713a13777da6\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " Sep 17 16:34:44.535985 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.535643 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ae856dd9-9b0c-480d-b09e-713a13777da6\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " Sep 17 16:34:44.535985 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.535670 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4zjb\" (UniqueName: \"kubernetes.io/projected/ae856dd9-9b0c-480d-b09e-713a13777da6-kube-api-access-k4zjb\") pod \"ae856dd9-9b0c-480d-b09e-713a13777da6\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " Sep 17 16:34:44.535985 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.535720 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-secret-alertmanager-kube-rbac-proxy\") pod \"ae856dd9-9b0c-480d-b09e-713a13777da6\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " Sep 17 16:34:44.535985 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.535729 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae856dd9-9b0c-480d-b09e-713a13777da6-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ae856dd9-9b0c-480d-b09e-713a13777da6" (UID: "ae856dd9-9b0c-480d-b09e-713a13777da6"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 16:34:44.535985 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.535744 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae856dd9-9b0c-480d-b09e-713a13777da6-metrics-client-ca\") pod \"ae856dd9-9b0c-480d-b09e-713a13777da6\" (UID: \"ae856dd9-9b0c-480d-b09e-713a13777da6\") " Sep 17 16:34:44.535985 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.535940 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae856dd9-9b0c-480d-b09e-713a13777da6-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ae856dd9-9b0c-480d-b09e-713a13777da6" (UID: "ae856dd9-9b0c-480d-b09e-713a13777da6"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:34:44.536526 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.536253 2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae856dd9-9b0c-480d-b09e-713a13777da6-alertmanager-main-db\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:44.536526 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.536280 2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae856dd9-9b0c-480d-b09e-713a13777da6-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:44.537046 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.536742 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae856dd9-9b0c-480d-b09e-713a13777da6-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ae856dd9-9b0c-480d-b09e-713a13777da6" (UID: "ae856dd9-9b0c-480d-b09e-713a13777da6"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:34:44.539005 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.538970 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae856dd9-9b0c-480d-b09e-713a13777da6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ae856dd9-9b0c-480d-b09e-713a13777da6" (UID: "ae856dd9-9b0c-480d-b09e-713a13777da6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 16:34:44.539207 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.539152 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ae856dd9-9b0c-480d-b09e-713a13777da6" (UID: "ae856dd9-9b0c-480d-b09e-713a13777da6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:34:44.539460 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.539375 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-config-volume" (OuterVolumeSpecName: "config-volume") pod "ae856dd9-9b0c-480d-b09e-713a13777da6" (UID: "ae856dd9-9b0c-480d-b09e-713a13777da6"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:34:44.539566 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.539538 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ae856dd9-9b0c-480d-b09e-713a13777da6" (UID: "ae856dd9-9b0c-480d-b09e-713a13777da6"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:34:44.539663 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.539644 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae856dd9-9b0c-480d-b09e-713a13777da6-config-out" (OuterVolumeSpecName: "config-out") pod "ae856dd9-9b0c-480d-b09e-713a13777da6" (UID: "ae856dd9-9b0c-480d-b09e-713a13777da6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 16:34:44.539716 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.539667 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ae856dd9-9b0c-480d-b09e-713a13777da6" (UID: "ae856dd9-9b0c-480d-b09e-713a13777da6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:34:44.541617 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.541590 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae856dd9-9b0c-480d-b09e-713a13777da6-kube-api-access-k4zjb" (OuterVolumeSpecName: "kube-api-access-k4zjb") pod "ae856dd9-9b0c-480d-b09e-713a13777da6" (UID: "ae856dd9-9b0c-480d-b09e-713a13777da6"). InnerVolumeSpecName "kube-api-access-k4zjb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 16:34:44.541694 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.541646 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ae856dd9-9b0c-480d-b09e-713a13777da6" (UID: "ae856dd9-9b0c-480d-b09e-713a13777da6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:34:44.543320 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.543295 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ae856dd9-9b0c-480d-b09e-713a13777da6" (UID: "ae856dd9-9b0c-480d-b09e-713a13777da6"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:34:44.550163 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.550143 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-web-config" (OuterVolumeSpecName: "web-config") pod "ae856dd9-9b0c-480d-b09e-713a13777da6" (UID: "ae856dd9-9b0c-480d-b09e-713a13777da6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:34:44.637060 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.637031 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-web-config\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:44.637060 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.637054 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-secret-alertmanager-main-tls\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:44.637291 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.637073 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:44.637291 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.637084 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae856dd9-9b0c-480d-b09e-713a13777da6-config-out\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:44.637291 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.637094 2581 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-config-volume\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:44.637291 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.637101 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae856dd9-9b0c-480d-b09e-713a13777da6-tls-assets\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:44.637291 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.637109 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:44.637291 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.637118 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4zjb\" (UniqueName: \"kubernetes.io/projected/ae856dd9-9b0c-480d-b09e-713a13777da6-kube-api-access-k4zjb\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:44.637291 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.637126 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:44.637291 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.637133 2581 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae856dd9-9b0c-480d-b09e-713a13777da6-metrics-client-ca\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:44.637291 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:44.637141 2581 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae856dd9-9b0c-480d-b09e-713a13777da6-cluster-tls-config\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:45.267996 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.267960 2581 generic.go:356] "Generic (PLEG): container finished" podID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerID="2ced5b05954603dbf0ec9c2dc28aa63bea08c929f84975afdd687862e0ceb3a9" exitCode=0 Sep 17 16:34:45.267996 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.268000 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae856dd9-9b0c-480d-b09e-713a13777da6","Type":"ContainerDied","Data":"2ced5b05954603dbf0ec9c2dc28aa63bea08c929f84975afdd687862e0ceb3a9"} Sep 17 16:34:45.268425 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.268032 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.268425 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.268057 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae856dd9-9b0c-480d-b09e-713a13777da6","Type":"ContainerDied","Data":"694edade9c818940906578730716d7d4dcdc0a42a88b6427d8ca1c2fbf381758"} Sep 17 16:34:45.268425 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.268072 2581 scope.go:117] "RemoveContainer" containerID="85bdd2d47a5a72832dc117a34c471b4be2dec0d82fd4ba3e8799bd2d984310c6" Sep 17 16:34:45.282517 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.282498 2581 scope.go:117] "RemoveContainer" containerID="7c60932f6590f77ef22f5e2a36e948aa5eb892906217b8f9d31aedf2bddbca7d" Sep 17 16:34:45.290011 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.289996 2581 scope.go:117] "RemoveContainer" containerID="95d91743c67fa13b5a1521e074fb94d82ca3b9e0fac741c9f1c809960fe971ce" Sep 17 16:34:45.296726 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.296709 2581 scope.go:117] "RemoveContainer" containerID="2ced5b05954603dbf0ec9c2dc28aa63bea08c929f84975afdd687862e0ceb3a9" Sep 17 16:34:45.298816 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.298794 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 16:34:45.303922 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.303905 2581 scope.go:117] "RemoveContainer" containerID="4e9a8c75b426ea719c48528ae88ec314d1e98bd729098f14b50ad8600531252e" Sep 17 16:34:45.308309 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.308284 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 16:34:45.311703 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.311681 2581 scope.go:117] "RemoveContainer" containerID="c83364b2286d56ecec3d6c1eecc99d98e701c1acc0579e81010d5a3ea5c711c0" Sep 17 16:34:45.318512 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.318488 2581 scope.go:117] "RemoveContainer" containerID="4872cbddbce4dff8013c446cd67551852e0b09f1ec83a7b2ce9893c54da8d1f8" Sep 17 16:34:45.325156 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.325140 2581 scope.go:117] "RemoveContainer" containerID="85bdd2d47a5a72832dc117a34c471b4be2dec0d82fd4ba3e8799bd2d984310c6" Sep 17 16:34:45.325398 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:34:45.325381 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85bdd2d47a5a72832dc117a34c471b4be2dec0d82fd4ba3e8799bd2d984310c6\": container with ID starting with 85bdd2d47a5a72832dc117a34c471b4be2dec0d82fd4ba3e8799bd2d984310c6 not found: ID does not exist" containerID="85bdd2d47a5a72832dc117a34c471b4be2dec0d82fd4ba3e8799bd2d984310c6" Sep 17 16:34:45.325476 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.325406 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85bdd2d47a5a72832dc117a34c471b4be2dec0d82fd4ba3e8799bd2d984310c6"} err="failed to get container status \"85bdd2d47a5a72832dc117a34c471b4be2dec0d82fd4ba3e8799bd2d984310c6\": rpc error: code = NotFound desc = could not find container \"85bdd2d47a5a72832dc117a34c471b4be2dec0d82fd4ba3e8799bd2d984310c6\": container with ID starting with 85bdd2d47a5a72832dc117a34c471b4be2dec0d82fd4ba3e8799bd2d984310c6 not found: ID does not exist" Sep 17 16:34:45.325476 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.325422 2581 scope.go:117] "RemoveContainer" containerID="7c60932f6590f77ef22f5e2a36e948aa5eb892906217b8f9d31aedf2bddbca7d" Sep 17 16:34:45.325694 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:34:45.325675 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c60932f6590f77ef22f5e2a36e948aa5eb892906217b8f9d31aedf2bddbca7d\": container with ID starting with 7c60932f6590f77ef22f5e2a36e948aa5eb892906217b8f9d31aedf2bddbca7d not found: ID does not exist" containerID="7c60932f6590f77ef22f5e2a36e948aa5eb892906217b8f9d31aedf2bddbca7d" Sep 17 16:34:45.325737 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.325698 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c60932f6590f77ef22f5e2a36e948aa5eb892906217b8f9d31aedf2bddbca7d"} err="failed to get container status \"7c60932f6590f77ef22f5e2a36e948aa5eb892906217b8f9d31aedf2bddbca7d\": rpc error: code = NotFound desc = could not find container \"7c60932f6590f77ef22f5e2a36e948aa5eb892906217b8f9d31aedf2bddbca7d\": container with ID starting with 7c60932f6590f77ef22f5e2a36e948aa5eb892906217b8f9d31aedf2bddbca7d not found: ID does not exist" Sep 17 16:34:45.325737 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.325710 2581 scope.go:117] "RemoveContainer" containerID="95d91743c67fa13b5a1521e074fb94d82ca3b9e0fac741c9f1c809960fe971ce" Sep 17 16:34:45.325941 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:34:45.325925 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95d91743c67fa13b5a1521e074fb94d82ca3b9e0fac741c9f1c809960fe971ce\": container with ID starting with 95d91743c67fa13b5a1521e074fb94d82ca3b9e0fac741c9f1c809960fe971ce not found: ID does not exist" containerID="95d91743c67fa13b5a1521e074fb94d82ca3b9e0fac741c9f1c809960fe971ce" Sep 17 16:34:45.325980 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.325944 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95d91743c67fa13b5a1521e074fb94d82ca3b9e0fac741c9f1c809960fe971ce"} err="failed to get container status \"95d91743c67fa13b5a1521e074fb94d82ca3b9e0fac741c9f1c809960fe971ce\": rpc error: code = NotFound desc = could not find container \"95d91743c67fa13b5a1521e074fb94d82ca3b9e0fac741c9f1c809960fe971ce\": container with ID starting with 95d91743c67fa13b5a1521e074fb94d82ca3b9e0fac741c9f1c809960fe971ce not found: ID does not exist" Sep 17 16:34:45.325980 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.325956 2581 scope.go:117] "RemoveContainer" containerID="2ced5b05954603dbf0ec9c2dc28aa63bea08c929f84975afdd687862e0ceb3a9" Sep 17 16:34:45.326177 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:34:45.326160 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ced5b05954603dbf0ec9c2dc28aa63bea08c929f84975afdd687862e0ceb3a9\": container with ID starting with 2ced5b05954603dbf0ec9c2dc28aa63bea08c929f84975afdd687862e0ceb3a9 not found: ID does not exist" containerID="2ced5b05954603dbf0ec9c2dc28aa63bea08c929f84975afdd687862e0ceb3a9" Sep 17 16:34:45.326226 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.326178 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ced5b05954603dbf0ec9c2dc28aa63bea08c929f84975afdd687862e0ceb3a9"} err="failed to get container status \"2ced5b05954603dbf0ec9c2dc28aa63bea08c929f84975afdd687862e0ceb3a9\": rpc error: code = NotFound desc = could not find container \"2ced5b05954603dbf0ec9c2dc28aa63bea08c929f84975afdd687862e0ceb3a9\": container with ID starting with 2ced5b05954603dbf0ec9c2dc28aa63bea08c929f84975afdd687862e0ceb3a9 not found: ID does not exist" Sep 17 16:34:45.326226 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.326189 2581 scope.go:117] "RemoveContainer" containerID="4e9a8c75b426ea719c48528ae88ec314d1e98bd729098f14b50ad8600531252e" Sep 17 16:34:45.326378 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:34:45.326363 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e9a8c75b426ea719c48528ae88ec314d1e98bd729098f14b50ad8600531252e\": container with ID starting with 4e9a8c75b426ea719c48528ae88ec314d1e98bd729098f14b50ad8600531252e not found: ID does not exist" containerID="4e9a8c75b426ea719c48528ae88ec314d1e98bd729098f14b50ad8600531252e" Sep 17 16:34:45.326417 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.326381 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e9a8c75b426ea719c48528ae88ec314d1e98bd729098f14b50ad8600531252e"} err="failed to get container status \"4e9a8c75b426ea719c48528ae88ec314d1e98bd729098f14b50ad8600531252e\": rpc error: code = NotFound desc = could not find container \"4e9a8c75b426ea719c48528ae88ec314d1e98bd729098f14b50ad8600531252e\": container with ID starting with 4e9a8c75b426ea719c48528ae88ec314d1e98bd729098f14b50ad8600531252e not found: ID does not exist" Sep 17 16:34:45.326417 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.326391 2581 scope.go:117] "RemoveContainer" containerID="c83364b2286d56ecec3d6c1eecc99d98e701c1acc0579e81010d5a3ea5c711c0" Sep 17 16:34:45.326626 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:34:45.326611 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c83364b2286d56ecec3d6c1eecc99d98e701c1acc0579e81010d5a3ea5c711c0\": container with ID starting with c83364b2286d56ecec3d6c1eecc99d98e701c1acc0579e81010d5a3ea5c711c0 not found: ID does not exist" containerID="c83364b2286d56ecec3d6c1eecc99d98e701c1acc0579e81010d5a3ea5c711c0" Sep 17 16:34:45.326664 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.326629 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c83364b2286d56ecec3d6c1eecc99d98e701c1acc0579e81010d5a3ea5c711c0"} err="failed to get container status \"c83364b2286d56ecec3d6c1eecc99d98e701c1acc0579e81010d5a3ea5c711c0\": rpc error: code = NotFound desc = could not find container \"c83364b2286d56ecec3d6c1eecc99d98e701c1acc0579e81010d5a3ea5c711c0\": container with ID starting with c83364b2286d56ecec3d6c1eecc99d98e701c1acc0579e81010d5a3ea5c711c0 not found: ID does not exist" Sep 17 16:34:45.326664 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.326640 2581 scope.go:117] "RemoveContainer" containerID="4872cbddbce4dff8013c446cd67551852e0b09f1ec83a7b2ce9893c54da8d1f8" Sep 17 16:34:45.326831 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:34:45.326817 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4872cbddbce4dff8013c446cd67551852e0b09f1ec83a7b2ce9893c54da8d1f8\": container with ID starting with 4872cbddbce4dff8013c446cd67551852e0b09f1ec83a7b2ce9893c54da8d1f8 not found: ID does not exist" containerID="4872cbddbce4dff8013c446cd67551852e0b09f1ec83a7b2ce9893c54da8d1f8" Sep 17 16:34:45.326866 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.326834 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4872cbddbce4dff8013c446cd67551852e0b09f1ec83a7b2ce9893c54da8d1f8"} err="failed to get container status \"4872cbddbce4dff8013c446cd67551852e0b09f1ec83a7b2ce9893c54da8d1f8\": rpc error: code = NotFound desc = could not find container \"4872cbddbce4dff8013c446cd67551852e0b09f1ec83a7b2ce9893c54da8d1f8\": container with ID starting with 4872cbddbce4dff8013c446cd67551852e0b09f1ec83a7b2ce9893c54da8d1f8 not found: ID does not exist" Sep 17 16:34:45.377769 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.377649 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 16:34:45.378017 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.378002 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerName="kube-rbac-proxy-web" Sep 17 16:34:45.378074 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.378019 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerName="kube-rbac-proxy-web" Sep 17 16:34:45.378074 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.378033 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerName="config-reloader" Sep 17 16:34:45.378074 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.378038 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerName="config-reloader" Sep 17 16:34:45.378074 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.378050 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerName="init-config-reloader" Sep 17 16:34:45.378074 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.378055 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerName="init-config-reloader" Sep 17 16:34:45.378074 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.378063 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerName="kube-rbac-proxy" Sep 17 16:34:45.378074 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.378069 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerName="kube-rbac-proxy" Sep 17 16:34:45.378274 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.378078 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerName="prom-label-proxy" Sep 17 16:34:45.378274 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.378083 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerName="prom-label-proxy" Sep 17 16:34:45.378274 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.378091 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ed6e089-ba41-4c13-9746-1eef08c0eb82" containerName="console" Sep 17 16:34:45.378274 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.378096 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ed6e089-ba41-4c13-9746-1eef08c0eb82" containerName="console" Sep 17 16:34:45.378274 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.378103 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerName="alertmanager" Sep 17 16:34:45.378274 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.378107 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerName="alertmanager" Sep 17 16:34:45.378274 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.378113 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerName="kube-rbac-proxy-metric" Sep 17 16:34:45.378274 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.378119 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerName="kube-rbac-proxy-metric" Sep 17 16:34:45.378274 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.378127 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d0dd23e-ddba-4506-84a1-5dba2680fd0c" containerName="console" Sep 17 16:34:45.378274 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.378131 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d0dd23e-ddba-4506-84a1-5dba2680fd0c" containerName="console" Sep 17 16:34:45.378274 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.378176 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d0dd23e-ddba-4506-84a1-5dba2680fd0c" containerName="console" Sep 17 16:34:45.378274 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.378184 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerName="kube-rbac-proxy-metric" Sep 17 16:34:45.378274 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.378191 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ed6e089-ba41-4c13-9746-1eef08c0eb82" containerName="console" Sep 17 16:34:45.378274 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.378197 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerName="kube-rbac-proxy" Sep 17 16:34:45.378274 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.378202 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerName="kube-rbac-proxy-web" Sep 17 16:34:45.378274 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.378209 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerName="alertmanager" Sep 17 16:34:45.378274 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.378215 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerName="config-reloader" Sep 17 16:34:45.378274 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.378220 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae856dd9-9b0c-480d-b09e-713a13777da6" containerName="prom-label-proxy" Sep 17 16:34:45.381914 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.381894 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.386078 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.386061 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 17 16:34:45.386163 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.386065 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 17 16:34:45.386306 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.386291 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 17 16:34:45.390060 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.390043 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 17 16:34:45.390152 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.390062 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 17 16:34:45.390152 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.390071 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 17 16:34:45.390152 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.390097 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 17 16:34:45.390400 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.390385 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 17 16:34:45.390548 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.390530 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gq4z9\"" Sep 17 16:34:45.401073 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.401049 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 17 16:34:45.419966 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.419945 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae856dd9-9b0c-480d-b09e-713a13777da6" path="/var/lib/kubelet/pods/ae856dd9-9b0c-480d-b09e-713a13777da6/volumes" Sep 17 16:34:45.420423 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.420410 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 16:34:45.444842 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.444821 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2639d60-1228-489e-9498-87d02432432d-config-out\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.444918 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.444850 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c2639d60-1228-489e-9498-87d02432432d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.444918 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.444872 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2639d60-1228-489e-9498-87d02432432d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.444918 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.444912 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2639d60-1228-489e-9498-87d02432432d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.445052 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.444939 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c2639d60-1228-489e-9498-87d02432432d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.445052 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.444971 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2639d60-1228-489e-9498-87d02432432d-web-config\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.445052 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.444996 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c2639d60-1228-489e-9498-87d02432432d-config-volume\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.445052 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.445012 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2639d60-1228-489e-9498-87d02432432d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.445052 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.445025 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c2639d60-1228-489e-9498-87d02432432d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.445052 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.445039 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c2639d60-1228-489e-9498-87d02432432d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.445262 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.445095 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2639d60-1228-489e-9498-87d02432432d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.445262 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.445135 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2639d60-1228-489e-9498-87d02432432d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.445262 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.445153 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smbqk\" (UniqueName: \"kubernetes.io/projected/c2639d60-1228-489e-9498-87d02432432d-kube-api-access-smbqk\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.545713 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.545659 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smbqk\" (UniqueName: \"kubernetes.io/projected/c2639d60-1228-489e-9498-87d02432432d-kube-api-access-smbqk\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.545713 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.545688 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2639d60-1228-489e-9498-87d02432432d-config-out\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.545836 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.545712 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c2639d60-1228-489e-9498-87d02432432d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.545836 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.545734 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2639d60-1228-489e-9498-87d02432432d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.545836 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.545762 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2639d60-1228-489e-9498-87d02432432d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.545946 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.545868 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c2639d60-1228-489e-9498-87d02432432d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.545946 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.545927 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2639d60-1228-489e-9498-87d02432432d-web-config\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.546038 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.545966 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c2639d60-1228-489e-9498-87d02432432d-config-volume\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.546038 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.545993 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2639d60-1228-489e-9498-87d02432432d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.546038 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.546016 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c2639d60-1228-489e-9498-87d02432432d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.546191 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.546041 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c2639d60-1228-489e-9498-87d02432432d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.546191 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.546096 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2639d60-1228-489e-9498-87d02432432d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.546191 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.546150 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2639d60-1228-489e-9498-87d02432432d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.546339 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.546220 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c2639d60-1228-489e-9498-87d02432432d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.546528 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.546507 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2639d60-1228-489e-9498-87d02432432d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.547758 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.547629 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2639d60-1228-489e-9498-87d02432432d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.549199 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.549131 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c2639d60-1228-489e-9498-87d02432432d-config-volume\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.549199 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.549166 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2639d60-1228-489e-9498-87d02432432d-config-out\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.549360 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.549269 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c2639d60-1228-489e-9498-87d02432432d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.549360 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.549350 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c2639d60-1228-489e-9498-87d02432432d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.549645 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.549621 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2639d60-1228-489e-9498-87d02432432d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.549856 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.549837 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2639d60-1228-489e-9498-87d02432432d-web-config\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.550055 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.550041 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c2639d60-1228-489e-9498-87d02432432d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.550249 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.550230 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2639d60-1228-489e-9498-87d02432432d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.550600 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.550585 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2639d60-1228-489e-9498-87d02432432d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.556184 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.556165 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smbqk\" (UniqueName: \"kubernetes.io/projected/c2639d60-1228-489e-9498-87d02432432d-kube-api-access-smbqk\") pod \"alertmanager-main-0\" (UID: \"c2639d60-1228-489e-9498-87d02432432d\") " pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.691053 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.691029 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 17 16:34:45.973272 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:45.973248 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 17 16:34:45.975415 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:34:45.975392 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2639d60_1228_489e_9498_87d02432432d.slice/crio-caba4a1700535e04b13016c07054943aa004bfd6c2b257e4a8be985a04777f3d WatchSource:0}: Error finding container caba4a1700535e04b13016c07054943aa004bfd6c2b257e4a8be985a04777f3d: Status 404 returned error can't find the container with id caba4a1700535e04b13016c07054943aa004bfd6c2b257e4a8be985a04777f3d Sep 17 16:34:46.274774 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:46.274707 2581 generic.go:356] "Generic (PLEG): container finished" podID="c2639d60-1228-489e-9498-87d02432432d" containerID="41a2e1739a09d10adb4cd5b9c98745c68a26550ceaf7459e1423ab8717bd2db1" exitCode=0 Sep 17 16:34:46.274774 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:46.274745 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2639d60-1228-489e-9498-87d02432432d","Type":"ContainerDied","Data":"41a2e1739a09d10adb4cd5b9c98745c68a26550ceaf7459e1423ab8717bd2db1"} Sep 17 16:34:46.275125 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:46.274799 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2639d60-1228-489e-9498-87d02432432d","Type":"ContainerStarted","Data":"caba4a1700535e04b13016c07054943aa004bfd6c2b257e4a8be985a04777f3d"} Sep 17 16:34:47.284520 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.284482 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2639d60-1228-489e-9498-87d02432432d","Type":"ContainerStarted","Data":"a6a748c6062cd89a19cfed66b663930456e5ebb357b279476d9bf706656b3214"} Sep 17 16:34:47.284952 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.284572 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2639d60-1228-489e-9498-87d02432432d","Type":"ContainerStarted","Data":"ebbc506b6c9c52c08f673d51098e95b6d7b3a6ce4fe1390762ec5b71d939e738"} Sep 17 16:34:47.284952 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.284613 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2639d60-1228-489e-9498-87d02432432d","Type":"ContainerStarted","Data":"7529803c40c3d636b6ec64ef59b5e8890965878a11963b93fd6839f1fce0de7d"} Sep 17 16:34:47.284952 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.284649 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2639d60-1228-489e-9498-87d02432432d","Type":"ContainerStarted","Data":"074e89400218d0d5158830de847933f2cbbca2099b97e24107d8769363c740b2"} Sep 17 16:34:47.284952 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.284687 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2639d60-1228-489e-9498-87d02432432d","Type":"ContainerStarted","Data":"853dc76448b0dd75737197097fafad1155fd30465a35a6a56ee863afa55f5b74"} Sep 17 16:34:47.284952 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.284722 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2639d60-1228-489e-9498-87d02432432d","Type":"ContainerStarted","Data":"9c4be3d6c3fb1badd302704237053cd67d2079a845cedc1b7c3d8c9804f563c3"} Sep 17 16:34:47.324726 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.324677 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.309728661 podStartE2EDuration="2.324660737s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.932076ms" isStatefulPod=false podCreationTimestamp="2026-09-17 16:34:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:34:47.321901903 +0000 UTC m=+152.054369478" watchObservedRunningTime="2026-09-17 16:34:47.324660737 +0000 UTC m=+152.057128312" Sep 17 16:34:47.559159 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.559063 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 16:34:47.559470 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.559418 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerName="prometheus" containerID="cri-o://92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798" gracePeriod=600 Sep 17 16:34:47.559825 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.559796 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerName="kube-rbac-proxy-thanos" containerID="cri-o://18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56" gracePeriod=600 Sep 17 16:34:47.559954 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.559909 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerName="kube-rbac-proxy" containerID="cri-o://6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b" gracePeriod=600 Sep 17 16:34:47.560013 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.559981 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerName="kube-rbac-proxy-web" containerID="cri-o://6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b" gracePeriod=600 Sep 17 16:34:47.560075 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.560057 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerName="thanos-sidecar" containerID="cri-o://c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562" gracePeriod=600 Sep 17 16:34:47.560157 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.560116 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerName="config-reloader" containerID="cri-o://90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd" gracePeriod=600 Sep 17 16:34:47.810712 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.810658 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:47.966963 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.966925 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/467243c1-82c9-4d62-8645-a5abe8b2dc30-tls-assets\") pod \"467243c1-82c9-4d62-8645-a5abe8b2dc30\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " Sep 17 16:34:47.967146 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.966981 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-prometheus-k8s-tls\") pod \"467243c1-82c9-4d62-8645-a5abe8b2dc30\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " Sep 17 16:34:47.967146 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.967008 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/467243c1-82c9-4d62-8645-a5abe8b2dc30-prometheus-k8s-db\") pod \"467243c1-82c9-4d62-8645-a5abe8b2dc30\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " Sep 17 16:34:47.967146 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.967048 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/467243c1-82c9-4d62-8645-a5abe8b2dc30-config-out\") pod \"467243c1-82c9-4d62-8645-a5abe8b2dc30\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " Sep 17 16:34:47.967146 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.967074 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-prometheus-k8s-rulefiles-0\") pod \"467243c1-82c9-4d62-8645-a5abe8b2dc30\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " Sep 17 16:34:47.967146 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.967125 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-web-config\") pod \"467243c1-82c9-4d62-8645-a5abe8b2dc30\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " Sep 17 16:34:47.967383 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.967154 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-configmap-serving-certs-ca-bundle\") pod \"467243c1-82c9-4d62-8645-a5abe8b2dc30\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " Sep 17 16:34:47.967383 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.967180 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-prometheus-trusted-ca-bundle\") pod \"467243c1-82c9-4d62-8645-a5abe8b2dc30\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " Sep 17 16:34:47.967383 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.967222 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-prometheus-k8s-rulefiles-1\") pod \"467243c1-82c9-4d62-8645-a5abe8b2dc30\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " Sep 17 16:34:47.967383 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.967257 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfznn\" (UniqueName: \"kubernetes.io/projected/467243c1-82c9-4d62-8645-a5abe8b2dc30-kube-api-access-bfznn\") pod \"467243c1-82c9-4d62-8645-a5abe8b2dc30\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " Sep 17 16:34:47.967383 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.967285 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"467243c1-82c9-4d62-8645-a5abe8b2dc30\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " Sep 17 16:34:47.967383 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.967316 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-thanos-prometheus-http-client-file\") pod \"467243c1-82c9-4d62-8645-a5abe8b2dc30\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " Sep 17 16:34:47.967383 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.967348 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-metrics-client-certs\") pod \"467243c1-82c9-4d62-8645-a5abe8b2dc30\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " Sep 17 16:34:47.967383 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.967380 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-config\") pod \"467243c1-82c9-4d62-8645-a5abe8b2dc30\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " Sep 17 16:34:47.967784 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.967410 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"467243c1-82c9-4d62-8645-a5abe8b2dc30\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " Sep 17 16:34:47.967784 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.967469 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-prometheus-k8s-rulefiles-2\") pod \"467243c1-82c9-4d62-8645-a5abe8b2dc30\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " Sep 17 16:34:47.967784 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.967513 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-grpc-tls\") pod \"467243c1-82c9-4d62-8645-a5abe8b2dc30\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " Sep 17 16:34:47.967784 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.967536 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-configmap-metrics-client-ca\") pod \"467243c1-82c9-4d62-8645-a5abe8b2dc30\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " Sep 17 16:34:47.967784 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.967568 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-kube-rbac-proxy\") pod \"467243c1-82c9-4d62-8645-a5abe8b2dc30\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " Sep 17 16:34:47.967784 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.967592 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-configmap-kubelet-serving-ca-bundle\") pod \"467243c1-82c9-4d62-8645-a5abe8b2dc30\" (UID: \"467243c1-82c9-4d62-8645-a5abe8b2dc30\") " Sep 17 16:34:47.968151 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.968122 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "467243c1-82c9-4d62-8645-a5abe8b2dc30" (UID: "467243c1-82c9-4d62-8645-a5abe8b2dc30"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:34:47.968772 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.968463 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "467243c1-82c9-4d62-8645-a5abe8b2dc30" (UID: "467243c1-82c9-4d62-8645-a5abe8b2dc30"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:34:47.969077 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.969031 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "467243c1-82c9-4d62-8645-a5abe8b2dc30" (UID: "467243c1-82c9-4d62-8645-a5abe8b2dc30"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:34:47.969401 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.969374 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/467243c1-82c9-4d62-8645-a5abe8b2dc30-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "467243c1-82c9-4d62-8645-a5abe8b2dc30" (UID: "467243c1-82c9-4d62-8645-a5abe8b2dc30"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 16:34:47.969743 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.969717 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "467243c1-82c9-4d62-8645-a5abe8b2dc30" (UID: "467243c1-82c9-4d62-8645-a5abe8b2dc30"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:34:47.969978 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.969954 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "467243c1-82c9-4d62-8645-a5abe8b2dc30" (UID: "467243c1-82c9-4d62-8645-a5abe8b2dc30"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:34:47.970542 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.970259 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/467243c1-82c9-4d62-8645-a5abe8b2dc30-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "467243c1-82c9-4d62-8645-a5abe8b2dc30" (UID: "467243c1-82c9-4d62-8645-a5abe8b2dc30"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 16:34:47.970542 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.970335 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "467243c1-82c9-4d62-8645-a5abe8b2dc30" (UID: "467243c1-82c9-4d62-8645-a5abe8b2dc30"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:34:47.970745 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.970347 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "467243c1-82c9-4d62-8645-a5abe8b2dc30" (UID: "467243c1-82c9-4d62-8645-a5abe8b2dc30"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:34:47.971780 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.971752 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "467243c1-82c9-4d62-8645-a5abe8b2dc30" (UID: "467243c1-82c9-4d62-8645-a5abe8b2dc30"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:34:47.972099 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.972062 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-config" (OuterVolumeSpecName: "config") pod "467243c1-82c9-4d62-8645-a5abe8b2dc30" (UID: "467243c1-82c9-4d62-8645-a5abe8b2dc30"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:34:47.972482 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.972446 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "467243c1-82c9-4d62-8645-a5abe8b2dc30" (UID: "467243c1-82c9-4d62-8645-a5abe8b2dc30"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:34:47.972838 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.972806 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "467243c1-82c9-4d62-8645-a5abe8b2dc30" (UID: "467243c1-82c9-4d62-8645-a5abe8b2dc30"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:34:47.973278 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.973258 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "467243c1-82c9-4d62-8645-a5abe8b2dc30" (UID: "467243c1-82c9-4d62-8645-a5abe8b2dc30"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:34:47.973465 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.973424 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "467243c1-82c9-4d62-8645-a5abe8b2dc30" (UID: "467243c1-82c9-4d62-8645-a5abe8b2dc30"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:34:47.973853 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.973835 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/467243c1-82c9-4d62-8645-a5abe8b2dc30-kube-api-access-bfznn" (OuterVolumeSpecName: "kube-api-access-bfznn") pod "467243c1-82c9-4d62-8645-a5abe8b2dc30" (UID: "467243c1-82c9-4d62-8645-a5abe8b2dc30"). InnerVolumeSpecName "kube-api-access-bfznn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 16:34:47.973920 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.973860 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/467243c1-82c9-4d62-8645-a5abe8b2dc30-config-out" (OuterVolumeSpecName: "config-out") pod "467243c1-82c9-4d62-8645-a5abe8b2dc30" (UID: "467243c1-82c9-4d62-8645-a5abe8b2dc30"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 16:34:47.974186 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.974167 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "467243c1-82c9-4d62-8645-a5abe8b2dc30" (UID: "467243c1-82c9-4d62-8645-a5abe8b2dc30"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:34:47.974549 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.974531 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "467243c1-82c9-4d62-8645-a5abe8b2dc30" (UID: "467243c1-82c9-4d62-8645-a5abe8b2dc30"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:34:47.984345 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:47.984326 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-web-config" (OuterVolumeSpecName: "web-config") pod "467243c1-82c9-4d62-8645-a5abe8b2dc30" (UID: "467243c1-82c9-4d62-8645-a5abe8b2dc30"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 16:34:48.068805 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.068757 2581 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-config\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:48.068805 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.068777 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:48.068805 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.068788 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:48.068805 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.068797 2581 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-grpc-tls\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:48.068805 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.068806 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-configmap-metrics-client-ca\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:48.068990 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.068815 2581 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-kube-rbac-proxy\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:48.068990 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.068823 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:48.068990 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.068831 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/467243c1-82c9-4d62-8645-a5abe8b2dc30-tls-assets\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:48.068990 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.068840 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:48.068990 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.068848 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/467243c1-82c9-4d62-8645-a5abe8b2dc30-prometheus-k8s-db\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:48.068990 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.068855 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/467243c1-82c9-4d62-8645-a5abe8b2dc30-config-out\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:48.068990 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.068862 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:48.068990 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.068870 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-web-config\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:48.068990 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.068878 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:48.068990 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.068885 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:48.068990 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.068892 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/467243c1-82c9-4d62-8645-a5abe8b2dc30-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:48.068990 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.068900 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfznn\" (UniqueName: \"kubernetes.io/projected/467243c1-82c9-4d62-8645-a5abe8b2dc30-kube-api-access-bfznn\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:48.068990 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.068908 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:48.068990 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.068916 2581 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:48.068990 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.068924 2581 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/467243c1-82c9-4d62-8645-a5abe8b2dc30-secret-metrics-client-certs\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:34:48.291848 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.291820 2581 generic.go:356] "Generic (PLEG): container finished" podID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerID="18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56" exitCode=0 Sep 17 16:34:48.291848 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.291845 2581 generic.go:356] "Generic (PLEG): container finished" podID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerID="6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b" exitCode=0 Sep 17 16:34:48.291848 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.291852 2581 generic.go:356] "Generic (PLEG): container finished" podID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerID="6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b" exitCode=0 Sep 17 16:34:48.292299 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.291857 2581 generic.go:356] "Generic (PLEG): container finished" podID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerID="c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562" exitCode=0 Sep 17 16:34:48.292299 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.291863 2581 generic.go:356] "Generic (PLEG): container finished" podID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerID="90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd" exitCode=0 Sep 17 16:34:48.292299 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.291868 2581 generic.go:356] "Generic (PLEG): container finished" podID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerID="92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798" exitCode=0 Sep 17 16:34:48.292299 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.291889 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.292299 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.291902 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"467243c1-82c9-4d62-8645-a5abe8b2dc30","Type":"ContainerDied","Data":"18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56"} Sep 17 16:34:48.292299 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.291995 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"467243c1-82c9-4d62-8645-a5abe8b2dc30","Type":"ContainerDied","Data":"6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b"} Sep 17 16:34:48.292299 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.292018 2581 scope.go:117] "RemoveContainer" containerID="18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56" Sep 17 16:34:48.292299 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.292038 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"467243c1-82c9-4d62-8645-a5abe8b2dc30","Type":"ContainerDied","Data":"6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b"} Sep 17 16:34:48.292299 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.292081 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"467243c1-82c9-4d62-8645-a5abe8b2dc30","Type":"ContainerDied","Data":"c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562"} Sep 17 16:34:48.292299 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.292123 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"467243c1-82c9-4d62-8645-a5abe8b2dc30","Type":"ContainerDied","Data":"90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd"} Sep 17 16:34:48.292299 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.292161 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"467243c1-82c9-4d62-8645-a5abe8b2dc30","Type":"ContainerDied","Data":"92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798"} Sep 17 16:34:48.292299 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.292201 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"467243c1-82c9-4d62-8645-a5abe8b2dc30","Type":"ContainerDied","Data":"41c3146320b0aecde74d670300e31e3a785b3197bac51ff9a4fe0333c4f8b2d1"} Sep 17 16:34:48.300479 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.300461 2581 scope.go:117] "RemoveContainer" containerID="6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b" Sep 17 16:34:48.307317 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.307295 2581 scope.go:117] "RemoveContainer" containerID="6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b" Sep 17 16:34:48.313779 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.313765 2581 scope.go:117] "RemoveContainer" containerID="c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562" Sep 17 16:34:48.318192 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.318174 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 16:34:48.320978 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.320962 2581 scope.go:117] "RemoveContainer" containerID="90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd" Sep 17 16:34:48.328306 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.328289 2581 scope.go:117] "RemoveContainer" containerID="92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798" Sep 17 16:34:48.328592 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.328576 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 16:34:48.335226 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.335210 2581 scope.go:117] "RemoveContainer" containerID="15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676" Sep 17 16:34:48.341878 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.341862 2581 scope.go:117] "RemoveContainer" containerID="18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56" Sep 17 16:34:48.342148 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:34:48.342115 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56\": container with ID starting with 18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56 not found: ID does not exist" containerID="18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56" Sep 17 16:34:48.342189 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.342155 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56"} err="failed to get container status \"18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56\": rpc error: code = NotFound desc = could not find container \"18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56\": container with ID starting with 18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56 not found: ID does not exist" Sep 17 16:34:48.342189 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.342174 2581 scope.go:117] "RemoveContainer" containerID="6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b" Sep 17 16:34:48.342397 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:34:48.342380 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b\": container with ID starting with 6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b not found: ID does not exist" containerID="6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b" Sep 17 16:34:48.342453 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.342402 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b"} err="failed to get container status \"6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b\": rpc error: code = NotFound desc = could not find container \"6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b\": container with ID starting with 6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b not found: ID does not exist" Sep 17 16:34:48.342453 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.342414 2581 scope.go:117] "RemoveContainer" containerID="6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b" Sep 17 16:34:48.342705 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:34:48.342691 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b\": container with ID starting with 6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b not found: ID does not exist" containerID="6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b" Sep 17 16:34:48.342740 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.342708 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b"} err="failed to get container status \"6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b\": rpc error: code = NotFound desc = could not find container \"6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b\": container with ID starting with 6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b not found: ID does not exist" Sep 17 16:34:48.342740 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.342720 2581 scope.go:117] "RemoveContainer" containerID="c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562" Sep 17 16:34:48.342928 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:34:48.342912 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562\": container with ID starting with c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562 not found: ID does not exist" containerID="c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562" Sep 17 16:34:48.342976 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.342931 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562"} err="failed to get container status \"c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562\": rpc error: code = NotFound desc = could not find container \"c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562\": container with ID starting with c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562 not found: ID does not exist" Sep 17 16:34:48.342976 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.342944 2581 scope.go:117] "RemoveContainer" containerID="90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd" Sep 17 16:34:48.343202 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:34:48.343185 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd\": container with ID starting with 90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd not found: ID does not exist" containerID="90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd" Sep 17 16:34:48.343312 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.343211 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd"} err="failed to get container status \"90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd\": rpc error: code = NotFound desc = could not find container \"90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd\": container with ID starting with 90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd not found: ID does not exist" Sep 17 16:34:48.343312 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.343231 2581 scope.go:117] "RemoveContainer" containerID="92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798" Sep 17 16:34:48.343518 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:34:48.343502 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798\": container with ID starting with 92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798 not found: ID does not exist" containerID="92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798" Sep 17 16:34:48.343563 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.343523 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798"} err="failed to get container status \"92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798\": rpc error: code = NotFound desc = could not find container \"92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798\": container with ID starting with 92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798 not found: ID does not exist" Sep 17 16:34:48.343563 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.343538 2581 scope.go:117] "RemoveContainer" containerID="15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676" Sep 17 16:34:48.343768 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:34:48.343751 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676\": container with ID starting with 15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676 not found: ID does not exist" containerID="15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676" Sep 17 16:34:48.343832 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.343777 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676"} err="failed to get container status \"15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676\": rpc error: code = NotFound desc = could not find container \"15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676\": container with ID starting with 15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676 not found: ID does not exist" Sep 17 16:34:48.343832 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.343796 2581 scope.go:117] "RemoveContainer" containerID="18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56" Sep 17 16:34:48.344049 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.344031 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56"} err="failed to get container status \"18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56\": rpc error: code = NotFound desc = could not find container \"18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56\": container with ID starting with 18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56 not found: ID does not exist" Sep 17 16:34:48.344087 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.344051 2581 scope.go:117] "RemoveContainer" containerID="6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b" Sep 17 16:34:48.344275 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.344258 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b"} err="failed to get container status \"6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b\": rpc error: code = NotFound desc = could not find container \"6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b\": container with ID starting with 6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b not found: ID does not exist" Sep 17 16:34:48.344342 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.344277 2581 scope.go:117] "RemoveContainer" containerID="6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b" Sep 17 16:34:48.344518 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.344503 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b"} err="failed to get container status \"6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b\": rpc error: code = NotFound desc = could not find container \"6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b\": container with ID starting with 6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b not found: ID does not exist" Sep 17 16:34:48.344569 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.344521 2581 scope.go:117] "RemoveContainer" containerID="c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562" Sep 17 16:34:48.344726 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.344708 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562"} err="failed to get container status \"c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562\": rpc error: code = NotFound desc = could not find container \"c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562\": container with ID starting with c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562 not found: ID does not exist" Sep 17 16:34:48.344786 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.344727 2581 scope.go:117] "RemoveContainer" containerID="90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd" Sep 17 16:34:48.344948 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.344929 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd"} err="failed to get container status \"90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd\": rpc error: code = NotFound desc = could not find container \"90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd\": container with ID starting with 90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd not found: ID does not exist" Sep 17 16:34:48.344990 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.344949 2581 scope.go:117] "RemoveContainer" containerID="92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798" Sep 17 16:34:48.345158 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.345141 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798"} err="failed to get container status \"92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798\": rpc error: code = NotFound desc = could not find container \"92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798\": container with ID starting with 92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798 not found: ID does not exist" Sep 17 16:34:48.345218 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.345159 2581 scope.go:117] "RemoveContainer" containerID="15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676" Sep 17 16:34:48.345375 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.345355 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676"} err="failed to get container status \"15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676\": rpc error: code = NotFound desc = could not find container \"15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676\": container with ID starting with 15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676 not found: ID does not exist" Sep 17 16:34:48.345419 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.345377 2581 scope.go:117] "RemoveContainer" containerID="18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56" Sep 17 16:34:48.345599 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.345583 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56"} err="failed to get container status \"18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56\": rpc error: code = NotFound desc = could not find container \"18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56\": container with ID starting with 18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56 not found: ID does not exist" Sep 17 16:34:48.345599 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.345599 2581 scope.go:117] "RemoveContainer" containerID="6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b" Sep 17 16:34:48.345809 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.345793 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b"} err="failed to get container status \"6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b\": rpc error: code = NotFound desc = could not find container \"6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b\": container with ID starting with 6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b not found: ID does not exist" Sep 17 16:34:48.345874 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.345811 2581 scope.go:117] "RemoveContainer" containerID="6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b" Sep 17 16:34:48.346061 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.346045 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b"} err="failed to get container status \"6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b\": rpc error: code = NotFound desc = could not find container \"6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b\": container with ID starting with 6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b not found: ID does not exist" Sep 17 16:34:48.346109 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.346061 2581 scope.go:117] "RemoveContainer" containerID="c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562" Sep 17 16:34:48.346249 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.346232 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562"} err="failed to get container status \"c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562\": rpc error: code = NotFound desc = could not find container \"c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562\": container with ID starting with c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562 not found: ID does not exist" Sep 17 16:34:48.346307 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.346250 2581 scope.go:117] "RemoveContainer" containerID="90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd" Sep 17 16:34:48.346582 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.346564 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd"} err="failed to get container status \"90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd\": rpc error: code = NotFound desc = could not find container \"90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd\": container with ID starting with 90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd not found: ID does not exist" Sep 17 16:34:48.346636 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.346583 2581 scope.go:117] "RemoveContainer" containerID="92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798" Sep 17 16:34:48.346768 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.346753 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798"} err="failed to get container status \"92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798\": rpc error: code = NotFound desc = could not find container \"92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798\": container with ID starting with 92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798 not found: ID does not exist" Sep 17 16:34:48.346812 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.346768 2581 scope.go:117] "RemoveContainer" containerID="15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676" Sep 17 16:34:48.346960 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.346941 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676"} err="failed to get container status \"15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676\": rpc error: code = NotFound desc = could not find container \"15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676\": container with ID starting with 15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676 not found: ID does not exist" Sep 17 16:34:48.346997 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.346961 2581 scope.go:117] "RemoveContainer" containerID="18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56" Sep 17 16:34:48.347181 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.347164 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56"} err="failed to get container status \"18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56\": rpc error: code = NotFound desc = could not find container \"18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56\": container with ID starting with 18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56 not found: ID does not exist" Sep 17 16:34:48.347217 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.347182 2581 scope.go:117] "RemoveContainer" containerID="6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b" Sep 17 16:34:48.347370 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.347350 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b"} err="failed to get container status \"6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b\": rpc error: code = NotFound desc = could not find container \"6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b\": container with ID starting with 6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b not found: ID does not exist" Sep 17 16:34:48.347411 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.347369 2581 scope.go:117] "RemoveContainer" containerID="6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b" Sep 17 16:34:48.347603 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.347582 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b"} err="failed to get container status \"6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b\": rpc error: code = NotFound desc = could not find container \"6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b\": container with ID starting with 6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b not found: ID does not exist" Sep 17 16:34:48.347642 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.347604 2581 scope.go:117] "RemoveContainer" containerID="c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562" Sep 17 16:34:48.347820 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.347801 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562"} err="failed to get container status \"c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562\": rpc error: code = NotFound desc = could not find container \"c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562\": container with ID starting with c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562 not found: ID does not exist" Sep 17 16:34:48.347857 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.347822 2581 scope.go:117] "RemoveContainer" containerID="90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd" Sep 17 16:34:48.348032 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.348014 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd"} err="failed to get container status \"90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd\": rpc error: code = NotFound desc = could not find container \"90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd\": container with ID starting with 90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd not found: ID does not exist" Sep 17 16:34:48.348073 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.348032 2581 scope.go:117] "RemoveContainer" containerID="92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798" Sep 17 16:34:48.348261 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.348244 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798"} err="failed to get container status \"92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798\": rpc error: code = NotFound desc = could not find container \"92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798\": container with ID starting with 92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798 not found: ID does not exist" Sep 17 16:34:48.348302 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.348262 2581 scope.go:117] "RemoveContainer" containerID="15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676" Sep 17 16:34:48.348508 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.348489 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676"} err="failed to get container status \"15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676\": rpc error: code = NotFound desc = could not find container \"15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676\": container with ID starting with 15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676 not found: ID does not exist" Sep 17 16:34:48.348569 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.348509 2581 scope.go:117] "RemoveContainer" containerID="18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56" Sep 17 16:34:48.348736 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.348715 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56"} err="failed to get container status \"18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56\": rpc error: code = NotFound desc = could not find container \"18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56\": container with ID starting with 18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56 not found: ID does not exist" Sep 17 16:34:48.348788 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.348738 2581 scope.go:117] "RemoveContainer" containerID="6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b" Sep 17 16:34:48.348963 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.348947 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b"} err="failed to get container status \"6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b\": rpc error: code = NotFound desc = could not find container \"6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b\": container with ID starting with 6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b not found: ID does not exist" Sep 17 16:34:48.349033 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.348964 2581 scope.go:117] "RemoveContainer" containerID="6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b" Sep 17 16:34:48.349207 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.349187 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b"} err="failed to get container status \"6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b\": rpc error: code = NotFound desc = could not find container \"6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b\": container with ID starting with 6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b not found: ID does not exist" Sep 17 16:34:48.349267 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.349209 2581 scope.go:117] "RemoveContainer" containerID="c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562" Sep 17 16:34:48.349424 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.349408 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562"} err="failed to get container status \"c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562\": rpc error: code = NotFound desc = could not find container \"c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562\": container with ID starting with c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562 not found: ID does not exist" Sep 17 16:34:48.349478 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.349425 2581 scope.go:117] "RemoveContainer" containerID="90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd" Sep 17 16:34:48.349670 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.349654 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd"} err="failed to get container status \"90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd\": rpc error: code = NotFound desc = could not find container \"90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd\": container with ID starting with 90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd not found: ID does not exist" Sep 17 16:34:48.349714 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.349670 2581 scope.go:117] "RemoveContainer" containerID="92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798" Sep 17 16:34:48.349886 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.349866 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798"} err="failed to get container status \"92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798\": rpc error: code = NotFound desc = could not find container \"92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798\": container with ID starting with 92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798 not found: ID does not exist" Sep 17 16:34:48.349959 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.349889 2581 scope.go:117] "RemoveContainer" containerID="15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676" Sep 17 16:34:48.350141 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.350126 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676"} err="failed to get container status \"15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676\": rpc error: code = NotFound desc = could not find container \"15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676\": container with ID starting with 15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676 not found: ID does not exist" Sep 17 16:34:48.350183 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.350142 2581 scope.go:117] "RemoveContainer" containerID="18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56" Sep 17 16:34:48.350329 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.350313 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56"} err="failed to get container status \"18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56\": rpc error: code = NotFound desc = could not find container \"18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56\": container with ID starting with 18f2772c9c0b30d14f493010c9a72296f3127c1c9ae38edbc646059718fdba56 not found: ID does not exist" Sep 17 16:34:48.350388 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.350331 2581 scope.go:117] "RemoveContainer" containerID="6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b" Sep 17 16:34:48.350590 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.350573 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b"} err="failed to get container status \"6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b\": rpc error: code = NotFound desc = could not find container \"6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b\": container with ID starting with 6f1661ae8801223cd2b5303607ce38ba09c645ca0de1bec05fa598b4a4a96b9b not found: ID does not exist" Sep 17 16:34:48.350633 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.350591 2581 scope.go:117] "RemoveContainer" containerID="6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b" Sep 17 16:34:48.350832 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.350812 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b"} err="failed to get container status \"6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b\": rpc error: code = NotFound desc = could not find container \"6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b\": container with ID starting with 6b3121627a1e2ba4342f838221eee73c507fba0f11820eb30e5b8dbab4d7579b not found: ID does not exist" Sep 17 16:34:48.350884 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.350833 2581 scope.go:117] "RemoveContainer" containerID="c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562" Sep 17 16:34:48.351093 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.351072 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562"} err="failed to get container status \"c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562\": rpc error: code = NotFound desc = could not find container \"c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562\": container with ID starting with c559830bc7406d78b4b376518bd56ff3e53cc26131e18c62d74db5819fa1d562 not found: ID does not exist" Sep 17 16:34:48.351093 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.351093 2581 scope.go:117] "RemoveContainer" containerID="90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd" Sep 17 16:34:48.351319 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.351300 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd"} err="failed to get container status \"90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd\": rpc error: code = NotFound desc = could not find container \"90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd\": container with ID starting with 90d9d742110b6d123410dbcea1526b6b3f5bf99c4680319af7e6bea48ba5bfcd not found: ID does not exist" Sep 17 16:34:48.351319 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.351319 2581 scope.go:117] "RemoveContainer" containerID="92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798" Sep 17 16:34:48.351620 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.351583 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798"} err="failed to get container status \"92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798\": rpc error: code = NotFound desc = could not find container \"92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798\": container with ID starting with 92b07dbe20ac601db5aaf39bf64660a8be4dd6a45ff771fbd99883d98bc53798 not found: ID does not exist" Sep 17 16:34:48.351620 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.351612 2581 scope.go:117] "RemoveContainer" containerID="15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676" Sep 17 16:34:48.351904 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.351879 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676"} err="failed to get container status \"15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676\": rpc error: code = NotFound desc = could not find container \"15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676\": container with ID starting with 15a476e633d7981923994fa980fb76c9a06d056b9f12b72c17222202cf052676 not found: ID does not exist" Sep 17 16:34:48.365456 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.362412 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 16:34:48.365456 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.363090 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerName="kube-rbac-proxy" Sep 17 16:34:48.365456 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.363108 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerName="kube-rbac-proxy" Sep 17 16:34:48.365456 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.363130 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerName="kube-rbac-proxy-thanos" Sep 17 16:34:48.365456 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.363139 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerName="kube-rbac-proxy-thanos" Sep 17 16:34:48.365456 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.363168 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerName="kube-rbac-proxy-web" Sep 17 16:34:48.365456 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.363177 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerName="kube-rbac-proxy-web" Sep 17 16:34:48.365456 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.363205 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerName="thanos-sidecar" Sep 17 16:34:48.365456 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.363213 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerName="thanos-sidecar" Sep 17 16:34:48.365456 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.363237 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerName="prometheus" Sep 17 16:34:48.365456 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.363245 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerName="prometheus" Sep 17 16:34:48.365456 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.363265 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerName="config-reloader" Sep 17 16:34:48.365456 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.363273 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerName="config-reloader" Sep 17 16:34:48.365456 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.363289 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerName="init-config-reloader" Sep 17 16:34:48.365456 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.363298 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerName="init-config-reloader" Sep 17 16:34:48.365456 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.363422 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerName="thanos-sidecar" Sep 17 16:34:48.365456 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.363462 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerName="kube-rbac-proxy" Sep 17 16:34:48.365456 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.363473 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerName="prometheus" Sep 17 16:34:48.365456 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.363488 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerName="config-reloader" Sep 17 16:34:48.365456 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.363498 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerName="kube-rbac-proxy-thanos" Sep 17 16:34:48.365456 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.363506 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="467243c1-82c9-4d62-8645-a5abe8b2dc30" containerName="kube-rbac-proxy-web" Sep 17 16:34:48.368954 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.368934 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.371608 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.371591 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 17 16:34:48.371706 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.371656 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 17 16:34:48.371706 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.371674 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 17 16:34:48.371869 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.371851 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 17 16:34:48.372005 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.371904 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 17 16:34:48.372214 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.372192 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 17 16:34:48.372293 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.372210 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 17 16:34:48.372600 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.372581 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 17 16:34:48.372704 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.372583 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 17 16:34:48.372816 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.372798 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 17 16:34:48.372895 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.372867 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 17 16:34:48.372895 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.372867 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-88ocsv5594tlc\"" Sep 17 16:34:48.373006 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.372918 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-4l4wg\"" Sep 17 16:34:48.373006 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.372958 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 17 16:34:48.376050 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.375830 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 17 16:34:48.379708 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.379688 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 17 16:34:48.391377 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.391358 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 16:34:48.472323 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.472298 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htzp7\" (UniqueName: \"kubernetes.io/projected/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-kube-api-access-htzp7\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.472467 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.472328 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.472467 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.472348 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.472467 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.472387 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.472467 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.472422 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.472467 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.472463 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.472670 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.472480 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-web-config\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.472670 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.472502 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-config\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.472670 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.472531 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-config-out\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.472670 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.472549 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.472670 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.472562 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.472670 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.472585 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.472670 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.472600 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.472670 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.472614 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.472670 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.472636 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.472670 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.472650 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.472670 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.472666 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.473052 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.472685 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.473052 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.472752 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.473052 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.472800 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.574047 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.573987 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.574047 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.574023 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.574047 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.574042 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.574237 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.574060 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.574237 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.574085 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.574237 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.574128 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.574237 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.574164 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htzp7\" (UniqueName: \"kubernetes.io/projected/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-kube-api-access-htzp7\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.574237 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.574189 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.574237 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.574220 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.574514 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.574251 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.574514 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.574285 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.574514 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.574308 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.574514 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.574329 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-web-config\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.574514 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.574355 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-config\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.574514 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.574375 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-config-out\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.574514 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.574399 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.574514 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.574421 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.574514 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.574500 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.574947 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.574532 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.574947 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.574560 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.574947 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.574707 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.575755 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.575100 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.575755 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.575298 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.575755 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.575705 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.576079 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.576048 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.576144 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.576094 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.577205 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.577158 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.578021 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.577953 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.578296 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.578276 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-web-config\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.578516 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.578491 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.579349 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.579305 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-config-out\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.579606 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.579583 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.579606 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.579598 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.579743 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.579702 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.579920 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.579887 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.580175 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.580147 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.580310 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.580196 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.580401 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.580380 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.580836 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.580818 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-config\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.583557 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.583539 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htzp7\" (UniqueName: \"kubernetes.io/projected/5bf2e9d3-30af-4267-88f7-67d7546dbb0c-kube-api-access-htzp7\") pod \"prometheus-k8s-0\" (UID: \"5bf2e9d3-30af-4267-88f7-67d7546dbb0c\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.678814 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.678792 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:34:48.961209 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:48.961180 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 17 16:34:48.963796 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:34:48.963768 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bf2e9d3_30af_4267_88f7_67d7546dbb0c.slice/crio-105715d72607446f749cd5c97fda0931854508a74b58d74b93baa90b214a75b3 WatchSource:0}: Error finding container 105715d72607446f749cd5c97fda0931854508a74b58d74b93baa90b214a75b3: Status 404 returned error can't find the container with id 105715d72607446f749cd5c97fda0931854508a74b58d74b93baa90b214a75b3 Sep 17 16:34:49.298379 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:49.298316 2581 generic.go:356] "Generic (PLEG): container finished" podID="5bf2e9d3-30af-4267-88f7-67d7546dbb0c" containerID="ae9520fd18dfcd82833731b0106539a77a207d9f8141cd5d4634e012c402be60" exitCode=0 Sep 17 16:34:49.298786 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:49.298406 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bf2e9d3-30af-4267-88f7-67d7546dbb0c","Type":"ContainerDied","Data":"ae9520fd18dfcd82833731b0106539a77a207d9f8141cd5d4634e012c402be60"} Sep 17 16:34:49.298786 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:49.298500 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bf2e9d3-30af-4267-88f7-67d7546dbb0c","Type":"ContainerStarted","Data":"105715d72607446f749cd5c97fda0931854508a74b58d74b93baa90b214a75b3"} Sep 17 16:34:49.424146 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:49.424109 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="467243c1-82c9-4d62-8645-a5abe8b2dc30" path="/var/lib/kubelet/pods/467243c1-82c9-4d62-8645-a5abe8b2dc30/volumes" Sep 17 16:34:50.307510 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:50.307475 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bf2e9d3-30af-4267-88f7-67d7546dbb0c","Type":"ContainerStarted","Data":"f968febe54765048d8bb2433b6767bc6d90e0462a518c53f7b3af94ebd1c2d49"} Sep 17 16:34:50.307908 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:50.307541 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bf2e9d3-30af-4267-88f7-67d7546dbb0c","Type":"ContainerStarted","Data":"ca89bc05ad965958b4dccbaaba7adbe0dc5fbf89dd7220d581f742c1602f3942"} Sep 17 16:34:50.307908 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:50.307573 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bf2e9d3-30af-4267-88f7-67d7546dbb0c","Type":"ContainerStarted","Data":"ba5171fa4e055e4b709d4184e7ff2d69b9a4fb406de619517377a6753a67c874"} Sep 17 16:34:50.307908 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:50.307596 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bf2e9d3-30af-4267-88f7-67d7546dbb0c","Type":"ContainerStarted","Data":"c1b18243376dec93b471b73c8dc8fcc865305d1347e6c061fee805b289f5ac37"} Sep 17 16:34:50.307908 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:50.307620 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bf2e9d3-30af-4267-88f7-67d7546dbb0c","Type":"ContainerStarted","Data":"0071d05a4b5f0097649fc0ddafcc552b2faab5e569f59e9537d7607e1f996517"} Sep 17 16:34:50.307908 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:50.307646 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5bf2e9d3-30af-4267-88f7-67d7546dbb0c","Type":"ContainerStarted","Data":"c688f83ed1032ce53477750e116f5d8ca90a1b9c5fc28d30040b3ca3f7918743"} Sep 17 16:34:50.340875 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:50.340819 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.320209937 podStartE2EDuration="2.340803426s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.593489ms" isStatefulPod=false podCreationTimestamp="2026-09-17 16:34:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:34:50.338953365 +0000 UTC m=+155.071420978" watchObservedRunningTime="2026-09-17 16:34:50.340803426 +0000 UTC m=+155.073271005" Sep 17 16:34:51.622393 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:51.622356 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:34:51.696239 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:51.696208 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:34:53.679238 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:34:53.679205 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:35:02.631634 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:35:02.631535 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:35:02.694156 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:35:02.694123 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:35:02.758916 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:35:02.758880 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:35:13.303464 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:35:13.303394 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:35:21.993264 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:35:21.993235 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:35:22.054689 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:35:22.054643 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:35:48.678945 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:35:48.678908 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:35:48.694772 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:35:48.694749 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:35:49.570464 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:35:49.570414 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 17 16:35:57.402015 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:35:57.401949 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:35:57.469794 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:35:57.469765 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:36:01.927136 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:36:01.927082 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:36:02.027131 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:36:02.027101 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:36:09.480042 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:36:09.480012 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:36:09.576905 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:36:09.576850 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:36:12.888845 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:36:12.888808 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:36:12.985270 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:36:12.985185 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:36:13.058203 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:36:13.058169 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:36:23.702325 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:36:23.702277 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:36:24.679987 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:36:24.679955 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:36:24.783668 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:36:24.783627 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:36:41.134952 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:36:41.134857 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:37:17.295265 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:37:17.295236 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jflqj_d6b66e55-13f3-43a0-9c6f-ed705c42995d/ovn-acl-logging/0.log" Sep 17 16:37:17.296888 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:37:17.296860 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jflqj_d6b66e55-13f3-43a0-9c6f-ed705c42995d/ovn-acl-logging/0.log" Sep 17 16:37:17.303843 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:37:17.303824 2581 kubelet.go:1648] "Image garbage collection succeeded" Sep 17 16:38:25.896221 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:38:25.896190 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:38:27.102998 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:38:27.102962 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:38:34.427362 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:38:34.427321 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:38:34.484525 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:38:34.484487 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:38:36.396741 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:38:36.396707 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:38:36.497343 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:38:36.497312 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:38:36.560907 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:38:36.560874 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:39:24.381271 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:39:24.381239 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:39:56.946954 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:39:56.946923 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:39:57.005839 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:39:57.005809 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:40:03.314300 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:40:03.314270 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:40:03.412248 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:40:03.412216 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:40:09.008604 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:40:09.008572 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:40:09.289084 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:40:09.289005 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:40:09.497906 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:40:09.497872 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:40:09.568888 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:40:09.568815 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:40:10.079629 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:40:10.079595 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:40:10.187494 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:40:10.187362 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:40:10.387859 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:40:10.387771 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:40:10.586933 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:40:10.586897 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:40:10.687243 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:40:10.687146 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:40:10.787807 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:40:10.787778 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:40:10.862129 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:40:10.862101 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:40:17.328416 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:40:17.328386 2581 scope.go:117] "RemoveContainer" containerID="95f670e7ed2b0639a16a0eb1953def12ddd62fcad2ddf8d7bfe92de49b40f493" Sep 17 16:41:04.052615 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:04.052572 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:41:04.165587 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:04.165555 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:41:15.261664 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:15.261630 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:41:16.148723 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:16.148694 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:41:18.917887 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:18.917852 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:41:19.021050 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:19.021012 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:41:19.113050 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:19.113004 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:41:21.205935 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:21.205904 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:41:21.314977 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:21.314931 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:41:21.326055 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:21.326026 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-8h6vk"] Sep 17 16:41:21.329162 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:21.329148 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-8h6vk" Sep 17 16:41:21.331557 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:21.331530 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 17 16:41:21.331691 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:21.331675 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 17 16:41:21.341575 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:21.341553 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-8h6vk"] Sep 17 16:41:21.406412 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:21.406387 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfe26020-b375-45f4-b293-6bb128ac068a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-8h6vk\" (UID: \"cfe26020-b375-45f4-b293-6bb128ac068a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-8h6vk" Sep 17 16:41:21.406525 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:21.406472 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58r57\" (UniqueName: \"kubernetes.io/projected/cfe26020-b375-45f4-b293-6bb128ac068a-kube-api-access-58r57\") pod \"cert-manager-webhook-6486ffd997-8h6vk\" (UID: \"cfe26020-b375-45f4-b293-6bb128ac068a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-8h6vk" Sep 17 16:41:21.507674 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:21.507615 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58r57\" (UniqueName: \"kubernetes.io/projected/cfe26020-b375-45f4-b293-6bb128ac068a-kube-api-access-58r57\") pod \"cert-manager-webhook-6486ffd997-8h6vk\" (UID: \"cfe26020-b375-45f4-b293-6bb128ac068a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-8h6vk" Sep 17 16:41:21.507674 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:21.507661 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfe26020-b375-45f4-b293-6bb128ac068a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-8h6vk\" (UID: \"cfe26020-b375-45f4-b293-6bb128ac068a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-8h6vk" Sep 17 16:41:21.521797 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:21.521776 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfe26020-b375-45f4-b293-6bb128ac068a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-8h6vk\" (UID: \"cfe26020-b375-45f4-b293-6bb128ac068a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-8h6vk" Sep 17 16:41:21.521984 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:21.521963 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58r57\" (UniqueName: \"kubernetes.io/projected/cfe26020-b375-45f4-b293-6bb128ac068a-kube-api-access-58r57\") pod \"cert-manager-webhook-6486ffd997-8h6vk\" (UID: \"cfe26020-b375-45f4-b293-6bb128ac068a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-8h6vk" Sep 17 16:41:21.655210 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:21.655187 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-8h6vk" Sep 17 16:41:21.928580 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:21.928554 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-8h6vk"] Sep 17 16:41:21.930456 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:41:21.930398 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcfe26020_b375_45f4_b293_6bb128ac068a.slice/crio-5cd085697a9e630485cb87cea84d5da986e2177b03155927b404c30cc3165a24 WatchSource:0}: Error finding container 5cd085697a9e630485cb87cea84d5da986e2177b03155927b404c30cc3165a24: Status 404 returned error can't find the container with id 5cd085697a9e630485cb87cea84d5da986e2177b03155927b404c30cc3165a24 Sep 17 16:41:21.932282 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:21.932265 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 16:41:22.868161 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:22.868119 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-8h6vk" event={"ID":"cfe26020-b375-45f4-b293-6bb128ac068a","Type":"ContainerStarted","Data":"5cd085697a9e630485cb87cea84d5da986e2177b03155927b404c30cc3165a24"} Sep 17 16:41:23.421404 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:23.421375 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:41:23.628244 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:23.628168 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:41:23.868919 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:23.868882 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:41:23.969313 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:23.969282 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:41:24.100310 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:24.100276 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nzkdf"] Sep 17 16:41:24.103898 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:24.103876 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nzkdf" Sep 17 16:41:24.106173 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:24.106154 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-l8tcq\"" Sep 17 16:41:24.117127 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:24.117105 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nzkdf"] Sep 17 16:41:24.233245 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:24.233213 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dca04d09-96fa-419b-8123-bf51aedc326f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nzkdf\" (UID: \"dca04d09-96fa-419b-8123-bf51aedc326f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nzkdf" Sep 17 16:41:24.233409 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:24.233329 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lghk\" (UniqueName: \"kubernetes.io/projected/dca04d09-96fa-419b-8123-bf51aedc326f-kube-api-access-9lghk\") pod \"cert-manager-cainjector-559cdd8c87-nzkdf\" (UID: \"dca04d09-96fa-419b-8123-bf51aedc326f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nzkdf" Sep 17 16:41:24.334320 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:24.334275 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dca04d09-96fa-419b-8123-bf51aedc326f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nzkdf\" (UID: \"dca04d09-96fa-419b-8123-bf51aedc326f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nzkdf" Sep 17 16:41:24.334528 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:24.334397 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lghk\" (UniqueName: \"kubernetes.io/projected/dca04d09-96fa-419b-8123-bf51aedc326f-kube-api-access-9lghk\") pod \"cert-manager-cainjector-559cdd8c87-nzkdf\" (UID: \"dca04d09-96fa-419b-8123-bf51aedc326f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nzkdf" Sep 17 16:41:24.345230 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:24.345202 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lghk\" (UniqueName: \"kubernetes.io/projected/dca04d09-96fa-419b-8123-bf51aedc326f-kube-api-access-9lghk\") pod \"cert-manager-cainjector-559cdd8c87-nzkdf\" (UID: \"dca04d09-96fa-419b-8123-bf51aedc326f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nzkdf" Sep 17 16:41:24.346785 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:24.346761 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dca04d09-96fa-419b-8123-bf51aedc326f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nzkdf\" (UID: \"dca04d09-96fa-419b-8123-bf51aedc326f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nzkdf" Sep 17 16:41:24.414501 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:24.414468 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nzkdf" Sep 17 16:41:25.140563 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:25.140538 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nzkdf"] Sep 17 16:41:25.142970 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:41:25.142941 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddca04d09_96fa_419b_8123_bf51aedc326f.slice/crio-3f73cea8538bd66caa9b7e80a94b0e524e8674890baf0d7757476eee2aff6d92 WatchSource:0}: Error finding container 3f73cea8538bd66caa9b7e80a94b0e524e8674890baf0d7757476eee2aff6d92: Status 404 returned error can't find the container with id 3f73cea8538bd66caa9b7e80a94b0e524e8674890baf0d7757476eee2aff6d92 Sep 17 16:41:25.537146 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:25.537113 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:41:25.638920 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:25.638888 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:41:25.747620 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:25.747581 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:41:25.883253 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:25.883155 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nzkdf" event={"ID":"dca04d09-96fa-419b-8123-bf51aedc326f","Type":"ContainerStarted","Data":"8610de08a9c13f22103b3ad5656ff16d4b665c3ab5365fa3b89e16e4a260f141"} Sep 17 16:41:25.883253 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:25.883209 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nzkdf" event={"ID":"dca04d09-96fa-419b-8123-bf51aedc326f","Type":"ContainerStarted","Data":"3f73cea8538bd66caa9b7e80a94b0e524e8674890baf0d7757476eee2aff6d92"} Sep 17 16:41:25.884809 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:25.884780 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-8h6vk" event={"ID":"cfe26020-b375-45f4-b293-6bb128ac068a","Type":"ContainerStarted","Data":"33a603ff53617ea2bc0821c0e4c02f24d88307649748121df74c421a4f8141f1"} Sep 17 16:41:25.884932 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:25.884887 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-8h6vk" Sep 17 16:41:25.905800 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:25.905750 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nzkdf" podStartSLOduration=1.905736068 podStartE2EDuration="1.905736068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:41:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:41:25.904485018 +0000 UTC m=+550.636952596" watchObservedRunningTime="2026-09-17 16:41:25.905736068 +0000 UTC m=+550.638203648" Sep 17 16:41:25.931064 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:25.931020 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-8h6vk" podStartSLOduration=1.932222184 podStartE2EDuration="4.931003808s" totalImagesPullingTime="2.998781624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:41:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:41:25.928961328 +0000 UTC m=+550.661428906" watchObservedRunningTime="2026-09-17 16:41:25.931003808 +0000 UTC m=+550.663471387" Sep 17 16:41:29.833919 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:29.833880 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:41:31.624051 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:31.624020 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:41:31.890157 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:31.890089 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-8h6vk" Sep 17 16:41:39.163842 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:39.163808 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:41:39.263758 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:39.263732 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:41:40.996617 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:40.996589 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m72zg"] Sep 17 16:41:41.002784 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:41.002764 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m72zg" Sep 17 16:41:41.005079 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:41.005059 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 17 16:41:41.005775 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:41.005756 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 17 16:41:41.005874 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:41.005759 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-gdbcm\"" Sep 17 16:41:41.012419 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:41.012396 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m72zg"] Sep 17 16:41:41.162405 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:41.162376 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74a0e409-0f01-4cf3-8238-b54ba5938108-tmp\") pod \"openshift-lws-operator-fd8ccff4c-m72zg\" (UID: \"74a0e409-0f01-4cf3-8238-b54ba5938108\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m72zg" Sep 17 16:41:41.162577 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:41.162413 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfhsg\" (UniqueName: \"kubernetes.io/projected/74a0e409-0f01-4cf3-8238-b54ba5938108-kube-api-access-pfhsg\") pod \"openshift-lws-operator-fd8ccff4c-m72zg\" (UID: \"74a0e409-0f01-4cf3-8238-b54ba5938108\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m72zg" Sep 17 16:41:41.263224 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:41.263148 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74a0e409-0f01-4cf3-8238-b54ba5938108-tmp\") pod \"openshift-lws-operator-fd8ccff4c-m72zg\" (UID: \"74a0e409-0f01-4cf3-8238-b54ba5938108\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m72zg" Sep 17 16:41:41.263224 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:41.263211 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfhsg\" (UniqueName: \"kubernetes.io/projected/74a0e409-0f01-4cf3-8238-b54ba5938108-kube-api-access-pfhsg\") pod \"openshift-lws-operator-fd8ccff4c-m72zg\" (UID: \"74a0e409-0f01-4cf3-8238-b54ba5938108\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m72zg" Sep 17 16:41:41.263488 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:41.263469 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74a0e409-0f01-4cf3-8238-b54ba5938108-tmp\") pod \"openshift-lws-operator-fd8ccff4c-m72zg\" (UID: \"74a0e409-0f01-4cf3-8238-b54ba5938108\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m72zg" Sep 17 16:41:41.273392 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:41.273365 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfhsg\" (UniqueName: \"kubernetes.io/projected/74a0e409-0f01-4cf3-8238-b54ba5938108-kube-api-access-pfhsg\") pod \"openshift-lws-operator-fd8ccff4c-m72zg\" (UID: \"74a0e409-0f01-4cf3-8238-b54ba5938108\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m72zg" Sep 17 16:41:41.313166 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:41.313143 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m72zg" Sep 17 16:41:41.586968 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:41.586948 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m72zg"] Sep 17 16:41:41.589129 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:41:41.589105 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74a0e409_0f01_4cf3_8238_b54ba5938108.slice/crio-05c0cc69833b9d36f88b5cf38ea884ee55925c73aa728f15fab27eec3947d3ef WatchSource:0}: Error finding container 05c0cc69833b9d36f88b5cf38ea884ee55925c73aa728f15fab27eec3947d3ef: Status 404 returned error can't find the container with id 05c0cc69833b9d36f88b5cf38ea884ee55925c73aa728f15fab27eec3947d3ef Sep 17 16:41:41.911714 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:41.911628 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:41:41.948634 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:41.948604 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m72zg" event={"ID":"74a0e409-0f01-4cf3-8238-b54ba5938108","Type":"ContainerStarted","Data":"05c0cc69833b9d36f88b5cf38ea884ee55925c73aa728f15fab27eec3947d3ef"} Sep 17 16:41:42.016254 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:42.016231 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:41:44.964423 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:44.964383 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m72zg" event={"ID":"74a0e409-0f01-4cf3-8238-b54ba5938108","Type":"ContainerStarted","Data":"7f12fb551a2f11620e4efbddb0865d0f56719063a2e040145464826f90f1ff58"} Sep 17 16:41:44.984647 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:44.984597 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m72zg" podStartSLOduration=2.510864246 podStartE2EDuration="4.984579121s" totalImagesPullingTime="2.473714875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:41:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:41:44.984017258 +0000 UTC m=+569.716484841" watchObservedRunningTime="2026-09-17 16:41:44.984579121 +0000 UTC m=+569.717046699" Sep 17 16:41:49.398002 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:49.397970 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:41:53.717105 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:53.717075 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:41:53.810794 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:53.810763 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d6dc9b5d9-6pggx"] Sep 17 16:41:53.813293 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:53.813278 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d6dc9b5d9-6pggx" Sep 17 16:41:53.815829 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:53.815808 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 17 16:41:53.816720 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:53.816675 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bdp2d\"" Sep 17 16:41:53.816720 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:53.816688 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 17 16:41:53.816888 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:53.816724 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 17 16:41:53.827312 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:53.827291 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d6dc9b5d9-6pggx"] Sep 17 16:41:53.848685 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:53.848654 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6beb7df5-c1f3-438e-a133-e7cb50d655d5-metrics-cert\") pod \"lws-controller-manager-6d6dc9b5d9-6pggx\" (UID: \"6beb7df5-c1f3-438e-a133-e7cb50d655d5\") " pod="openshift-lws-operator/lws-controller-manager-6d6dc9b5d9-6pggx" Sep 17 16:41:53.848790 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:53.848703 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6beb7df5-c1f3-438e-a133-e7cb50d655d5-manager-config\") pod \"lws-controller-manager-6d6dc9b5d9-6pggx\" (UID: \"6beb7df5-c1f3-438e-a133-e7cb50d655d5\") " pod="openshift-lws-operator/lws-controller-manager-6d6dc9b5d9-6pggx" Sep 17 16:41:53.848790 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:53.848734 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6beb7df5-c1f3-438e-a133-e7cb50d655d5-cert\") pod \"lws-controller-manager-6d6dc9b5d9-6pggx\" (UID: \"6beb7df5-c1f3-438e-a133-e7cb50d655d5\") " pod="openshift-lws-operator/lws-controller-manager-6d6dc9b5d9-6pggx" Sep 17 16:41:53.848790 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:53.848762 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrvjx\" (UniqueName: \"kubernetes.io/projected/6beb7df5-c1f3-438e-a133-e7cb50d655d5-kube-api-access-jrvjx\") pod \"lws-controller-manager-6d6dc9b5d9-6pggx\" (UID: \"6beb7df5-c1f3-438e-a133-e7cb50d655d5\") " pod="openshift-lws-operator/lws-controller-manager-6d6dc9b5d9-6pggx" Sep 17 16:41:53.849159 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:53.849141 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:41:53.949908 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:53.949874 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6beb7df5-c1f3-438e-a133-e7cb50d655d5-cert\") pod \"lws-controller-manager-6d6dc9b5d9-6pggx\" (UID: \"6beb7df5-c1f3-438e-a133-e7cb50d655d5\") " pod="openshift-lws-operator/lws-controller-manager-6d6dc9b5d9-6pggx" Sep 17 16:41:53.949908 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:53.949910 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrvjx\" (UniqueName: \"kubernetes.io/projected/6beb7df5-c1f3-438e-a133-e7cb50d655d5-kube-api-access-jrvjx\") pod \"lws-controller-manager-6d6dc9b5d9-6pggx\" (UID: \"6beb7df5-c1f3-438e-a133-e7cb50d655d5\") " pod="openshift-lws-operator/lws-controller-manager-6d6dc9b5d9-6pggx" Sep 17 16:41:53.950097 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:53.949977 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6beb7df5-c1f3-438e-a133-e7cb50d655d5-metrics-cert\") pod \"lws-controller-manager-6d6dc9b5d9-6pggx\" (UID: \"6beb7df5-c1f3-438e-a133-e7cb50d655d5\") " pod="openshift-lws-operator/lws-controller-manager-6d6dc9b5d9-6pggx" Sep 17 16:41:53.950097 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:53.950000 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6beb7df5-c1f3-438e-a133-e7cb50d655d5-manager-config\") pod \"lws-controller-manager-6d6dc9b5d9-6pggx\" (UID: \"6beb7df5-c1f3-438e-a133-e7cb50d655d5\") " pod="openshift-lws-operator/lws-controller-manager-6d6dc9b5d9-6pggx" Sep 17 16:41:53.950957 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:53.950930 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6beb7df5-c1f3-438e-a133-e7cb50d655d5-manager-config\") pod \"lws-controller-manager-6d6dc9b5d9-6pggx\" (UID: \"6beb7df5-c1f3-438e-a133-e7cb50d655d5\") " pod="openshift-lws-operator/lws-controller-manager-6d6dc9b5d9-6pggx" Sep 17 16:41:53.952585 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:53.952565 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6beb7df5-c1f3-438e-a133-e7cb50d655d5-metrics-cert\") pod \"lws-controller-manager-6d6dc9b5d9-6pggx\" (UID: \"6beb7df5-c1f3-438e-a133-e7cb50d655d5\") " pod="openshift-lws-operator/lws-controller-manager-6d6dc9b5d9-6pggx" Sep 17 16:41:53.952662 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:53.952629 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6beb7df5-c1f3-438e-a133-e7cb50d655d5-cert\") pod \"lws-controller-manager-6d6dc9b5d9-6pggx\" (UID: \"6beb7df5-c1f3-438e-a133-e7cb50d655d5\") " pod="openshift-lws-operator/lws-controller-manager-6d6dc9b5d9-6pggx" Sep 17 16:41:53.959709 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:53.959689 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:41:53.961662 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:53.961644 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrvjx\" (UniqueName: \"kubernetes.io/projected/6beb7df5-c1f3-438e-a133-e7cb50d655d5-kube-api-access-jrvjx\") pod \"lws-controller-manager-6d6dc9b5d9-6pggx\" (UID: \"6beb7df5-c1f3-438e-a133-e7cb50d655d5\") " pod="openshift-lws-operator/lws-controller-manager-6d6dc9b5d9-6pggx" Sep 17 16:41:54.045833 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:54.045778 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:41:54.122121 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:54.122099 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d6dc9b5d9-6pggx" Sep 17 16:41:54.413819 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:54.413740 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d6dc9b5d9-6pggx"] Sep 17 16:41:54.416954 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:41:54.416927 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6beb7df5_c1f3_438e_a133_e7cb50d655d5.slice/crio-9d1c0de1e4243058159ef279ce5bc179baa76e977a29e24f30971a1b2867ab83 WatchSource:0}: Error finding container 9d1c0de1e4243058159ef279ce5bc179baa76e977a29e24f30971a1b2867ab83: Status 404 returned error can't find the container with id 9d1c0de1e4243058159ef279ce5bc179baa76e977a29e24f30971a1b2867ab83 Sep 17 16:41:55.005497 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:55.005461 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d6dc9b5d9-6pggx" event={"ID":"6beb7df5-c1f3-438e-a133-e7cb50d655d5","Type":"ContainerStarted","Data":"9d1c0de1e4243058159ef279ce5bc179baa76e977a29e24f30971a1b2867ab83"} Sep 17 16:41:55.191055 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:55.191018 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:41:57.866959 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:57.866887 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:41:57.967036 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:57.966987 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:41:58.019567 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:58.019536 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d6dc9b5d9-6pggx" event={"ID":"6beb7df5-c1f3-438e-a133-e7cb50d655d5","Type":"ContainerStarted","Data":"f2a2b84fcfe24d47f36f6e2464363ca08ce349e1fe6f321d5aaccb8cc5a800bb"} Sep 17 16:41:58.019707 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:58.019630 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6d6dc9b5d9-6pggx" Sep 17 16:41:58.037077 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:41:58.037026 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6d6dc9b5d9-6pggx" podStartSLOduration=1.9252607940000002 podStartE2EDuration="5.037005768s" totalImagesPullingTime="3.111744974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:41:58.036149531 +0000 UTC m=+582.768617112" watchObservedRunningTime="2026-09-17 16:41:58.037005768 +0000 UTC m=+582.769473348" Sep 17 16:42:00.535824 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:00.535792 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:00.600245 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:00.600215 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:03.838513 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:03.838469 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:05.973580 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:05.973548 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:06.073950 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:06.073920 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:09.026273 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:09.026243 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6d6dc9b5d9-6pggx" Sep 17 16:42:17.331783 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:17.331742 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jflqj_d6b66e55-13f3-43a0-9c6f-ed705c42995d/ovn-acl-logging/0.log" Sep 17 16:42:17.333054 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:17.333029 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jflqj_d6b66e55-13f3-43a0-9c6f-ed705c42995d/ovn-acl-logging/0.log" Sep 17 16:42:20.526613 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:20.526582 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:21.324315 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:21.324268 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:22.134281 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:22.134244 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:24.386136 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:24.386103 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:24.515647 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:24.515610 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:25.771376 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:25.771343 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:26.833007 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:26.832967 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:27.155228 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:27.155124 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-65dc8f76f5-xxjqt"] Sep 17 16:42:27.159322 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:27.159306 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-xxjqt" Sep 17 16:42:27.161676 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:27.161654 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 17 16:42:27.161790 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:27.161656 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 17 16:42:27.162386 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:27.162357 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Sep 17 16:42:27.162504 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:27.162403 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-8vf5n\"" Sep 17 16:42:27.170884 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:27.170864 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-65dc8f76f5-xxjqt"] Sep 17 16:42:27.230684 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:27.230654 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfrg5\" (UniqueName: \"kubernetes.io/projected/700b3c09-32c3-4de5-8230-07b58f49d1d9-kube-api-access-tfrg5\") pod \"dns-operator-controller-manager-65dc8f76f5-xxjqt\" (UID: \"700b3c09-32c3-4de5-8230-07b58f49d1d9\") " pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-xxjqt" Sep 17 16:42:27.331163 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:27.331135 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfrg5\" (UniqueName: \"kubernetes.io/projected/700b3c09-32c3-4de5-8230-07b58f49d1d9-kube-api-access-tfrg5\") pod \"dns-operator-controller-manager-65dc8f76f5-xxjqt\" (UID: \"700b3c09-32c3-4de5-8230-07b58f49d1d9\") " pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-xxjqt" Sep 17 16:42:27.348355 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:27.348337 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfrg5\" (UniqueName: \"kubernetes.io/projected/700b3c09-32c3-4de5-8230-07b58f49d1d9-kube-api-access-tfrg5\") pod \"dns-operator-controller-manager-65dc8f76f5-xxjqt\" (UID: \"700b3c09-32c3-4de5-8230-07b58f49d1d9\") " pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-xxjqt" Sep 17 16:42:27.470084 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:27.470064 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-xxjqt" Sep 17 16:42:27.755280 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:27.755258 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-65dc8f76f5-xxjqt"] Sep 17 16:42:27.757606 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:42:27.757579 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod700b3c09_32c3_4de5_8230_07b58f49d1d9.slice/crio-c05fd7f89140269a7511c5a948c183111e86bc14fb9dab785654c3313133b193 WatchSource:0}: Error finding container c05fd7f89140269a7511c5a948c183111e86bc14fb9dab785654c3313133b193: Status 404 returned error can't find the container with id c05fd7f89140269a7511c5a948c183111e86bc14fb9dab785654c3313133b193 Sep 17 16:42:27.943312 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:27.943262 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:28.151629 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:28.151554 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-xxjqt" event={"ID":"700b3c09-32c3-4de5-8230-07b58f49d1d9","Type":"ContainerStarted","Data":"c05fd7f89140269a7511c5a948c183111e86bc14fb9dab785654c3313133b193"} Sep 17 16:42:28.190743 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:28.190714 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:29.747290 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:29.747255 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:30.132022 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:30.131925 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:30.458259 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:30.458229 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:31.169771 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:31.169741 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-xxjqt" event={"ID":"700b3c09-32c3-4de5-8230-07b58f49d1d9","Type":"ContainerStarted","Data":"972eef10eec78ad0846dbd512b37f94629d015531366b4b2b013d448a2ceb11c"} Sep 17 16:42:31.170168 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:31.169851 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-xxjqt" Sep 17 16:42:31.194332 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:31.194287 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-xxjqt" podStartSLOduration=1.458248951 podStartE2EDuration="4.19427473s" totalImagesPullingTime="2.736025779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:31.193293039 +0000 UTC m=+615.925760673" watchObservedRunningTime="2026-09-17 16:42:31.19427473 +0000 UTC m=+615.926742308" Sep 17 16:42:32.281353 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:32.281315 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-6fc8f864f4-xsm95"] Sep 17 16:42:32.283916 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:32.283896 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6fc8f864f4-xsm95" Sep 17 16:42:32.286409 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:32.286385 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-c4fv6\"" Sep 17 16:42:32.301836 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:32.301812 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6fc8f864f4-xsm95"] Sep 17 16:42:32.375321 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:32.375292 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwld5\" (UniqueName: \"kubernetes.io/projected/0c1340fd-f6d2-4cac-9f90-9da308755999-kube-api-access-hwld5\") pod \"authorino-operator-6fc8f864f4-xsm95\" (UID: \"0c1340fd-f6d2-4cac-9f90-9da308755999\") " pod="kuadrant-system/authorino-operator-6fc8f864f4-xsm95" Sep 17 16:42:32.476601 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:32.476576 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwld5\" (UniqueName: \"kubernetes.io/projected/0c1340fd-f6d2-4cac-9f90-9da308755999-kube-api-access-hwld5\") pod \"authorino-operator-6fc8f864f4-xsm95\" (UID: \"0c1340fd-f6d2-4cac-9f90-9da308755999\") " pod="kuadrant-system/authorino-operator-6fc8f864f4-xsm95" Sep 17 16:42:32.488092 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:32.488067 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:32.490596 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:32.490577 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwld5\" (UniqueName: \"kubernetes.io/projected/0c1340fd-f6d2-4cac-9f90-9da308755999-kube-api-access-hwld5\") pod \"authorino-operator-6fc8f864f4-xsm95\" (UID: \"0c1340fd-f6d2-4cac-9f90-9da308755999\") " pod="kuadrant-system/authorino-operator-6fc8f864f4-xsm95" Sep 17 16:42:32.593555 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:32.593497 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6fc8f864f4-xsm95" Sep 17 16:42:32.612791 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:32.612764 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:32.863055 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:32.863007 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6fc8f864f4-xsm95"] Sep 17 16:42:32.865218 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:42:32.865193 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c1340fd_f6d2_4cac_9f90_9da308755999.slice/crio-ed41b7ab29aca0e1a4f59604fceb6bf3cc91669d655f428e75516e5638e9a4e4 WatchSource:0}: Error finding container ed41b7ab29aca0e1a4f59604fceb6bf3cc91669d655f428e75516e5638e9a4e4: Status 404 returned error can't find the container with id ed41b7ab29aca0e1a4f59604fceb6bf3cc91669d655f428e75516e5638e9a4e4 Sep 17 16:42:33.180480 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:33.180382 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6fc8f864f4-xsm95" event={"ID":"0c1340fd-f6d2-4cac-9f90-9da308755999","Type":"ContainerStarted","Data":"ed41b7ab29aca0e1a4f59604fceb6bf3cc91669d655f428e75516e5638e9a4e4"} Sep 17 16:42:35.192826 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:35.192797 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6fc8f864f4-xsm95" event={"ID":"0c1340fd-f6d2-4cac-9f90-9da308755999","Type":"ContainerStarted","Data":"05dcaf591a82c29994587b93f755db7e4d2a4a7420a842439f7071e40579dd05"} Sep 17 16:42:35.193213 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:35.192903 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-6fc8f864f4-xsm95" Sep 17 16:42:35.212071 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:35.212031 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-6fc8f864f4-xsm95" podStartSLOduration=1.501628288 podStartE2EDuration="3.212018089s" totalImagesPullingTime="1.710389801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:42:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:35.210691968 +0000 UTC m=+619.943159548" watchObservedRunningTime="2026-09-17 16:42:35.212018089 +0000 UTC m=+619.944485668" Sep 17 16:42:35.337158 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:35.337133 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:35.437298 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:35.437258 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:35.733864 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:35.733822 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:35.790361 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:35.790334 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:36.142378 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:36.142277 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:36.209078 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:36.209056 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:41.882018 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:41.881985 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:41.986041 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:41.986008 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:42.177595 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:42.177531 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-65dc8f76f5-xxjqt" Sep 17 16:42:46.199811 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:46.199778 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-6fc8f864f4-xsm95" Sep 17 16:42:46.591030 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:46.591005 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:46.686906 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:46.686880 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:51.367946 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:51.367909 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:51.476601 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:51.476572 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:56.548776 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:56.548724 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:56.608799 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:56.608776 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:56.752078 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:56.752057 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:56.853117 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:56.853043 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:57.753225 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:57.753189 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:42:57.852961 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:42:57.852924 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:01.558736 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:43:01.558687 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:01.627795 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:43:01.627759 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:02.655045 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:43:02.655015 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:02.717986 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:43:02.717952 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:07.424579 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:43:07.424543 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:07.523568 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:43:07.523535 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:12.206285 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:43:12.206249 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:12.303176 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:43:12.303144 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:13.301911 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:43:13.301874 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:43:13.305535 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:43:13.305511 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xvw4n"] Sep 17 16:43:13.308769 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:43:13.308753 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-xvw4n" Sep 17 16:43:13.310961 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:43:13.310945 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kt495\"" Sep 17 16:43:13.311029 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:43:13.310978 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 17 16:43:13.317913 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:43:13.317893 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xvw4n"] Sep 17 16:43:13.398487 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:43:13.398452 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f94v\" (UniqueName: \"kubernetes.io/projected/87c894dd-71d3-430a-b257-5c8928a6cb80-kube-api-access-7f94v\") pod \"limitador-limitador-8588749977-xvw4n\" (UID: \"87c894dd-71d3-430a-b257-5c8928a6cb80\") " pod="kuadrant-system/limitador-limitador-8588749977-xvw4n" Sep 17 16:43:13.398620 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:43:13.398517 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/87c894dd-71d3-430a-b257-5c8928a6cb80-config-file\") pod \"limitador-limitador-8588749977-xvw4n\" (UID: \"87c894dd-71d3-430a-b257-5c8928a6cb80\") " pod="kuadrant-system/limitador-limitador-8588749977-xvw4n" Sep 17 16:43:13.403731 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:43:13.403707 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xvw4n"] Sep 17 16:43:13.499732 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:43:13.499706 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f94v\" (UniqueName: \"kubernetes.io/projected/87c894dd-71d3-430a-b257-5c8928a6cb80-kube-api-access-7f94v\") pod \"limitador-limitador-8588749977-xvw4n\" (UID: \"87c894dd-71d3-430a-b257-5c8928a6cb80\") " pod="kuadrant-system/limitador-limitador-8588749977-xvw4n" Sep 17 16:43:13.499891 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:43:13.499823 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/87c894dd-71d3-430a-b257-5c8928a6cb80-config-file\") pod \"limitador-limitador-8588749977-xvw4n\" (UID: \"87c894dd-71d3-430a-b257-5c8928a6cb80\") " pod="kuadrant-system/limitador-limitador-8588749977-xvw4n" Sep 17 16:43:13.500543 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:43:13.500524 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/87c894dd-71d3-430a-b257-5c8928a6cb80-config-file\") pod \"limitador-limitador-8588749977-xvw4n\" (UID: \"87c894dd-71d3-430a-b257-5c8928a6cb80\") " pod="kuadrant-system/limitador-limitador-8588749977-xvw4n" Sep 17 16:43:13.508612 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:43:13.508585 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f94v\" (UniqueName: \"kubernetes.io/projected/87c894dd-71d3-430a-b257-5c8928a6cb80-kube-api-access-7f94v\") pod \"limitador-limitador-8588749977-xvw4n\" (UID: \"87c894dd-71d3-430a-b257-5c8928a6cb80\") " pod="kuadrant-system/limitador-limitador-8588749977-xvw4n" Sep 17 16:43:13.619678 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:43:13.619586 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-xvw4n" Sep 17 16:43:13.890181 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:43:13.890108 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xvw4n"] Sep 17 16:43:13.894014 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:43:13.893982 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87c894dd_71d3_430a_b257_5c8928a6cb80.slice/crio-e724ba6eb184bce6afb1e71a3c285b60ad83ca16b65c676486a03ca564025078 WatchSource:0}: Error finding container e724ba6eb184bce6afb1e71a3c285b60ad83ca16b65c676486a03ca564025078: Status 404 returned error can't find the container with id e724ba6eb184bce6afb1e71a3c285b60ad83ca16b65c676486a03ca564025078 Sep 17 16:43:14.376844 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:43:14.376808 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-xvw4n" event={"ID":"87c894dd-71d3-430a-b257-5c8928a6cb80","Type":"ContainerStarted","Data":"e724ba6eb184bce6afb1e71a3c285b60ad83ca16b65c676486a03ca564025078"} Sep 17 16:43:16.387954 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:43:16.387918 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-xvw4n" event={"ID":"87c894dd-71d3-430a-b257-5c8928a6cb80","Type":"ContainerStarted","Data":"ed7e91b12403fa908eae8beecd325ccaef2e59c2e5566e026d24da9dc19c04c9"} Sep 17 16:43:16.388302 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:43:16.388029 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-xvw4n" Sep 17 16:43:16.408755 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:43:16.408715 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-xvw4n" podStartSLOduration=1.042975013 podStartE2EDuration="3.408701232s" totalImagesPullingTime="2.365726219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:43:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:43:16.406906494 +0000 UTC m=+661.139374074" watchObservedRunningTime="2026-09-17 16:43:16.408701232 +0000 UTC m=+661.141168811" Sep 17 16:43:27.392638 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:43:27.392600 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-xvw4n" Sep 17 16:44:32.968583 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:44:32.968551 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:44:34.931893 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:44:34.931831 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:45:25.100028 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:45:25.099993 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:46:25.447647 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:46:25.447606 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:46:26.237779 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:46:26.237743 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:47:17.362793 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:47:17.362708 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jflqj_d6b66e55-13f3-43a0-9c6f-ed705c42995d/ovn-acl-logging/0.log" Sep 17 16:47:17.365615 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:47:17.365594 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jflqj_d6b66e55-13f3-43a0-9c6f-ed705c42995d/ovn-acl-logging/0.log" Sep 17 16:48:13.609335 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:13.609299 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xvw4n"] Sep 17 16:48:13.610880 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:13.609527 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-xvw4n" podUID="87c894dd-71d3-430a-b257-5c8928a6cb80" containerName="limitador" containerID="cri-o://ed7e91b12403fa908eae8beecd325ccaef2e59c2e5566e026d24da9dc19c04c9" gracePeriod=30 Sep 17 16:48:13.663658 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:13.663628 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:48:14.158031 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:14.158006 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-xvw4n" Sep 17 16:48:14.232899 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:14.232872 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/87c894dd-71d3-430a-b257-5c8928a6cb80-config-file\") pod \"87c894dd-71d3-430a-b257-5c8928a6cb80\" (UID: \"87c894dd-71d3-430a-b257-5c8928a6cb80\") " Sep 17 16:48:14.233066 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:14.232992 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7f94v\" (UniqueName: \"kubernetes.io/projected/87c894dd-71d3-430a-b257-5c8928a6cb80-kube-api-access-7f94v\") pod \"87c894dd-71d3-430a-b257-5c8928a6cb80\" (UID: \"87c894dd-71d3-430a-b257-5c8928a6cb80\") " Sep 17 16:48:14.233302 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:14.233274 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87c894dd-71d3-430a-b257-5c8928a6cb80-config-file" (OuterVolumeSpecName: "config-file") pod "87c894dd-71d3-430a-b257-5c8928a6cb80" (UID: "87c894dd-71d3-430a-b257-5c8928a6cb80"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 16:48:14.235270 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:14.235247 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87c894dd-71d3-430a-b257-5c8928a6cb80-kube-api-access-7f94v" (OuterVolumeSpecName: "kube-api-access-7f94v") pod "87c894dd-71d3-430a-b257-5c8928a6cb80" (UID: "87c894dd-71d3-430a-b257-5c8928a6cb80"). InnerVolumeSpecName "kube-api-access-7f94v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 16:48:14.334146 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:14.334120 2581 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/87c894dd-71d3-430a-b257-5c8928a6cb80-config-file\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:48:14.334146 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:14.334145 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7f94v\" (UniqueName: \"kubernetes.io/projected/87c894dd-71d3-430a-b257-5c8928a6cb80-kube-api-access-7f94v\") on node \"ip-10-0-129-101.ec2.internal\" DevicePath \"\"" Sep 17 16:48:14.755912 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:14.755874 2581 generic.go:356] "Generic (PLEG): container finished" podID="87c894dd-71d3-430a-b257-5c8928a6cb80" containerID="ed7e91b12403fa908eae8beecd325ccaef2e59c2e5566e026d24da9dc19c04c9" exitCode=0 Sep 17 16:48:14.756283 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:14.755925 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-xvw4n" Sep 17 16:48:14.756283 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:14.755959 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-xvw4n" event={"ID":"87c894dd-71d3-430a-b257-5c8928a6cb80","Type":"ContainerDied","Data":"ed7e91b12403fa908eae8beecd325ccaef2e59c2e5566e026d24da9dc19c04c9"} Sep 17 16:48:14.756283 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:14.756018 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-xvw4n" event={"ID":"87c894dd-71d3-430a-b257-5c8928a6cb80","Type":"ContainerDied","Data":"e724ba6eb184bce6afb1e71a3c285b60ad83ca16b65c676486a03ca564025078"} Sep 17 16:48:14.756283 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:14.756041 2581 scope.go:117] "RemoveContainer" containerID="ed7e91b12403fa908eae8beecd325ccaef2e59c2e5566e026d24da9dc19c04c9" Sep 17 16:48:14.764475 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:14.764451 2581 scope.go:117] "RemoveContainer" containerID="ed7e91b12403fa908eae8beecd325ccaef2e59c2e5566e026d24da9dc19c04c9" Sep 17 16:48:14.764765 ip-10-0-129-101 kubenswrapper[2581]: E0917 16:48:14.764746 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed7e91b12403fa908eae8beecd325ccaef2e59c2e5566e026d24da9dc19c04c9\": container with ID starting with ed7e91b12403fa908eae8beecd325ccaef2e59c2e5566e026d24da9dc19c04c9 not found: ID does not exist" containerID="ed7e91b12403fa908eae8beecd325ccaef2e59c2e5566e026d24da9dc19c04c9" Sep 17 16:48:14.764827 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:14.764774 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed7e91b12403fa908eae8beecd325ccaef2e59c2e5566e026d24da9dc19c04c9"} err="failed to get container status \"ed7e91b12403fa908eae8beecd325ccaef2e59c2e5566e026d24da9dc19c04c9\": rpc error: code = NotFound desc = could not find container \"ed7e91b12403fa908eae8beecd325ccaef2e59c2e5566e026d24da9dc19c04c9\": container with ID starting with ed7e91b12403fa908eae8beecd325ccaef2e59c2e5566e026d24da9dc19c04c9 not found: ID does not exist" Sep 17 16:48:14.778162 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:14.778136 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xvw4n"] Sep 17 16:48:14.782392 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:14.782367 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-xvw4n"] Sep 17 16:48:15.420282 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:15.420239 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87c894dd-71d3-430a-b257-5c8928a6cb80" path="/var/lib/kubelet/pods/87c894dd-71d3-430a-b257-5c8928a6cb80/volumes" Sep 17 16:48:28.946994 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:28.946913 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:48:28.947517 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:28.947496 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-l8sd5"] Sep 17 16:48:28.947825 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:28.947812 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87c894dd-71d3-430a-b257-5c8928a6cb80" containerName="limitador" Sep 17 16:48:28.947872 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:28.947826 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="87c894dd-71d3-430a-b257-5c8928a6cb80" containerName="limitador" Sep 17 16:48:28.947916 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:28.947911 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="87c894dd-71d3-430a-b257-5c8928a6cb80" containerName="limitador" Sep 17 16:48:28.950467 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:28.950425 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-l8sd5" Sep 17 16:48:28.952533 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:28.952512 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kt495\"" Sep 17 16:48:28.952677 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:28.952518 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 17 16:48:28.963125 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:28.963105 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-l8sd5"] Sep 17 16:48:28.996785 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:28.996763 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-l8sd5"] Sep 17 16:48:29.048275 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:29.048250 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x9zf\" (UniqueName: \"kubernetes.io/projected/77a79fc8-c1e1-4b46-b779-9fe80fa04a43-kube-api-access-5x9zf\") pod \"limitador-limitador-8588749977-l8sd5\" (UID: \"77a79fc8-c1e1-4b46-b779-9fe80fa04a43\") " pod="kuadrant-system/limitador-limitador-8588749977-l8sd5" Sep 17 16:48:29.048390 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:29.048296 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/77a79fc8-c1e1-4b46-b779-9fe80fa04a43-config-file\") pod \"limitador-limitador-8588749977-l8sd5\" (UID: \"77a79fc8-c1e1-4b46-b779-9fe80fa04a43\") " pod="kuadrant-system/limitador-limitador-8588749977-l8sd5" Sep 17 16:48:29.149237 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:29.149216 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x9zf\" (UniqueName: \"kubernetes.io/projected/77a79fc8-c1e1-4b46-b779-9fe80fa04a43-kube-api-access-5x9zf\") pod \"limitador-limitador-8588749977-l8sd5\" (UID: \"77a79fc8-c1e1-4b46-b779-9fe80fa04a43\") " pod="kuadrant-system/limitador-limitador-8588749977-l8sd5" Sep 17 16:48:29.149337 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:29.149258 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/77a79fc8-c1e1-4b46-b779-9fe80fa04a43-config-file\") pod \"limitador-limitador-8588749977-l8sd5\" (UID: \"77a79fc8-c1e1-4b46-b779-9fe80fa04a43\") " pod="kuadrant-system/limitador-limitador-8588749977-l8sd5" Sep 17 16:48:29.149837 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:29.149820 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/77a79fc8-c1e1-4b46-b779-9fe80fa04a43-config-file\") pod \"limitador-limitador-8588749977-l8sd5\" (UID: \"77a79fc8-c1e1-4b46-b779-9fe80fa04a43\") " pod="kuadrant-system/limitador-limitador-8588749977-l8sd5" Sep 17 16:48:29.157995 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:29.157965 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x9zf\" (UniqueName: \"kubernetes.io/projected/77a79fc8-c1e1-4b46-b779-9fe80fa04a43-kube-api-access-5x9zf\") pod \"limitador-limitador-8588749977-l8sd5\" (UID: \"77a79fc8-c1e1-4b46-b779-9fe80fa04a43\") " pod="kuadrant-system/limitador-limitador-8588749977-l8sd5" Sep 17 16:48:29.260559 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:29.260538 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-l8sd5" Sep 17 16:48:29.536527 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:29.536500 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-l8sd5"] Sep 17 16:48:29.539332 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:48:29.539304 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77a79fc8_c1e1_4b46_b779_9fe80fa04a43.slice/crio-fb2d7bbaea746826d8ab8b5706a1bbb617eab312254c06d2c5068717e3d58164 WatchSource:0}: Error finding container fb2d7bbaea746826d8ab8b5706a1bbb617eab312254c06d2c5068717e3d58164: Status 404 returned error can't find the container with id fb2d7bbaea746826d8ab8b5706a1bbb617eab312254c06d2c5068717e3d58164 Sep 17 16:48:29.826761 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:29.826655 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-l8sd5" event={"ID":"77a79fc8-c1e1-4b46-b779-9fe80fa04a43","Type":"ContainerStarted","Data":"f38770d42ba4eb9d55c2a5d4aab8e0ab7f7cb75bafcd3fde702f8a83d9899b1b"} Sep 17 16:48:29.826761 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:29.826713 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-l8sd5" event={"ID":"77a79fc8-c1e1-4b46-b779-9fe80fa04a43","Type":"ContainerStarted","Data":"fb2d7bbaea746826d8ab8b5706a1bbb617eab312254c06d2c5068717e3d58164"} Sep 17 16:48:29.826988 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:29.826818 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-l8sd5" Sep 17 16:48:29.849743 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:29.849693 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-l8sd5" podStartSLOduration=1.8496766930000001 podStartE2EDuration="1.849676693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:48:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:48:29.848581761 +0000 UTC m=+974.581049341" watchObservedRunningTime="2026-09-17 16:48:29.849676693 +0000 UTC m=+974.582144292" Sep 17 16:48:40.832219 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:40.832180 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-l8sd5" Sep 17 16:48:45.238068 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:48:45.238035 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:49:40.030390 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:49:40.030349 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:49:41.614086 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:49:41.614050 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:50:43.250621 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:50:43.250588 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:52:17.393635 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:52:17.393602 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jflqj_d6b66e55-13f3-43a0-9c6f-ed705c42995d/ovn-acl-logging/0.log" Sep 17 16:52:17.397452 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:52:17.397414 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jflqj_d6b66e55-13f3-43a0-9c6f-ed705c42995d/ovn-acl-logging/0.log" Sep 17 16:53:34.449223 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:53:34.449190 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:34.595850 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:53:34.595822 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:55.884316 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:53:55.884279 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:56.031094 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:53:56.031065 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:56.047615 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:53:56.047586 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fscp7/must-gather-wc2rz"] Sep 17 16:53:56.050983 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:53:56.050969 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fscp7/must-gather-wc2rz" Sep 17 16:53:56.053161 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:53:56.053143 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fscp7\"/\"openshift-service-ca.crt\"" Sep 17 16:53:56.054004 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:53:56.053989 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fscp7\"/\"default-dockercfg-vl49z\"" Sep 17 16:53:56.054069 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:53:56.054020 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fscp7\"/\"kube-root-ca.crt\"" Sep 17 16:53:56.062657 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:53:56.062631 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fscp7/must-gather-wc2rz"] Sep 17 16:53:56.070851 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:53:56.070826 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5c05647f-3abd-480f-b7af-791a7dcf87e3-must-gather-output\") pod \"must-gather-wc2rz\" (UID: \"5c05647f-3abd-480f-b7af-791a7dcf87e3\") " pod="openshift-must-gather-fscp7/must-gather-wc2rz" Sep 17 16:53:56.070955 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:53:56.070862 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qntxk\" (UniqueName: \"kubernetes.io/projected/5c05647f-3abd-480f-b7af-791a7dcf87e3-kube-api-access-qntxk\") pod \"must-gather-wc2rz\" (UID: \"5c05647f-3abd-480f-b7af-791a7dcf87e3\") " pod="openshift-must-gather-fscp7/must-gather-wc2rz" Sep 17 16:53:56.126193 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:53:56.126172 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:53:56.171408 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:53:56.171352 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qntxk\" (UniqueName: \"kubernetes.io/projected/5c05647f-3abd-480f-b7af-791a7dcf87e3-kube-api-access-qntxk\") pod \"must-gather-wc2rz\" (UID: \"5c05647f-3abd-480f-b7af-791a7dcf87e3\") " pod="openshift-must-gather-fscp7/must-gather-wc2rz" Sep 17 16:53:56.171508 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:53:56.171457 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5c05647f-3abd-480f-b7af-791a7dcf87e3-must-gather-output\") pod \"must-gather-wc2rz\" (UID: \"5c05647f-3abd-480f-b7af-791a7dcf87e3\") " pod="openshift-must-gather-fscp7/must-gather-wc2rz" Sep 17 16:53:56.171748 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:53:56.171729 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5c05647f-3abd-480f-b7af-791a7dcf87e3-must-gather-output\") pod \"must-gather-wc2rz\" (UID: \"5c05647f-3abd-480f-b7af-791a7dcf87e3\") " pod="openshift-must-gather-fscp7/must-gather-wc2rz" Sep 17 16:53:56.182351 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:53:56.182334 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qntxk\" (UniqueName: \"kubernetes.io/projected/5c05647f-3abd-480f-b7af-791a7dcf87e3-kube-api-access-qntxk\") pod \"must-gather-wc2rz\" (UID: \"5c05647f-3abd-480f-b7af-791a7dcf87e3\") " pod="openshift-must-gather-fscp7/must-gather-wc2rz" Sep 17 16:53:56.360897 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:53:56.360868 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fscp7/must-gather-wc2rz" Sep 17 16:53:56.632159 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:53:56.632137 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fscp7/must-gather-wc2rz"] Sep 17 16:53:56.634735 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:53:56.634707 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c05647f_3abd_480f_b7af_791a7dcf87e3.slice/crio-66a6e6b1bd56a383fead39fbb457c7b038ff0606cd2dc54d7236345284732577 WatchSource:0}: Error finding container 66a6e6b1bd56a383fead39fbb457c7b038ff0606cd2dc54d7236345284732577: Status 404 returned error can't find the container with id 66a6e6b1bd56a383fead39fbb457c7b038ff0606cd2dc54d7236345284732577 Sep 17 16:53:56.636748 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:53:56.636724 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 16:53:57.345995 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:53:57.345956 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fscp7/must-gather-wc2rz" event={"ID":"5c05647f-3abd-480f-b7af-791a7dcf87e3","Type":"ContainerStarted","Data":"66a6e6b1bd56a383fead39fbb457c7b038ff0606cd2dc54d7236345284732577"} Sep 17 16:53:58.355111 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:53:58.355080 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fscp7/must-gather-wc2rz" event={"ID":"5c05647f-3abd-480f-b7af-791a7dcf87e3","Type":"ContainerStarted","Data":"833c76a017aa92410042f682cc558cfb2b3a72c5f2f65160da5bba68d1b7b31a"} Sep 17 16:53:58.355111 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:53:58.355121 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fscp7/must-gather-wc2rz" event={"ID":"5c05647f-3abd-480f-b7af-791a7dcf87e3","Type":"ContainerStarted","Data":"0c9181b0f0705b5d96fcd7ceea8a1b15486a69619c7cc91d65d2c25be93b3067"} Sep 17 16:53:58.373478 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:53:58.373386 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fscp7/must-gather-wc2rz" podStartSLOduration=1.6067943169999999 podStartE2EDuration="2.373363268s" totalImagesPullingTime="766.568951ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:53:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:53:58.371506393 +0000 UTC m=+1303.103973972" watchObservedRunningTime="2026-09-17 16:53:58.373363268 +0000 UTC m=+1303.105830850" Sep 17 16:53:58.942491 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:53:58.942463 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cdn7r_71c447a9-be09-4350-841c-a054f2e33b6b/global-pull-secret-syncer/0.log" Sep 17 16:53:59.031565 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:53:59.031535 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" Sep 17 16:53:59.143765 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:53:59.143733 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-101.ec2.internal_f9b2c501adb92de6a6b87fdccf169cbd/haproxy/0.log" Sep 17 16:54:02.072819 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:02.072776 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:54:02.147472 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:02.147385 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gvdpj_0b91d9e7-b505-4f06-96a9-615c27c19983/konnectivity-agent/0.log" limit=1024 Sep 17 16:54:03.338888 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:03.337970 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6fc8f864f4-xsm95_0c1340fd-f6d2-4cac-9f90-9da308755999/manager/0.log" Sep 17 16:54:03.381048 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:03.381020 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65dc8f76f5-xxjqt_700b3c09-32c3-4de5-8230-07b58f49d1d9/manager/0.log" Sep 17 16:54:03.489277 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:03.489237 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-8588749977-l8sd5_77a79fc8-c1e1-4b46-b779-9fe80fa04a43/limitador/0.log" Sep 17 16:54:04.919087 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:04.919030 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2639d60-1228-489e-9498-87d02432432d/alertmanager/0.log" Sep 17 16:54:04.958227 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:04.958199 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2639d60-1228-489e-9498-87d02432432d/config-reloader/0.log" Sep 17 16:54:04.988490 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:04.988466 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2639d60-1228-489e-9498-87d02432432d/kube-rbac-proxy-web/0.log" Sep 17 16:54:05.018586 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:05.018548 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2639d60-1228-489e-9498-87d02432432d/kube-rbac-proxy/0.log" Sep 17 16:54:05.045907 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:05.045877 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2639d60-1228-489e-9498-87d02432432d/kube-rbac-proxy-metric/0.log" Sep 17 16:54:05.077669 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:05.077643 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2639d60-1228-489e-9498-87d02432432d/prom-label-proxy/0.log" Sep 17 16:54:05.113542 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:05.113506 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2639d60-1228-489e-9498-87d02432432d/init-config-reloader/0.log" Sep 17 16:54:05.202680 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:05.202598 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-426dn_e0877f57-28be-44ae-b2fd-cda40918eff2/kube-state-metrics/0.log" Sep 17 16:54:05.234266 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:05.234230 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-426dn_e0877f57-28be-44ae-b2fd-cda40918eff2/kube-rbac-proxy-main/0.log" Sep 17 16:54:05.263027 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:05.262994 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-426dn_e0877f57-28be-44ae-b2fd-cda40918eff2/kube-rbac-proxy-self/0.log" Sep 17 16:54:05.297775 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:05.297746 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-69dcb7c788-lbhvh_14056693-bf8a-4c6b-843a-1bd5b2cd5095/metrics-server/0.log" Sep 17 16:54:05.340168 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:05.340133 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-z2tct_6856c598-60bc-4bb8-a7d8-ab0d18a3b55b/monitoring-plugin/0.log" Sep 17 16:54:05.477444 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:05.477401 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2wlx9_0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde/node-exporter/0.log" Sep 17 16:54:05.507585 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:05.507555 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2wlx9_0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde/kube-rbac-proxy/0.log" Sep 17 16:54:05.538947 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:05.538912 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2wlx9_0fd3f4f0-fbbe-4eb8-a767-e2c4dfc5edde/init-textfile/0.log" Sep 17 16:54:05.657271 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:05.657236 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-rw6dm_ca11a3ac-e5ba-4970-8dcb-a81efc81038e/kube-rbac-proxy-main/0.log" Sep 17 16:54:05.683451 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:05.683406 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-rw6dm_ca11a3ac-e5ba-4970-8dcb-a81efc81038e/kube-rbac-proxy-self/0.log" Sep 17 16:54:05.714121 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:05.714086 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-rw6dm_ca11a3ac-e5ba-4970-8dcb-a81efc81038e/openshift-state-metrics/0.log" Sep 17 16:54:05.775285 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:05.775204 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5bf2e9d3-30af-4267-88f7-67d7546dbb0c/prometheus/0.log" Sep 17 16:54:05.812002 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:05.811975 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5bf2e9d3-30af-4267-88f7-67d7546dbb0c/config-reloader/0.log" Sep 17 16:54:05.843218 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:05.843187 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5bf2e9d3-30af-4267-88f7-67d7546dbb0c/thanos-sidecar/0.log" Sep 17 16:54:05.880255 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:05.880234 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5bf2e9d3-30af-4267-88f7-67d7546dbb0c/kube-rbac-proxy-web/0.log" Sep 17 16:54:05.916203 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:05.916139 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5bf2e9d3-30af-4267-88f7-67d7546dbb0c/kube-rbac-proxy/0.log" Sep 17 16:54:05.953633 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:05.953600 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5bf2e9d3-30af-4267-88f7-67d7546dbb0c/kube-rbac-proxy-thanos/0.log" Sep 17 16:54:05.978048 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:05.977990 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5bf2e9d3-30af-4267-88f7-67d7546dbb0c/init-config-reloader/0.log" Sep 17 16:54:06.022737 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:06.022702 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-lmlmf_4f36bd22-9905-40f8-be73-a1b1781f4599/prometheus-operator/0.log" Sep 17 16:54:06.048418 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:06.048338 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-lmlmf_4f36bd22-9905-40f8-be73-a1b1781f4599/kube-rbac-proxy/0.log" Sep 17 16:54:06.091454 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:06.090736 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-8qp2s_5e2cfac3-f193-4a4b-acdf-02c6ee4dcbc4/prometheus-operator-admission-webhook/0.log" Sep 17 16:54:06.219140 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:06.219118 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74b6d5f87c-5wwbd_c6b9fa9f-4315-4290-97cd-b3df6fb101e1/thanos-query/0.log" Sep 17 16:54:06.249533 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:06.249423 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74b6d5f87c-5wwbd_c6b9fa9f-4315-4290-97cd-b3df6fb101e1/kube-rbac-proxy-web/0.log" Sep 17 16:54:06.281181 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:06.281147 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74b6d5f87c-5wwbd_c6b9fa9f-4315-4290-97cd-b3df6fb101e1/kube-rbac-proxy/0.log" Sep 17 16:54:06.312010 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:06.311933 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74b6d5f87c-5wwbd_c6b9fa9f-4315-4290-97cd-b3df6fb101e1/prom-label-proxy/0.log" Sep 17 16:54:06.342375 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:06.342338 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74b6d5f87c-5wwbd_c6b9fa9f-4315-4290-97cd-b3df6fb101e1/kube-rbac-proxy-rules/0.log" Sep 17 16:54:06.370857 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:06.370818 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74b6d5f87c-5wwbd_c6b9fa9f-4315-4290-97cd-b3df6fb101e1/kube-rbac-proxy-metrics/0.log" Sep 17 16:54:08.530943 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:08.530910 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fscp7/perf-node-gather-daemonset-q9d7n"] Sep 17 16:54:08.537415 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:08.537380 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fscp7/perf-node-gather-daemonset-q9d7n" Sep 17 16:54:08.545898 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:08.545866 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fscp7/perf-node-gather-daemonset-q9d7n"] Sep 17 16:54:08.615231 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:08.615200 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pqgx\" (UniqueName: \"kubernetes.io/projected/209869a1-1abb-4573-8cd7-6aff3ba0f25c-kube-api-access-6pqgx\") pod \"perf-node-gather-daemonset-q9d7n\" (UID: \"209869a1-1abb-4573-8cd7-6aff3ba0f25c\") " pod="openshift-must-gather-fscp7/perf-node-gather-daemonset-q9d7n" Sep 17 16:54:08.615421 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:08.615262 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/209869a1-1abb-4573-8cd7-6aff3ba0f25c-sys\") pod \"perf-node-gather-daemonset-q9d7n\" (UID: \"209869a1-1abb-4573-8cd7-6aff3ba0f25c\") " pod="openshift-must-gather-fscp7/perf-node-gather-daemonset-q9d7n" Sep 17 16:54:08.615421 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:08.615312 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/209869a1-1abb-4573-8cd7-6aff3ba0f25c-proc\") pod \"perf-node-gather-daemonset-q9d7n\" (UID: \"209869a1-1abb-4573-8cd7-6aff3ba0f25c\") " pod="openshift-must-gather-fscp7/perf-node-gather-daemonset-q9d7n" Sep 17 16:54:08.615421 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:08.615326 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/209869a1-1abb-4573-8cd7-6aff3ba0f25c-podres\") pod \"perf-node-gather-daemonset-q9d7n\" (UID: \"209869a1-1abb-4573-8cd7-6aff3ba0f25c\") " pod="openshift-must-gather-fscp7/perf-node-gather-daemonset-q9d7n" Sep 17 16:54:08.615421 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:08.615352 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/209869a1-1abb-4573-8cd7-6aff3ba0f25c-lib-modules\") pod \"perf-node-gather-daemonset-q9d7n\" (UID: \"209869a1-1abb-4573-8cd7-6aff3ba0f25c\") " pod="openshift-must-gather-fscp7/perf-node-gather-daemonset-q9d7n" Sep 17 16:54:08.715983 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:08.715945 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pqgx\" (UniqueName: \"kubernetes.io/projected/209869a1-1abb-4573-8cd7-6aff3ba0f25c-kube-api-access-6pqgx\") pod \"perf-node-gather-daemonset-q9d7n\" (UID: \"209869a1-1abb-4573-8cd7-6aff3ba0f25c\") " pod="openshift-must-gather-fscp7/perf-node-gather-daemonset-q9d7n" Sep 17 16:54:08.716157 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:08.716037 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/209869a1-1abb-4573-8cd7-6aff3ba0f25c-sys\") pod \"perf-node-gather-daemonset-q9d7n\" (UID: \"209869a1-1abb-4573-8cd7-6aff3ba0f25c\") " pod="openshift-must-gather-fscp7/perf-node-gather-daemonset-q9d7n" Sep 17 16:54:08.716157 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:08.716071 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/209869a1-1abb-4573-8cd7-6aff3ba0f25c-proc\") pod \"perf-node-gather-daemonset-q9d7n\" (UID: \"209869a1-1abb-4573-8cd7-6aff3ba0f25c\") " pod="openshift-must-gather-fscp7/perf-node-gather-daemonset-q9d7n" Sep 17 16:54:08.716157 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:08.716095 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/209869a1-1abb-4573-8cd7-6aff3ba0f25c-podres\") pod \"perf-node-gather-daemonset-q9d7n\" (UID: \"209869a1-1abb-4573-8cd7-6aff3ba0f25c\") " pod="openshift-must-gather-fscp7/perf-node-gather-daemonset-q9d7n" Sep 17 16:54:08.716157 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:08.716124 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/209869a1-1abb-4573-8cd7-6aff3ba0f25c-lib-modules\") pod \"perf-node-gather-daemonset-q9d7n\" (UID: \"209869a1-1abb-4573-8cd7-6aff3ba0f25c\") " pod="openshift-must-gather-fscp7/perf-node-gather-daemonset-q9d7n" Sep 17 16:54:08.716451 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:08.716161 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/209869a1-1abb-4573-8cd7-6aff3ba0f25c-sys\") pod \"perf-node-gather-daemonset-q9d7n\" (UID: \"209869a1-1abb-4573-8cd7-6aff3ba0f25c\") " pod="openshift-must-gather-fscp7/perf-node-gather-daemonset-q9d7n" Sep 17 16:54:08.716451 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:08.716209 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/209869a1-1abb-4573-8cd7-6aff3ba0f25c-proc\") pod \"perf-node-gather-daemonset-q9d7n\" (UID: \"209869a1-1abb-4573-8cd7-6aff3ba0f25c\") " pod="openshift-must-gather-fscp7/perf-node-gather-daemonset-q9d7n" Sep 17 16:54:08.716451 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:08.716334 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/209869a1-1abb-4573-8cd7-6aff3ba0f25c-lib-modules\") pod \"perf-node-gather-daemonset-q9d7n\" (UID: \"209869a1-1abb-4573-8cd7-6aff3ba0f25c\") " pod="openshift-must-gather-fscp7/perf-node-gather-daemonset-q9d7n" Sep 17 16:54:08.716451 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:08.716339 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/209869a1-1abb-4573-8cd7-6aff3ba0f25c-podres\") pod \"perf-node-gather-daemonset-q9d7n\" (UID: \"209869a1-1abb-4573-8cd7-6aff3ba0f25c\") " pod="openshift-must-gather-fscp7/perf-node-gather-daemonset-q9d7n" Sep 17 16:54:08.725101 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:08.725070 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pqgx\" (UniqueName: \"kubernetes.io/projected/209869a1-1abb-4573-8cd7-6aff3ba0f25c-kube-api-access-6pqgx\") pod \"perf-node-gather-daemonset-q9d7n\" (UID: \"209869a1-1abb-4573-8cd7-6aff3ba0f25c\") " pod="openshift-must-gather-fscp7/perf-node-gather-daemonset-q9d7n" Sep 17 16:54:08.854141 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:08.854055 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fscp7/perf-node-gather-daemonset-q9d7n" Sep 17 16:54:09.139318 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:09.139261 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fscp7/perf-node-gather-daemonset-q9d7n"] Sep 17 16:54:09.142528 ip-10-0-129-101 kubenswrapper[2581]: W0917 16:54:09.142492 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod209869a1_1abb_4573_8cd7_6aff3ba0f25c.slice/crio-220c42ac9f44e8a24e13490d29223689468bc472306b15b6ae8cdd0b10a9f71b WatchSource:0}: Error finding container 220c42ac9f44e8a24e13490d29223689468bc472306b15b6ae8cdd0b10a9f71b: Status 404 returned error can't find the container with id 220c42ac9f44e8a24e13490d29223689468bc472306b15b6ae8cdd0b10a9f71b Sep 17 16:54:09.433153 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:09.433066 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fscp7/perf-node-gather-daemonset-q9d7n" event={"ID":"209869a1-1abb-4573-8cd7-6aff3ba0f25c","Type":"ContainerStarted","Data":"4deab0a170f8197df02e642d5572b15394eb2d8f3680e28660089c13c147b984"} Sep 17 16:54:09.433153 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:09.433131 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fscp7/perf-node-gather-daemonset-q9d7n" event={"ID":"209869a1-1abb-4573-8cd7-6aff3ba0f25c","Type":"ContainerStarted","Data":"220c42ac9f44e8a24e13490d29223689468bc472306b15b6ae8cdd0b10a9f71b"} Sep 17 16:54:09.433377 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:09.433158 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fscp7/perf-node-gather-daemonset-q9d7n" Sep 17 16:54:09.450709 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:09.450650 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fscp7/perf-node-gather-daemonset-q9d7n" podStartSLOduration=1.450635595 podStartE2EDuration="1.450635595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:54:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:54:09.449071694 +0000 UTC m=+1314.181539264" watchObservedRunningTime="2026-09-17 16:54:09.450635595 +0000 UTC m=+1314.183103173" Sep 17 16:54:10.240340 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:10.240306 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gmcnc_c6664218-0b50-402a-ba5b-dd5632ac696e/dns/0.log" Sep 17 16:54:10.264229 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:10.264202 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gmcnc_c6664218-0b50-402a-ba5b-dd5632ac696e/kube-rbac-proxy/0.log" Sep 17 16:54:10.417229 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:10.417196 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-btzx7_e7d9d424-72bd-454a-af3a-2334a1ba3891/dns-node-resolver/0.log" Sep 17 16:54:11.080488 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:11.080442 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zqkgf_5d65b63e-ceb1-4912-aeea-36e3285e6070/node-ca/0.log" Sep 17 16:54:12.685845 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:12.685814 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tzn87_acda35d5-1e08-4d58-a6c7-d6b0f9999771/serve-healthcheck-canary/0.log" Sep 17 16:54:13.472953 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:13.472927 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zzh9n_3e74c429-ee05-4ff3-bd0c-88faca9c3f26/kube-rbac-proxy/0.log" Sep 17 16:54:13.500180 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:13.500153 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zzh9n_3e74c429-ee05-4ff3-bd0c-88faca9c3f26/exporter/0.log" Sep 17 16:54:13.529470 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:13.529414 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zzh9n_3e74c429-ee05-4ff3-bd0c-88faca9c3f26/extractor/0.log" Sep 17 16:54:15.451591 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:15.451549 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fscp7/perf-node-gather-daemonset-q9d7n" Sep 17 16:54:15.896533 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:15.896510 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6d6dc9b5d9-6pggx_6beb7df5-c1f3-438e-a133-e7cb50d655d5/manager/0.log" Sep 17 16:54:15.936379 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:15.936352 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-m72zg_74a0e409-0f01-4cf3-8238-b54ba5938108/openshift-lws-operator/0.log" Sep 17 16:54:23.012609 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:23.012584 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbgjd_062048ed-07c1-4c34-af9b-bb44392c07d2/kube-multus-additional-cni-plugins/0.log" Sep 17 16:54:23.037884 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:23.037836 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbgjd_062048ed-07c1-4c34-af9b-bb44392c07d2/egress-router-binary-copy/0.log" Sep 17 16:54:23.063196 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:23.063171 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbgjd_062048ed-07c1-4c34-af9b-bb44392c07d2/cni-plugins/0.log" Sep 17 16:54:23.104600 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:23.104578 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbgjd_062048ed-07c1-4c34-af9b-bb44392c07d2/bond-cni-plugin/0.log" Sep 17 16:54:23.134395 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:23.134376 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbgjd_062048ed-07c1-4c34-af9b-bb44392c07d2/routeoverride-cni/0.log" Sep 17 16:54:23.166751 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:23.166737 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbgjd_062048ed-07c1-4c34-af9b-bb44392c07d2/whereabouts-cni-bincopy/0.log" Sep 17 16:54:23.196727 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:23.196706 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbgjd_062048ed-07c1-4c34-af9b-bb44392c07d2/whereabouts-cni/0.log" Sep 17 16:54:23.284619 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:23.284568 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-q4ccz_3fe9cdb3-d0f8-4133-99ec-8ac1dfa34b20/kube-multus/0.log" Sep 17 16:54:23.317685 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:23.317665 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-66zvl_07690c0a-a396-4f6c-9248-41722d757b2f/network-metrics-daemon/0.log" Sep 17 16:54:23.346562 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:23.346539 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-66zvl_07690c0a-a396-4f6c-9248-41722d757b2f/kube-rbac-proxy/0.log" Sep 17 16:54:24.766317 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:24.766292 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jflqj_d6b66e55-13f3-43a0-9c6f-ed705c42995d/ovn-controller/0.log" Sep 17 16:54:24.788195 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:24.788169 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jflqj_d6b66e55-13f3-43a0-9c6f-ed705c42995d/ovn-acl-logging/0.log" Sep 17 16:54:24.788312 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:24.788228 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jflqj_d6b66e55-13f3-43a0-9c6f-ed705c42995d/ovn-acl-logging/1.log" Sep 17 16:54:24.806132 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:24.806112 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jflqj_d6b66e55-13f3-43a0-9c6f-ed705c42995d/kube-rbac-proxy-node/0.log" Sep 17 16:54:24.830104 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:24.830075 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jflqj_d6b66e55-13f3-43a0-9c6f-ed705c42995d/kube-rbac-proxy-ovn-metrics/0.log" Sep 17 16:54:24.852634 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:24.852608 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jflqj_d6b66e55-13f3-43a0-9c6f-ed705c42995d/northd/0.log" Sep 17 16:54:24.877521 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:24.877494 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jflqj_d6b66e55-13f3-43a0-9c6f-ed705c42995d/nbdb/0.log" Sep 17 16:54:24.905195 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:24.905169 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jflqj_d6b66e55-13f3-43a0-9c6f-ed705c42995d/sbdb/0.log" Sep 17 16:54:24.948207 ip-10-0-129-101 kubenswrapper[2581]: I0917 16:54:24.948183 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jflqj_d6b66e55-13f3-43a0-9c6f-ed705c42995d/ovnkube-controller/0.log"