Sep 09 23:01:47.449745 ip-10-0-140-137 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 09 23:01:47.449760 ip-10-0-140-137 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 09 23:01:47.449770 ip-10-0-140-137 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 09 23:01:47.449983 ip-10-0-140-137 systemd[1]: Failed to start Kubernetes Kubelet. Sep 09 23:01:58.821023 ip-10-0-140-137 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 09 23:01:58.821043 ip-10-0-140-137 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot e6868a5a596e44dda04475920b4254ca -- Sep 09 23:03:36.229090 ip-10-0-140-137 systemd[1]: Starting Kubernetes Kubelet... Sep 09 23:03:36.621282 ip-10-0-140-137 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 23:03:36.621282 ip-10-0-140-137 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 09 23:03:36.621282 ip-10-0-140-137 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 23:03:36.621282 ip-10-0-140-137 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 09 23:03:36.621282 ip-10-0-140-137 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 23:03:36.623750 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.623658 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 09 23:03:36.628464 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628437 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:03:36.628464 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628456 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:03:36.628464 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628462 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:03:36.628464 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628465 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:03:36.628464 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628468 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:03:36.628464 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628472 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:03:36.628464 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628475 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:03:36.628712 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628478 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:03:36.628712 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628481 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:03:36.628712 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628484 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:03:36.628712 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628487 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:03:36.628712 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628490 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:03:36.628712 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628493 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:03:36.628712 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628496 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:03:36.628712 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628498 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:03:36.628712 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628501 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:03:36.628712 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628504 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:03:36.628712 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628507 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:03:36.628712 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628510 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:03:36.628712 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628513 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:03:36.628712 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628518 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:03:36.628712 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628521 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:03:36.628712 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628525 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:03:36.628712 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628527 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:03:36.628712 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628530 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:03:36.628712 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628533 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:03:36.629222 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628537 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:03:36.629222 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628540 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:03:36.629222 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628543 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:03:36.629222 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628545 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:03:36.629222 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628548 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:03:36.629222 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628550 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:03:36.629222 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628555 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:03:36.629222 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628558 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:03:36.629222 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628561 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:03:36.629222 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628563 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:03:36.629222 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628566 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:03:36.629222 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628569 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:03:36.629222 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628572 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:03:36.629222 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628575 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:03:36.629222 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628580 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:03:36.629222 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628583 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:03:36.629222 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628586 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:03:36.629222 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628589 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:03:36.629222 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628592 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:03:36.629222 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628595 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:03:36.629715 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628597 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:03:36.629715 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628600 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:03:36.629715 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628604 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:03:36.629715 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628608 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:03:36.629715 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628612 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:03:36.629715 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628615 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:03:36.629715 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628617 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:03:36.629715 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628620 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:03:36.629715 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628623 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:03:36.629715 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628625 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:03:36.629715 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628628 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:03:36.629715 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628633 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:03:36.629715 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628637 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:03:36.629715 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628641 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:03:36.629715 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628644 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:03:36.629715 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628647 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:03:36.629715 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628650 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:03:36.629715 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628654 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:03:36.629715 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628657 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:03:36.629715 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628660 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:03:36.630211 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628663 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:03:36.630211 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628666 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:03:36.630211 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628669 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:03:36.630211 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628671 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:03:36.630211 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628674 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:03:36.630211 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628677 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:03:36.630211 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628680 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:03:36.630211 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628683 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:03:36.630211 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628685 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:03:36.630211 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628688 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:03:36.630211 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628691 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:03:36.630211 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628694 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:03:36.630211 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628697 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:03:36.630211 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628699 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:03:36.630211 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628702 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:03:36.630211 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628705 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:03:36.630211 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628708 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:03:36.630211 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628711 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:03:36.630211 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628714 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:03:36.630211 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628717 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:03:36.630714 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628720 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:03:36.630714 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628723 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:03:36.630714 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628726 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:03:36.630714 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628728 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:03:36.630714 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628731 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:03:36.630714 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628734 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:03:36.630714 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628736 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:03:36.630714 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628739 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:03:36.630714 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628741 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:03:36.630714 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628744 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:03:36.630714 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628747 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:03:36.630714 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628750 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:03:36.630714 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.628752 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:03:36.630714 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629467 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:03:36.630714 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629474 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:03:36.630714 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629477 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:03:36.630714 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629480 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:03:36.630714 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629483 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:03:36.630714 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629486 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:03:36.631189 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629488 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:03:36.631189 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629491 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:03:36.631189 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629494 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:03:36.631189 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629497 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:03:36.631189 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629499 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:03:36.631189 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629504 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:03:36.631189 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629508 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:03:36.631189 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629512 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:03:36.631189 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629514 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:03:36.631189 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629517 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:03:36.631189 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629520 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:03:36.631189 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629524 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:03:36.631189 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629527 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:03:36.631189 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629530 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:03:36.631189 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629532 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:03:36.631189 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629535 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:03:36.631189 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629537 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:03:36.631189 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629540 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:03:36.631189 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629543 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:03:36.631698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629545 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:03:36.631698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629548 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:03:36.631698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629551 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:03:36.631698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629553 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:03:36.631698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629556 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:03:36.631698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629559 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:03:36.631698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629561 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:03:36.631698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629564 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:03:36.631698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629566 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:03:36.631698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629569 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:03:36.631698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629571 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:03:36.631698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629574 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:03:36.631698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629578 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:03:36.631698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629581 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:03:36.631698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629583 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:03:36.631698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629586 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:03:36.631698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629588 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:03:36.631698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629591 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:03:36.631698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629594 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:03:36.631698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629597 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:03:36.632216 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629600 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:03:36.632216 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629602 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:03:36.632216 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629605 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:03:36.632216 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629607 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:03:36.632216 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629610 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:03:36.632216 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629613 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:03:36.632216 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629616 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:03:36.632216 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629618 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:03:36.632216 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629621 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:03:36.632216 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629624 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:03:36.632216 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629626 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:03:36.632216 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629629 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:03:36.632216 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629632 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:03:36.632216 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629637 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:03:36.632216 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629640 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:03:36.632216 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629643 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:03:36.632216 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629645 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:03:36.632216 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629647 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:03:36.632216 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629650 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:03:36.632673 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629652 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:03:36.632673 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629655 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:03:36.632673 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629658 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:03:36.632673 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629660 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:03:36.632673 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629664 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:03:36.632673 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629668 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:03:36.632673 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629671 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:03:36.632673 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629674 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:03:36.632673 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629676 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:03:36.632673 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629679 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:03:36.632673 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629682 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:03:36.632673 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629686 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:03:36.632673 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629689 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:03:36.632673 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629691 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:03:36.632673 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629694 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:03:36.632673 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629696 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:03:36.632673 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629699 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:03:36.632673 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629701 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:03:36.632673 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629704 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:03:36.632673 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629707 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:03:36.633180 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629709 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:03:36.633180 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629712 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:03:36.633180 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629714 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:03:36.633180 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629717 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:03:36.633180 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629720 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:03:36.633180 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629722 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:03:36.633180 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629725 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:03:36.633180 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629728 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:03:36.633180 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629731 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:03:36.633180 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629733 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:03:36.633180 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629735 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:03:36.633180 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629738 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:03:36.633180 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629740 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:03:36.633180 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629743 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:03:36.633180 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.629745 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:03:36.633180 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630173 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:03:36.633180 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630179 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:03:36.633180 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630183 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:03:36.633180 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630186 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:03:36.633180 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630189 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:03:36.633739 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630192 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:03:36.633739 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630195 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:03:36.633739 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630198 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:03:36.633739 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630201 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:03:36.633739 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630204 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:03:36.633739 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630207 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:03:36.633739 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630215 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:03:36.633739 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630219 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:03:36.633739 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630222 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:03:36.633739 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630225 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:03:36.633739 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630228 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:03:36.633739 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630231 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:03:36.633739 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630234 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:03:36.633739 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630237 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:03:36.633739 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630240 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:03:36.633739 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630242 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:03:36.633739 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630245 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:03:36.633739 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630248 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:03:36.633739 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630250 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:03:36.634223 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630253 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:03:36.634223 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630255 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:03:36.634223 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630258 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:03:36.634223 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630260 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:03:36.634223 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630263 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:03:36.634223 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630265 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:03:36.634223 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630268 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:03:36.634223 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630271 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:03:36.634223 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630273 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:03:36.634223 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630276 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:03:36.634223 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630279 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:03:36.634223 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630282 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:03:36.634223 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630284 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:03:36.634223 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630287 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:03:36.634223 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630290 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:03:36.634223 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630293 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:03:36.634223 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630295 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:03:36.634223 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630299 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:03:36.634223 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630301 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:03:36.634223 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630304 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:03:36.634723 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630306 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:03:36.634723 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630309 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:03:36.634723 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630313 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:03:36.634723 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630316 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:03:36.634723 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630319 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:03:36.634723 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630322 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:03:36.634723 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630325 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:03:36.634723 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630327 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:03:36.634723 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630330 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:03:36.634723 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630334 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:03:36.634723 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630337 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:03:36.634723 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630340 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:03:36.634723 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630343 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:03:36.634723 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630345 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:03:36.634723 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630348 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:03:36.634723 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630351 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:03:36.634723 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630353 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:03:36.634723 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630356 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:03:36.634723 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630358 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:03:36.635201 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630361 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:03:36.635201 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630363 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:03:36.635201 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630366 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:03:36.635201 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630368 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:03:36.635201 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630371 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:03:36.635201 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630373 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:03:36.635201 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630376 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:03:36.635201 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630378 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:03:36.635201 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630381 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:03:36.635201 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630384 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:03:36.635201 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630387 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:03:36.635201 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630390 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:03:36.635201 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630392 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:03:36.635201 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630395 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:03:36.635201 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630397 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:03:36.635201 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630399 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:03:36.635201 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630402 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:03:36.635201 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630404 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:03:36.635201 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630407 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:03:36.635201 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630409 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:03:36.635698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630412 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:03:36.635698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630414 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:03:36.635698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630417 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:03:36.635698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630419 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:03:36.635698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630422 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:03:36.635698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630424 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:03:36.635698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630427 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:03:36.635698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630429 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:03:36.635698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630432 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:03:36.635698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630434 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:03:36.635698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630437 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:03:36.635698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630440 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:03:36.635698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630442 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:03:36.635698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630444 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:03:36.635698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630447 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:03:36.635698 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.630453 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:03:36.635698 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630531 2575 flags.go:64] FLAG: --address="0.0.0.0" Sep 09 23:03:36.635698 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630568 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 09 23:03:36.635698 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630574 2575 flags.go:64] FLAG: --anonymous-auth="true" Sep 09 23:03:36.635698 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630579 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 09 23:03:36.635698 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630583 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 09 23:03:36.636217 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630587 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 09 23:03:36.636217 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630591 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 09 23:03:36.636217 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630595 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 09 23:03:36.636217 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630598 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 09 23:03:36.636217 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630601 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 09 23:03:36.636217 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630605 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 09 23:03:36.636217 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630608 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 09 23:03:36.636217 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630611 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 09 23:03:36.636217 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630614 2575 flags.go:64] FLAG: --cgroup-root="" Sep 09 23:03:36.636217 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630617 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 09 23:03:36.636217 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630620 2575 flags.go:64] FLAG: --client-ca-file="" Sep 09 23:03:36.636217 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630624 2575 flags.go:64] FLAG: --cloud-provider="external" Sep 09 23:03:36.636217 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630627 2575 flags.go:64] FLAG: --cluster-dns="[]" Sep 09 23:03:36.636217 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630638 2575 flags.go:64] FLAG: --cluster-domain="" Sep 09 23:03:36.636217 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630641 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 09 23:03:36.636217 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630644 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 09 23:03:36.636217 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630647 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 09 23:03:36.636217 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630650 2575 flags.go:64] FLAG: --container-log-max-files="5" Sep 09 23:03:36.636217 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630658 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 09 23:03:36.636217 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630661 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 09 23:03:36.636217 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630664 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 09 23:03:36.636217 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630668 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 09 23:03:36.636217 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630671 2575 flags.go:64] FLAG: --contention-profiling="false" Sep 09 23:03:36.636217 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630674 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 09 23:03:36.636799 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630677 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 09 23:03:36.636799 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630680 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 09 23:03:36.636799 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630684 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 09 23:03:36.636799 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630688 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 09 23:03:36.636799 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630691 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 09 23:03:36.636799 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630702 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 09 23:03:36.636799 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630705 2575 flags.go:64] FLAG: --enable-load-reader="false" Sep 09 23:03:36.636799 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630712 2575 flags.go:64] FLAG: --enable-server="true" Sep 09 23:03:36.636799 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630715 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 09 23:03:36.636799 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630720 2575 flags.go:64] FLAG: --event-burst="100" Sep 09 23:03:36.636799 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630723 2575 flags.go:64] FLAG: --event-qps="50" Sep 09 23:03:36.636799 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630726 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 09 23:03:36.636799 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630730 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 09 23:03:36.636799 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630732 2575 flags.go:64] FLAG: --eviction-hard="" Sep 09 23:03:36.636799 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630736 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 09 23:03:36.636799 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630739 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 09 23:03:36.636799 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630742 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 09 23:03:36.636799 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630745 2575 flags.go:64] FLAG: --eviction-soft="" Sep 09 23:03:36.636799 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630748 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 09 23:03:36.636799 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630751 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 09 23:03:36.636799 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630757 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 09 23:03:36.636799 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630760 2575 flags.go:64] FLAG: --experimental-mounter-path="" Sep 09 23:03:36.636799 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630763 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 09 23:03:36.636799 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630766 2575 flags.go:64] FLAG: --fail-swap-on="true" Sep 09 23:03:36.636799 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630769 2575 flags.go:64] FLAG: --feature-gates="" Sep 09 23:03:36.637469 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630773 2575 flags.go:64] FLAG: --file-check-frequency="20s" Sep 09 23:03:36.637469 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630776 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 09 23:03:36.637469 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630779 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 09 23:03:36.637469 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630782 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 09 23:03:36.637469 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630785 2575 flags.go:64] FLAG: --healthz-port="10248" Sep 09 23:03:36.637469 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630788 2575 flags.go:64] FLAG: --help="false" Sep 09 23:03:36.637469 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630791 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-140-137.ec2.internal" Sep 09 23:03:36.637469 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630794 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 09 23:03:36.637469 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630796 2575 flags.go:64] FLAG: --http-check-frequency="20s" Sep 09 23:03:36.637469 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630800 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 09 23:03:36.637469 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630804 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 09 23:03:36.637469 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630807 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 09 23:03:36.637469 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630810 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 09 23:03:36.637469 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630813 2575 flags.go:64] FLAG: --image-service-endpoint="" Sep 09 23:03:36.637469 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630817 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 09 23:03:36.637469 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630820 2575 flags.go:64] FLAG: --kube-api-burst="100" Sep 09 23:03:36.637469 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630823 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 09 23:03:36.637469 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630840 2575 flags.go:64] FLAG: --kube-api-qps="50" Sep 09 23:03:36.637469 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630843 2575 flags.go:64] FLAG: --kube-reserved="" Sep 09 23:03:36.637469 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630846 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 09 23:03:36.637469 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630849 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 09 23:03:36.637469 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630852 2575 flags.go:64] FLAG: --kubelet-cgroups="" Sep 09 23:03:36.637469 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630855 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 09 23:03:36.637469 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630858 2575 flags.go:64] FLAG: --lock-file="" Sep 09 23:03:36.638070 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630861 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 09 23:03:36.638070 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630864 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 09 23:03:36.638070 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630867 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 09 23:03:36.638070 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630877 2575 flags.go:64] FLAG: --log-json-split-stream="false" Sep 09 23:03:36.638070 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630881 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 09 23:03:36.638070 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630884 2575 flags.go:64] FLAG: --log-text-split-stream="false" Sep 09 23:03:36.638070 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630887 2575 flags.go:64] FLAG: --logging-format="text" Sep 09 23:03:36.638070 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630889 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 09 23:03:36.638070 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630893 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 09 23:03:36.638070 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630896 2575 flags.go:64] FLAG: --manifest-url="" Sep 09 23:03:36.638070 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630898 2575 flags.go:64] FLAG: --manifest-url-header="" Sep 09 23:03:36.638070 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630903 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 09 23:03:36.638070 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630906 2575 flags.go:64] FLAG: --max-open-files="1000000" Sep 09 23:03:36.638070 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630910 2575 flags.go:64] FLAG: --max-pods="110" Sep 09 23:03:36.638070 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630912 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 09 23:03:36.638070 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630915 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 09 23:03:36.638070 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630918 2575 flags.go:64] FLAG: --memory-manager-policy="None" Sep 09 23:03:36.638070 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630922 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 09 23:03:36.638070 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630926 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 09 23:03:36.638070 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630929 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 09 23:03:36.638070 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630932 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 09 23:03:36.638070 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630939 2575 flags.go:64] FLAG: --node-status-max-images="50" Sep 09 23:03:36.638070 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630944 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 09 23:03:36.638070 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630947 2575 flags.go:64] FLAG: --oom-score-adj="-999" Sep 09 23:03:36.638070 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630950 2575 flags.go:64] FLAG: --pod-cidr="" Sep 09 23:03:36.638687 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630953 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 09 23:03:36.638687 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630958 2575 flags.go:64] FLAG: --pod-manifest-path="" Sep 09 23:03:36.638687 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630961 2575 flags.go:64] FLAG: --pod-max-pids="-1" Sep 09 23:03:36.638687 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630964 2575 flags.go:64] FLAG: --pods-per-core="0" Sep 09 23:03:36.638687 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630966 2575 flags.go:64] FLAG: --port="10250" Sep 09 23:03:36.638687 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630970 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 09 23:03:36.638687 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630973 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-078c5f4656f456606" Sep 09 23:03:36.638687 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630976 2575 flags.go:64] FLAG: --qos-reserved="" Sep 09 23:03:36.638687 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630979 2575 flags.go:64] FLAG: --read-only-port="10255" Sep 09 23:03:36.638687 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630982 2575 flags.go:64] FLAG: --register-node="true" Sep 09 23:03:36.638687 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630985 2575 flags.go:64] FLAG: --register-with-taints="" Sep 09 23:03:36.638687 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630988 2575 flags.go:64] FLAG: --registry-burst="10" Sep 09 23:03:36.638687 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630991 2575 flags.go:64] FLAG: --registry-qps="5" Sep 09 23:03:36.638687 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630994 2575 flags.go:64] FLAG: --reserved-cpus="" Sep 09 23:03:36.638687 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.630997 2575 flags.go:64] FLAG: --reserved-memory="" Sep 09 23:03:36.638687 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631001 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 09 23:03:36.638687 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631004 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 09 23:03:36.638687 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631006 2575 flags.go:64] FLAG: --rotate-certificates="false" Sep 09 23:03:36.638687 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631009 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 09 23:03:36.638687 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631012 2575 flags.go:64] FLAG: --runonce="false" Sep 09 23:03:36.638687 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631015 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 09 23:03:36.638687 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631018 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 09 23:03:36.638687 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631021 2575 flags.go:64] FLAG: --seccomp-default="false" Sep 09 23:03:36.638687 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631023 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 09 23:03:36.638687 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631026 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 09 23:03:36.639353 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631031 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 09 23:03:36.639353 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631034 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 09 23:03:36.639353 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631037 2575 flags.go:64] FLAG: --storage-driver-password="root" Sep 09 23:03:36.639353 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631039 2575 flags.go:64] FLAG: --storage-driver-secure="false" Sep 09 23:03:36.639353 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631044 2575 flags.go:64] FLAG: --storage-driver-table="stats" Sep 09 23:03:36.639353 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631047 2575 flags.go:64] FLAG: --storage-driver-user="root" Sep 09 23:03:36.639353 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631049 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 09 23:03:36.639353 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631053 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 09 23:03:36.639353 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631056 2575 flags.go:64] FLAG: --system-cgroups="" Sep 09 23:03:36.639353 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631058 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 09 23:03:36.639353 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631063 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 09 23:03:36.639353 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631066 2575 flags.go:64] FLAG: --tls-cert-file="" Sep 09 23:03:36.639353 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631069 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 09 23:03:36.639353 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631073 2575 flags.go:64] FLAG: --tls-min-version="" Sep 09 23:03:36.639353 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631076 2575 flags.go:64] FLAG: --tls-private-key-file="" Sep 09 23:03:36.639353 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631079 2575 flags.go:64] FLAG: --topology-manager-policy="none" Sep 09 23:03:36.639353 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631082 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 09 23:03:36.639353 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631085 2575 flags.go:64] FLAG: --topology-manager-scope="container" Sep 09 23:03:36.639353 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631088 2575 flags.go:64] FLAG: --v="2" Sep 09 23:03:36.639353 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631092 2575 flags.go:64] FLAG: --version="false" Sep 09 23:03:36.639353 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631096 2575 flags.go:64] FLAG: --vmodule="" Sep 09 23:03:36.639353 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631100 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 09 23:03:36.639353 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.631103 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 09 23:03:36.639353 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631213 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:03:36.639353 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631216 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:03:36.639983 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631221 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:03:36.639983 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631225 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:03:36.639983 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631228 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:03:36.639983 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631231 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:03:36.639983 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631234 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:03:36.639983 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631236 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:03:36.639983 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631239 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:03:36.639983 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631243 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:03:36.639983 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631246 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:03:36.639983 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631248 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:03:36.639983 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631251 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:03:36.639983 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631255 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:03:36.639983 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631258 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:03:36.639983 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631260 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:03:36.639983 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631263 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:03:36.639983 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631266 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:03:36.639983 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631269 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:03:36.639983 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631271 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:03:36.639983 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631274 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:03:36.639983 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631276 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:03:36.640507 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631279 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:03:36.640507 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631281 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:03:36.640507 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631284 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:03:36.640507 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631288 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:03:36.640507 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631292 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:03:36.640507 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631295 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:03:36.640507 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631297 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:03:36.640507 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631300 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:03:36.640507 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631303 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:03:36.640507 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631306 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:03:36.640507 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631310 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:03:36.640507 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631313 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:03:36.640507 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631316 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:03:36.640507 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631319 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:03:36.640507 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631322 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:03:36.640507 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631336 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:03:36.640507 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631339 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:03:36.640507 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631341 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:03:36.640507 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631344 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:03:36.640994 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631349 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:03:36.640994 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631351 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:03:36.640994 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631354 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:03:36.640994 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631357 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:03:36.640994 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631361 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:03:36.640994 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631363 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:03:36.640994 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631366 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:03:36.640994 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631369 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:03:36.640994 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631371 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:03:36.640994 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631374 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:03:36.640994 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631377 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:03:36.640994 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631379 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:03:36.640994 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631382 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:03:36.640994 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631384 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:03:36.640994 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631387 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:03:36.640994 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631390 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:03:36.640994 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631393 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:03:36.640994 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631395 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:03:36.640994 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631398 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:03:36.641474 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631401 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:03:36.641474 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631403 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:03:36.641474 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631406 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:03:36.641474 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631409 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:03:36.641474 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631411 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:03:36.641474 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631414 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:03:36.641474 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631417 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:03:36.641474 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631419 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:03:36.641474 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631422 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:03:36.641474 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631424 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:03:36.641474 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631427 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:03:36.641474 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631429 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:03:36.641474 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631432 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:03:36.641474 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631436 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:03:36.641474 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631438 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:03:36.641474 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631441 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:03:36.641474 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631444 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:03:36.641474 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631447 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:03:36.641474 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631450 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:03:36.641474 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631453 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:03:36.641987 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631455 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:03:36.641987 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631458 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:03:36.641987 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631460 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:03:36.641987 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631463 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:03:36.641987 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631465 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:03:36.641987 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631468 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:03:36.641987 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631470 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:03:36.641987 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631473 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:03:36.641987 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631476 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:03:36.641987 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631478 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:03:36.641987 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631481 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:03:36.641987 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631483 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:03:36.641987 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631486 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:03:36.641987 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631488 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:03:36.641987 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631491 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:03:36.641987 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631493 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:03:36.641987 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631497 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:03:36.641987 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631499 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:03:36.641987 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.631502 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:03:36.642440 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.632049 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 23:03:36.642440 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.639170 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 09 23:03:36.642440 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.639185 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 09 23:03:36.642440 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.640665 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 09 23:03:36.642440 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.640674 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 09 23:03:36.642440 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640730 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:03:36.642440 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640735 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:03:36.642440 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640738 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:03:36.642440 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640741 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:03:36.642440 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640744 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:03:36.642440 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640746 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:03:36.642440 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640749 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:03:36.642440 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640752 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:03:36.642440 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640756 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:03:36.642802 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640760 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:03:36.642802 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640763 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:03:36.642802 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640766 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:03:36.642802 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640768 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:03:36.642802 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640771 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:03:36.642802 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640774 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:03:36.642802 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640777 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:03:36.642802 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640781 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:03:36.642802 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640784 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:03:36.642802 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640788 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:03:36.642802 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640791 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:03:36.642802 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640793 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:03:36.642802 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640796 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:03:36.642802 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640799 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:03:36.642802 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640802 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:03:36.642802 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640804 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:03:36.642802 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640807 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:03:36.642802 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640809 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:03:36.642802 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640812 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:03:36.643273 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640815 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:03:36.643273 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640819 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:03:36.643273 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640821 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:03:36.643273 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640834 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:03:36.643273 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640837 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:03:36.643273 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640839 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:03:36.643273 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640842 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:03:36.643273 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640845 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:03:36.643273 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640847 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:03:36.643273 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640850 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:03:36.643273 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640852 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:03:36.643273 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640855 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:03:36.643273 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640859 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:03:36.643273 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640862 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:03:36.643273 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640865 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:03:36.643273 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640869 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:03:36.643273 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640871 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:03:36.643273 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640874 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:03:36.643273 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640876 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:03:36.643273 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640879 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:03:36.643771 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640882 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:03:36.643771 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640884 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:03:36.643771 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640887 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:03:36.643771 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640889 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:03:36.643771 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640892 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:03:36.643771 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640895 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:03:36.643771 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640897 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:03:36.643771 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640900 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:03:36.643771 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640902 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:03:36.643771 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640904 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:03:36.643771 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640907 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:03:36.643771 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640909 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:03:36.643771 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640913 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:03:36.643771 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640916 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:03:36.643771 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640919 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:03:36.643771 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640922 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:03:36.643771 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640925 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:03:36.643771 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640927 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:03:36.643771 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640930 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:03:36.643771 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640932 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:03:36.644303 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640935 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:03:36.644303 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640938 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:03:36.644303 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640940 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:03:36.644303 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640942 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:03:36.644303 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640945 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:03:36.644303 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640947 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:03:36.644303 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640950 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:03:36.644303 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640952 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:03:36.644303 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640955 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:03:36.644303 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640957 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:03:36.644303 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640960 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:03:36.644303 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640963 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:03:36.644303 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640965 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:03:36.644303 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640968 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:03:36.644303 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640970 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:03:36.644303 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640973 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:03:36.644303 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640975 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:03:36.644303 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640978 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:03:36.644303 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640981 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:03:36.644303 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640983 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:03:36.644793 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640986 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:03:36.644793 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640988 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:03:36.644793 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640991 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:03:36.644793 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640994 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:03:36.644793 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.640997 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:03:36.644793 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641001 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:03:36.644793 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641003 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:03:36.644793 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641007 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:03:36.644793 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641010 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:03:36.644793 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641012 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:03:36.644793 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641015 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:03:36.644793 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.641020 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 23:03:36.644793 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641128 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:03:36.644793 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641134 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:03:36.645217 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641137 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:03:36.645217 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641140 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:03:36.645217 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641143 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:03:36.645217 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641146 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:03:36.645217 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641148 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:03:36.645217 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641152 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:03:36.645217 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641154 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:03:36.645217 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641157 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:03:36.645217 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641160 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:03:36.645217 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641163 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:03:36.645217 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641165 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:03:36.645217 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641168 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:03:36.645217 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641170 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:03:36.645217 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641173 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:03:36.645217 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641176 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:03:36.645217 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641178 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:03:36.645217 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641181 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:03:36.645217 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641183 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:03:36.645217 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641186 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:03:36.645217 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641188 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:03:36.645701 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641191 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:03:36.645701 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641193 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:03:36.645701 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641196 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:03:36.645701 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641199 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:03:36.645701 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641201 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:03:36.645701 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641204 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:03:36.645701 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641207 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:03:36.645701 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641209 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:03:36.645701 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641212 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:03:36.645701 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641215 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:03:36.645701 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641218 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:03:36.645701 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641221 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:03:36.645701 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641223 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:03:36.645701 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641226 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:03:36.645701 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641229 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:03:36.645701 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641231 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:03:36.645701 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641233 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:03:36.645701 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641236 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:03:36.645701 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641239 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:03:36.646174 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641243 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:03:36.646174 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641246 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:03:36.646174 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641249 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:03:36.646174 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641252 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:03:36.646174 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641254 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:03:36.646174 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641257 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:03:36.646174 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641260 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:03:36.646174 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641262 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:03:36.646174 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641265 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:03:36.646174 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641267 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:03:36.646174 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641270 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:03:36.646174 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641272 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:03:36.646174 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641275 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:03:36.646174 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641277 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:03:36.646174 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641279 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:03:36.646174 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641282 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:03:36.646174 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641285 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:03:36.646174 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641288 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:03:36.646174 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641291 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:03:36.646621 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641293 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:03:36.646621 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641297 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:03:36.646621 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641300 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:03:36.646621 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641302 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:03:36.646621 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641305 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:03:36.646621 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641308 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:03:36.646621 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641310 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:03:36.646621 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641313 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:03:36.646621 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641315 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:03:36.646621 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641318 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:03:36.646621 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641320 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:03:36.646621 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641323 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:03:36.646621 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641325 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:03:36.646621 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641327 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:03:36.646621 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641331 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:03:36.646621 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641335 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:03:36.646621 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641337 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:03:36.646621 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641340 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:03:36.646621 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641342 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:03:36.647105 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641345 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:03:36.647105 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641347 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:03:36.647105 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641350 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:03:36.647105 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641352 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:03:36.647105 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641355 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:03:36.647105 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641357 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:03:36.647105 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641360 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:03:36.647105 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641362 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:03:36.647105 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641364 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:03:36.647105 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641367 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:03:36.647105 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641370 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:03:36.647105 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641372 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:03:36.647105 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641375 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:03:36.647105 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641377 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:03:36.647105 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641380 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:03:36.647105 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641384 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:03:36.647105 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641386 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:03:36.647105 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641388 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:03:36.647105 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641391 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:03:36.647105 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:36.641394 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:03:36.647576 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.641398 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 23:03:36.647576 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.641501 2575 server.go:962] "Client rotation is on, will bootstrap in background" Sep 09 23:03:36.647576 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.643395 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 09 23:03:36.647576 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.644234 2575 server.go:1019] "Starting client certificate rotation" Sep 09 23:03:36.647576 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.644333 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 23:03:36.647576 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.644366 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 23:03:36.647576 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.646859 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 23:03:36.651121 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.651105 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 23:03:36.660925 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.660860 2575 log.go:25] "Validated CRI v1 runtime API" Sep 09 23:03:36.663714 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.663697 2575 log.go:25] "Validated CRI v1 image API" Sep 09 23:03:36.664930 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.664908 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 09 23:03:36.668040 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.668010 2575 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c51cd1f7-e657-41aa-9234-863ea7d33665:/dev/nvme0n1p3 fbca55cd-4def-46ab-a2f0-38721d61cd64:/dev/nvme0n1p4] Sep 09 23:03:36.668105 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.668039 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 09 23:03:36.671459 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.671443 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 23:03:36.674202 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.674093 2575 manager.go:216] Machine: {Timestamp:2026-09-09 23:03:36.672700859 +0000 UTC m=+0.330356493 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099357 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec274e76d58dd6ead6a867e33ca1cb36 SystemUUID:ec274e76-d58d-d6ea-d6a8-67e33ca1cb36 BootID:e6868a5a-596e-44dd-a044-75920b4254ca Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:dd:37:97:23:bf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:dd:37:97:23:bf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:02:0c:ef:9e:c3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 09 23:03:36.674202 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.674198 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 09 23:03:36.674331 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.674319 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 09 23:03:36.677143 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.677121 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 09 23:03:36.677274 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.677146 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-137.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 09 23:03:36.677951 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.677941 2575 topology_manager.go:138] "Creating topology manager with none policy" Sep 09 23:03:36.677991 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.677953 2575 container_manager_linux.go:309] "Creating device plugin manager" Sep 09 23:03:36.677991 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.677961 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 23:03:36.678614 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.678603 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 23:03:36.679708 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.679697 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 09 23:03:36.682515 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.682503 2575 state_mem.go:36] "Initialized new in-memory state store" Sep 09 23:03:36.682626 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.682617 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 09 23:03:36.682664 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.682651 2575 kubelet.go:486] "Attempting to sync node with API server" Sep 09 23:03:36.682664 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.682661 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 09 23:03:36.682729 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.682673 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 09 23:03:36.682729 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.682684 2575 kubelet.go:398] "Adding apiserver pod source" Sep 09 23:03:36.682729 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.682700 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 09 23:03:36.683175 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.683162 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 23:03:36.683231 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.683189 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 23:03:36.685343 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.685328 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 09 23:03:36.687438 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.687424 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 09 23:03:36.687506 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.687454 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 09 23:03:36.687631 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.687621 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 09 23:03:36.687661 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.687637 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 09 23:03:36.687661 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.687643 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 09 23:03:36.687661 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.687648 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 09 23:03:36.687661 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.687655 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 09 23:03:36.687661 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.687660 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 09 23:03:36.688261 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.688251 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 09 23:03:36.688261 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.688261 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 09 23:03:36.688327 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.688267 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 09 23:03:36.688327 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.688273 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 09 23:03:36.688327 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.688282 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 09 23:03:36.688327 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.688289 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 09 23:03:36.689220 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.689210 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 09 23:03:36.689220 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.689220 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 09 23:03:36.692222 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.692204 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-137.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 09 23:03:36.692273 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:36.692254 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 09 23:03:36.692532 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:36.692501 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-137.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 09 23:03:36.692610 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.692594 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wqptf" Sep 09 23:03:36.693179 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.693166 2575 server.go:1268] "Started kubelet" Sep 09 23:03:36.693247 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.693212 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 09 23:03:36.693341 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.693295 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 09 23:03:36.693389 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.693371 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 09 23:03:36.694065 ip-10-0-140-137 systemd[1]: Started Kubernetes Kubelet. Sep 09 23:03:36.695192 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.694768 2575 server.go:310] "Adding debug handlers to kubelet server" Sep 09 23:03:36.697986 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.697875 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 09 23:03:36.697986 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.697932 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wqptf" Sep 09 23:03:36.700740 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:36.700710 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 09 23:03:36.701917 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:36.700990 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-137.ec2.internal.18d3c97d3af04f54 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-137.ec2.internal,UID:ip-10-0-140-137.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-137.ec2.internal,},FirstTimestamp:2026-09-09 23:03:36.693141332 +0000 UTC m=+0.350796966,LastTimestamp:2026-09-09 23:03:36.693141332 +0000 UTC m=+0.350796966,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-137.ec2.internal,}" Sep 09 23:03:36.702076 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.702063 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 09 23:03:36.702141 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.702084 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 09 23:03:36.702192 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:36.702152 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-137.ec2.internal\" not found" Sep 09 23:03:36.702577 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.702558 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 09 23:03:36.702577 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.702560 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 09 23:03:36.702688 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.702588 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 09 23:03:36.702688 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.702678 2575 reconstruct.go:97] "Volume reconstruction finished" Sep 09 23:03:36.702688 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.702688 2575 reconciler.go:29] "Reconciler: start to sync state" Sep 09 23:03:36.703002 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.702985 2575 factory.go:55] Registering systemd factory Sep 09 23:03:36.703054 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.703017 2575 factory.go:223] Registration of the systemd container factory successfully Sep 09 23:03:36.703236 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.703224 2575 factory.go:153] Registering CRI-O factory Sep 09 23:03:36.703236 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.703236 2575 factory.go:223] Registration of the crio container factory successfully Sep 09 23:03:36.703359 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.703315 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 09 23:03:36.703359 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.703330 2575 factory.go:103] Registering Raw factory Sep 09 23:03:36.703359 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.703344 2575 manager.go:1196] Started watching for new ooms in manager Sep 09 23:03:36.703743 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.703729 2575 manager.go:349] Starting recovery of all containers Sep 09 23:03:36.709880 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.709856 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:03:36.713058 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:36.713031 2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-137.ec2.internal\" not found" node="ip-10-0-140-137.ec2.internal" Sep 09 23:03:36.716086 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.716069 2575 manager.go:354] Recovery completed Sep 09 23:03:36.721508 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.721494 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:03:36.723246 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.723231 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:03:36.723317 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.723263 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:03:36.723317 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.723277 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:03:36.723879 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.723863 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:03:36.723963 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.723915 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 09 23:03:36.723963 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.723929 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 09 23:03:36.723963 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.723951 2575 state_mem.go:36] "Initialized new in-memory state store" Sep 09 23:03:36.725086 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.725070 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:03:36.725163 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.725098 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:03:36.725163 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.725111 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:03:36.725163 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.725142 2575 policy_none.go:49] "None policy: Start" Sep 09 23:03:36.725163 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.725160 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 09 23:03:36.725343 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.725171 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 09 23:03:36.726225 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.726213 2575 policy_none.go:47] "Start" Sep 09 23:03:36.749709 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.749692 2575 manager.go:337] "Starting Device Plugin manager" Sep 09 23:03:36.785905 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:36.749872 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 09 23:03:36.785905 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.749892 2575 server.go:87] "Starting device plugin registration server" Sep 09 23:03:36.785905 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.750154 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 09 23:03:36.785905 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.750168 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 09 23:03:36.785905 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.750360 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 09 23:03:36.785905 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.750429 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 09 23:03:36.785905 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.750437 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 09 23:03:36.785905 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:36.751031 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 09 23:03:36.785905 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:36.751093 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-137.ec2.internal\" not found" Sep 09 23:03:36.830707 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.830675 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 09 23:03:36.831861 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.831819 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 09 23:03:36.831941 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.831900 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 09 23:03:36.831941 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.831925 2575 kubelet.go:2448] "Starting kubelet main sync loop" Sep 09 23:03:36.832029 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:36.831968 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 09 23:03:36.834243 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.834225 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:03:36.851179 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.851157 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:03:36.852058 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.852041 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:03:36.852117 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.852072 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:03:36.852117 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.852082 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:03:36.852117 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.852102 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-137.ec2.internal" Sep 09 23:03:36.859099 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.859086 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-137.ec2.internal" Sep 09 23:03:36.859145 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:36.859106 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-137.ec2.internal\": node \"ip-10-0-140-137.ec2.internal\" not found" Sep 09 23:03:36.873010 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:36.872945 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-137.ec2.internal\" not found" Sep 09 23:03:36.932183 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.932161 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-137.ec2.internal"] Sep 09 23:03:36.932246 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.932232 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:03:36.933573 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.933557 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:03:36.933671 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.933586 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:03:36.933671 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.933600 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:03:36.934898 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.934861 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:03:36.934985 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.934955 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal" Sep 09 23:03:36.934985 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.934980 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:03:36.935504 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.935490 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:03:36.935598 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.935505 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:03:36.935598 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.935526 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:03:36.935598 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.935530 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:03:36.935598 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.935539 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:03:36.935598 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.935543 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:03:36.936638 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.936621 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-137.ec2.internal" Sep 09 23:03:36.936716 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.936649 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:03:36.937328 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.937312 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:03:36.937408 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.937341 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:03:36.937408 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:36.937352 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:03:36.972425 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:36.972405 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-137.ec2.internal\" not found" node="ip-10-0-140-137.ec2.internal" Sep 09 23:03:36.973022 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:36.973008 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-137.ec2.internal\" not found" Sep 09 23:03:36.976660 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:36.976644 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-137.ec2.internal\" not found" node="ip-10-0-140-137.ec2.internal" Sep 09 23:03:37.004099 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:37.004074 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7bf1a5b1f568ae4ec290635c1d4a989f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal\" (UID: \"7bf1a5b1f568ae4ec290635c1d4a989f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal" Sep 09 23:03:37.004189 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:37.004114 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bf1a5b1f568ae4ec290635c1d4a989f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal\" (UID: \"7bf1a5b1f568ae4ec290635c1d4a989f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal" Sep 09 23:03:37.004189 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:37.004138 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3aa92973b9fc245d1f83164656b4e586-config\") pod \"kube-apiserver-proxy-ip-10-0-140-137.ec2.internal\" (UID: \"3aa92973b9fc245d1f83164656b4e586\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-137.ec2.internal" Sep 09 23:03:37.073711 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:37.073682 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-137.ec2.internal\" not found" Sep 09 23:03:37.105044 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:37.105024 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7bf1a5b1f568ae4ec290635c1d4a989f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal\" (UID: \"7bf1a5b1f568ae4ec290635c1d4a989f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal" Sep 09 23:03:37.105117 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:37.105099 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7bf1a5b1f568ae4ec290635c1d4a989f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal\" (UID: \"7bf1a5b1f568ae4ec290635c1d4a989f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal" Sep 09 23:03:37.105150 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:37.105112 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bf1a5b1f568ae4ec290635c1d4a989f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal\" (UID: \"7bf1a5b1f568ae4ec290635c1d4a989f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal" Sep 09 23:03:37.105182 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:37.105142 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3aa92973b9fc245d1f83164656b4e586-config\") pod \"kube-apiserver-proxy-ip-10-0-140-137.ec2.internal\" (UID: \"3aa92973b9fc245d1f83164656b4e586\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-137.ec2.internal" Sep 09 23:03:37.105182 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:37.105176 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7bf1a5b1f568ae4ec290635c1d4a989f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal\" (UID: \"7bf1a5b1f568ae4ec290635c1d4a989f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal" Sep 09 23:03:37.105245 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:37.105194 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3aa92973b9fc245d1f83164656b4e586-config\") pod \"kube-apiserver-proxy-ip-10-0-140-137.ec2.internal\" (UID: \"3aa92973b9fc245d1f83164656b4e586\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-137.ec2.internal" Sep 09 23:03:37.174320 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:37.174266 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-137.ec2.internal\" not found" Sep 09 23:03:37.274874 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:37.274845 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-137.ec2.internal\" not found" Sep 09 23:03:37.274874 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:37.274862 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal" Sep 09 23:03:37.279529 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:37.279517 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-137.ec2.internal" Sep 09 23:03:37.375152 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:37.375129 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-137.ec2.internal\" not found" Sep 09 23:03:37.477021 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:37.476860 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-137.ec2.internal\" not found" Sep 09 23:03:37.578030 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:37.578006 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-137.ec2.internal\" not found" Sep 09 23:03:37.644495 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:37.644473 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 09 23:03:37.644886 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:37.644612 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 23:03:37.644886 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:37.644636 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 23:03:37.679045 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:37.679013 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-137.ec2.internal\" not found" Sep 09 23:03:37.703106 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:37.703038 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 22:58:37 +0000 UTC" deadline="2028-04-16 16:14:31.159728463 +0000 UTC" Sep 09 23:03:37.703106 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:37.703071 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14033h10m53.456662585s" Sep 09 23:03:37.780839 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:37.780809 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-137.ec2.internal\" not found" Sep 09 23:03:37.822090 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:37.822058 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bf1a5b1f568ae4ec290635c1d4a989f.slice/crio-e9d897b80b328eac5e1b2d9edd736cb5126ed87fcfbbc8a17a356b16cb677bae WatchSource:0}: Error finding container e9d897b80b328eac5e1b2d9edd736cb5126ed87fcfbbc8a17a356b16cb677bae: Status 404 returned error can't find the container with id e9d897b80b328eac5e1b2d9edd736cb5126ed87fcfbbc8a17a356b16cb677bae Sep 09 23:03:37.822824 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:37.822800 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aa92973b9fc245d1f83164656b4e586.slice/crio-20d44e95d9791ebcea4b57537ed88b19d7606bf26d6d6e5921713d894728b6ad WatchSource:0}: Error finding container 20d44e95d9791ebcea4b57537ed88b19d7606bf26d6d6e5921713d894728b6ad: Status 404 returned error can't find the container with id 20d44e95d9791ebcea4b57537ed88b19d7606bf26d6d6e5921713d894728b6ad Sep 09 23:03:37.828862 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:37.828848 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:03:37.836389 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:37.836341 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-137.ec2.internal" event={"ID":"3aa92973b9fc245d1f83164656b4e586","Type":"ContainerStarted","Data":"20d44e95d9791ebcea4b57537ed88b19d7606bf26d6d6e5921713d894728b6ad"} Sep 09 23:03:37.837350 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:37.837331 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal" event={"ID":"7bf1a5b1f568ae4ec290635c1d4a989f","Type":"ContainerStarted","Data":"e9d897b80b328eac5e1b2d9edd736cb5126ed87fcfbbc8a17a356b16cb677bae"} Sep 09 23:03:37.881383 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:37.881347 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-137.ec2.internal\" not found" Sep 09 23:03:37.982005 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:37.981952 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-137.ec2.internal\" not found" Sep 09 23:03:38.013578 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.013558 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:03:38.035524 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.035504 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:03:38.102723 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.102689 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal" Sep 09 23:03:38.112862 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.112845 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 23:03:38.114078 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.114065 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-137.ec2.internal" Sep 09 23:03:38.120370 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.120350 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 23:03:38.525125 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.525085 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:03:38.684289 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.684255 2575 apiserver.go:52] "Watching apiserver" Sep 09 23:03:38.690761 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.690737 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 09 23:03:38.691372 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.691347 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal","openshift-multus/multus-additional-cni-plugins-8g29j","openshift-multus/multus-rf5t5","openshift-multus/network-metrics-daemon-kgfhj","kube-system/konnectivity-agent-gf774","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7dk2","openshift-dns/node-resolver-httmw","openshift-network-diagnostics/network-check-target-n6b4v","openshift-network-operator/iptables-alerter-q2fzc","openshift-ovn-kubernetes/ovnkube-node-q6gsr","kube-system/global-pull-secret-syncer-2smzh","kube-system/kube-apiserver-proxy-ip-10-0-140-137.ec2.internal","openshift-cluster-node-tuning-operator/tuned-m6vxb","openshift-image-registry/node-ca-w4qwh"] Sep 09 23:03:38.693037 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.693013 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-httmw" Sep 09 23:03:38.694457 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.694146 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.695882 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.695858 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jmczk\"" Sep 09 23:03:38.696226 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.696082 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.696694 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.696665 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 09 23:03:38.697746 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.697586 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:03:38.699232 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.697929 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 09 23:03:38.699232 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.698264 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 09 23:03:38.699232 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.698403 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 09 23:03:38.699232 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.698587 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pxz5c\"" Sep 09 23:03:38.699232 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.699136 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:03:38.699556 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:38.699391 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgfhj" podUID="d1e3264c-002a-4855-bb40-0c63971351d9" Sep 09 23:03:38.700816 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.700313 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gf774" Sep 09 23:03:38.700816 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.700477 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 09 23:03:38.700975 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.700822 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 09 23:03:38.701627 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.701605 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 09 23:03:38.702382 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.702356 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7dk2" Sep 09 23:03:38.702783 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.702759 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 09 23:03:38.703233 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.703215 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 09 23:03:38.703391 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.703366 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zq6sg\"" Sep 09 23:03:38.703577 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.703562 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 09 23:03:38.703828 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.703807 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bdx42\"" Sep 09 23:03:38.704928 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.704672 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 09 23:03:38.704928 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.704893 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q2fzc" Sep 09 23:03:38.705059 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.704953 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 09 23:03:38.705536 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.705513 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 09 23:03:38.707013 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.706990 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9dgfn\"" Sep 09 23:03:38.707486 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.707466 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w4qwh" Sep 09 23:03:38.708376 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.708173 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 09 23:03:38.708376 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.708196 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 09 23:03:38.708376 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.708276 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cq98b\"" Sep 09 23:03:38.708376 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.708348 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:03:38.710550 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.709986 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 09 23:03:38.710550 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.710075 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-g6vml\"" Sep 09 23:03:38.710550 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.710213 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 09 23:03:38.710550 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.710404 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 09 23:03:38.711868 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.711514 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8g29j" Sep 09 23:03:38.713701 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.713657 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.714155 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.713965 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 09 23:03:38.714155 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.713988 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 09 23:03:38.714384 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.714364 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xxvbn\"" Sep 09 23:03:38.715956 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.715719 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:03:38.715956 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:38.715781 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2smzh" podUID="cd6cb31a-9cc7-4e2a-9ab7-019055393d6c" Sep 09 23:03:38.715956 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.715718 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8z86\" (UniqueName: \"kubernetes.io/projected/d1e3264c-002a-4855-bb40-0c63971351d9-kube-api-access-r8z86\") pod \"network-metrics-daemon-kgfhj\" (UID: \"d1e3264c-002a-4855-bb40-0c63971351d9\") " pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:03:38.715956 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.715914 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d69cc447-0cc3-4ead-a3df-9b30d1ab5e7d-host-slash\") pod \"iptables-alerter-q2fzc\" (UID: \"d69cc447-0cc3-4ead-a3df-9b30d1ab5e7d\") " pod="openshift-network-operator/iptables-alerter-q2fzc" Sep 09 23:03:38.715956 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.715946 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-multus-cni-dir\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.716382 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.715974 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-host-var-lib-kubelet\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.716382 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716006 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a4919899-9165-48b3-aa64-d1de1dcb5d68-multus-daemon-config\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.716382 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716031 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-host-run-multus-certs\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.716382 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716058 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dc2d\" (UniqueName: \"kubernetes.io/projected/a4919899-9165-48b3-aa64-d1de1dcb5d68-kube-api-access-6dc2d\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.716382 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716085 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a3234f19-0f18-483b-9f8e-0e5d00969664-konnectivity-ca\") pod \"konnectivity-agent-gf774\" (UID: \"a3234f19-0f18-483b-9f8e-0e5d00969664\") " pod="kube-system/konnectivity-agent-gf774" Sep 09 23:03:38.716382 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716112 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/df232391-c5b8-4647-902a-148d4ebf442e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f7dk2\" (UID: \"df232391-c5b8-4647-902a-148d4ebf442e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7dk2" Sep 09 23:03:38.716382 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716136 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-etc-tuned\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.716382 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716166 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/de1b41b8-0f82-4297-a438-e47b0e1e683a-hosts-file\") pod \"node-resolver-httmw\" (UID: \"de1b41b8-0f82-4297-a438-e47b0e1e683a\") " pod="openshift-dns/node-resolver-httmw" Sep 09 23:03:38.716382 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716192 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-lib-modules\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.716382 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716222 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-multus-socket-dir-parent\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.716382 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716249 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-host-run-k8s-cni-cncf-io\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.716382 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716273 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-hostroot\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.716382 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716299 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/df232391-c5b8-4647-902a-148d4ebf442e-registration-dir\") pod \"aws-ebs-csi-driver-node-f7dk2\" (UID: \"df232391-c5b8-4647-902a-148d4ebf442e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7dk2" Sep 09 23:03:38.716382 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716324 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs\") pod \"network-metrics-daemon-kgfhj\" (UID: \"d1e3264c-002a-4855-bb40-0c63971351d9\") " pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:03:38.716382 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716350 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d69cc447-0cc3-4ead-a3df-9b30d1ab5e7d-iptables-alerter-script\") pod \"iptables-alerter-q2fzc\" (UID: \"d69cc447-0cc3-4ead-a3df-9b30d1ab5e7d\") " pod="openshift-network-operator/iptables-alerter-q2fzc" Sep 09 23:03:38.716382 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716389 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de1b41b8-0f82-4297-a438-e47b0e1e683a-tmp-dir\") pod \"node-resolver-httmw\" (UID: \"de1b41b8-0f82-4297-a438-e47b0e1e683a\") " pod="openshift-dns/node-resolver-httmw" Sep 09 23:03:38.717207 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716414 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-multus-conf-dir\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.717207 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716441 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-etc-kubernetes\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.717207 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716464 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/df232391-c5b8-4647-902a-148d4ebf442e-etc-selinux\") pod \"aws-ebs-csi-driver-node-f7dk2\" (UID: \"df232391-c5b8-4647-902a-148d4ebf442e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7dk2" Sep 09 23:03:38.717207 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716490 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-etc-modprobe-d\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.717207 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716512 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-sys\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.717207 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716535 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-host\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.717207 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716539 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 09 23:03:38.717207 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716553 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 09 23:03:38.717207 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716560 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-cnibin\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.717207 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716584 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-host-var-lib-cni-multus\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.717207 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716609 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/df232391-c5b8-4647-902a-148d4ebf442e-socket-dir\") pod \"aws-ebs-csi-driver-node-f7dk2\" (UID: \"df232391-c5b8-4647-902a-148d4ebf442e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7dk2" Sep 09 23:03:38.717207 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716642 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a3234f19-0f18-483b-9f8e-0e5d00969664-agent-certs\") pod \"konnectivity-agent-gf774\" (UID: \"a3234f19-0f18-483b-9f8e-0e5d00969664\") " pod="kube-system/konnectivity-agent-gf774" Sep 09 23:03:38.717207 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716659 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb2vp\" (UniqueName: \"kubernetes.io/projected/d69cc447-0cc3-4ead-a3df-9b30d1ab5e7d-kube-api-access-rb2vp\") pod \"iptables-alerter-q2fzc\" (UID: \"d69cc447-0cc3-4ead-a3df-9b30d1ab5e7d\") " pod="openshift-network-operator/iptables-alerter-q2fzc" Sep 09 23:03:38.717207 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716674 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-etc-systemd\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.717207 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716690 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl47l\" (UniqueName: \"kubernetes.io/projected/df232391-c5b8-4647-902a-148d4ebf442e-kube-api-access-zl47l\") pod \"aws-ebs-csi-driver-node-f7dk2\" (UID: \"df232391-c5b8-4647-902a-148d4ebf442e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7dk2" Sep 09 23:03:38.717207 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716731 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-etc-kubernetes\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.717207 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716757 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-etc-sysctl-d\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.717207 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716787 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-etc-sysctl-conf\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.718167 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716812 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-run\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.718167 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716841 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 09 23:03:38.718167 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716843 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4919899-9165-48b3-aa64-d1de1dcb5d68-cni-binary-copy\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.718167 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.716923 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/df232391-c5b8-4647-902a-148d4ebf442e-device-dir\") pod \"aws-ebs-csi-driver-node-f7dk2\" (UID: \"df232391-c5b8-4647-902a-148d4ebf442e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7dk2" Sep 09 23:03:38.718167 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.717063 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/df232391-c5b8-4647-902a-148d4ebf442e-sys-fs\") pod \"aws-ebs-csi-driver-node-f7dk2\" (UID: \"df232391-c5b8-4647-902a-148d4ebf442e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7dk2" Sep 09 23:03:38.718167 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.717095 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k49x9\" (UniqueName: \"kubernetes.io/projected/de1b41b8-0f82-4297-a438-e47b0e1e683a-kube-api-access-k49x9\") pod \"node-resolver-httmw\" (UID: \"de1b41b8-0f82-4297-a438-e47b0e1e683a\") " pod="openshift-dns/node-resolver-httmw" Sep 09 23:03:38.718167 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.717124 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-etc-sysconfig\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.718167 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.717151 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-var-lib-kubelet\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.718167 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.717177 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-tmp\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.718167 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.717222 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4bmb\" (UniqueName: \"kubernetes.io/projected/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-kube-api-access-l4bmb\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.718167 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.717249 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-system-cni-dir\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.718167 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.717286 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-host-run-netns\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.718167 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.717311 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-host-var-lib-cni-bin\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.718167 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.717739 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:03:38.718167 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:38.717811 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6b4v" podUID="291c484c-874a-4ff5-987c-ef066e122a96" Sep 09 23:03:38.718167 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.717838 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 09 23:03:38.718167 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.717937 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 09 23:03:38.718167 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.718074 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 23:03:38.719066 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.718287 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 09 23:03:38.719066 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.718379 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rjx5p\"" Sep 09 23:03:38.737080 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.737059 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hgjzw" Sep 09 23:03:38.746806 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.746266 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hgjzw" Sep 09 23:03:38.804329 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.804303 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 09 23:03:38.818215 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.818185 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-host-var-lib-cni-bin\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.818336 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.818230 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/df232391-c5b8-4647-902a-148d4ebf442e-registration-dir\") pod \"aws-ebs-csi-driver-node-f7dk2\" (UID: \"df232391-c5b8-4647-902a-148d4ebf442e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7dk2" Sep 09 23:03:38.818336 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.818260 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8z86\" (UniqueName: \"kubernetes.io/projected/d1e3264c-002a-4855-bb40-0c63971351d9-kube-api-access-r8z86\") pod \"network-metrics-daemon-kgfhj\" (UID: \"d1e3264c-002a-4855-bb40-0c63971351d9\") " pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:03:38.818443 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.818330 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-host-var-lib-cni-bin\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.818443 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.818358 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-host-var-lib-kubelet\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.818443 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.818394 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a4919899-9165-48b3-aa64-d1de1dcb5d68-multus-daemon-config\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.818443 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.818396 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-host-var-lib-kubelet\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.818443 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.818330 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/df232391-c5b8-4647-902a-148d4ebf442e-registration-dir\") pod \"aws-ebs-csi-driver-node-f7dk2\" (UID: \"df232391-c5b8-4647-902a-148d4ebf442e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7dk2" Sep 09 23:03:38.818443 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.818419 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/df232391-c5b8-4647-902a-148d4ebf442e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f7dk2\" (UID: \"df232391-c5b8-4647-902a-148d4ebf442e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7dk2" Sep 09 23:03:38.818798 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.818448 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-run-openvswitch\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.818798 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.818493 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a3181805-89ae-4090-9e2e-4a15a4f32439-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8g29j\" (UID: \"a3181805-89ae-4090-9e2e-4a15a4f32439\") " pod="openshift-multus/multus-additional-cni-plugins-8g29j" Sep 09 23:03:38.818798 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.818519 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cd6cb31a-9cc7-4e2a-9ab7-019055393d6c-kubelet-config\") pod \"global-pull-secret-syncer-2smzh\" (UID: \"cd6cb31a-9cc7-4e2a-9ab7-019055393d6c\") " pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:03:38.818798 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.818543 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-var-lib-openvswitch\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.818798 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.818567 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-etc-openvswitch\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.818798 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.818595 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-etc-tuned\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.818798 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.818614 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/df232391-c5b8-4647-902a-148d4ebf442e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f7dk2\" (UID: \"df232391-c5b8-4647-902a-148d4ebf442e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7dk2" Sep 09 23:03:38.818798 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.818740 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/de1b41b8-0f82-4297-a438-e47b0e1e683a-hosts-file\") pod \"node-resolver-httmw\" (UID: \"de1b41b8-0f82-4297-a438-e47b0e1e683a\") " pod="openshift-dns/node-resolver-httmw" Sep 09 23:03:38.818798 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.818769 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-multus-socket-dir-parent\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.818798 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.818787 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-hostroot\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.819343 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.818811 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-host-cni-bin\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.819343 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.818867 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/01cc3a72-4b5d-4af7-9db4-219af2288772-ovnkube-script-lib\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.819343 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.818884 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d69cc447-0cc3-4ead-a3df-9b30d1ab5e7d-iptables-alerter-script\") pod \"iptables-alerter-q2fzc\" (UID: \"d69cc447-0cc3-4ead-a3df-9b30d1ab5e7d\") " pod="openshift-network-operator/iptables-alerter-q2fzc" Sep 09 23:03:38.819343 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.818910 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de1b41b8-0f82-4297-a438-e47b0e1e683a-tmp-dir\") pod \"node-resolver-httmw\" (UID: \"de1b41b8-0f82-4297-a438-e47b0e1e683a\") " pod="openshift-dns/node-resolver-httmw" Sep 09 23:03:38.819343 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.818917 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 09 23:03:38.819343 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.818954 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1f8dd862-bb98-45c7-b5a9-4c5575d06ad8-serviceca\") pod \"node-ca-w4qwh\" (UID: \"1f8dd862-bb98-45c7-b5a9-4c5575d06ad8\") " pod="openshift-image-registry/node-ca-w4qwh" Sep 09 23:03:38.819343 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.818964 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-hostroot\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.819343 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.818980 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr8j4\" (UniqueName: \"kubernetes.io/projected/01cc3a72-4b5d-4af7-9db4-219af2288772-kube-api-access-rr8j4\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.819343 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.819006 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3181805-89ae-4090-9e2e-4a15a4f32439-system-cni-dir\") pod \"multus-additional-cni-plugins-8g29j\" (UID: \"a3181805-89ae-4090-9e2e-4a15a4f32439\") " pod="openshift-multus/multus-additional-cni-plugins-8g29j" Sep 09 23:03:38.819343 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.819019 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a4919899-9165-48b3-aa64-d1de1dcb5d68-multus-daemon-config\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.819343 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.819035 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-etc-modprobe-d\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.819343 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.819061 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-sys\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.819343 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.819114 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-sys\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.819343 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.819124 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/de1b41b8-0f82-4297-a438-e47b0e1e683a-hosts-file\") pod \"node-resolver-httmw\" (UID: \"de1b41b8-0f82-4297-a438-e47b0e1e683a\") " pod="openshift-dns/node-resolver-httmw" Sep 09 23:03:38.819343 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.819157 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-host\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.819343 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.819182 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-host-var-lib-cni-multus\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.819343 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.819211 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-node-log\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.819343 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.819219 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-multus-socket-dir-parent\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.820185 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.819257 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de1b41b8-0f82-4297-a438-e47b0e1e683a-tmp-dir\") pod \"node-resolver-httmw\" (UID: \"de1b41b8-0f82-4297-a438-e47b0e1e683a\") " pod="openshift-dns/node-resolver-httmw" Sep 09 23:03:38.820185 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.819258 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb2vp\" (UniqueName: \"kubernetes.io/projected/d69cc447-0cc3-4ead-a3df-9b30d1ab5e7d-kube-api-access-rb2vp\") pod \"iptables-alerter-q2fzc\" (UID: \"d69cc447-0cc3-4ead-a3df-9b30d1ab5e7d\") " pod="openshift-network-operator/iptables-alerter-q2fzc" Sep 09 23:03:38.820185 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.819428 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-host-var-lib-cni-multus\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.820185 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.819439 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-host\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.820185 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.819477 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-etc-systemd\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.820185 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.819520 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl47l\" (UniqueName: \"kubernetes.io/projected/df232391-c5b8-4647-902a-148d4ebf442e-kube-api-access-zl47l\") pod \"aws-ebs-csi-driver-node-f7dk2\" (UID: \"df232391-c5b8-4647-902a-148d4ebf442e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7dk2" Sep 09 23:03:38.820185 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.819530 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-etc-systemd\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.820185 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.819547 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-etc-modprobe-d\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.820185 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.819568 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/01cc3a72-4b5d-4af7-9db4-219af2288772-ovnkube-config\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.820185 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.819674 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-etc-sysctl-conf\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.820185 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.819707 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/df232391-c5b8-4647-902a-148d4ebf442e-device-dir\") pod \"aws-ebs-csi-driver-node-f7dk2\" (UID: \"df232391-c5b8-4647-902a-148d4ebf442e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7dk2" Sep 09 23:03:38.820185 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.819745 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/df232391-c5b8-4647-902a-148d4ebf442e-sys-fs\") pod \"aws-ebs-csi-driver-node-f7dk2\" (UID: \"df232391-c5b8-4647-902a-148d4ebf442e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7dk2" Sep 09 23:03:38.820185 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.819775 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-host-cni-netd\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.820185 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.819785 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/df232391-c5b8-4647-902a-148d4ebf442e-device-dir\") pod \"aws-ebs-csi-driver-node-f7dk2\" (UID: \"df232391-c5b8-4647-902a-148d4ebf442e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7dk2" Sep 09 23:03:38.820185 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.819791 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-etc-sysctl-conf\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.820185 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.819802 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a3181805-89ae-4090-9e2e-4a15a4f32439-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8g29j\" (UID: \"a3181805-89ae-4090-9e2e-4a15a4f32439\") " pod="openshift-multus/multus-additional-cni-plugins-8g29j" Sep 09 23:03:38.820185 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.819821 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d69cc447-0cc3-4ead-a3df-9b30d1ab5e7d-iptables-alerter-script\") pod \"iptables-alerter-q2fzc\" (UID: \"d69cc447-0cc3-4ead-a3df-9b30d1ab5e7d\") " pod="openshift-network-operator/iptables-alerter-q2fzc" Sep 09 23:03:38.820848 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.819843 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/df232391-c5b8-4647-902a-148d4ebf442e-sys-fs\") pod \"aws-ebs-csi-driver-node-f7dk2\" (UID: \"df232391-c5b8-4647-902a-148d4ebf442e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7dk2" Sep 09 23:03:38.820848 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.819835 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f8dd862-bb98-45c7-b5a9-4c5575d06ad8-host\") pod \"node-ca-w4qwh\" (UID: \"1f8dd862-bb98-45c7-b5a9-4c5575d06ad8\") " pod="openshift-image-registry/node-ca-w4qwh" Sep 09 23:03:38.820848 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.819881 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hkwh\" (UniqueName: \"kubernetes.io/projected/1f8dd862-bb98-45c7-b5a9-4c5575d06ad8-kube-api-access-6hkwh\") pod \"node-ca-w4qwh\" (UID: \"1f8dd862-bb98-45c7-b5a9-4c5575d06ad8\") " pod="openshift-image-registry/node-ca-w4qwh" Sep 09 23:03:38.820848 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.819910 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k49x9\" (UniqueName: \"kubernetes.io/projected/de1b41b8-0f82-4297-a438-e47b0e1e683a-kube-api-access-k49x9\") pod \"node-resolver-httmw\" (UID: \"de1b41b8-0f82-4297-a438-e47b0e1e683a\") " pod="openshift-dns/node-resolver-httmw" Sep 09 23:03:38.820848 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820021 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-host-run-netns\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.820848 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820044 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dc2d\" (UniqueName: \"kubernetes.io/projected/a4919899-9165-48b3-aa64-d1de1dcb5d68-kube-api-access-6dc2d\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.820848 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820065 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a3181805-89ae-4090-9e2e-4a15a4f32439-cni-binary-copy\") pod \"multus-additional-cni-plugins-8g29j\" (UID: \"a3181805-89ae-4090-9e2e-4a15a4f32439\") " pod="openshift-multus/multus-additional-cni-plugins-8g29j" Sep 09 23:03:38.820848 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820082 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d69cc447-0cc3-4ead-a3df-9b30d1ab5e7d-host-slash\") pod \"iptables-alerter-q2fzc\" (UID: \"d69cc447-0cc3-4ead-a3df-9b30d1ab5e7d\") " pod="openshift-network-operator/iptables-alerter-q2fzc" Sep 09 23:03:38.820848 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820098 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-multus-cni-dir\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.820848 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820115 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-host-run-multus-certs\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.820848 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820130 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/01cc3a72-4b5d-4af7-9db4-219af2288772-env-overrides\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.820848 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820147 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd6cb31a-9cc7-4e2a-9ab7-019055393d6c-original-pull-secret\") pod \"global-pull-secret-syncer-2smzh\" (UID: \"cd6cb31a-9cc7-4e2a-9ab7-019055393d6c\") " pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:03:38.820848 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820197 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-host-run-multus-certs\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.820848 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820239 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d69cc447-0cc3-4ead-a3df-9b30d1ab5e7d-host-slash\") pod \"iptables-alerter-q2fzc\" (UID: \"d69cc447-0cc3-4ead-a3df-9b30d1ab5e7d\") " pod="openshift-network-operator/iptables-alerter-q2fzc" Sep 09 23:03:38.820848 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820262 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-host-run-netns\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.820848 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820279 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a3234f19-0f18-483b-9f8e-0e5d00969664-konnectivity-ca\") pod \"konnectivity-agent-gf774\" (UID: \"a3234f19-0f18-483b-9f8e-0e5d00969664\") " pod="kube-system/konnectivity-agent-gf774" Sep 09 23:03:38.820848 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820316 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-host-kubelet\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.821556 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820318 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-multus-cni-dir\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.821556 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820345 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-host-run-ovn-kubernetes\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.821556 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820374 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/df232391-c5b8-4647-902a-148d4ebf442e-etc-selinux\") pod \"aws-ebs-csi-driver-node-f7dk2\" (UID: \"df232391-c5b8-4647-902a-148d4ebf442e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7dk2" Sep 09 23:03:38.821556 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820399 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-systemd-units\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.821556 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820424 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-lib-modules\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.821556 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820449 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-host-run-k8s-cni-cncf-io\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.821556 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820473 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs\") pod \"network-metrics-daemon-kgfhj\" (UID: \"d1e3264c-002a-4855-bb40-0c63971351d9\") " pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:03:38.821556 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820498 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-multus-conf-dir\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.821556 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820507 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/df232391-c5b8-4647-902a-148d4ebf442e-etc-selinux\") pod \"aws-ebs-csi-driver-node-f7dk2\" (UID: \"df232391-c5b8-4647-902a-148d4ebf442e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7dk2" Sep 09 23:03:38.821556 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820522 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-etc-kubernetes\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.821556 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820540 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-host-run-k8s-cni-cncf-io\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.821556 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820547 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a3181805-89ae-4090-9e2e-4a15a4f32439-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8g29j\" (UID: \"a3181805-89ae-4090-9e2e-4a15a4f32439\") " pod="openshift-multus/multus-additional-cni-plugins-8g29j" Sep 09 23:03:38.821556 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820575 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-cnibin\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.821556 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820600 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/df232391-c5b8-4647-902a-148d4ebf442e-socket-dir\") pod \"aws-ebs-csi-driver-node-f7dk2\" (UID: \"df232391-c5b8-4647-902a-148d4ebf442e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7dk2" Sep 09 23:03:38.821556 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820627 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-host-run-netns\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.821556 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820645 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-lib-modules\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.821556 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820651 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a3234f19-0f18-483b-9f8e-0e5d00969664-agent-certs\") pod \"konnectivity-agent-gf774\" (UID: \"a3234f19-0f18-483b-9f8e-0e5d00969664\") " pod="kube-system/konnectivity-agent-gf774" Sep 09 23:03:38.822449 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820678 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-host-slash\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.822449 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820701 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-run-ovn\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.822449 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:38.820714 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:03:38.822449 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820727 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.822449 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820755 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a3181805-89ae-4090-9e2e-4a15a4f32439-cnibin\") pod \"multus-additional-cni-plugins-8g29j\" (UID: \"a3181805-89ae-4090-9e2e-4a15a4f32439\") " pod="openshift-multus/multus-additional-cni-plugins-8g29j" Sep 09 23:03:38.822449 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:38.820785 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs podName:d1e3264c-002a-4855-bb40-0c63971351d9 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:39.320755094 +0000 UTC m=+2.978410718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs") pod "network-metrics-daemon-kgfhj" (UID: "d1e3264c-002a-4855-bb40-0c63971351d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:03:38.822449 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820812 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-multus-conf-dir\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.822449 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820884 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-cnibin\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.822449 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820904 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/df232391-c5b8-4647-902a-148d4ebf442e-socket-dir\") pod \"aws-ebs-csi-driver-node-f7dk2\" (UID: \"df232391-c5b8-4647-902a-148d4ebf442e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7dk2" Sep 09 23:03:38.822449 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820922 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a3234f19-0f18-483b-9f8e-0e5d00969664-konnectivity-ca\") pod \"konnectivity-agent-gf774\" (UID: \"a3234f19-0f18-483b-9f8e-0e5d00969664\") " pod="kube-system/konnectivity-agent-gf774" Sep 09 23:03:38.822449 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.820930 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-etc-kubernetes\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.822449 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.821010 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjds7\" (UniqueName: \"kubernetes.io/projected/a3181805-89ae-4090-9e2e-4a15a4f32439-kube-api-access-mjds7\") pod \"multus-additional-cni-plugins-8g29j\" (UID: \"a3181805-89ae-4090-9e2e-4a15a4f32439\") " pod="openshift-multus/multus-additional-cni-plugins-8g29j" Sep 09 23:03:38.822449 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.821039 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cd6cb31a-9cc7-4e2a-9ab7-019055393d6c-dbus\") pod \"global-pull-secret-syncer-2smzh\" (UID: \"cd6cb31a-9cc7-4e2a-9ab7-019055393d6c\") " pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:03:38.822449 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.821064 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-etc-kubernetes\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.822449 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.821089 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-etc-sysctl-d\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.822449 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.821112 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-run\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.822449 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.821135 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4919899-9165-48b3-aa64-d1de1dcb5d68-cni-binary-copy\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.823336 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.821158 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-run-systemd\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.823336 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.821183 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-log-socket\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.823336 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.821231 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-etc-kubernetes\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.823336 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.821243 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/01cc3a72-4b5d-4af7-9db4-219af2288772-ovn-node-metrics-cert\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.823336 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.821273 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckq7h\" (UniqueName: \"kubernetes.io/projected/291c484c-874a-4ff5-987c-ef066e122a96-kube-api-access-ckq7h\") pod \"network-check-target-n6b4v\" (UID: \"291c484c-874a-4ff5-987c-ef066e122a96\") " pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:03:38.823336 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.821300 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-etc-sysconfig\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.823336 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.821325 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-var-lib-kubelet\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.823336 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.821350 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-tmp\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.823336 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.821370 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4bmb\" (UniqueName: \"kubernetes.io/projected/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-kube-api-access-l4bmb\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.823336 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.821393 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-system-cni-dir\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.823336 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.821416 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-etc-sysctl-d\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.823336 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.821486 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4919899-9165-48b3-aa64-d1de1dcb5d68-system-cni-dir\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.823336 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.821491 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-run\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.823336 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.821543 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-etc-sysconfig\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.823336 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.821739 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4919899-9165-48b3-aa64-d1de1dcb5d68-cni-binary-copy\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.823336 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.821785 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-var-lib-kubelet\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.824789 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.824763 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-tmp\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.825094 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.825056 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-etc-tuned\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.826641 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.826369 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a3234f19-0f18-483b-9f8e-0e5d00969664-agent-certs\") pod \"konnectivity-agent-gf774\" (UID: \"a3234f19-0f18-483b-9f8e-0e5d00969664\") " pod="kube-system/konnectivity-agent-gf774" Sep 09 23:03:38.827841 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.827787 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8z86\" (UniqueName: \"kubernetes.io/projected/d1e3264c-002a-4855-bb40-0c63971351d9-kube-api-access-r8z86\") pod \"network-metrics-daemon-kgfhj\" (UID: \"d1e3264c-002a-4855-bb40-0c63971351d9\") " pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:03:38.835893 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.835869 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl47l\" (UniqueName: \"kubernetes.io/projected/df232391-c5b8-4647-902a-148d4ebf442e-kube-api-access-zl47l\") pod \"aws-ebs-csi-driver-node-f7dk2\" (UID: \"df232391-c5b8-4647-902a-148d4ebf442e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7dk2" Sep 09 23:03:38.836636 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.836333 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k49x9\" (UniqueName: \"kubernetes.io/projected/de1b41b8-0f82-4297-a438-e47b0e1e683a-kube-api-access-k49x9\") pod \"node-resolver-httmw\" (UID: \"de1b41b8-0f82-4297-a438-e47b0e1e683a\") " pod="openshift-dns/node-resolver-httmw" Sep 09 23:03:38.838629 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.838561 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dc2d\" (UniqueName: \"kubernetes.io/projected/a4919899-9165-48b3-aa64-d1de1dcb5d68-kube-api-access-6dc2d\") pod \"multus-rf5t5\" (UID: \"a4919899-9165-48b3-aa64-d1de1dcb5d68\") " pod="openshift-multus/multus-rf5t5" Sep 09 23:03:38.839239 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.839217 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb2vp\" (UniqueName: \"kubernetes.io/projected/d69cc447-0cc3-4ead-a3df-9b30d1ab5e7d-kube-api-access-rb2vp\") pod \"iptables-alerter-q2fzc\" (UID: \"d69cc447-0cc3-4ead-a3df-9b30d1ab5e7d\") " pod="openshift-network-operator/iptables-alerter-q2fzc" Sep 09 23:03:38.840308 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.840265 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4bmb\" (UniqueName: \"kubernetes.io/projected/eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4-kube-api-access-l4bmb\") pod \"tuned-m6vxb\" (UID: \"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4\") " pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:38.900949 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.900925 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:03:38.922678 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.922648 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-node-log\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.922791 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.922682 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/01cc3a72-4b5d-4af7-9db4-219af2288772-ovnkube-config\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.922791 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.922710 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-host-cni-netd\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.922791 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.922734 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a3181805-89ae-4090-9e2e-4a15a4f32439-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8g29j\" (UID: \"a3181805-89ae-4090-9e2e-4a15a4f32439\") " pod="openshift-multus/multus-additional-cni-plugins-8g29j" Sep 09 23:03:38.922791 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.922759 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f8dd862-bb98-45c7-b5a9-4c5575d06ad8-host\") pod \"node-ca-w4qwh\" (UID: \"1f8dd862-bb98-45c7-b5a9-4c5575d06ad8\") " pod="openshift-image-registry/node-ca-w4qwh" Sep 09 23:03:38.922791 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.922759 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-node-log\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.922791 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.922782 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hkwh\" (UniqueName: \"kubernetes.io/projected/1f8dd862-bb98-45c7-b5a9-4c5575d06ad8-kube-api-access-6hkwh\") pod \"node-ca-w4qwh\" (UID: \"1f8dd862-bb98-45c7-b5a9-4c5575d06ad8\") " pod="openshift-image-registry/node-ca-w4qwh" Sep 09 23:03:38.924644 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.922810 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a3181805-89ae-4090-9e2e-4a15a4f32439-cni-binary-copy\") pod \"multus-additional-cni-plugins-8g29j\" (UID: \"a3181805-89ae-4090-9e2e-4a15a4f32439\") " pod="openshift-multus/multus-additional-cni-plugins-8g29j" Sep 09 23:03:38.924644 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.922815 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-host-cni-netd\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.924644 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.922838 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/01cc3a72-4b5d-4af7-9db4-219af2288772-env-overrides\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.924644 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.922894 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd6cb31a-9cc7-4e2a-9ab7-019055393d6c-original-pull-secret\") pod \"global-pull-secret-syncer-2smzh\" (UID: \"cd6cb31a-9cc7-4e2a-9ab7-019055393d6c\") " pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:03:38.924644 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.922920 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-host-kubelet\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.924644 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.922921 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f8dd862-bb98-45c7-b5a9-4c5575d06ad8-host\") pod \"node-ca-w4qwh\" (UID: \"1f8dd862-bb98-45c7-b5a9-4c5575d06ad8\") " pod="openshift-image-registry/node-ca-w4qwh" Sep 09 23:03:38.924644 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.922944 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-host-run-ovn-kubernetes\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.924644 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.922966 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-systemd-units\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.924644 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923007 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a3181805-89ae-4090-9e2e-4a15a4f32439-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8g29j\" (UID: \"a3181805-89ae-4090-9e2e-4a15a4f32439\") " pod="openshift-multus/multus-additional-cni-plugins-8g29j" Sep 09 23:03:38.924644 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923036 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-host-run-netns\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.924644 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923060 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-host-slash\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.924644 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923098 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-run-ovn\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.924644 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923123 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.924644 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923149 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a3181805-89ae-4090-9e2e-4a15a4f32439-cnibin\") pod \"multus-additional-cni-plugins-8g29j\" (UID: \"a3181805-89ae-4090-9e2e-4a15a4f32439\") " pod="openshift-multus/multus-additional-cni-plugins-8g29j" Sep 09 23:03:38.924644 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923189 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjds7\" (UniqueName: \"kubernetes.io/projected/a3181805-89ae-4090-9e2e-4a15a4f32439-kube-api-access-mjds7\") pod \"multus-additional-cni-plugins-8g29j\" (UID: \"a3181805-89ae-4090-9e2e-4a15a4f32439\") " pod="openshift-multus/multus-additional-cni-plugins-8g29j" Sep 09 23:03:38.924644 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923214 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cd6cb31a-9cc7-4e2a-9ab7-019055393d6c-dbus\") pod \"global-pull-secret-syncer-2smzh\" (UID: \"cd6cb31a-9cc7-4e2a-9ab7-019055393d6c\") " pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:03:38.924644 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923241 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-run-systemd\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.925494 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923268 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-log-socket\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.925494 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923295 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/01cc3a72-4b5d-4af7-9db4-219af2288772-ovn-node-metrics-cert\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.925494 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923322 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckq7h\" (UniqueName: \"kubernetes.io/projected/291c484c-874a-4ff5-987c-ef066e122a96-kube-api-access-ckq7h\") pod \"network-check-target-n6b4v\" (UID: \"291c484c-874a-4ff5-987c-ef066e122a96\") " pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:03:38.925494 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923393 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-run-ovn\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.925494 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923435 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.925494 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923448 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/01cc3a72-4b5d-4af7-9db4-219af2288772-ovnkube-config\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.925494 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923474 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a3181805-89ae-4090-9e2e-4a15a4f32439-cnibin\") pod \"multus-additional-cni-plugins-8g29j\" (UID: \"a3181805-89ae-4090-9e2e-4a15a4f32439\") " pod="openshift-multus/multus-additional-cni-plugins-8g29j" Sep 09 23:03:38.925494 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923501 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a3181805-89ae-4090-9e2e-4a15a4f32439-cni-binary-copy\") pod \"multus-additional-cni-plugins-8g29j\" (UID: \"a3181805-89ae-4090-9e2e-4a15a4f32439\") " pod="openshift-multus/multus-additional-cni-plugins-8g29j" Sep 09 23:03:38.925494 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923504 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a3181805-89ae-4090-9e2e-4a15a4f32439-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8g29j\" (UID: \"a3181805-89ae-4090-9e2e-4a15a4f32439\") " pod="openshift-multus/multus-additional-cni-plugins-8g29j" Sep 09 23:03:38.925494 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923503 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-run-systemd\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.925494 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923528 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-log-socket\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.925494 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:38.923613 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:03:38.925494 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:38.923664 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd6cb31a-9cc7-4e2a-9ab7-019055393d6c-original-pull-secret podName:cd6cb31a-9cc7-4e2a-9ab7-019055393d6c nodeName:}" failed. No retries permitted until 2026-09-09 23:03:39.423647584 +0000 UTC m=+3.081303208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd6cb31a-9cc7-4e2a-9ab7-019055393d6c-original-pull-secret") pod "global-pull-secret-syncer-2smzh" (UID: "cd6cb31a-9cc7-4e2a-9ab7-019055393d6c") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:03:38.925494 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923695 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-host-run-ovn-kubernetes\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.925494 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923732 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-host-run-netns\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.925494 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923725 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/01cc3a72-4b5d-4af7-9db4-219af2288772-env-overrides\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.925494 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923769 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-run-openvswitch\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.926265 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923798 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a3181805-89ae-4090-9e2e-4a15a4f32439-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8g29j\" (UID: \"a3181805-89ae-4090-9e2e-4a15a4f32439\") " pod="openshift-multus/multus-additional-cni-plugins-8g29j" Sep 09 23:03:38.926265 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923808 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cd6cb31a-9cc7-4e2a-9ab7-019055393d6c-dbus\") pod \"global-pull-secret-syncer-2smzh\" (UID: \"cd6cb31a-9cc7-4e2a-9ab7-019055393d6c\") " pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:03:38.926265 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923827 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cd6cb31a-9cc7-4e2a-9ab7-019055393d6c-kubelet-config\") pod \"global-pull-secret-syncer-2smzh\" (UID: \"cd6cb31a-9cc7-4e2a-9ab7-019055393d6c\") " pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:03:38.926265 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923835 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-host-slash\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.926265 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923856 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-var-lib-openvswitch\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.926265 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923861 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-run-openvswitch\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.926265 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923875 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-systemd-units\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.926265 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923928 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-var-lib-openvswitch\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.926265 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923933 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-host-kubelet\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.926265 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923949 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-etc-openvswitch\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.926265 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923983 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-host-cni-bin\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.926265 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.923996 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cd6cb31a-9cc7-4e2a-9ab7-019055393d6c-kubelet-config\") pod \"global-pull-secret-syncer-2smzh\" (UID: \"cd6cb31a-9cc7-4e2a-9ab7-019055393d6c\") " pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:03:38.926265 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.924007 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/01cc3a72-4b5d-4af7-9db4-219af2288772-ovnkube-script-lib\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.926265 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.924031 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1f8dd862-bb98-45c7-b5a9-4c5575d06ad8-serviceca\") pod \"node-ca-w4qwh\" (UID: \"1f8dd862-bb98-45c7-b5a9-4c5575d06ad8\") " pod="openshift-image-registry/node-ca-w4qwh" Sep 09 23:03:38.926265 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.924041 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-etc-openvswitch\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.926265 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.924056 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr8j4\" (UniqueName: \"kubernetes.io/projected/01cc3a72-4b5d-4af7-9db4-219af2288772-kube-api-access-rr8j4\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.926265 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.924076 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3181805-89ae-4090-9e2e-4a15a4f32439-system-cni-dir\") pod \"multus-additional-cni-plugins-8g29j\" (UID: \"a3181805-89ae-4090-9e2e-4a15a4f32439\") " pod="openshift-multus/multus-additional-cni-plugins-8g29j" Sep 09 23:03:38.927038 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.924077 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a3181805-89ae-4090-9e2e-4a15a4f32439-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8g29j\" (UID: \"a3181805-89ae-4090-9e2e-4a15a4f32439\") " pod="openshift-multus/multus-additional-cni-plugins-8g29j" Sep 09 23:03:38.927038 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.924140 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3181805-89ae-4090-9e2e-4a15a4f32439-system-cni-dir\") pod \"multus-additional-cni-plugins-8g29j\" (UID: \"a3181805-89ae-4090-9e2e-4a15a4f32439\") " pod="openshift-multus/multus-additional-cni-plugins-8g29j" Sep 09 23:03:38.927038 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.924317 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01cc3a72-4b5d-4af7-9db4-219af2288772-host-cni-bin\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.927038 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.924393 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a3181805-89ae-4090-9e2e-4a15a4f32439-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8g29j\" (UID: \"a3181805-89ae-4090-9e2e-4a15a4f32439\") " pod="openshift-multus/multus-additional-cni-plugins-8g29j" Sep 09 23:03:38.927038 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.924574 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/01cc3a72-4b5d-4af7-9db4-219af2288772-ovnkube-script-lib\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.927038 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.924581 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1f8dd862-bb98-45c7-b5a9-4c5575d06ad8-serviceca\") pod \"node-ca-w4qwh\" (UID: \"1f8dd862-bb98-45c7-b5a9-4c5575d06ad8\") " pod="openshift-image-registry/node-ca-w4qwh" Sep 09 23:03:38.927253 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.927134 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/01cc3a72-4b5d-4af7-9db4-219af2288772-ovn-node-metrics-cert\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:38.929906 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:38.929883 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:03:38.929906 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:38.929905 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:03:38.930072 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:38.929919 2575 projected.go:196] Error preparing data for projected volume kube-api-access-ckq7h for pod openshift-network-diagnostics/network-check-target-n6b4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:03:38.930072 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:38.929974 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/291c484c-874a-4ff5-987c-ef066e122a96-kube-api-access-ckq7h podName:291c484c-874a-4ff5-987c-ef066e122a96 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:39.429957283 +0000 UTC m=+3.087612925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ckq7h" (UniqueName: "kubernetes.io/projected/291c484c-874a-4ff5-987c-ef066e122a96-kube-api-access-ckq7h") pod "network-check-target-n6b4v" (UID: "291c484c-874a-4ff5-987c-ef066e122a96") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:03:38.932842 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.932812 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjds7\" (UniqueName: \"kubernetes.io/projected/a3181805-89ae-4090-9e2e-4a15a4f32439-kube-api-access-mjds7\") pod \"multus-additional-cni-plugins-8g29j\" (UID: \"a3181805-89ae-4090-9e2e-4a15a4f32439\") " pod="openshift-multus/multus-additional-cni-plugins-8g29j" Sep 09 23:03:38.933797 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.933758 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hkwh\" (UniqueName: \"kubernetes.io/projected/1f8dd862-bb98-45c7-b5a9-4c5575d06ad8-kube-api-access-6hkwh\") pod \"node-ca-w4qwh\" (UID: \"1f8dd862-bb98-45c7-b5a9-4c5575d06ad8\") " pod="openshift-image-registry/node-ca-w4qwh" Sep 09 23:03:38.933883 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:38.933845 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr8j4\" (UniqueName: \"kubernetes.io/projected/01cc3a72-4b5d-4af7-9db4-219af2288772-kube-api-access-rr8j4\") pod \"ovnkube-node-q6gsr\" (UID: \"01cc3a72-4b5d-4af7-9db4-219af2288772\") " pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:39.010157 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:39.010133 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-httmw" Sep 09 23:03:39.022998 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:39.022975 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" Sep 09 23:03:39.031958 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:39.031912 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rf5t5" Sep 09 23:03:39.039839 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:39.039805 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gf774" Sep 09 23:03:39.047690 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:39.047666 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7dk2" Sep 09 23:03:39.055322 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:39.055300 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q2fzc" Sep 09 23:03:39.064004 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:39.063986 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w4qwh" Sep 09 23:03:39.078226 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:39.078203 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8g29j" Sep 09 23:03:39.082157 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:39.082134 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:03:39.327140 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:39.327046 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs\") pod \"network-metrics-daemon-kgfhj\" (UID: \"d1e3264c-002a-4855-bb40-0c63971351d9\") " pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:03:39.327292 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:39.327186 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:03:39.327292 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:39.327255 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs podName:d1e3264c-002a-4855-bb40-0c63971351d9 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:40.327238799 +0000 UTC m=+3.984894423 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs") pod "network-metrics-daemon-kgfhj" (UID: "d1e3264c-002a-4855-bb40-0c63971351d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:03:39.428131 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:39.428099 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd6cb31a-9cc7-4e2a-9ab7-019055393d6c-original-pull-secret\") pod \"global-pull-secret-syncer-2smzh\" (UID: \"cd6cb31a-9cc7-4e2a-9ab7-019055393d6c\") " pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:03:39.428296 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:39.428239 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:03:39.428357 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:39.428302 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd6cb31a-9cc7-4e2a-9ab7-019055393d6c-original-pull-secret podName:cd6cb31a-9cc7-4e2a-9ab7-019055393d6c nodeName:}" failed. No retries permitted until 2026-09-09 23:03:40.428284274 +0000 UTC m=+4.085939897 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd6cb31a-9cc7-4e2a-9ab7-019055393d6c-original-pull-secret") pod "global-pull-secret-syncer-2smzh" (UID: "cd6cb31a-9cc7-4e2a-9ab7-019055393d6c") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:03:39.529019 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:39.528984 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckq7h\" (UniqueName: \"kubernetes.io/projected/291c484c-874a-4ff5-987c-ef066e122a96-kube-api-access-ckq7h\") pod \"network-check-target-n6b4v\" (UID: \"291c484c-874a-4ff5-987c-ef066e122a96\") " pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:03:39.529211 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:39.529159 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:03:39.529211 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:39.529182 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:03:39.529211 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:39.529192 2575 projected.go:196] Error preparing data for projected volume kube-api-access-ckq7h for pod openshift-network-diagnostics/network-check-target-n6b4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:03:39.529341 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:39.529250 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/291c484c-874a-4ff5-987c-ef066e122a96-kube-api-access-ckq7h podName:291c484c-874a-4ff5-987c-ef066e122a96 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:40.529234332 +0000 UTC m=+4.186889970 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ckq7h" (UniqueName: "kubernetes.io/projected/291c484c-874a-4ff5-987c-ef066e122a96-kube-api-access-ckq7h") pod "network-check-target-n6b4v" (UID: "291c484c-874a-4ff5-987c-ef066e122a96") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:03:39.749215 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:39.749116 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 22:58:39 +0000 UTC" deadline="2028-04-12 18:34:48.639868594 +0000 UTC" Sep 09 23:03:39.749215 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:39.749165 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13939h31m8.890706277s" Sep 09 23:03:39.793508 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:39.793481 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01cc3a72_4b5d_4af7_9db4_219af2288772.slice/crio-84522d94cf27e9be325e89d2dc5dd21a4d633cf7f83571c12abb5453710ab069 WatchSource:0}: Error finding container 84522d94cf27e9be325e89d2dc5dd21a4d633cf7f83571c12abb5453710ab069: Status 404 returned error can't find the container with id 84522d94cf27e9be325e89d2dc5dd21a4d633cf7f83571c12abb5453710ab069 Sep 09 23:03:39.811514 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:39.811472 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb1674f9_a1bb_4a45_bb4b_4782cc74d1d4.slice/crio-a76fa89fd3d3054804047bca5df4dfec657e54fe079c848c48cb730bdf6d35de WatchSource:0}: Error finding container a76fa89fd3d3054804047bca5df4dfec657e54fe079c848c48cb730bdf6d35de: Status 404 returned error can't find the container with id a76fa89fd3d3054804047bca5df4dfec657e54fe079c848c48cb730bdf6d35de Sep 09 23:03:39.812529 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:39.812505 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3234f19_0f18_483b_9f8e_0e5d00969664.slice/crio-d2815a49c2266a75c642b7066237c40400159eeae279cf9d13e1c258a98f2add WatchSource:0}: Error finding container d2815a49c2266a75c642b7066237c40400159eeae279cf9d13e1c258a98f2add: Status 404 returned error can't find the container with id d2815a49c2266a75c642b7066237c40400159eeae279cf9d13e1c258a98f2add Sep 09 23:03:39.814780 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:39.814661 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3181805_89ae_4090_9e2e_4a15a4f32439.slice/crio-0b05e448a4acf60a3d659abddac93a28d738e00b3aa826ec363afb6f1052a785 WatchSource:0}: Error finding container 0b05e448a4acf60a3d659abddac93a28d738e00b3aa826ec363afb6f1052a785: Status 404 returned error can't find the container with id 0b05e448a4acf60a3d659abddac93a28d738e00b3aa826ec363afb6f1052a785 Sep 09 23:03:39.815926 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:39.815812 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde1b41b8_0f82_4297_a438_e47b0e1e683a.slice/crio-12a602cb5b96439f79a39127bae3c8ee385427bd91b9a92b585da496a29956a6 WatchSource:0}: Error finding container 12a602cb5b96439f79a39127bae3c8ee385427bd91b9a92b585da496a29956a6: Status 404 returned error can't find the container with id 12a602cb5b96439f79a39127bae3c8ee385427bd91b9a92b585da496a29956a6 Sep 09 23:03:39.816152 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:39.816122 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf232391_c5b8_4647_902a_148d4ebf442e.slice/crio-2a30d43235226c61b12822bc6fff8d7754871b86a2503cfb03e1e19fb28d8ae0 WatchSource:0}: Error finding container 2a30d43235226c61b12822bc6fff8d7754871b86a2503cfb03e1e19fb28d8ae0: Status 404 returned error can't find the container with id 2a30d43235226c61b12822bc6fff8d7754871b86a2503cfb03e1e19fb28d8ae0 Sep 09 23:03:39.817110 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:39.817086 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd69cc447_0cc3_4ead_a3df_9b30d1ab5e7d.slice/crio-70a77ac290d468aee834c037b9bf3cfffd06e49155b59c9ab2addec0a58622d6 WatchSource:0}: Error finding container 70a77ac290d468aee834c037b9bf3cfffd06e49155b59c9ab2addec0a58622d6: Status 404 returned error can't find the container with id 70a77ac290d468aee834c037b9bf3cfffd06e49155b59c9ab2addec0a58622d6 Sep 09 23:03:39.818030 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:39.817803 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f8dd862_bb98_45c7_b5a9_4c5575d06ad8.slice/crio-41912e1959ab668ea89350f6dafad8252f3222be63a7c718c8a606583d0e55b2 WatchSource:0}: Error finding container 41912e1959ab668ea89350f6dafad8252f3222be63a7c718c8a606583d0e55b2: Status 404 returned error can't find the container with id 41912e1959ab668ea89350f6dafad8252f3222be63a7c718c8a606583d0e55b2 Sep 09 23:03:39.819277 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:03:39.819243 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4919899_9165_48b3_aa64_d1de1dcb5d68.slice/crio-336650c10e30ed9bff681bae06d56103e7f7ce9cb49df0142522fd23c7d68641 WatchSource:0}: Error finding container 336650c10e30ed9bff681bae06d56103e7f7ce9cb49df0142522fd23c7d68641: Status 404 returned error can't find the container with id 336650c10e30ed9bff681bae06d56103e7f7ce9cb49df0142522fd23c7d68641 Sep 09 23:03:39.832461 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:39.832442 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:03:39.832547 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:39.832528 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6b4v" podUID="291c484c-874a-4ff5-987c-ef066e122a96" Sep 09 23:03:39.842128 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:39.842105 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" event={"ID":"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4","Type":"ContainerStarted","Data":"a76fa89fd3d3054804047bca5df4dfec657e54fe079c848c48cb730bdf6d35de"} Sep 09 23:03:39.843423 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:39.843399 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w4qwh" event={"ID":"1f8dd862-bb98-45c7-b5a9-4c5575d06ad8","Type":"ContainerStarted","Data":"41912e1959ab668ea89350f6dafad8252f3222be63a7c718c8a606583d0e55b2"} Sep 09 23:03:39.844658 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:39.844612 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7dk2" event={"ID":"df232391-c5b8-4647-902a-148d4ebf442e","Type":"ContainerStarted","Data":"2a30d43235226c61b12822bc6fff8d7754871b86a2503cfb03e1e19fb28d8ae0"} Sep 09 23:03:39.846051 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:39.845998 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8g29j" event={"ID":"a3181805-89ae-4090-9e2e-4a15a4f32439","Type":"ContainerStarted","Data":"0b05e448a4acf60a3d659abddac93a28d738e00b3aa826ec363afb6f1052a785"} Sep 09 23:03:39.847222 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:39.847199 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" event={"ID":"01cc3a72-4b5d-4af7-9db4-219af2288772","Type":"ContainerStarted","Data":"84522d94cf27e9be325e89d2dc5dd21a4d633cf7f83571c12abb5453710ab069"} Sep 09 23:03:39.848465 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:39.848428 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rf5t5" event={"ID":"a4919899-9165-48b3-aa64-d1de1dcb5d68","Type":"ContainerStarted","Data":"336650c10e30ed9bff681bae06d56103e7f7ce9cb49df0142522fd23c7d68641"} Sep 09 23:03:39.849544 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:39.849521 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q2fzc" event={"ID":"d69cc447-0cc3-4ead-a3df-9b30d1ab5e7d","Type":"ContainerStarted","Data":"70a77ac290d468aee834c037b9bf3cfffd06e49155b59c9ab2addec0a58622d6"} Sep 09 23:03:39.853405 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:39.853378 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-httmw" event={"ID":"de1b41b8-0f82-4297-a438-e47b0e1e683a","Type":"ContainerStarted","Data":"12a602cb5b96439f79a39127bae3c8ee385427bd91b9a92b585da496a29956a6"} Sep 09 23:03:39.855889 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:39.855867 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gf774" event={"ID":"a3234f19-0f18-483b-9f8e-0e5d00969664","Type":"ContainerStarted","Data":"d2815a49c2266a75c642b7066237c40400159eeae279cf9d13e1c258a98f2add"} Sep 09 23:03:40.336298 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:40.335758 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs\") pod \"network-metrics-daemon-kgfhj\" (UID: \"d1e3264c-002a-4855-bb40-0c63971351d9\") " pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:03:40.340403 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:40.340374 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:03:40.340542 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:40.340462 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs podName:d1e3264c-002a-4855-bb40-0c63971351d9 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:42.340441279 +0000 UTC m=+5.998096920 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs") pod "network-metrics-daemon-kgfhj" (UID: "d1e3264c-002a-4855-bb40-0c63971351d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:03:40.436908 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:40.436868 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd6cb31a-9cc7-4e2a-9ab7-019055393d6c-original-pull-secret\") pod \"global-pull-secret-syncer-2smzh\" (UID: \"cd6cb31a-9cc7-4e2a-9ab7-019055393d6c\") " pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:03:40.437067 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:40.437036 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:03:40.437144 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:40.437095 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd6cb31a-9cc7-4e2a-9ab7-019055393d6c-original-pull-secret podName:cd6cb31a-9cc7-4e2a-9ab7-019055393d6c nodeName:}" failed. No retries permitted until 2026-09-09 23:03:42.43707694 +0000 UTC m=+6.094732565 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd6cb31a-9cc7-4e2a-9ab7-019055393d6c-original-pull-secret") pod "global-pull-secret-syncer-2smzh" (UID: "cd6cb31a-9cc7-4e2a-9ab7-019055393d6c") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:03:40.538047 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:40.538008 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckq7h\" (UniqueName: \"kubernetes.io/projected/291c484c-874a-4ff5-987c-ef066e122a96-kube-api-access-ckq7h\") pod \"network-check-target-n6b4v\" (UID: \"291c484c-874a-4ff5-987c-ef066e122a96\") " pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:03:40.538207 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:40.538178 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:03:40.538207 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:40.538196 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:03:40.538314 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:40.538209 2575 projected.go:196] Error preparing data for projected volume kube-api-access-ckq7h for pod openshift-network-diagnostics/network-check-target-n6b4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:03:40.538314 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:40.538268 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/291c484c-874a-4ff5-987c-ef066e122a96-kube-api-access-ckq7h podName:291c484c-874a-4ff5-987c-ef066e122a96 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:42.538247597 +0000 UTC m=+6.195903228 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ckq7h" (UniqueName: "kubernetes.io/projected/291c484c-874a-4ff5-987c-ef066e122a96-kube-api-access-ckq7h") pod "network-check-target-n6b4v" (UID: "291c484c-874a-4ff5-987c-ef066e122a96") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:03:40.749725 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:40.749605 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 22:58:39 +0000 UTC" deadline="2028-02-23 00:50:31.525240625 +0000 UTC" Sep 09 23:03:40.749725 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:40.749673 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12745h46m50.775571669s" Sep 09 23:03:40.835564 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:40.835528 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:03:40.835723 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:40.835685 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgfhj" podUID="d1e3264c-002a-4855-bb40-0c63971351d9" Sep 09 23:03:40.836189 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:40.836163 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:03:40.836296 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:40.836277 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2smzh" podUID="cd6cb31a-9cc7-4e2a-9ab7-019055393d6c" Sep 09 23:03:40.874055 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:40.874018 2575 generic.go:356] "Generic (PLEG): container finished" podID="7bf1a5b1f568ae4ec290635c1d4a989f" containerID="f133a1df5324b68cb1c374f5b2dac7379e09ca57c6e80caaa0c4b8206826ed45" exitCode=0 Sep 09 23:03:40.874744 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:40.874717 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal" event={"ID":"7bf1a5b1f568ae4ec290635c1d4a989f","Type":"ContainerDied","Data":"f133a1df5324b68cb1c374f5b2dac7379e09ca57c6e80caaa0c4b8206826ed45"} Sep 09 23:03:40.900813 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:40.900733 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-137.ec2.internal" event={"ID":"3aa92973b9fc245d1f83164656b4e586","Type":"ContainerStarted","Data":"e7dda1acce82a63fdd241f56b931b286df753396b5a12f950aefe42db1d66298"} Sep 09 23:03:41.832159 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:41.832083 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:03:41.832620 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:41.832206 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6b4v" podUID="291c484c-874a-4ff5-987c-ef066e122a96" Sep 09 23:03:41.940433 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:41.940396 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal" event={"ID":"7bf1a5b1f568ae4ec290635c1d4a989f","Type":"ContainerStarted","Data":"734b1b773c180103f02ac91773289b46c3df45eb990716ff53e9e7aedbae3e94"} Sep 09 23:03:41.956148 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:41.956087 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-137.ec2.internal" podStartSLOduration=3.956064484 podStartE2EDuration="3.956064484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:03:40.915426227 +0000 UTC m=+4.573081875" watchObservedRunningTime="2026-09-09 23:03:41.956064484 +0000 UTC m=+5.613720134" Sep 09 23:03:42.356565 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:42.356502 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs\") pod \"network-metrics-daemon-kgfhj\" (UID: \"d1e3264c-002a-4855-bb40-0c63971351d9\") " pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:03:42.357019 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:42.356750 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:03:42.357019 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:42.356822 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs podName:d1e3264c-002a-4855-bb40-0c63971351d9 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:46.356802373 +0000 UTC m=+10.014458003 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs") pod "network-metrics-daemon-kgfhj" (UID: "d1e3264c-002a-4855-bb40-0c63971351d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:03:42.457223 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:42.457180 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd6cb31a-9cc7-4e2a-9ab7-019055393d6c-original-pull-secret\") pod \"global-pull-secret-syncer-2smzh\" (UID: \"cd6cb31a-9cc7-4e2a-9ab7-019055393d6c\") " pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:03:42.457408 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:42.457381 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:03:42.457489 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:42.457445 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd6cb31a-9cc7-4e2a-9ab7-019055393d6c-original-pull-secret podName:cd6cb31a-9cc7-4e2a-9ab7-019055393d6c nodeName:}" failed. No retries permitted until 2026-09-09 23:03:46.457427134 +0000 UTC m=+10.115082764 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd6cb31a-9cc7-4e2a-9ab7-019055393d6c-original-pull-secret") pod "global-pull-secret-syncer-2smzh" (UID: "cd6cb31a-9cc7-4e2a-9ab7-019055393d6c") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:03:42.558159 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:42.558087 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckq7h\" (UniqueName: \"kubernetes.io/projected/291c484c-874a-4ff5-987c-ef066e122a96-kube-api-access-ckq7h\") pod \"network-check-target-n6b4v\" (UID: \"291c484c-874a-4ff5-987c-ef066e122a96\") " pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:03:42.558327 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:42.558309 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:03:42.558400 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:42.558332 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:03:42.558400 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:42.558347 2575 projected.go:196] Error preparing data for projected volume kube-api-access-ckq7h for pod openshift-network-diagnostics/network-check-target-n6b4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:03:42.558512 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:42.558408 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/291c484c-874a-4ff5-987c-ef066e122a96-kube-api-access-ckq7h podName:291c484c-874a-4ff5-987c-ef066e122a96 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:46.558389048 +0000 UTC m=+10.216044679 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ckq7h" (UniqueName: "kubernetes.io/projected/291c484c-874a-4ff5-987c-ef066e122a96-kube-api-access-ckq7h") pod "network-check-target-n6b4v" (UID: "291c484c-874a-4ff5-987c-ef066e122a96") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:03:42.835398 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:42.835315 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:03:42.835846 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:42.835467 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgfhj" podUID="d1e3264c-002a-4855-bb40-0c63971351d9" Sep 09 23:03:42.835846 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:42.835540 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:03:42.835846 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:42.835615 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2smzh" podUID="cd6cb31a-9cc7-4e2a-9ab7-019055393d6c" Sep 09 23:03:43.832540 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:43.832502 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:03:43.832728 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:43.832632 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6b4v" podUID="291c484c-874a-4ff5-987c-ef066e122a96" Sep 09 23:03:44.833917 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:44.833738 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:03:44.833917 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:44.833891 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgfhj" podUID="d1e3264c-002a-4855-bb40-0c63971351d9" Sep 09 23:03:44.834409 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:44.833982 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:03:44.834409 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:44.834085 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2smzh" podUID="cd6cb31a-9cc7-4e2a-9ab7-019055393d6c" Sep 09 23:03:45.832445 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:45.832360 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:03:45.832613 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:45.832490 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6b4v" podUID="291c484c-874a-4ff5-987c-ef066e122a96" Sep 09 23:03:46.391104 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:46.391066 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs\") pod \"network-metrics-daemon-kgfhj\" (UID: \"d1e3264c-002a-4855-bb40-0c63971351d9\") " pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:03:46.391525 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:46.391198 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:03:46.391525 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:46.391277 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs podName:d1e3264c-002a-4855-bb40-0c63971351d9 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:54.391256058 +0000 UTC m=+18.048911696 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs") pod "network-metrics-daemon-kgfhj" (UID: "d1e3264c-002a-4855-bb40-0c63971351d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:03:46.491696 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:46.491663 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd6cb31a-9cc7-4e2a-9ab7-019055393d6c-original-pull-secret\") pod \"global-pull-secret-syncer-2smzh\" (UID: \"cd6cb31a-9cc7-4e2a-9ab7-019055393d6c\") " pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:03:46.491879 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:46.491819 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:03:46.491960 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:46.491901 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd6cb31a-9cc7-4e2a-9ab7-019055393d6c-original-pull-secret podName:cd6cb31a-9cc7-4e2a-9ab7-019055393d6c nodeName:}" failed. No retries permitted until 2026-09-09 23:03:54.491880935 +0000 UTC m=+18.149536572 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd6cb31a-9cc7-4e2a-9ab7-019055393d6c-original-pull-secret") pod "global-pull-secret-syncer-2smzh" (UID: "cd6cb31a-9cc7-4e2a-9ab7-019055393d6c") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:03:46.593009 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:46.592927 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckq7h\" (UniqueName: \"kubernetes.io/projected/291c484c-874a-4ff5-987c-ef066e122a96-kube-api-access-ckq7h\") pod \"network-check-target-n6b4v\" (UID: \"291c484c-874a-4ff5-987c-ef066e122a96\") " pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:03:46.593178 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:46.593131 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:03:46.593178 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:46.593158 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:03:46.593178 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:46.593171 2575 projected.go:196] Error preparing data for projected volume kube-api-access-ckq7h for pod openshift-network-diagnostics/network-check-target-n6b4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:03:46.593344 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:46.593308 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/291c484c-874a-4ff5-987c-ef066e122a96-kube-api-access-ckq7h podName:291c484c-874a-4ff5-987c-ef066e122a96 nodeName:}" failed. No retries permitted until 2026-09-09 23:03:54.593283674 +0000 UTC m=+18.250939296 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ckq7h" (UniqueName: "kubernetes.io/projected/291c484c-874a-4ff5-987c-ef066e122a96-kube-api-access-ckq7h") pod "network-check-target-n6b4v" (UID: "291c484c-874a-4ff5-987c-ef066e122a96") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:03:46.833529 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:46.833449 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:03:46.833689 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:46.833576 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgfhj" podUID="d1e3264c-002a-4855-bb40-0c63971351d9" Sep 09 23:03:46.833689 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:46.833600 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:03:46.833803 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:46.833706 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2smzh" podUID="cd6cb31a-9cc7-4e2a-9ab7-019055393d6c" Sep 09 23:03:47.832288 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:47.832249 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:03:47.832759 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:47.832384 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6b4v" podUID="291c484c-874a-4ff5-987c-ef066e122a96" Sep 09 23:03:48.832470 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:48.832393 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:03:48.832939 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:48.832399 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:03:48.832939 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:48.832569 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgfhj" podUID="d1e3264c-002a-4855-bb40-0c63971351d9" Sep 09 23:03:48.832939 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:48.832611 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2smzh" podUID="cd6cb31a-9cc7-4e2a-9ab7-019055393d6c" Sep 09 23:03:49.832302 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:49.832269 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:03:49.832451 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:49.832365 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6b4v" podUID="291c484c-874a-4ff5-987c-ef066e122a96" Sep 09 23:03:50.833160 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:50.833130 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:03:50.833600 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:50.833261 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2smzh" podUID="cd6cb31a-9cc7-4e2a-9ab7-019055393d6c" Sep 09 23:03:50.833600 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:50.833310 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:03:50.833600 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:50.833423 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgfhj" podUID="d1e3264c-002a-4855-bb40-0c63971351d9" Sep 09 23:03:51.833117 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:51.833074 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:03:51.833287 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:51.833212 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6b4v" podUID="291c484c-874a-4ff5-987c-ef066e122a96" Sep 09 23:03:52.832866 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:52.832818 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:03:52.833033 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:52.832939 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2smzh" podUID="cd6cb31a-9cc7-4e2a-9ab7-019055393d6c" Sep 09 23:03:52.833033 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:52.832999 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:03:52.833146 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:52.833124 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgfhj" podUID="d1e3264c-002a-4855-bb40-0c63971351d9" Sep 09 23:03:53.832543 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:53.832500 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:03:53.833020 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:53.832645 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6b4v" podUID="291c484c-874a-4ff5-987c-ef066e122a96" Sep 09 23:03:54.461663 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:54.461574 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs\") pod \"network-metrics-daemon-kgfhj\" (UID: \"d1e3264c-002a-4855-bb40-0c63971351d9\") " pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:03:54.461817 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:54.461710 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:03:54.461817 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:54.461770 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs podName:d1e3264c-002a-4855-bb40-0c63971351d9 nodeName:}" failed. No retries permitted until 2026-09-09 23:04:10.461753548 +0000 UTC m=+34.119409170 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs") pod "network-metrics-daemon-kgfhj" (UID: "d1e3264c-002a-4855-bb40-0c63971351d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:03:54.562348 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:54.562309 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd6cb31a-9cc7-4e2a-9ab7-019055393d6c-original-pull-secret\") pod \"global-pull-secret-syncer-2smzh\" (UID: \"cd6cb31a-9cc7-4e2a-9ab7-019055393d6c\") " pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:03:54.562498 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:54.562473 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:03:54.562571 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:54.562549 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd6cb31a-9cc7-4e2a-9ab7-019055393d6c-original-pull-secret podName:cd6cb31a-9cc7-4e2a-9ab7-019055393d6c nodeName:}" failed. No retries permitted until 2026-09-09 23:04:10.562531597 +0000 UTC m=+34.220187225 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd6cb31a-9cc7-4e2a-9ab7-019055393d6c-original-pull-secret") pod "global-pull-secret-syncer-2smzh" (UID: "cd6cb31a-9cc7-4e2a-9ab7-019055393d6c") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:03:54.663543 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:54.663503 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckq7h\" (UniqueName: \"kubernetes.io/projected/291c484c-874a-4ff5-987c-ef066e122a96-kube-api-access-ckq7h\") pod \"network-check-target-n6b4v\" (UID: \"291c484c-874a-4ff5-987c-ef066e122a96\") " pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:03:54.663727 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:54.663665 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:03:54.663727 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:54.663687 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:03:54.663727 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:54.663699 2575 projected.go:196] Error preparing data for projected volume kube-api-access-ckq7h for pod openshift-network-diagnostics/network-check-target-n6b4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:03:54.663923 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:54.663759 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/291c484c-874a-4ff5-987c-ef066e122a96-kube-api-access-ckq7h podName:291c484c-874a-4ff5-987c-ef066e122a96 nodeName:}" failed. No retries permitted until 2026-09-09 23:04:10.663740859 +0000 UTC m=+34.321396485 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ckq7h" (UniqueName: "kubernetes.io/projected/291c484c-874a-4ff5-987c-ef066e122a96-kube-api-access-ckq7h") pod "network-check-target-n6b4v" (UID: "291c484c-874a-4ff5-987c-ef066e122a96") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:03:54.832547 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:54.832456 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:03:54.832699 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:54.832613 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgfhj" podUID="d1e3264c-002a-4855-bb40-0c63971351d9" Sep 09 23:03:54.832699 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:54.832667 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:03:54.833089 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:54.832774 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2smzh" podUID="cd6cb31a-9cc7-4e2a-9ab7-019055393d6c" Sep 09 23:03:55.832618 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:55.832582 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:03:55.832794 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:55.832712 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6b4v" podUID="291c484c-874a-4ff5-987c-ef066e122a96" Sep 09 23:03:56.833861 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:56.833808 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:03:56.834261 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:56.833875 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:03:56.834393 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:56.834335 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgfhj" podUID="d1e3264c-002a-4855-bb40-0c63971351d9" Sep 09 23:03:56.835135 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:56.835027 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2smzh" podUID="cd6cb31a-9cc7-4e2a-9ab7-019055393d6c" Sep 09 23:03:57.832075 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:57.832051 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:03:57.832192 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:57.832167 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6b4v" podUID="291c484c-874a-4ff5-987c-ef066e122a96" Sep 09 23:03:57.986382 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:57.986179 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8g29j" event={"ID":"a3181805-89ae-4090-9e2e-4a15a4f32439","Type":"ContainerStarted","Data":"fe9e871af3bd53e8c7a5d8357c226b484fa9a986030b23e0a885d334b501dca2"} Sep 09 23:03:57.987786 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:57.987762 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" event={"ID":"01cc3a72-4b5d-4af7-9db4-219af2288772","Type":"ContainerStarted","Data":"e08d66d234bdf7864983b8a51a94de88847d7a5c1fb4b876e8eb9b710b9116bd"} Sep 09 23:03:57.989116 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:57.989082 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-httmw" event={"ID":"de1b41b8-0f82-4297-a438-e47b0e1e683a","Type":"ContainerStarted","Data":"693e1f0b53aa6863c9327381a243ffcb42317045a909f319b019d55c834254b5"} Sep 09 23:03:57.990537 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:57.990506 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gf774" event={"ID":"a3234f19-0f18-483b-9f8e-0e5d00969664","Type":"ContainerStarted","Data":"ac1abe53b78984ad33476e93e8f7cb07438e8f03586e454feccca53108d9797d"} Sep 09 23:03:57.992026 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:57.991997 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" event={"ID":"eb1674f9-a1bb-4a45-bb4b-4782cc74d1d4","Type":"ContainerStarted","Data":"b7105fcb5648694bb8fddeeb10712216b99e53b517ebd0dd7da21bc571bc7a56"} Sep 09 23:03:57.993387 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:57.993358 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w4qwh" event={"ID":"1f8dd862-bb98-45c7-b5a9-4c5575d06ad8","Type":"ContainerStarted","Data":"5a2851df55bf3c6d9d72a15344c8739f07700dee2df58372dc551416cd98af0d"} Sep 09 23:03:57.994717 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:57.994698 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7dk2" event={"ID":"df232391-c5b8-4647-902a-148d4ebf442e","Type":"ContainerStarted","Data":"b63f369167d5ae0cdbb8fba3e85be119dfbca8f8917758114027223b77961366"} Sep 09 23:03:58.010540 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:58.010503 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-137.ec2.internal" podStartSLOduration=20.01048974 podStartE2EDuration="20.01048974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:03:41.957157943 +0000 UTC m=+5.614813585" watchObservedRunningTime="2026-09-09 23:03:58.01048974 +0000 UTC m=+21.668145383" Sep 09 23:03:58.028268 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:58.028232 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-httmw" podStartSLOduration=3.276734008 podStartE2EDuration="21.0282185s" totalImagesPullingTime="17.751484492s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:03:58.027950481 +0000 UTC m=+21.685606125" watchObservedRunningTime="2026-09-09 23:03:58.0282185 +0000 UTC m=+21.685874143" Sep 09 23:03:58.045391 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:58.045357 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-w4qwh" podStartSLOduration=3.257215864 podStartE2EDuration="21.045345107s" totalImagesPullingTime="17.788129243s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:03:58.045222638 +0000 UTC m=+21.702878279" watchObservedRunningTime="2026-09-09 23:03:58.045345107 +0000 UTC m=+21.703000750" Sep 09 23:03:58.062476 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:58.062438 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-m6vxb" podStartSLOduration=3.266678748 podStartE2EDuration="21.062427209s" totalImagesPullingTime="17.795748461s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:03:58.062041874 +0000 UTC m=+21.719697518" watchObservedRunningTime="2026-09-09 23:03:58.062427209 +0000 UTC m=+21.720082853" Sep 09 23:03:58.079148 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:58.079111 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gf774" podStartSLOduration=3.324355381 podStartE2EDuration="21.079098798s" totalImagesPullingTime="17.754743417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:03:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:03:58.078928807 +0000 UTC m=+21.736584452" watchObservedRunningTime="2026-09-09 23:03:58.079098798 +0000 UTC m=+21.736754443" Sep 09 23:03:58.178646 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:58.178629 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gf774" Sep 09 23:03:58.832784 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:58.832744 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:03:58.832937 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:58.832883 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2smzh" podUID="cd6cb31a-9cc7-4e2a-9ab7-019055393d6c" Sep 09 23:03:58.832994 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:58.832933 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:03:58.833074 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:58.833057 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgfhj" podUID="d1e3264c-002a-4855-bb40-0c63971351d9" Sep 09 23:03:58.997641 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:58.997602 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rf5t5" event={"ID":"a4919899-9165-48b3-aa64-d1de1dcb5d68","Type":"ContainerStarted","Data":"accc3cb55042263f99852aeaa3f0c9e347158ecd4764b209a1e32b82c7d43a03"} Sep 09 23:03:58.999045 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:58.999016 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q2fzc" event={"ID":"d69cc447-0cc3-4ead-a3df-9b30d1ab5e7d","Type":"ContainerStarted","Data":"b4b949c28d79115e6fac706e2cc362f9d77e7bfd2f6d9756b41dfba7cb8adbe0"} Sep 09 23:03:59.000387 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:59.000366 2575 generic.go:356] "Generic (PLEG): container finished" podID="a3181805-89ae-4090-9e2e-4a15a4f32439" containerID="fe9e871af3bd53e8c7a5d8357c226b484fa9a986030b23e0a885d334b501dca2" exitCode=0 Sep 09 23:03:59.000535 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:59.000440 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8g29j" event={"ID":"a3181805-89ae-4090-9e2e-4a15a4f32439","Type":"ContainerDied","Data":"fe9e871af3bd53e8c7a5d8357c226b484fa9a986030b23e0a885d334b501dca2"} Sep 09 23:03:59.003231 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:59.003214 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6gsr_01cc3a72-4b5d-4af7-9db4-219af2288772/ovn-acl-logging/0.log" Sep 09 23:03:59.003580 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:59.003562 2575 generic.go:356] "Generic (PLEG): container finished" podID="01cc3a72-4b5d-4af7-9db4-219af2288772" containerID="117c01eac02142975937688df13b749ae755fd724b9691d712c9e429888614df" exitCode=1 Sep 09 23:03:59.003667 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:59.003650 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" event={"ID":"01cc3a72-4b5d-4af7-9db4-219af2288772","Type":"ContainerStarted","Data":"21a96ccb6804c4036897b501027685a1d6504c12bf12e15d1edb70c9a0c2c025"} Sep 09 23:03:59.003723 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:59.003711 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" event={"ID":"01cc3a72-4b5d-4af7-9db4-219af2288772","Type":"ContainerStarted","Data":"8240bb51b638e417a9a2fde0f4a9865ba0a6b814484be9792c325b578c58a3f2"} Sep 09 23:03:59.003762 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:59.003753 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" event={"ID":"01cc3a72-4b5d-4af7-9db4-219af2288772","Type":"ContainerStarted","Data":"339384d2f20a51fb75218988f4bcf22098377bd9005e687bd06046e75fefdda5"} Sep 09 23:03:59.003791 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:59.003782 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" event={"ID":"01cc3a72-4b5d-4af7-9db4-219af2288772","Type":"ContainerStarted","Data":"e32bf758c6e0ef30fb6496d87a05ff150010cf6e6ec993ab79b72b04fc0b9954"} Sep 09 23:03:59.003842 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:59.003818 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" event={"ID":"01cc3a72-4b5d-4af7-9db4-219af2288772","Type":"ContainerDied","Data":"117c01eac02142975937688df13b749ae755fd724b9691d712c9e429888614df"} Sep 09 23:03:59.014602 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:59.014559 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rf5t5" podStartSLOduration=3.643937524 podStartE2EDuration="22.014545521s" totalImagesPullingTime="18.370607997s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:03:59.014228099 +0000 UTC m=+22.671883744" watchObservedRunningTime="2026-09-09 23:03:59.014545521 +0000 UTC m=+22.672201219" Sep 09 23:03:59.253978 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:59.253951 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 09 23:03:59.762337 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:59.762238 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T23:03:59.253973769Z","UUID":"117b55d9-515e-4e16-b85e-ee9b036500a3","Handler":null,"Name":"","Endpoint":""} Sep 09 23:03:59.764222 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:59.764194 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 09 23:03:59.764367 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:59.764232 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 09 23:03:59.832881 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:03:59.832853 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:03:59.833052 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:03:59.833000 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6b4v" podUID="291c484c-874a-4ff5-987c-ef066e122a96" Sep 09 23:04:00.008865 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:00.008814 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7dk2" event={"ID":"df232391-c5b8-4647-902a-148d4ebf442e","Type":"ContainerStarted","Data":"d22ca44dd79015601a72177d0e721e2ade0ff47584404fa74ed4248f028f4957"} Sep 09 23:04:00.832290 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:00.832205 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:04:00.832290 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:00.832253 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:04:00.832503 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:00.832378 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgfhj" podUID="d1e3264c-002a-4855-bb40-0c63971351d9" Sep 09 23:04:00.832571 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:00.832525 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2smzh" podUID="cd6cb31a-9cc7-4e2a-9ab7-019055393d6c" Sep 09 23:04:01.013269 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:01.013229 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7dk2" event={"ID":"df232391-c5b8-4647-902a-148d4ebf442e","Type":"ContainerStarted","Data":"731f73ee6877530089855ac39297c4e70564c9ee4797773b3286ae3a0a03decf"} Sep 09 23:04:01.017213 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:01.017190 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6gsr_01cc3a72-4b5d-4af7-9db4-219af2288772/ovn-acl-logging/0.log" Sep 09 23:04:01.017648 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:01.017626 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" event={"ID":"01cc3a72-4b5d-4af7-9db4-219af2288772","Type":"ContainerStarted","Data":"18ece41340219a506a600f53ff69b8755bc8f79a733bdc966855433ac943ebee"} Sep 09 23:04:01.033889 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:01.033847 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f7dk2" podStartSLOduration=4.197716509 podStartE2EDuration="24.033817066s" totalImagesPullingTime="19.836100557s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:04:01.033422874 +0000 UTC m=+24.691078518" watchObservedRunningTime="2026-09-09 23:04:01.033817066 +0000 UTC m=+24.691472711" Sep 09 23:04:01.034063 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:01.034036 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-q2fzc" podStartSLOduration=6.246013134 podStartE2EDuration="24.034027178s" totalImagesPullingTime="17.788014044s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:03:59.047340192 +0000 UTC m=+22.704995837" watchObservedRunningTime="2026-09-09 23:04:01.034027178 +0000 UTC m=+24.691682824" Sep 09 23:04:01.478926 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:01.478886 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gf774" Sep 09 23:04:01.479596 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:01.479575 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gf774" Sep 09 23:04:01.833054 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:01.832986 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:04:01.833184 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:01.833085 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6b4v" podUID="291c484c-874a-4ff5-987c-ef066e122a96" Sep 09 23:04:02.020172 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:02.020138 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gf774" Sep 09 23:04:02.833297 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:02.833002 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:04:02.833297 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:02.833067 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:04:02.833511 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:02.833378 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgfhj" podUID="d1e3264c-002a-4855-bb40-0c63971351d9" Sep 09 23:04:02.833568 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:02.833516 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2smzh" podUID="cd6cb31a-9cc7-4e2a-9ab7-019055393d6c" Sep 09 23:04:03.832904 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:03.832850 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:04:03.833458 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:03.832955 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6b4v" podUID="291c484c-874a-4ff5-987c-ef066e122a96" Sep 09 23:04:04.025227 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:04.025197 2575 generic.go:356] "Generic (PLEG): container finished" podID="a3181805-89ae-4090-9e2e-4a15a4f32439" containerID="91a6f07e26d757a153db2f7adeff4e2ac101ea38f7e2870035b7f78e9922ef56" exitCode=0 Sep 09 23:04:04.025372 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:04.025284 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8g29j" event={"ID":"a3181805-89ae-4090-9e2e-4a15a4f32439","Type":"ContainerDied","Data":"91a6f07e26d757a153db2f7adeff4e2ac101ea38f7e2870035b7f78e9922ef56"} Sep 09 23:04:04.028887 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:04.028868 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6gsr_01cc3a72-4b5d-4af7-9db4-219af2288772/ovn-acl-logging/0.log" Sep 09 23:04:04.029238 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:04.029216 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" event={"ID":"01cc3a72-4b5d-4af7-9db4-219af2288772","Type":"ContainerStarted","Data":"7c6bd18454b67ea61b81c494161b0b464b22a80684f27e2592285039b60da824"} Sep 09 23:04:04.029939 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:04.029459 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:04:04.029939 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:04.029527 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:04:04.029939 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:04.029584 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:04:04.029939 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:04.029631 2575 scope.go:117] "RemoveContainer" containerID="117c01eac02142975937688df13b749ae755fd724b9691d712c9e429888614df" Sep 09 23:04:04.044732 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:04.044713 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:04:04.044889 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:04.044874 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:04:04.832677 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:04.832474 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:04:04.832975 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:04.832492 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:04:04.832975 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:04.832776 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgfhj" podUID="d1e3264c-002a-4855-bb40-0c63971351d9" Sep 09 23:04:04.832975 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:04.832870 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2smzh" podUID="cd6cb31a-9cc7-4e2a-9ab7-019055393d6c" Sep 09 23:04:05.035719 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:05.035691 2575 generic.go:356] "Generic (PLEG): container finished" podID="a3181805-89ae-4090-9e2e-4a15a4f32439" containerID="09297e06c7920b2f21cf20aedffab5b5ab7aac95ae2ea039a8f8512d0eda1794" exitCode=0 Sep 09 23:04:05.035842 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:05.035781 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8g29j" event={"ID":"a3181805-89ae-4090-9e2e-4a15a4f32439","Type":"ContainerDied","Data":"09297e06c7920b2f21cf20aedffab5b5ab7aac95ae2ea039a8f8512d0eda1794"} Sep 09 23:04:05.039948 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:05.039930 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6gsr_01cc3a72-4b5d-4af7-9db4-219af2288772/ovn-acl-logging/0.log" Sep 09 23:04:05.040317 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:05.040296 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" event={"ID":"01cc3a72-4b5d-4af7-9db4-219af2288772","Type":"ContainerStarted","Data":"a0db834f149d47e420d16ee8d713f08dcad359fe1b8edb66158138b8209d21a5"} Sep 09 23:04:05.077194 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:05.077156 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" podStartSLOduration=10.036226649 podStartE2EDuration="28.077145171s" totalImagesPullingTime="18.040918522s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:04:05.075619967 +0000 UTC m=+28.733275612" watchObservedRunningTime="2026-09-09 23:04:05.077145171 +0000 UTC m=+28.734800816" Sep 09 23:04:05.168750 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:05.168672 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2smzh"] Sep 09 23:04:05.168844 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:05.168766 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:04:05.168895 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:05.168874 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2smzh" podUID="cd6cb31a-9cc7-4e2a-9ab7-019055393d6c" Sep 09 23:04:05.171886 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:05.171865 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n6b4v"] Sep 09 23:04:05.171988 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:05.171963 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:04:05.172088 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:05.172067 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6b4v" podUID="291c484c-874a-4ff5-987c-ef066e122a96" Sep 09 23:04:05.172479 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:05.172454 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kgfhj"] Sep 09 23:04:05.172564 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:05.172537 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:04:05.172644 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:05.172617 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgfhj" podUID="d1e3264c-002a-4855-bb40-0c63971351d9" Sep 09 23:04:06.044546 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:06.044471 2575 generic.go:356] "Generic (PLEG): container finished" podID="a3181805-89ae-4090-9e2e-4a15a4f32439" containerID="f6fb5cdb8a4a85ec0e1909669cc9880942ef1940176ee044da0da9cf2b24bd1e" exitCode=0 Sep 09 23:04:06.044926 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:06.044553 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8g29j" event={"ID":"a3181805-89ae-4090-9e2e-4a15a4f32439","Type":"ContainerDied","Data":"f6fb5cdb8a4a85ec0e1909669cc9880942ef1940176ee044da0da9cf2b24bd1e"} Sep 09 23:04:06.832916 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:06.832887 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:04:06.833060 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:06.832975 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgfhj" podUID="d1e3264c-002a-4855-bb40-0c63971351d9" Sep 09 23:04:06.833131 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:06.833079 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:04:06.833213 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:06.833192 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2smzh" podUID="cd6cb31a-9cc7-4e2a-9ab7-019055393d6c" Sep 09 23:04:06.833275 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:06.833256 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:04:06.833352 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:06.833337 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6b4v" podUID="291c484c-874a-4ff5-987c-ef066e122a96" Sep 09 23:04:08.832610 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:08.832390 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:04:08.833097 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:08.832402 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:04:08.833097 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:08.832705 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6b4v" podUID="291c484c-874a-4ff5-987c-ef066e122a96" Sep 09 23:04:08.833097 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:08.832804 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgfhj" podUID="d1e3264c-002a-4855-bb40-0c63971351d9" Sep 09 23:04:08.833097 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:08.832433 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:04:08.833097 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:08.832919 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2smzh" podUID="cd6cb31a-9cc7-4e2a-9ab7-019055393d6c" Sep 09 23:04:10.480966 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:10.480929 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs\") pod \"network-metrics-daemon-kgfhj\" (UID: \"d1e3264c-002a-4855-bb40-0c63971351d9\") " pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:04:10.481432 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:10.481105 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:04:10.481432 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:10.481185 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs podName:d1e3264c-002a-4855-bb40-0c63971351d9 nodeName:}" failed. No retries permitted until 2026-09-09 23:04:42.481163912 +0000 UTC m=+66.138819538 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs") pod "network-metrics-daemon-kgfhj" (UID: "d1e3264c-002a-4855-bb40-0c63971351d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:04:10.581261 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:10.581230 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd6cb31a-9cc7-4e2a-9ab7-019055393d6c-original-pull-secret\") pod \"global-pull-secret-syncer-2smzh\" (UID: \"cd6cb31a-9cc7-4e2a-9ab7-019055393d6c\") " pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:04:10.581447 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:10.581397 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:04:10.581515 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:10.581475 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd6cb31a-9cc7-4e2a-9ab7-019055393d6c-original-pull-secret podName:cd6cb31a-9cc7-4e2a-9ab7-019055393d6c nodeName:}" failed. No retries permitted until 2026-09-09 23:04:42.581453609 +0000 UTC m=+66.239109243 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd6cb31a-9cc7-4e2a-9ab7-019055393d6c-original-pull-secret") pod "global-pull-secret-syncer-2smzh" (UID: "cd6cb31a-9cc7-4e2a-9ab7-019055393d6c") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:04:10.681823 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:10.681789 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckq7h\" (UniqueName: \"kubernetes.io/projected/291c484c-874a-4ff5-987c-ef066e122a96-kube-api-access-ckq7h\") pod \"network-check-target-n6b4v\" (UID: \"291c484c-874a-4ff5-987c-ef066e122a96\") " pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:04:10.681978 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:10.681961 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:04:10.682038 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:10.681982 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:04:10.682038 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:10.681992 2575 projected.go:196] Error preparing data for projected volume kube-api-access-ckq7h for pod openshift-network-diagnostics/network-check-target-n6b4v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:04:10.682112 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:10.682047 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/291c484c-874a-4ff5-987c-ef066e122a96-kube-api-access-ckq7h podName:291c484c-874a-4ff5-987c-ef066e122a96 nodeName:}" failed. No retries permitted until 2026-09-09 23:04:42.682031063 +0000 UTC m=+66.339686690 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ckq7h" (UniqueName: "kubernetes.io/projected/291c484c-874a-4ff5-987c-ef066e122a96-kube-api-access-ckq7h") pod "network-check-target-n6b4v" (UID: "291c484c-874a-4ff5-987c-ef066e122a96") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:04:10.833032 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:10.832962 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:04:10.833200 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:10.832969 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:04:10.833200 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:10.833074 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n6b4v" podUID="291c484c-874a-4ff5-987c-ef066e122a96" Sep 09 23:04:10.833200 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:10.833090 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:04:10.833200 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:10.833174 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgfhj" podUID="d1e3264c-002a-4855-bb40-0c63971351d9" Sep 09 23:04:10.833399 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:10.833283 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2smzh" podUID="cd6cb31a-9cc7-4e2a-9ab7-019055393d6c" Sep 09 23:04:11.128311 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.128234 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-137.ec2.internal" event="NodeReady" Sep 09 23:04:11.128469 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.128385 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 09 23:04:11.212942 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.212910 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pcppn"] Sep 09 23:04:11.242115 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.242092 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rs28s"] Sep 09 23:04:11.242276 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.242230 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pcppn" Sep 09 23:04:11.244943 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.244918 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 09 23:04:11.245094 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.244976 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jj6sk\"" Sep 09 23:04:11.245183 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.245149 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 09 23:04:11.257643 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.257586 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pcppn"] Sep 09 23:04:11.257643 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.257628 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rs28s"] Sep 09 23:04:11.257803 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.257715 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rs28s" Sep 09 23:04:11.260885 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.260862 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cc82g\"" Sep 09 23:04:11.260885 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.260885 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 09 23:04:11.261338 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.261315 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 09 23:04:11.261538 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.261525 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 09 23:04:11.386856 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.386722 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26ae1701-512d-437e-9a23-22871cfbc0fe-tmp-dir\") pod \"dns-default-pcppn\" (UID: \"26ae1701-512d-437e-9a23-22871cfbc0fe\") " pod="openshift-dns/dns-default-pcppn" Sep 09 23:04:11.389779 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.389749 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26ae1701-512d-437e-9a23-22871cfbc0fe-metrics-tls\") pod \"dns-default-pcppn\" (UID: \"26ae1701-512d-437e-9a23-22871cfbc0fe\") " pod="openshift-dns/dns-default-pcppn" Sep 09 23:04:11.389942 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.389859 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrxwv\" (UniqueName: \"kubernetes.io/projected/26ae1701-512d-437e-9a23-22871cfbc0fe-kube-api-access-hrxwv\") pod \"dns-default-pcppn\" (UID: \"26ae1701-512d-437e-9a23-22871cfbc0fe\") " pod="openshift-dns/dns-default-pcppn" Sep 09 23:04:11.390292 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.390276 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slvlt\" (UniqueName: \"kubernetes.io/projected/43889511-11da-4b62-a69b-abf53121b273-kube-api-access-slvlt\") pod \"ingress-canary-rs28s\" (UID: \"43889511-11da-4b62-a69b-abf53121b273\") " pod="openshift-ingress-canary/ingress-canary-rs28s" Sep 09 23:04:11.390366 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.390316 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43889511-11da-4b62-a69b-abf53121b273-cert\") pod \"ingress-canary-rs28s\" (UID: \"43889511-11da-4b62-a69b-abf53121b273\") " pod="openshift-ingress-canary/ingress-canary-rs28s" Sep 09 23:04:11.390432 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.390369 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/26ae1701-512d-437e-9a23-22871cfbc0fe-config-volume\") pod \"dns-default-pcppn\" (UID: \"26ae1701-512d-437e-9a23-22871cfbc0fe\") " pod="openshift-dns/dns-default-pcppn" Sep 09 23:04:11.490893 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.490858 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrxwv\" (UniqueName: \"kubernetes.io/projected/26ae1701-512d-437e-9a23-22871cfbc0fe-kube-api-access-hrxwv\") pod \"dns-default-pcppn\" (UID: \"26ae1701-512d-437e-9a23-22871cfbc0fe\") " pod="openshift-dns/dns-default-pcppn" Sep 09 23:04:11.490893 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.490894 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slvlt\" (UniqueName: \"kubernetes.io/projected/43889511-11da-4b62-a69b-abf53121b273-kube-api-access-slvlt\") pod \"ingress-canary-rs28s\" (UID: \"43889511-11da-4b62-a69b-abf53121b273\") " pod="openshift-ingress-canary/ingress-canary-rs28s" Sep 09 23:04:11.491392 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.490913 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43889511-11da-4b62-a69b-abf53121b273-cert\") pod \"ingress-canary-rs28s\" (UID: \"43889511-11da-4b62-a69b-abf53121b273\") " pod="openshift-ingress-canary/ingress-canary-rs28s" Sep 09 23:04:11.491392 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.491069 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/26ae1701-512d-437e-9a23-22871cfbc0fe-config-volume\") pod \"dns-default-pcppn\" (UID: \"26ae1701-512d-437e-9a23-22871cfbc0fe\") " pod="openshift-dns/dns-default-pcppn" Sep 09 23:04:11.491392 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.491120 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26ae1701-512d-437e-9a23-22871cfbc0fe-tmp-dir\") pod \"dns-default-pcppn\" (UID: \"26ae1701-512d-437e-9a23-22871cfbc0fe\") " pod="openshift-dns/dns-default-pcppn" Sep 09 23:04:11.491392 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.491163 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26ae1701-512d-437e-9a23-22871cfbc0fe-metrics-tls\") pod \"dns-default-pcppn\" (UID: \"26ae1701-512d-437e-9a23-22871cfbc0fe\") " pod="openshift-dns/dns-default-pcppn" Sep 09 23:04:11.491392 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:11.491261 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:04:11.491392 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:11.491316 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26ae1701-512d-437e-9a23-22871cfbc0fe-metrics-tls podName:26ae1701-512d-437e-9a23-22871cfbc0fe nodeName:}" failed. No retries permitted until 2026-09-09 23:04:11.991301327 +0000 UTC m=+35.648956950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26ae1701-512d-437e-9a23-22871cfbc0fe-metrics-tls") pod "dns-default-pcppn" (UID: "26ae1701-512d-437e-9a23-22871cfbc0fe") : secret "dns-default-metrics-tls" not found Sep 09 23:04:11.491706 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.491420 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26ae1701-512d-437e-9a23-22871cfbc0fe-tmp-dir\") pod \"dns-default-pcppn\" (UID: \"26ae1701-512d-437e-9a23-22871cfbc0fe\") " pod="openshift-dns/dns-default-pcppn" Sep 09 23:04:11.491706 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.491624 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/26ae1701-512d-437e-9a23-22871cfbc0fe-config-volume\") pod \"dns-default-pcppn\" (UID: \"26ae1701-512d-437e-9a23-22871cfbc0fe\") " pod="openshift-dns/dns-default-pcppn" Sep 09 23:04:11.495252 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.495232 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43889511-11da-4b62-a69b-abf53121b273-cert\") pod \"ingress-canary-rs28s\" (UID: \"43889511-11da-4b62-a69b-abf53121b273\") " pod="openshift-ingress-canary/ingress-canary-rs28s" Sep 09 23:04:11.499677 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.499649 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slvlt\" (UniqueName: \"kubernetes.io/projected/43889511-11da-4b62-a69b-abf53121b273-kube-api-access-slvlt\") pod \"ingress-canary-rs28s\" (UID: \"43889511-11da-4b62-a69b-abf53121b273\") " pod="openshift-ingress-canary/ingress-canary-rs28s" Sep 09 23:04:11.499769 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.499728 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrxwv\" (UniqueName: \"kubernetes.io/projected/26ae1701-512d-437e-9a23-22871cfbc0fe-kube-api-access-hrxwv\") pod \"dns-default-pcppn\" (UID: \"26ae1701-512d-437e-9a23-22871cfbc0fe\") " pod="openshift-dns/dns-default-pcppn" Sep 09 23:04:11.567821 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.567796 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rs28s" Sep 09 23:04:11.869923 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.869746 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rs28s"] Sep 09 23:04:11.873684 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:04:11.873659 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43889511_11da_4b62_a69b_abf53121b273.slice/crio-ac57c6b4be7301007421ca1aff1ffbe7d775f26b16d146292afc5d78817d7ac0 WatchSource:0}: Error finding container ac57c6b4be7301007421ca1aff1ffbe7d775f26b16d146292afc5d78817d7ac0: Status 404 returned error can't find the container with id ac57c6b4be7301007421ca1aff1ffbe7d775f26b16d146292afc5d78817d7ac0 Sep 09 23:04:11.994946 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:11.994916 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26ae1701-512d-437e-9a23-22871cfbc0fe-metrics-tls\") pod \"dns-default-pcppn\" (UID: \"26ae1701-512d-437e-9a23-22871cfbc0fe\") " pod="openshift-dns/dns-default-pcppn" Sep 09 23:04:11.995062 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:11.995037 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:04:11.995108 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:11.995091 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26ae1701-512d-437e-9a23-22871cfbc0fe-metrics-tls podName:26ae1701-512d-437e-9a23-22871cfbc0fe nodeName:}" failed. No retries permitted until 2026-09-09 23:04:12.995076507 +0000 UTC m=+36.652732149 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26ae1701-512d-437e-9a23-22871cfbc0fe-metrics-tls") pod "dns-default-pcppn" (UID: "26ae1701-512d-437e-9a23-22871cfbc0fe") : secret "dns-default-metrics-tls" not found Sep 09 23:04:12.062299 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:12.062265 2575 generic.go:356] "Generic (PLEG): container finished" podID="a3181805-89ae-4090-9e2e-4a15a4f32439" containerID="ea6f20750092413bf7753c6bcafb0dfcba08fb2080b1c0da76aacc042bd1c12e" exitCode=0 Sep 09 23:04:12.062406 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:12.062366 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8g29j" event={"ID":"a3181805-89ae-4090-9e2e-4a15a4f32439","Type":"ContainerDied","Data":"ea6f20750092413bf7753c6bcafb0dfcba08fb2080b1c0da76aacc042bd1c12e"} Sep 09 23:04:12.063537 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:12.063514 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rs28s" event={"ID":"43889511-11da-4b62-a69b-abf53121b273","Type":"ContainerStarted","Data":"ac57c6b4be7301007421ca1aff1ffbe7d775f26b16d146292afc5d78817d7ac0"} Sep 09 23:04:12.832404 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:12.832373 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:04:12.833299 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:12.832373 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:04:12.833299 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:12.832522 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:04:12.835346 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:12.835177 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 23:04:12.835346 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:12.835177 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 23:04:12.836649 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:12.836626 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hwds4\"" Sep 09 23:04:12.836649 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:12.836644 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 23:04:12.836649 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:12.836659 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-64srt\"" Sep 09 23:04:12.836902 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:12.836743 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 23:04:13.001163 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:13.001128 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26ae1701-512d-437e-9a23-22871cfbc0fe-metrics-tls\") pod \"dns-default-pcppn\" (UID: \"26ae1701-512d-437e-9a23-22871cfbc0fe\") " pod="openshift-dns/dns-default-pcppn" Sep 09 23:04:13.001323 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:13.001243 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:04:13.001323 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:13.001300 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26ae1701-512d-437e-9a23-22871cfbc0fe-metrics-tls podName:26ae1701-512d-437e-9a23-22871cfbc0fe nodeName:}" failed. No retries permitted until 2026-09-09 23:04:15.001286905 +0000 UTC m=+38.658942540 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26ae1701-512d-437e-9a23-22871cfbc0fe-metrics-tls") pod "dns-default-pcppn" (UID: "26ae1701-512d-437e-9a23-22871cfbc0fe") : secret "dns-default-metrics-tls" not found Sep 09 23:04:13.069657 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:13.069629 2575 generic.go:356] "Generic (PLEG): container finished" podID="a3181805-89ae-4090-9e2e-4a15a4f32439" containerID="a8545051d5606ed3a647578dceb4ae88f9d1c2d17d70d19589b35fed46488470" exitCode=0 Sep 09 23:04:13.069802 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:13.069683 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8g29j" event={"ID":"a3181805-89ae-4090-9e2e-4a15a4f32439","Type":"ContainerDied","Data":"a8545051d5606ed3a647578dceb4ae88f9d1c2d17d70d19589b35fed46488470"} Sep 09 23:04:14.076501 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:14.076463 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8g29j" event={"ID":"a3181805-89ae-4090-9e2e-4a15a4f32439","Type":"ContainerStarted","Data":"2b2943fba08f65bd421e9c4cc556a923cd1bc073b76dc1fbd6394da37b1b08e8"} Sep 09 23:04:14.098758 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:14.098694 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8g29j" podStartSLOduration=7.655492784 podStartE2EDuration="37.09867567s" totalImagesPullingTime="29.443182886s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:04:14.098435533 +0000 UTC m=+37.756091176" watchObservedRunningTime="2026-09-09 23:04:14.09867567 +0000 UTC m=+37.756331318" Sep 09 23:04:15.015566 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:15.015546 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26ae1701-512d-437e-9a23-22871cfbc0fe-metrics-tls\") pod \"dns-default-pcppn\" (UID: \"26ae1701-512d-437e-9a23-22871cfbc0fe\") " pod="openshift-dns/dns-default-pcppn" Sep 09 23:04:15.015657 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:15.015645 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:04:15.015725 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:15.015714 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26ae1701-512d-437e-9a23-22871cfbc0fe-metrics-tls podName:26ae1701-512d-437e-9a23-22871cfbc0fe nodeName:}" failed. No retries permitted until 2026-09-09 23:04:19.015692885 +0000 UTC m=+42.673348507 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26ae1701-512d-437e-9a23-22871cfbc0fe-metrics-tls") pod "dns-default-pcppn" (UID: "26ae1701-512d-437e-9a23-22871cfbc0fe") : secret "dns-default-metrics-tls" not found Sep 09 23:04:15.080441 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:15.080413 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rs28s" event={"ID":"43889511-11da-4b62-a69b-abf53121b273","Type":"ContainerStarted","Data":"0d469b64f90288adef0d4a787d57c61b649e8b3897239b0fef00ab13251caa58"} Sep 09 23:04:15.094757 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:15.094711 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rs28s" podStartSLOduration=1.033469343 podStartE2EDuration="4.09469545s" totalImagesPullingTime="3.061226107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:04:15.094277083 +0000 UTC m=+38.751932731" watchObservedRunningTime="2026-09-09 23:04:15.09469545 +0000 UTC m=+38.752351094" Sep 09 23:04:19.042556 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:19.042310 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26ae1701-512d-437e-9a23-22871cfbc0fe-metrics-tls\") pod \"dns-default-pcppn\" (UID: \"26ae1701-512d-437e-9a23-22871cfbc0fe\") " pod="openshift-dns/dns-default-pcppn" Sep 09 23:04:19.042956 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:19.042460 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:04:19.042956 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:19.042666 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26ae1701-512d-437e-9a23-22871cfbc0fe-metrics-tls podName:26ae1701-512d-437e-9a23-22871cfbc0fe nodeName:}" failed. No retries permitted until 2026-09-09 23:04:27.042645868 +0000 UTC m=+50.700301507 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26ae1701-512d-437e-9a23-22871cfbc0fe-metrics-tls") pod "dns-default-pcppn" (UID: "26ae1701-512d-437e-9a23-22871cfbc0fe") : secret "dns-default-metrics-tls" not found Sep 09 23:04:27.092621 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:27.092585 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26ae1701-512d-437e-9a23-22871cfbc0fe-metrics-tls\") pod \"dns-default-pcppn\" (UID: \"26ae1701-512d-437e-9a23-22871cfbc0fe\") " pod="openshift-dns/dns-default-pcppn" Sep 09 23:04:27.093036 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:27.092721 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:04:27.093036 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:27.092779 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26ae1701-512d-437e-9a23-22871cfbc0fe-metrics-tls podName:26ae1701-512d-437e-9a23-22871cfbc0fe nodeName:}" failed. No retries permitted until 2026-09-09 23:04:43.092762604 +0000 UTC m=+66.750418239 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26ae1701-512d-437e-9a23-22871cfbc0fe-metrics-tls") pod "dns-default-pcppn" (UID: "26ae1701-512d-437e-9a23-22871cfbc0fe") : secret "dns-default-metrics-tls" not found Sep 09 23:04:36.055019 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:36.054993 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q6gsr" Sep 09 23:04:42.493839 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:42.493777 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs\") pod \"network-metrics-daemon-kgfhj\" (UID: \"d1e3264c-002a-4855-bb40-0c63971351d9\") " pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:04:42.496408 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:42.496389 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 23:04:42.504255 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:42.504237 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 09 23:04:42.504304 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:42.504294 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs podName:d1e3264c-002a-4855-bb40-0c63971351d9 nodeName:}" failed. No retries permitted until 2026-09-09 23:05:46.504275441 +0000 UTC m=+130.161931076 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs") pod "network-metrics-daemon-kgfhj" (UID: "d1e3264c-002a-4855-bb40-0c63971351d9") : secret "metrics-daemon-secret" not found Sep 09 23:04:42.594731 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:42.594704 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd6cb31a-9cc7-4e2a-9ab7-019055393d6c-original-pull-secret\") pod \"global-pull-secret-syncer-2smzh\" (UID: \"cd6cb31a-9cc7-4e2a-9ab7-019055393d6c\") " pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:04:42.597870 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:42.597854 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 23:04:42.609376 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:42.609344 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd6cb31a-9cc7-4e2a-9ab7-019055393d6c-original-pull-secret\") pod \"global-pull-secret-syncer-2smzh\" (UID: \"cd6cb31a-9cc7-4e2a-9ab7-019055393d6c\") " pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:04:42.695927 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:42.695900 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckq7h\" (UniqueName: \"kubernetes.io/projected/291c484c-874a-4ff5-987c-ef066e122a96-kube-api-access-ckq7h\") pod \"network-check-target-n6b4v\" (UID: \"291c484c-874a-4ff5-987c-ef066e122a96\") " pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:04:42.698417 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:42.698402 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 23:04:42.708433 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:42.708416 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 23:04:42.719634 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:42.719613 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckq7h\" (UniqueName: \"kubernetes.io/projected/291c484c-874a-4ff5-987c-ef066e122a96-kube-api-access-ckq7h\") pod \"network-check-target-n6b4v\" (UID: \"291c484c-874a-4ff5-987c-ef066e122a96\") " pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:04:42.854684 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:42.854623 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hwds4\"" Sep 09 23:04:42.857519 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:42.857505 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2smzh" Sep 09 23:04:42.861943 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:42.861922 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:04:43.097368 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:43.097333 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26ae1701-512d-437e-9a23-22871cfbc0fe-metrics-tls\") pod \"dns-default-pcppn\" (UID: \"26ae1701-512d-437e-9a23-22871cfbc0fe\") " pod="openshift-dns/dns-default-pcppn" Sep 09 23:04:43.097507 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:43.097449 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:04:43.097507 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:04:43.097502 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26ae1701-512d-437e-9a23-22871cfbc0fe-metrics-tls podName:26ae1701-512d-437e-9a23-22871cfbc0fe nodeName:}" failed. No retries permitted until 2026-09-09 23:05:15.097486557 +0000 UTC m=+98.755142178 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26ae1701-512d-437e-9a23-22871cfbc0fe-metrics-tls") pod "dns-default-pcppn" (UID: "26ae1701-512d-437e-9a23-22871cfbc0fe") : secret "dns-default-metrics-tls" not found Sep 09 23:04:43.132013 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:43.131986 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2smzh"] Sep 09 23:04:43.134662 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:43.134640 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n6b4v"] Sep 09 23:04:43.135432 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:04:43.135411 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd6cb31a_9cc7_4e2a_9ab7_019055393d6c.slice/crio-91d3a7d3fe8a3a42e8b8513e494b7fa34764a98dc3276c95f9bd82af33aa666f WatchSource:0}: Error finding container 91d3a7d3fe8a3a42e8b8513e494b7fa34764a98dc3276c95f9bd82af33aa666f: Status 404 returned error can't find the container with id 91d3a7d3fe8a3a42e8b8513e494b7fa34764a98dc3276c95f9bd82af33aa666f Sep 09 23:04:43.137020 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:04:43.137000 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod291c484c_874a_4ff5_987c_ef066e122a96.slice/crio-e8bdd06b2606b99532857a6f5397b9c74688f4400d07b392d52a837dba8d9f90 WatchSource:0}: Error finding container e8bdd06b2606b99532857a6f5397b9c74688f4400d07b392d52a837dba8d9f90: Status 404 returned error can't find the container with id e8bdd06b2606b99532857a6f5397b9c74688f4400d07b392d52a837dba8d9f90 Sep 09 23:04:43.141469 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:43.141444 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2smzh" event={"ID":"cd6cb31a-9cc7-4e2a-9ab7-019055393d6c","Type":"ContainerStarted","Data":"91d3a7d3fe8a3a42e8b8513e494b7fa34764a98dc3276c95f9bd82af33aa666f"} Sep 09 23:04:43.142545 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:43.142523 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n6b4v" event={"ID":"291c484c-874a-4ff5-987c-ef066e122a96","Type":"ContainerStarted","Data":"e8bdd06b2606b99532857a6f5397b9c74688f4400d07b392d52a837dba8d9f90"} Sep 09 23:04:48.157813 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:48.157774 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n6b4v" event={"ID":"291c484c-874a-4ff5-987c-ef066e122a96","Type":"ContainerStarted","Data":"61b8166ca5b6812e6e485c518b2481a9ef5885a42c2b4d27b1509401cd3dd251"} Sep 09 23:04:48.158320 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:48.157890 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:04:48.159287 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:48.159257 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2smzh" event={"ID":"cd6cb31a-9cc7-4e2a-9ab7-019055393d6c","Type":"ContainerStarted","Data":"5b478e6f83347ef998cb52fefea588b4ae26dfc910099cc24d17676ee4c32df4"} Sep 09 23:04:48.171776 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:48.171737 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-n6b4v" podStartSLOduration=66.897473522 podStartE2EDuration="1m11.171723824s" totalImagesPullingTime="4.274250302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:03:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:04:48.171480827 +0000 UTC m=+71.829136472" watchObservedRunningTime="2026-09-09 23:04:48.171723824 +0000 UTC m=+71.829379459" Sep 09 23:04:48.184709 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:04:48.184671 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2smzh" podStartSLOduration=66.90612117 podStartE2EDuration="1m11.184659796s" totalImagesPullingTime="4.278538626s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:03:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:04:48.184622681 +0000 UTC m=+71.842278323" watchObservedRunningTime="2026-09-09 23:04:48.184659796 +0000 UTC m=+71.842315422" Sep 09 23:05:15.196882 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:15.196848 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26ae1701-512d-437e-9a23-22871cfbc0fe-metrics-tls\") pod \"dns-default-pcppn\" (UID: \"26ae1701-512d-437e-9a23-22871cfbc0fe\") " pod="openshift-dns/dns-default-pcppn" Sep 09 23:05:15.197269 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:05:15.197002 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:05:15.197269 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:05:15.197067 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26ae1701-512d-437e-9a23-22871cfbc0fe-metrics-tls podName:26ae1701-512d-437e-9a23-22871cfbc0fe nodeName:}" failed. No retries permitted until 2026-09-09 23:06:19.197051818 +0000 UTC m=+162.854707440 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26ae1701-512d-437e-9a23-22871cfbc0fe-metrics-tls") pod "dns-default-pcppn" (UID: "26ae1701-512d-437e-9a23-22871cfbc0fe") : secret "dns-default-metrics-tls" not found Sep 09 23:05:19.164822 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:19.164790 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-n6b4v" Sep 09 23:05:23.418110 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:23.418075 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r"] Sep 09 23:05:23.420984 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:23.420967 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" Sep 09 23:05:23.423668 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:23.423639 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 09 23:05:23.423797 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:23.423665 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 09 23:05:23.424592 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:23.424571 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 09 23:05:23.424685 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:23.424609 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 09 23:05:23.424740 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:23.424718 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 09 23:05:23.424842 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:23.424815 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 09 23:05:23.424934 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:23.424919 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 09 23:05:23.433506 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:23.433481 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r"] Sep 09 23:05:23.452710 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:23.452685 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/95a15aa4-9fea-4b18-9e5c-2788d992bdd9-hub\") pod \"cluster-proxy-proxy-agent-6d78db56d8-blc2r\" (UID: \"95a15aa4-9fea-4b18-9e5c-2788d992bdd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" Sep 09 23:05:23.452802 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:23.452721 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44mht\" (UniqueName: \"kubernetes.io/projected/95a15aa4-9fea-4b18-9e5c-2788d992bdd9-kube-api-access-44mht\") pod \"cluster-proxy-proxy-agent-6d78db56d8-blc2r\" (UID: \"95a15aa4-9fea-4b18-9e5c-2788d992bdd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" Sep 09 23:05:23.452802 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:23.452752 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/95a15aa4-9fea-4b18-9e5c-2788d992bdd9-ca\") pod \"cluster-proxy-proxy-agent-6d78db56d8-blc2r\" (UID: \"95a15aa4-9fea-4b18-9e5c-2788d992bdd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" Sep 09 23:05:23.452903 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:23.452797 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/95a15aa4-9fea-4b18-9e5c-2788d992bdd9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6d78db56d8-blc2r\" (UID: \"95a15aa4-9fea-4b18-9e5c-2788d992bdd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" Sep 09 23:05:23.452903 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:23.452848 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/95a15aa4-9fea-4b18-9e5c-2788d992bdd9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6d78db56d8-blc2r\" (UID: \"95a15aa4-9fea-4b18-9e5c-2788d992bdd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" Sep 09 23:05:23.452966 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:23.452913 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/95a15aa4-9fea-4b18-9e5c-2788d992bdd9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6d78db56d8-blc2r\" (UID: \"95a15aa4-9fea-4b18-9e5c-2788d992bdd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" Sep 09 23:05:23.553484 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:23.553449 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/95a15aa4-9fea-4b18-9e5c-2788d992bdd9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6d78db56d8-blc2r\" (UID: \"95a15aa4-9fea-4b18-9e5c-2788d992bdd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" Sep 09 23:05:23.553484 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:23.553486 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/95a15aa4-9fea-4b18-9e5c-2788d992bdd9-hub\") pod \"cluster-proxy-proxy-agent-6d78db56d8-blc2r\" (UID: \"95a15aa4-9fea-4b18-9e5c-2788d992bdd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" Sep 09 23:05:23.553689 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:23.553536 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44mht\" (UniqueName: \"kubernetes.io/projected/95a15aa4-9fea-4b18-9e5c-2788d992bdd9-kube-api-access-44mht\") pod \"cluster-proxy-proxy-agent-6d78db56d8-blc2r\" (UID: \"95a15aa4-9fea-4b18-9e5c-2788d992bdd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" Sep 09 23:05:23.553689 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:23.553587 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/95a15aa4-9fea-4b18-9e5c-2788d992bdd9-ca\") pod \"cluster-proxy-proxy-agent-6d78db56d8-blc2r\" (UID: \"95a15aa4-9fea-4b18-9e5c-2788d992bdd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" Sep 09 23:05:23.553689 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:23.553615 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/95a15aa4-9fea-4b18-9e5c-2788d992bdd9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6d78db56d8-blc2r\" (UID: \"95a15aa4-9fea-4b18-9e5c-2788d992bdd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" Sep 09 23:05:23.553689 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:23.553650 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/95a15aa4-9fea-4b18-9e5c-2788d992bdd9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6d78db56d8-blc2r\" (UID: \"95a15aa4-9fea-4b18-9e5c-2788d992bdd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" Sep 09 23:05:23.554451 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:23.554421 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/95a15aa4-9fea-4b18-9e5c-2788d992bdd9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6d78db56d8-blc2r\" (UID: \"95a15aa4-9fea-4b18-9e5c-2788d992bdd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" Sep 09 23:05:23.556078 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:23.556054 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/95a15aa4-9fea-4b18-9e5c-2788d992bdd9-ca\") pod \"cluster-proxy-proxy-agent-6d78db56d8-blc2r\" (UID: \"95a15aa4-9fea-4b18-9e5c-2788d992bdd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" Sep 09 23:05:23.556177 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:23.556115 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/95a15aa4-9fea-4b18-9e5c-2788d992bdd9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6d78db56d8-blc2r\" (UID: \"95a15aa4-9fea-4b18-9e5c-2788d992bdd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" Sep 09 23:05:23.556177 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:23.556139 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/95a15aa4-9fea-4b18-9e5c-2788d992bdd9-hub\") pod \"cluster-proxy-proxy-agent-6d78db56d8-blc2r\" (UID: \"95a15aa4-9fea-4b18-9e5c-2788d992bdd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" Sep 09 23:05:23.556177 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:23.556139 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/95a15aa4-9fea-4b18-9e5c-2788d992bdd9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6d78db56d8-blc2r\" (UID: \"95a15aa4-9fea-4b18-9e5c-2788d992bdd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" Sep 09 23:05:23.561054 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:23.561036 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44mht\" (UniqueName: \"kubernetes.io/projected/95a15aa4-9fea-4b18-9e5c-2788d992bdd9-kube-api-access-44mht\") pod \"cluster-proxy-proxy-agent-6d78db56d8-blc2r\" (UID: \"95a15aa4-9fea-4b18-9e5c-2788d992bdd9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" Sep 09 23:05:23.739725 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:23.739636 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" Sep 09 23:05:24.012550 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:24.012480 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r"] Sep 09 23:05:24.016081 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:05:24.016044 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95a15aa4_9fea_4b18_9e5c_2788d992bdd9.slice/crio-fb711352f8498f3b4e1ce0b8122abf2ad30ad1cdb7365f6899175b75e97f1354 WatchSource:0}: Error finding container fb711352f8498f3b4e1ce0b8122abf2ad30ad1cdb7365f6899175b75e97f1354: Status 404 returned error can't find the container with id fb711352f8498f3b4e1ce0b8122abf2ad30ad1cdb7365f6899175b75e97f1354 Sep 09 23:05:24.246456 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:24.246423 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" event={"ID":"95a15aa4-9fea-4b18-9e5c-2788d992bdd9","Type":"ContainerStarted","Data":"fb711352f8498f3b4e1ce0b8122abf2ad30ad1cdb7365f6899175b75e97f1354"} Sep 09 23:05:28.261014 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:28.260981 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" event={"ID":"95a15aa4-9fea-4b18-9e5c-2788d992bdd9","Type":"ContainerStarted","Data":"22aa4651062b579e14e421880e6854ca0474d493966e323f4fea06dc32d3a3eb"} Sep 09 23:05:28.261014 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:28.261024 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" event={"ID":"95a15aa4-9fea-4b18-9e5c-2788d992bdd9","Type":"ContainerStarted","Data":"54d08660c6c857f00646732405e6aac9a4f560ac9b0d6da12e280bbe1f5f8be0"} Sep 09 23:05:28.261405 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:28.261036 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" event={"ID":"95a15aa4-9fea-4b18-9e5c-2788d992bdd9","Type":"ContainerStarted","Data":"11f39296534a3ee6568a134cfb1efe635bb1f7ea2206cdac802c34612a7fdfb5"} Sep 09 23:05:28.280984 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:28.280936 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" podStartSLOduration=1.526652613 podStartE2EDuration="5.280921698s" totalImagesPullingTime="3.754269085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:05:28.280205111 +0000 UTC m=+111.937860755" watchObservedRunningTime="2026-09-09 23:05:28.280921698 +0000 UTC m=+111.938577342" Sep 09 23:05:46.599428 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:05:46.599388 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs\") pod \"network-metrics-daemon-kgfhj\" (UID: \"d1e3264c-002a-4855-bb40-0c63971351d9\") " pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:05:46.599951 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:05:46.599538 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 09 23:05:46.599951 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:05:46.599608 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs podName:d1e3264c-002a-4855-bb40-0c63971351d9 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:48.599592995 +0000 UTC m=+252.257248621 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs") pod "network-metrics-daemon-kgfhj" (UID: "d1e3264c-002a-4855-bb40-0c63971351d9") : secret "metrics-daemon-secret" not found Sep 09 23:06:14.253723 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:06:14.253672 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pcppn" podUID="26ae1701-512d-437e-9a23-22871cfbc0fe" Sep 09 23:06:14.392392 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:06:14.392362 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pcppn" Sep 09 23:06:15.845019 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:06:15.844980 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-kgfhj" podUID="d1e3264c-002a-4855-bb40-0c63971351d9" Sep 09 23:06:19.216349 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:06:19.216303 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26ae1701-512d-437e-9a23-22871cfbc0fe-metrics-tls\") pod \"dns-default-pcppn\" (UID: \"26ae1701-512d-437e-9a23-22871cfbc0fe\") " pod="openshift-dns/dns-default-pcppn" Sep 09 23:06:19.216751 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:06:19.216445 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:06:19.216751 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:06:19.216501 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26ae1701-512d-437e-9a23-22871cfbc0fe-metrics-tls podName:26ae1701-512d-437e-9a23-22871cfbc0fe nodeName:}" failed. No retries permitted until 2026-09-09 23:08:21.216487021 +0000 UTC m=+284.874142646 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26ae1701-512d-437e-9a23-22871cfbc0fe-metrics-tls") pod "dns-default-pcppn" (UID: "26ae1701-512d-437e-9a23-22871cfbc0fe") : secret "dns-default-metrics-tls" not found Sep 09 23:06:26.833709 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:06:26.833676 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:07:46.913259 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:46.913229 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-hhvwl"] Sep 09 23:07:46.915740 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:46.915725 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-hhvwl" Sep 09 23:07:46.918074 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:46.918054 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 09 23:07:46.918197 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:46.918074 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-2rv94\"" Sep 09 23:07:46.918197 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:46.918123 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 09 23:07:46.925994 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:46.925972 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-hhvwl"] Sep 09 23:07:46.988952 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:46.988930 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghgsn\" (UniqueName: \"kubernetes.io/projected/d2d517b8-af90-4ae1-a7a3-3d1c1eb2ea6c-kube-api-access-ghgsn\") pod \"migrator-fdbb8fdff-hhvwl\" (UID: \"d2d517b8-af90-4ae1-a7a3-3d1c1eb2ea6c\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-hhvwl" Sep 09 23:07:47.089720 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:47.089697 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghgsn\" (UniqueName: \"kubernetes.io/projected/d2d517b8-af90-4ae1-a7a3-3d1c1eb2ea6c-kube-api-access-ghgsn\") pod \"migrator-fdbb8fdff-hhvwl\" (UID: \"d2d517b8-af90-4ae1-a7a3-3d1c1eb2ea6c\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-hhvwl" Sep 09 23:07:47.096986 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:47.096959 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghgsn\" (UniqueName: \"kubernetes.io/projected/d2d517b8-af90-4ae1-a7a3-3d1c1eb2ea6c-kube-api-access-ghgsn\") pod \"migrator-fdbb8fdff-hhvwl\" (UID: \"d2d517b8-af90-4ae1-a7a3-3d1c1eb2ea6c\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-hhvwl" Sep 09 23:07:47.224409 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:47.224350 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-hhvwl" Sep 09 23:07:47.496252 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:47.496187 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-hhvwl"] Sep 09 23:07:47.499232 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:07:47.499204 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2d517b8_af90_4ae1_a7a3_3d1c1eb2ea6c.slice/crio-a17b3d0ac87ebfb57d96438bb4d713bc386abc1222ceef10d3038975ca43b2dd WatchSource:0}: Error finding container a17b3d0ac87ebfb57d96438bb4d713bc386abc1222ceef10d3038975ca43b2dd: Status 404 returned error can't find the container with id a17b3d0ac87ebfb57d96438bb4d713bc386abc1222ceef10d3038975ca43b2dd Sep 09 23:07:47.647107 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:47.647078 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-hhvwl" event={"ID":"d2d517b8-af90-4ae1-a7a3-3d1c1eb2ea6c","Type":"ContainerStarted","Data":"a17b3d0ac87ebfb57d96438bb4d713bc386abc1222ceef10d3038975ca43b2dd"} Sep 09 23:07:47.648910 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:47.648885 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vc7g4"] Sep 09 23:07:47.652612 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:47.652583 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vc7g4" Sep 09 23:07:47.655547 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:47.655524 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 09 23:07:47.655547 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:47.655535 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 09 23:07:47.655723 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:47.655568 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6xppp\"" Sep 09 23:07:47.655723 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:47.655595 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 09 23:07:47.656196 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:47.656179 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 09 23:07:47.664282 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:47.664257 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vc7g4"] Sep 09 23:07:47.694028 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:47.694009 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgkrd\" (UniqueName: \"kubernetes.io/projected/1534082f-bb94-49ff-8515-5be4bb6d9167-kube-api-access-qgkrd\") pod \"insights-runtime-extractor-vc7g4\" (UID: \"1534082f-bb94-49ff-8515-5be4bb6d9167\") " pod="openshift-insights/insights-runtime-extractor-vc7g4" Sep 09 23:07:47.694120 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:47.694041 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1534082f-bb94-49ff-8515-5be4bb6d9167-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vc7g4\" (UID: \"1534082f-bb94-49ff-8515-5be4bb6d9167\") " pod="openshift-insights/insights-runtime-extractor-vc7g4" Sep 09 23:07:47.694120 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:47.694068 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1534082f-bb94-49ff-8515-5be4bb6d9167-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vc7g4\" (UID: \"1534082f-bb94-49ff-8515-5be4bb6d9167\") " pod="openshift-insights/insights-runtime-extractor-vc7g4" Sep 09 23:07:47.694120 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:47.694099 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1534082f-bb94-49ff-8515-5be4bb6d9167-data-volume\") pod \"insights-runtime-extractor-vc7g4\" (UID: \"1534082f-bb94-49ff-8515-5be4bb6d9167\") " pod="openshift-insights/insights-runtime-extractor-vc7g4" Sep 09 23:07:47.694224 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:47.694135 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1534082f-bb94-49ff-8515-5be4bb6d9167-crio-socket\") pod \"insights-runtime-extractor-vc7g4\" (UID: \"1534082f-bb94-49ff-8515-5be4bb6d9167\") " pod="openshift-insights/insights-runtime-extractor-vc7g4" Sep 09 23:07:47.794782 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:47.794712 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1534082f-bb94-49ff-8515-5be4bb6d9167-crio-socket\") pod \"insights-runtime-extractor-vc7g4\" (UID: \"1534082f-bb94-49ff-8515-5be4bb6d9167\") " pod="openshift-insights/insights-runtime-extractor-vc7g4" Sep 09 23:07:47.794782 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:47.794762 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgkrd\" (UniqueName: \"kubernetes.io/projected/1534082f-bb94-49ff-8515-5be4bb6d9167-kube-api-access-qgkrd\") pod \"insights-runtime-extractor-vc7g4\" (UID: \"1534082f-bb94-49ff-8515-5be4bb6d9167\") " pod="openshift-insights/insights-runtime-extractor-vc7g4" Sep 09 23:07:47.794965 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:47.794798 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1534082f-bb94-49ff-8515-5be4bb6d9167-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vc7g4\" (UID: \"1534082f-bb94-49ff-8515-5be4bb6d9167\") " pod="openshift-insights/insights-runtime-extractor-vc7g4" Sep 09 23:07:47.794965 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:47.794818 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1534082f-bb94-49ff-8515-5be4bb6d9167-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vc7g4\" (UID: \"1534082f-bb94-49ff-8515-5be4bb6d9167\") " pod="openshift-insights/insights-runtime-extractor-vc7g4" Sep 09 23:07:47.794965 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:47.794859 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1534082f-bb94-49ff-8515-5be4bb6d9167-data-volume\") pod \"insights-runtime-extractor-vc7g4\" (UID: \"1534082f-bb94-49ff-8515-5be4bb6d9167\") " pod="openshift-insights/insights-runtime-extractor-vc7g4" Sep 09 23:07:47.794965 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:47.794866 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1534082f-bb94-49ff-8515-5be4bb6d9167-crio-socket\") pod \"insights-runtime-extractor-vc7g4\" (UID: \"1534082f-bb94-49ff-8515-5be4bb6d9167\") " pod="openshift-insights/insights-runtime-extractor-vc7g4" Sep 09 23:07:47.794965 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:07:47.794927 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:07:47.794965 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:07:47.794962 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:07:47.795154 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:07:47.795007 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1534082f-bb94-49ff-8515-5be4bb6d9167-kube-rbac-proxy-cm podName:1534082f-bb94-49ff-8515-5be4bb6d9167 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:48.294988907 +0000 UTC m=+251.952644532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1534082f-bb94-49ff-8515-5be4bb6d9167-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vc7g4" (UID: "1534082f-bb94-49ff-8515-5be4bb6d9167") : configmap "kube-rbac-proxy" not found Sep 09 23:07:47.795154 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:07:47.795020 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1534082f-bb94-49ff-8515-5be4bb6d9167-insights-runtime-extractor-tls podName:1534082f-bb94-49ff-8515-5be4bb6d9167 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:48.295013956 +0000 UTC m=+251.952669577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1534082f-bb94-49ff-8515-5be4bb6d9167-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vc7g4" (UID: "1534082f-bb94-49ff-8515-5be4bb6d9167") : secret "insights-runtime-extractor-tls" not found Sep 09 23:07:47.795154 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:47.795132 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1534082f-bb94-49ff-8515-5be4bb6d9167-data-volume\") pod \"insights-runtime-extractor-vc7g4\" (UID: \"1534082f-bb94-49ff-8515-5be4bb6d9167\") " pod="openshift-insights/insights-runtime-extractor-vc7g4" Sep 09 23:07:47.806262 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:47.802977 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgkrd\" (UniqueName: \"kubernetes.io/projected/1534082f-bb94-49ff-8515-5be4bb6d9167-kube-api-access-qgkrd\") pod \"insights-runtime-extractor-vc7g4\" (UID: \"1534082f-bb94-49ff-8515-5be4bb6d9167\") " pod="openshift-insights/insights-runtime-extractor-vc7g4" Sep 09 23:07:48.298021 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:48.297984 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1534082f-bb94-49ff-8515-5be4bb6d9167-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vc7g4\" (UID: \"1534082f-bb94-49ff-8515-5be4bb6d9167\") " pod="openshift-insights/insights-runtime-extractor-vc7g4" Sep 09 23:07:48.298427 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:48.298082 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1534082f-bb94-49ff-8515-5be4bb6d9167-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vc7g4\" (UID: \"1534082f-bb94-49ff-8515-5be4bb6d9167\") " pod="openshift-insights/insights-runtime-extractor-vc7g4" Sep 09 23:07:48.298427 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:07:48.298139 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:07:48.298427 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:07:48.298170 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:07:48.298427 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:07:48.298213 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1534082f-bb94-49ff-8515-5be4bb6d9167-insights-runtime-extractor-tls podName:1534082f-bb94-49ff-8515-5be4bb6d9167 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:49.298196413 +0000 UTC m=+252.955852035 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1534082f-bb94-49ff-8515-5be4bb6d9167-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vc7g4" (UID: "1534082f-bb94-49ff-8515-5be4bb6d9167") : secret "insights-runtime-extractor-tls" not found Sep 09 23:07:48.298427 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:07:48.298228 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1534082f-bb94-49ff-8515-5be4bb6d9167-kube-rbac-proxy-cm podName:1534082f-bb94-49ff-8515-5be4bb6d9167 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:49.298221478 +0000 UTC m=+252.955877099 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1534082f-bb94-49ff-8515-5be4bb6d9167-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vc7g4" (UID: "1534082f-bb94-49ff-8515-5be4bb6d9167") : configmap "kube-rbac-proxy" not found Sep 09 23:07:48.599768 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:48.599697 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs\") pod \"network-metrics-daemon-kgfhj\" (UID: \"d1e3264c-002a-4855-bb40-0c63971351d9\") " pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:07:48.599950 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:07:48.599926 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 09 23:07:48.600049 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:07:48.600037 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs podName:d1e3264c-002a-4855-bb40-0c63971351d9 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:50.600019537 +0000 UTC m=+374.257675160 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs") pod "network-metrics-daemon-kgfhj" (UID: "d1e3264c-002a-4855-bb40-0c63971351d9") : secret "metrics-daemon-secret" not found Sep 09 23:07:49.306069 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:49.306041 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1534082f-bb94-49ff-8515-5be4bb6d9167-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vc7g4\" (UID: \"1534082f-bb94-49ff-8515-5be4bb6d9167\") " pod="openshift-insights/insights-runtime-extractor-vc7g4" Sep 09 23:07:49.306420 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:07:49.306169 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:07:49.306420 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:07:49.306220 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:07:49.306420 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:07:49.306236 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1534082f-bb94-49ff-8515-5be4bb6d9167-insights-runtime-extractor-tls podName:1534082f-bb94-49ff-8515-5be4bb6d9167 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:51.306217022 +0000 UTC m=+254.963872661 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1534082f-bb94-49ff-8515-5be4bb6d9167-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vc7g4" (UID: "1534082f-bb94-49ff-8515-5be4bb6d9167") : secret "insights-runtime-extractor-tls" not found Sep 09 23:07:49.306420 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:49.306170 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1534082f-bb94-49ff-8515-5be4bb6d9167-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vc7g4\" (UID: \"1534082f-bb94-49ff-8515-5be4bb6d9167\") " pod="openshift-insights/insights-runtime-extractor-vc7g4" Sep 09 23:07:49.306420 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:07:49.306264 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1534082f-bb94-49ff-8515-5be4bb6d9167-kube-rbac-proxy-cm podName:1534082f-bb94-49ff-8515-5be4bb6d9167 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:51.306249249 +0000 UTC m=+254.963904872 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1534082f-bb94-49ff-8515-5be4bb6d9167-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vc7g4" (UID: "1534082f-bb94-49ff-8515-5be4bb6d9167") : configmap "kube-rbac-proxy" not found Sep 09 23:07:49.655392 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:49.655363 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-hhvwl" event={"ID":"d2d517b8-af90-4ae1-a7a3-3d1c1eb2ea6c","Type":"ContainerStarted","Data":"83d0b530189be96d60408e7e01a0c2c6d5cffd61bb0c01a06b2563585d89af10"} Sep 09 23:07:49.655533 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:49.655409 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-hhvwl" event={"ID":"d2d517b8-af90-4ae1-a7a3-3d1c1eb2ea6c","Type":"ContainerStarted","Data":"331f75e85ba0b4b908320f038d9b79ee49209cadf7dafec3f25463662cc78406"} Sep 09 23:07:49.669372 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:49.669303 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-hhvwl" podStartSLOduration=1.93670955 podStartE2EDuration="3.669288121s" totalImagesPullingTime="1.732578571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:07:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:07:49.668683391 +0000 UTC m=+253.326339057" watchObservedRunningTime="2026-09-09 23:07:49.669288121 +0000 UTC m=+253.326943769" Sep 09 23:07:50.413303 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:50.413276 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-httmw_de1b41b8-0f82-4297-a438-e47b0e1e683a/dns-node-resolver/0.log" Sep 09 23:07:51.318615 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:51.318579 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1534082f-bb94-49ff-8515-5be4bb6d9167-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vc7g4\" (UID: \"1534082f-bb94-49ff-8515-5be4bb6d9167\") " pod="openshift-insights/insights-runtime-extractor-vc7g4" Sep 09 23:07:51.318805 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:51.318620 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1534082f-bb94-49ff-8515-5be4bb6d9167-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vc7g4\" (UID: \"1534082f-bb94-49ff-8515-5be4bb6d9167\") " pod="openshift-insights/insights-runtime-extractor-vc7g4" Sep 09 23:07:51.318805 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:07:51.318693 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:07:51.318805 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:07:51.318747 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1534082f-bb94-49ff-8515-5be4bb6d9167-kube-rbac-proxy-cm podName:1534082f-bb94-49ff-8515-5be4bb6d9167 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:55.318734561 +0000 UTC m=+258.976390186 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1534082f-bb94-49ff-8515-5be4bb6d9167-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vc7g4" (UID: "1534082f-bb94-49ff-8515-5be4bb6d9167") : configmap "kube-rbac-proxy" not found Sep 09 23:07:51.318805 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:07:51.318753 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:07:51.318805 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:07:51.318800 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1534082f-bb94-49ff-8515-5be4bb6d9167-insights-runtime-extractor-tls podName:1534082f-bb94-49ff-8515-5be4bb6d9167 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:55.318786864 +0000 UTC m=+258.976442492 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1534082f-bb94-49ff-8515-5be4bb6d9167-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vc7g4" (UID: "1534082f-bb94-49ff-8515-5be4bb6d9167") : secret "insights-runtime-extractor-tls" not found Sep 09 23:07:51.614075 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:51.614009 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w4qwh_1f8dd862-bb98-45c7-b5a9-4c5575d06ad8/node-ca/0.log" Sep 09 23:07:52.413869 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:52.413843 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rs28s_43889511-11da-4b62-a69b-abf53121b273/serve-healthcheck-canary/0.log" Sep 09 23:07:52.614310 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:52.614283 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-hhvwl_d2d517b8-af90-4ae1-a7a3-3d1c1eb2ea6c/migrator/0.log" Sep 09 23:07:52.814253 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:52.814188 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-hhvwl_d2d517b8-af90-4ae1-a7a3-3d1c1eb2ea6c/graceful-termination/0.log" Sep 09 23:07:55.352415 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:55.352380 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1534082f-bb94-49ff-8515-5be4bb6d9167-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vc7g4\" (UID: \"1534082f-bb94-49ff-8515-5be4bb6d9167\") " pod="openshift-insights/insights-runtime-extractor-vc7g4" Sep 09 23:07:55.352415 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:07:55.352417 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1534082f-bb94-49ff-8515-5be4bb6d9167-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vc7g4\" (UID: \"1534082f-bb94-49ff-8515-5be4bb6d9167\") " pod="openshift-insights/insights-runtime-extractor-vc7g4" Sep 09 23:07:55.352810 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:07:55.352494 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:07:55.352810 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:07:55.352575 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1534082f-bb94-49ff-8515-5be4bb6d9167-kube-rbac-proxy-cm podName:1534082f-bb94-49ff-8515-5be4bb6d9167 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:03.352560207 +0000 UTC m=+267.010215829 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1534082f-bb94-49ff-8515-5be4bb6d9167-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vc7g4" (UID: "1534082f-bb94-49ff-8515-5be4bb6d9167") : configmap "kube-rbac-proxy" not found Sep 09 23:07:55.352810 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:07:55.352500 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:07:55.352810 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:07:55.352644 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1534082f-bb94-49ff-8515-5be4bb6d9167-insights-runtime-extractor-tls podName:1534082f-bb94-49ff-8515-5be4bb6d9167 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:03.352630237 +0000 UTC m=+267.010285869 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1534082f-bb94-49ff-8515-5be4bb6d9167-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vc7g4" (UID: "1534082f-bb94-49ff-8515-5be4bb6d9167") : secret "insights-runtime-extractor-tls" not found Sep 09 23:08:03.407122 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:03.407036 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1534082f-bb94-49ff-8515-5be4bb6d9167-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vc7g4\" (UID: \"1534082f-bb94-49ff-8515-5be4bb6d9167\") " pod="openshift-insights/insights-runtime-extractor-vc7g4" Sep 09 23:08:03.407122 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:03.407081 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1534082f-bb94-49ff-8515-5be4bb6d9167-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vc7g4\" (UID: \"1534082f-bb94-49ff-8515-5be4bb6d9167\") " pod="openshift-insights/insights-runtime-extractor-vc7g4" Sep 09 23:08:03.407507 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:08:03.407190 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:08:03.407507 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:08:03.407255 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1534082f-bb94-49ff-8515-5be4bb6d9167-insights-runtime-extractor-tls podName:1534082f-bb94-49ff-8515-5be4bb6d9167 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:19.407239116 +0000 UTC m=+283.064894738 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1534082f-bb94-49ff-8515-5be4bb6d9167-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vc7g4" (UID: "1534082f-bb94-49ff-8515-5be4bb6d9167") : secret "insights-runtime-extractor-tls" not found Sep 09 23:08:03.407596 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:03.407515 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1534082f-bb94-49ff-8515-5be4bb6d9167-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vc7g4\" (UID: \"1534082f-bb94-49ff-8515-5be4bb6d9167\") " pod="openshift-insights/insights-runtime-extractor-vc7g4" Sep 09 23:08:03.740725 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:03.740646 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" podUID="95a15aa4-9fea-4b18-9e5c-2788d992bdd9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 23:08:10.988282 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:10.988249 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-999868c4f-gkrc9"] Sep 09 23:08:10.991113 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:10.991098 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-999868c4f-gkrc9" Sep 09 23:08:10.993281 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:10.993260 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 09 23:08:10.993557 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:10.993542 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 09 23:08:10.994424 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:10.994409 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 09 23:08:10.994699 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:10.994683 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-699nw\"" Sep 09 23:08:10.999512 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:10.999494 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 09 23:08:11.004057 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:11.004039 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-999868c4f-gkrc9"] Sep 09 23:08:11.061280 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:11.061258 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71501650-e6bd-414f-b61f-2fa77ab8f45d-registry-tls\") pod \"image-registry-999868c4f-gkrc9\" (UID: \"71501650-e6bd-414f-b61f-2fa77ab8f45d\") " pod="openshift-image-registry/image-registry-999868c4f-gkrc9" Sep 09 23:08:11.061355 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:11.061299 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz86f\" (UniqueName: \"kubernetes.io/projected/71501650-e6bd-414f-b61f-2fa77ab8f45d-kube-api-access-xz86f\") pod \"image-registry-999868c4f-gkrc9\" (UID: \"71501650-e6bd-414f-b61f-2fa77ab8f45d\") " pod="openshift-image-registry/image-registry-999868c4f-gkrc9" Sep 09 23:08:11.061400 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:11.061349 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/71501650-e6bd-414f-b61f-2fa77ab8f45d-image-registry-private-configuration\") pod \"image-registry-999868c4f-gkrc9\" (UID: \"71501650-e6bd-414f-b61f-2fa77ab8f45d\") " pod="openshift-image-registry/image-registry-999868c4f-gkrc9" Sep 09 23:08:11.061400 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:11.061373 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/71501650-e6bd-414f-b61f-2fa77ab8f45d-registry-certificates\") pod \"image-registry-999868c4f-gkrc9\" (UID: \"71501650-e6bd-414f-b61f-2fa77ab8f45d\") " pod="openshift-image-registry/image-registry-999868c4f-gkrc9" Sep 09 23:08:11.061468 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:11.061431 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/71501650-e6bd-414f-b61f-2fa77ab8f45d-installation-pull-secrets\") pod \"image-registry-999868c4f-gkrc9\" (UID: \"71501650-e6bd-414f-b61f-2fa77ab8f45d\") " pod="openshift-image-registry/image-registry-999868c4f-gkrc9" Sep 09 23:08:11.061468 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:11.061463 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/71501650-e6bd-414f-b61f-2fa77ab8f45d-ca-trust-extracted\") pod \"image-registry-999868c4f-gkrc9\" (UID: \"71501650-e6bd-414f-b61f-2fa77ab8f45d\") " pod="openshift-image-registry/image-registry-999868c4f-gkrc9" Sep 09 23:08:11.061528 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:11.061479 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/71501650-e6bd-414f-b61f-2fa77ab8f45d-trusted-ca\") pod \"image-registry-999868c4f-gkrc9\" (UID: \"71501650-e6bd-414f-b61f-2fa77ab8f45d\") " pod="openshift-image-registry/image-registry-999868c4f-gkrc9" Sep 09 23:08:11.061528 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:11.061505 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/71501650-e6bd-414f-b61f-2fa77ab8f45d-bound-sa-token\") pod \"image-registry-999868c4f-gkrc9\" (UID: \"71501650-e6bd-414f-b61f-2fa77ab8f45d\") " pod="openshift-image-registry/image-registry-999868c4f-gkrc9" Sep 09 23:08:11.162398 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:11.162375 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz86f\" (UniqueName: \"kubernetes.io/projected/71501650-e6bd-414f-b61f-2fa77ab8f45d-kube-api-access-xz86f\") pod \"image-registry-999868c4f-gkrc9\" (UID: \"71501650-e6bd-414f-b61f-2fa77ab8f45d\") " pod="openshift-image-registry/image-registry-999868c4f-gkrc9" Sep 09 23:08:11.162480 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:11.162413 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/71501650-e6bd-414f-b61f-2fa77ab8f45d-image-registry-private-configuration\") pod \"image-registry-999868c4f-gkrc9\" (UID: \"71501650-e6bd-414f-b61f-2fa77ab8f45d\") " pod="openshift-image-registry/image-registry-999868c4f-gkrc9" Sep 09 23:08:11.162480 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:11.162430 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/71501650-e6bd-414f-b61f-2fa77ab8f45d-registry-certificates\") pod \"image-registry-999868c4f-gkrc9\" (UID: \"71501650-e6bd-414f-b61f-2fa77ab8f45d\") " pod="openshift-image-registry/image-registry-999868c4f-gkrc9" Sep 09 23:08:11.162480 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:11.162454 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/71501650-e6bd-414f-b61f-2fa77ab8f45d-installation-pull-secrets\") pod \"image-registry-999868c4f-gkrc9\" (UID: \"71501650-e6bd-414f-b61f-2fa77ab8f45d\") " pod="openshift-image-registry/image-registry-999868c4f-gkrc9" Sep 09 23:08:11.162578 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:11.162511 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/71501650-e6bd-414f-b61f-2fa77ab8f45d-ca-trust-extracted\") pod \"image-registry-999868c4f-gkrc9\" (UID: \"71501650-e6bd-414f-b61f-2fa77ab8f45d\") " pod="openshift-image-registry/image-registry-999868c4f-gkrc9" Sep 09 23:08:11.162686 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:11.162657 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/71501650-e6bd-414f-b61f-2fa77ab8f45d-trusted-ca\") pod \"image-registry-999868c4f-gkrc9\" (UID: \"71501650-e6bd-414f-b61f-2fa77ab8f45d\") " pod="openshift-image-registry/image-registry-999868c4f-gkrc9" Sep 09 23:08:11.162754 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:11.162724 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/71501650-e6bd-414f-b61f-2fa77ab8f45d-bound-sa-token\") pod \"image-registry-999868c4f-gkrc9\" (UID: \"71501650-e6bd-414f-b61f-2fa77ab8f45d\") " pod="openshift-image-registry/image-registry-999868c4f-gkrc9" Sep 09 23:08:11.162808 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:11.162766 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71501650-e6bd-414f-b61f-2fa77ab8f45d-registry-tls\") pod \"image-registry-999868c4f-gkrc9\" (UID: \"71501650-e6bd-414f-b61f-2fa77ab8f45d\") " pod="openshift-image-registry/image-registry-999868c4f-gkrc9" Sep 09 23:08:11.162931 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:11.162902 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/71501650-e6bd-414f-b61f-2fa77ab8f45d-ca-trust-extracted\") pod \"image-registry-999868c4f-gkrc9\" (UID: \"71501650-e6bd-414f-b61f-2fa77ab8f45d\") " pod="openshift-image-registry/image-registry-999868c4f-gkrc9" Sep 09 23:08:11.163401 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:11.163377 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/71501650-e6bd-414f-b61f-2fa77ab8f45d-registry-certificates\") pod \"image-registry-999868c4f-gkrc9\" (UID: \"71501650-e6bd-414f-b61f-2fa77ab8f45d\") " pod="openshift-image-registry/image-registry-999868c4f-gkrc9" Sep 09 23:08:11.163576 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:11.163560 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/71501650-e6bd-414f-b61f-2fa77ab8f45d-trusted-ca\") pod \"image-registry-999868c4f-gkrc9\" (UID: \"71501650-e6bd-414f-b61f-2fa77ab8f45d\") " pod="openshift-image-registry/image-registry-999868c4f-gkrc9" Sep 09 23:08:11.164931 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:11.164913 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/71501650-e6bd-414f-b61f-2fa77ab8f45d-installation-pull-secrets\") pod \"image-registry-999868c4f-gkrc9\" (UID: \"71501650-e6bd-414f-b61f-2fa77ab8f45d\") " pod="openshift-image-registry/image-registry-999868c4f-gkrc9" Sep 09 23:08:11.165354 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:11.165331 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71501650-e6bd-414f-b61f-2fa77ab8f45d-registry-tls\") pod \"image-registry-999868c4f-gkrc9\" (UID: \"71501650-e6bd-414f-b61f-2fa77ab8f45d\") " pod="openshift-image-registry/image-registry-999868c4f-gkrc9" Sep 09 23:08:11.165354 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:11.165344 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/71501650-e6bd-414f-b61f-2fa77ab8f45d-image-registry-private-configuration\") pod \"image-registry-999868c4f-gkrc9\" (UID: \"71501650-e6bd-414f-b61f-2fa77ab8f45d\") " pod="openshift-image-registry/image-registry-999868c4f-gkrc9" Sep 09 23:08:11.172538 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:11.172515 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz86f\" (UniqueName: \"kubernetes.io/projected/71501650-e6bd-414f-b61f-2fa77ab8f45d-kube-api-access-xz86f\") pod \"image-registry-999868c4f-gkrc9\" (UID: \"71501650-e6bd-414f-b61f-2fa77ab8f45d\") " pod="openshift-image-registry/image-registry-999868c4f-gkrc9" Sep 09 23:08:11.172538 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:11.172533 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/71501650-e6bd-414f-b61f-2fa77ab8f45d-bound-sa-token\") pod \"image-registry-999868c4f-gkrc9\" (UID: \"71501650-e6bd-414f-b61f-2fa77ab8f45d\") " pod="openshift-image-registry/image-registry-999868c4f-gkrc9" Sep 09 23:08:11.300317 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:11.300253 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-999868c4f-gkrc9" Sep 09 23:08:11.567288 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:11.567221 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-999868c4f-gkrc9"] Sep 09 23:08:11.569920 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:08:11.569890 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71501650_e6bd_414f_b61f_2fa77ab8f45d.slice/crio-c121406137acabac32472d780929c5e1cbe6f11f6fcc5a845e5f86229a0761d6 WatchSource:0}: Error finding container c121406137acabac32472d780929c5e1cbe6f11f6fcc5a845e5f86229a0761d6: Status 404 returned error can't find the container with id c121406137acabac32472d780929c5e1cbe6f11f6fcc5a845e5f86229a0761d6 Sep 09 23:08:11.720844 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:11.720799 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-999868c4f-gkrc9" event={"ID":"71501650-e6bd-414f-b61f-2fa77ab8f45d","Type":"ContainerStarted","Data":"2007fb59d2f33c26e662431276c6d1f48d9b4bf810eb1de6378cdc92190959cc"} Sep 09 23:08:11.720971 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:11.720878 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-999868c4f-gkrc9" event={"ID":"71501650-e6bd-414f-b61f-2fa77ab8f45d","Type":"ContainerStarted","Data":"c121406137acabac32472d780929c5e1cbe6f11f6fcc5a845e5f86229a0761d6"} Sep 09 23:08:11.720971 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:11.720907 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-999868c4f-gkrc9" Sep 09 23:08:11.739671 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:11.739625 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-999868c4f-gkrc9" podStartSLOduration=1.739610677 podStartE2EDuration="1.739610677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:08:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:11.738414484 +0000 UTC m=+275.396070127" watchObservedRunningTime="2026-09-09 23:08:11.739610677 +0000 UTC m=+275.397266396" Sep 09 23:08:13.740968 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:13.740932 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" podUID="95a15aa4-9fea-4b18-9e5c-2788d992bdd9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 23:08:17.393423 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:08:17.393385 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pcppn" podUID="26ae1701-512d-437e-9a23-22871cfbc0fe" Sep 09 23:08:17.737163 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:17.737097 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pcppn" Sep 09 23:08:19.418035 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:19.417994 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1534082f-bb94-49ff-8515-5be4bb6d9167-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vc7g4\" (UID: \"1534082f-bb94-49ff-8515-5be4bb6d9167\") " pod="openshift-insights/insights-runtime-extractor-vc7g4" Sep 09 23:08:19.420213 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:19.420189 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1534082f-bb94-49ff-8515-5be4bb6d9167-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vc7g4\" (UID: \"1534082f-bb94-49ff-8515-5be4bb6d9167\") " pod="openshift-insights/insights-runtime-extractor-vc7g4" Sep 09 23:08:19.461174 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:19.461155 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vc7g4" Sep 09 23:08:19.729709 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:19.729642 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vc7g4"] Sep 09 23:08:19.732513 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:08:19.732487 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1534082f_bb94_49ff_8515_5be4bb6d9167.slice/crio-e9c20d45a202b5802f74ae857d989b449117effaf8480cdf80f10ac283b81723 WatchSource:0}: Error finding container e9c20d45a202b5802f74ae857d989b449117effaf8480cdf80f10ac283b81723: Status 404 returned error can't find the container with id e9c20d45a202b5802f74ae857d989b449117effaf8480cdf80f10ac283b81723 Sep 09 23:08:19.742948 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:19.742927 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vc7g4" event={"ID":"1534082f-bb94-49ff-8515-5be4bb6d9167","Type":"ContainerStarted","Data":"e9c20d45a202b5802f74ae857d989b449117effaf8480cdf80f10ac283b81723"} Sep 09 23:08:20.747216 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:20.747188 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vc7g4" event={"ID":"1534082f-bb94-49ff-8515-5be4bb6d9167","Type":"ContainerStarted","Data":"f947031ee8de6b71f0e7ee33259182d71f2901a4d3c825307ea6fb758365e33c"} Sep 09 23:08:20.747499 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:20.747239 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vc7g4" event={"ID":"1534082f-bb94-49ff-8515-5be4bb6d9167","Type":"ContainerStarted","Data":"f15e86c67e935a9b18d7ed3f8003dfebe1c45102c78ab65ea72d243e10701396"} Sep 09 23:08:21.231986 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:21.231958 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26ae1701-512d-437e-9a23-22871cfbc0fe-metrics-tls\") pod \"dns-default-pcppn\" (UID: \"26ae1701-512d-437e-9a23-22871cfbc0fe\") " pod="openshift-dns/dns-default-pcppn" Sep 09 23:08:21.234263 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:21.234234 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26ae1701-512d-437e-9a23-22871cfbc0fe-metrics-tls\") pod \"dns-default-pcppn\" (UID: \"26ae1701-512d-437e-9a23-22871cfbc0fe\") " pod="openshift-dns/dns-default-pcppn" Sep 09 23:08:21.340470 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:21.340442 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jj6sk\"" Sep 09 23:08:21.348427 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:21.348397 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pcppn" Sep 09 23:08:21.624694 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:21.624661 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pcppn"] Sep 09 23:08:21.627994 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:08:21.627969 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26ae1701_512d_437e_9a23_22871cfbc0fe.slice/crio-4cc00eba67a5f3eb7efff93c4b7e0e571e4061c859a2dd48678a03b04a86a4be WatchSource:0}: Error finding container 4cc00eba67a5f3eb7efff93c4b7e0e571e4061c859a2dd48678a03b04a86a4be: Status 404 returned error can't find the container with id 4cc00eba67a5f3eb7efff93c4b7e0e571e4061c859a2dd48678a03b04a86a4be Sep 09 23:08:21.751899 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:21.751867 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pcppn" event={"ID":"26ae1701-512d-437e-9a23-22871cfbc0fe","Type":"ContainerStarted","Data":"4cc00eba67a5f3eb7efff93c4b7e0e571e4061c859a2dd48678a03b04a86a4be"} Sep 09 23:08:22.756777 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:22.756741 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vc7g4" event={"ID":"1534082f-bb94-49ff-8515-5be4bb6d9167","Type":"ContainerStarted","Data":"5e6c00ee77faf82f0804afde7e03322aede911049eff248a4b0f897ce332e5a9"} Sep 09 23:08:22.773054 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:22.773004 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vc7g4" podStartSLOduration=33.471773308 podStartE2EDuration="35.772988775s" totalImagesPullingTime="2.301215467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:07:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:22.771667409 +0000 UTC m=+286.429323052" watchObservedRunningTime="2026-09-09 23:08:22.772988775 +0000 UTC m=+286.430644417" Sep 09 23:08:23.740924 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:23.740845 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" podUID="95a15aa4-9fea-4b18-9e5c-2788d992bdd9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 09 23:08:23.740924 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:23.740910 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" Sep 09 23:08:23.741443 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:23.741404 2575 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"22aa4651062b579e14e421880e6854ca0474d493966e323f4fea06dc32d3a3eb"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" containerMessage="Container service-proxy failed liveness probe, will be restarted" Sep 09 23:08:23.741486 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:23.741468 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" podUID="95a15aa4-9fea-4b18-9e5c-2788d992bdd9" containerName="service-proxy" containerID="cri-o://22aa4651062b579e14e421880e6854ca0474d493966e323f4fea06dc32d3a3eb" gracePeriod=30 Sep 09 23:08:23.761097 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:23.761070 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pcppn" event={"ID":"26ae1701-512d-437e-9a23-22871cfbc0fe","Type":"ContainerStarted","Data":"6525c7695ee51dd0b74498e78cf0ed5eacb0de076783774b9680002b98d2f88c"} Sep 09 23:08:23.761498 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:23.761128 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pcppn" event={"ID":"26ae1701-512d-437e-9a23-22871cfbc0fe","Type":"ContainerStarted","Data":"3178c3224262f01e96346d245ef2f5cf2d40933ba69c4b8be0fcbd5ee79aae02"} Sep 09 23:08:23.781332 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:23.781294 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pcppn" podStartSLOduration=251.021269364 podStartE2EDuration="4m12.781280059s" totalImagesPullingTime="1.760010695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:23.77997546 +0000 UTC m=+287.437631103" watchObservedRunningTime="2026-09-09 23:08:23.781280059 +0000 UTC m=+287.438935703" Sep 09 23:08:24.766975 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:24.766944 2575 generic.go:356] "Generic (PLEG): container finished" podID="95a15aa4-9fea-4b18-9e5c-2788d992bdd9" containerID="22aa4651062b579e14e421880e6854ca0474d493966e323f4fea06dc32d3a3eb" exitCode=2 Sep 09 23:08:24.767332 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:24.767014 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" event={"ID":"95a15aa4-9fea-4b18-9e5c-2788d992bdd9","Type":"ContainerDied","Data":"22aa4651062b579e14e421880e6854ca0474d493966e323f4fea06dc32d3a3eb"} Sep 09 23:08:24.767332 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:24.767060 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6d78db56d8-blc2r" event={"ID":"95a15aa4-9fea-4b18-9e5c-2788d992bdd9","Type":"ContainerStarted","Data":"8516cc727fc2708caa9eee194fe8832488748acdedd4260a6203c99bb00fc417"} Sep 09 23:08:24.767332 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:24.767204 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pcppn" Sep 09 23:08:26.102652 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.102616 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pnrp8"] Sep 09 23:08:26.105988 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.105967 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pnrp8" Sep 09 23:08:26.108713 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.108693 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 09 23:08:26.108801 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.108753 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 09 23:08:26.109278 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.109261 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 09 23:08:26.109857 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.109823 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dg28d\"" Sep 09 23:08:26.109965 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.109880 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 09 23:08:26.110019 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.109969 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 09 23:08:26.110214 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.110201 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 09 23:08:26.166219 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.166196 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/599fb6e8-09aa-428b-8f1d-9a47ed6eb919-node-exporter-tls\") pod \"node-exporter-pnrp8\" (UID: \"599fb6e8-09aa-428b-8f1d-9a47ed6eb919\") " pod="openshift-monitoring/node-exporter-pnrp8" Sep 09 23:08:26.166339 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.166254 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/599fb6e8-09aa-428b-8f1d-9a47ed6eb919-node-exporter-wtmp\") pod \"node-exporter-pnrp8\" (UID: \"599fb6e8-09aa-428b-8f1d-9a47ed6eb919\") " pod="openshift-monitoring/node-exporter-pnrp8" Sep 09 23:08:26.166339 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.166282 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/599fb6e8-09aa-428b-8f1d-9a47ed6eb919-metrics-client-ca\") pod \"node-exporter-pnrp8\" (UID: \"599fb6e8-09aa-428b-8f1d-9a47ed6eb919\") " pod="openshift-monitoring/node-exporter-pnrp8" Sep 09 23:08:26.166418 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.166338 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cgzk\" (UniqueName: \"kubernetes.io/projected/599fb6e8-09aa-428b-8f1d-9a47ed6eb919-kube-api-access-4cgzk\") pod \"node-exporter-pnrp8\" (UID: \"599fb6e8-09aa-428b-8f1d-9a47ed6eb919\") " pod="openshift-monitoring/node-exporter-pnrp8" Sep 09 23:08:26.166418 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.166363 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/599fb6e8-09aa-428b-8f1d-9a47ed6eb919-node-exporter-accelerators-collector-config\") pod \"node-exporter-pnrp8\" (UID: \"599fb6e8-09aa-428b-8f1d-9a47ed6eb919\") " pod="openshift-monitoring/node-exporter-pnrp8" Sep 09 23:08:26.166418 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.166381 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/599fb6e8-09aa-428b-8f1d-9a47ed6eb919-root\") pod \"node-exporter-pnrp8\" (UID: \"599fb6e8-09aa-428b-8f1d-9a47ed6eb919\") " pod="openshift-monitoring/node-exporter-pnrp8" Sep 09 23:08:26.166418 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.166401 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/599fb6e8-09aa-428b-8f1d-9a47ed6eb919-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pnrp8\" (UID: \"599fb6e8-09aa-428b-8f1d-9a47ed6eb919\") " pod="openshift-monitoring/node-exporter-pnrp8" Sep 09 23:08:26.166550 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.166438 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/599fb6e8-09aa-428b-8f1d-9a47ed6eb919-sys\") pod \"node-exporter-pnrp8\" (UID: \"599fb6e8-09aa-428b-8f1d-9a47ed6eb919\") " pod="openshift-monitoring/node-exporter-pnrp8" Sep 09 23:08:26.166550 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.166462 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/599fb6e8-09aa-428b-8f1d-9a47ed6eb919-node-exporter-textfile\") pod \"node-exporter-pnrp8\" (UID: \"599fb6e8-09aa-428b-8f1d-9a47ed6eb919\") " pod="openshift-monitoring/node-exporter-pnrp8" Sep 09 23:08:26.267703 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.267679 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/599fb6e8-09aa-428b-8f1d-9a47ed6eb919-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pnrp8\" (UID: \"599fb6e8-09aa-428b-8f1d-9a47ed6eb919\") " pod="openshift-monitoring/node-exporter-pnrp8" Sep 09 23:08:26.267818 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.267707 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/599fb6e8-09aa-428b-8f1d-9a47ed6eb919-sys\") pod \"node-exporter-pnrp8\" (UID: \"599fb6e8-09aa-428b-8f1d-9a47ed6eb919\") " pod="openshift-monitoring/node-exporter-pnrp8" Sep 09 23:08:26.267818 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.267723 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/599fb6e8-09aa-428b-8f1d-9a47ed6eb919-node-exporter-textfile\") pod \"node-exporter-pnrp8\" (UID: \"599fb6e8-09aa-428b-8f1d-9a47ed6eb919\") " pod="openshift-monitoring/node-exporter-pnrp8" Sep 09 23:08:26.267818 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.267746 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/599fb6e8-09aa-428b-8f1d-9a47ed6eb919-node-exporter-tls\") pod \"node-exporter-pnrp8\" (UID: \"599fb6e8-09aa-428b-8f1d-9a47ed6eb919\") " pod="openshift-monitoring/node-exporter-pnrp8" Sep 09 23:08:26.267818 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.267806 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/599fb6e8-09aa-428b-8f1d-9a47ed6eb919-sys\") pod \"node-exporter-pnrp8\" (UID: \"599fb6e8-09aa-428b-8f1d-9a47ed6eb919\") " pod="openshift-monitoring/node-exporter-pnrp8" Sep 09 23:08:26.268010 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:08:26.267915 2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 09 23:08:26.268010 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.267938 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/599fb6e8-09aa-428b-8f1d-9a47ed6eb919-node-exporter-wtmp\") pod \"node-exporter-pnrp8\" (UID: \"599fb6e8-09aa-428b-8f1d-9a47ed6eb919\") " pod="openshift-monitoring/node-exporter-pnrp8" Sep 09 23:08:26.268010 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.267961 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/599fb6e8-09aa-428b-8f1d-9a47ed6eb919-metrics-client-ca\") pod \"node-exporter-pnrp8\" (UID: \"599fb6e8-09aa-428b-8f1d-9a47ed6eb919\") " pod="openshift-monitoring/node-exporter-pnrp8" Sep 09 23:08:26.268010 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:08:26.267978 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/599fb6e8-09aa-428b-8f1d-9a47ed6eb919-node-exporter-tls podName:599fb6e8-09aa-428b-8f1d-9a47ed6eb919 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:26.767958677 +0000 UTC m=+290.425614313 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/599fb6e8-09aa-428b-8f1d-9a47ed6eb919-node-exporter-tls") pod "node-exporter-pnrp8" (UID: "599fb6e8-09aa-428b-8f1d-9a47ed6eb919") : secret "node-exporter-tls" not found Sep 09 23:08:26.268202 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.268022 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cgzk\" (UniqueName: \"kubernetes.io/projected/599fb6e8-09aa-428b-8f1d-9a47ed6eb919-kube-api-access-4cgzk\") pod \"node-exporter-pnrp8\" (UID: \"599fb6e8-09aa-428b-8f1d-9a47ed6eb919\") " pod="openshift-monitoring/node-exporter-pnrp8" Sep 09 23:08:26.268202 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.268051 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/599fb6e8-09aa-428b-8f1d-9a47ed6eb919-node-exporter-accelerators-collector-config\") pod \"node-exporter-pnrp8\" (UID: \"599fb6e8-09aa-428b-8f1d-9a47ed6eb919\") " pod="openshift-monitoring/node-exporter-pnrp8" Sep 09 23:08:26.268202 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.268056 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/599fb6e8-09aa-428b-8f1d-9a47ed6eb919-node-exporter-textfile\") pod \"node-exporter-pnrp8\" (UID: \"599fb6e8-09aa-428b-8f1d-9a47ed6eb919\") " pod="openshift-monitoring/node-exporter-pnrp8" Sep 09 23:08:26.268202 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.268070 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/599fb6e8-09aa-428b-8f1d-9a47ed6eb919-node-exporter-wtmp\") pod \"node-exporter-pnrp8\" (UID: \"599fb6e8-09aa-428b-8f1d-9a47ed6eb919\") " pod="openshift-monitoring/node-exporter-pnrp8" Sep 09 23:08:26.268202 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.268081 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/599fb6e8-09aa-428b-8f1d-9a47ed6eb919-root\") pod \"node-exporter-pnrp8\" (UID: \"599fb6e8-09aa-428b-8f1d-9a47ed6eb919\") " pod="openshift-monitoring/node-exporter-pnrp8" Sep 09 23:08:26.268202 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.268148 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/599fb6e8-09aa-428b-8f1d-9a47ed6eb919-root\") pod \"node-exporter-pnrp8\" (UID: \"599fb6e8-09aa-428b-8f1d-9a47ed6eb919\") " pod="openshift-monitoring/node-exporter-pnrp8" Sep 09 23:08:26.268503 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.268415 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/599fb6e8-09aa-428b-8f1d-9a47ed6eb919-metrics-client-ca\") pod \"node-exporter-pnrp8\" (UID: \"599fb6e8-09aa-428b-8f1d-9a47ed6eb919\") " pod="openshift-monitoring/node-exporter-pnrp8" Sep 09 23:08:26.268583 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.268565 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/599fb6e8-09aa-428b-8f1d-9a47ed6eb919-node-exporter-accelerators-collector-config\") pod \"node-exporter-pnrp8\" (UID: \"599fb6e8-09aa-428b-8f1d-9a47ed6eb919\") " pod="openshift-monitoring/node-exporter-pnrp8" Sep 09 23:08:26.270010 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.269993 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/599fb6e8-09aa-428b-8f1d-9a47ed6eb919-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pnrp8\" (UID: \"599fb6e8-09aa-428b-8f1d-9a47ed6eb919\") " pod="openshift-monitoring/node-exporter-pnrp8" Sep 09 23:08:26.277566 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.277548 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cgzk\" (UniqueName: \"kubernetes.io/projected/599fb6e8-09aa-428b-8f1d-9a47ed6eb919-kube-api-access-4cgzk\") pod \"node-exporter-pnrp8\" (UID: \"599fb6e8-09aa-428b-8f1d-9a47ed6eb919\") " pod="openshift-monitoring/node-exporter-pnrp8" Sep 09 23:08:26.771243 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.771209 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/599fb6e8-09aa-428b-8f1d-9a47ed6eb919-node-exporter-tls\") pod \"node-exporter-pnrp8\" (UID: \"599fb6e8-09aa-428b-8f1d-9a47ed6eb919\") " pod="openshift-monitoring/node-exporter-pnrp8" Sep 09 23:08:26.773460 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:26.773438 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/599fb6e8-09aa-428b-8f1d-9a47ed6eb919-node-exporter-tls\") pod \"node-exporter-pnrp8\" (UID: \"599fb6e8-09aa-428b-8f1d-9a47ed6eb919\") " pod="openshift-monitoring/node-exporter-pnrp8" Sep 09 23:08:27.015312 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.015281 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pnrp8" Sep 09 23:08:27.026164 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:08:27.026135 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod599fb6e8_09aa_428b_8f1d_9a47ed6eb919.slice/crio-bfdff3c4c4372d4cdee7a707230ab7dc318035ca76878c00a91a867179b54a48 WatchSource:0}: Error finding container bfdff3c4c4372d4cdee7a707230ab7dc318035ca76878c00a91a867179b54a48: Status 404 returned error can't find the container with id bfdff3c4c4372d4cdee7a707230ab7dc318035ca76878c00a91a867179b54a48 Sep 09 23:08:27.099342 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.099319 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:08:27.103924 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.103900 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.106372 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.106348 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 09 23:08:27.106472 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.106348 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 09 23:08:27.106472 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.106393 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 09 23:08:27.106472 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.106391 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 09 23:08:27.106663 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.106650 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 09 23:08:27.106706 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.106667 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jpn5l\"" Sep 09 23:08:27.106899 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.106879 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 09 23:08:27.106899 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.106892 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 09 23:08:27.107038 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.106891 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 09 23:08:27.107214 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.107199 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 09 23:08:27.116627 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.116608 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:08:27.174149 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.174127 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/066314f1-1ad2-4a24-addd-800d91ade1c1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.174252 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.174162 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vglvw\" (UniqueName: \"kubernetes.io/projected/066314f1-1ad2-4a24-addd-800d91ade1c1-kube-api-access-vglvw\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.174252 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.174181 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.174323 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.174250 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.174323 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.174274 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-web-config\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.174323 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.174295 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/066314f1-1ad2-4a24-addd-800d91ade1c1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.174323 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.174309 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-config-volume\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.174442 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.174325 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/066314f1-1ad2-4a24-addd-800d91ade1c1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.174442 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.174348 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/066314f1-1ad2-4a24-addd-800d91ade1c1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.174442 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.174382 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.174442 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.174403 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.174442 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.174429 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.174585 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.174445 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/066314f1-1ad2-4a24-addd-800d91ade1c1-config-out\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.241008 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.240983 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bc8589fbf-hmlfg"] Sep 09 23:08:27.243894 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.243880 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bc8589fbf-hmlfg" Sep 09 23:08:27.247086 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.247066 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 09 23:08:27.247183 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.247099 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 09 23:08:27.247379 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.247363 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-28x98\"" Sep 09 23:08:27.247705 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.247690 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 09 23:08:27.247840 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.247811 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 09 23:08:27.247910 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.247885 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 09 23:08:27.247972 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.247911 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 09 23:08:27.247972 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.247916 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 09 23:08:27.252864 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.252847 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 09 23:08:27.256322 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.256303 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bc8589fbf-hmlfg"] Sep 09 23:08:27.274923 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.274877 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.274923 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.274905 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.275131 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.274924 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.275131 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.274942 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/066314f1-1ad2-4a24-addd-800d91ade1c1-config-out\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.275131 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.275014 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/066314f1-1ad2-4a24-addd-800d91ade1c1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.275131 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.275068 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vglvw\" (UniqueName: \"kubernetes.io/projected/066314f1-1ad2-4a24-addd-800d91ade1c1-kube-api-access-vglvw\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.275131 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.275095 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.275408 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.275385 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.275463 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.275423 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-web-config\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.275463 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.275458 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/066314f1-1ad2-4a24-addd-800d91ade1c1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.275568 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.275482 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-config-volume\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.275568 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.275507 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/066314f1-1ad2-4a24-addd-800d91ade1c1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.275568 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.275534 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/066314f1-1ad2-4a24-addd-800d91ade1c1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.275854 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.275814 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/066314f1-1ad2-4a24-addd-800d91ade1c1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.275994 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.275855 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/066314f1-1ad2-4a24-addd-800d91ade1c1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.276090 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:08:27.275592 2575 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 09 23:08:27.276184 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:08:27.276166 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/066314f1-1ad2-4a24-addd-800d91ade1c1-alertmanager-trusted-ca-bundle podName:066314f1-1ad2-4a24-addd-800d91ade1c1 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:27.776146344 +0000 UTC m=+291.433801980 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/066314f1-1ad2-4a24-addd-800d91ade1c1-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "066314f1-1ad2-4a24-addd-800d91ade1c1") : configmap references non-existent config key: ca-bundle.crt Sep 09 23:08:27.276297 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:08:27.276284 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-secret-alertmanager-main-tls podName:066314f1-1ad2-4a24-addd-800d91ade1c1 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:27.776264243 +0000 UTC m=+291.433919896 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "066314f1-1ad2-4a24-addd-800d91ade1c1") : secret "alertmanager-main-tls" not found Sep 09 23:08:27.277530 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.277477 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/066314f1-1ad2-4a24-addd-800d91ade1c1-config-out\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.278222 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.277928 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.278222 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.277979 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.278222 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.278185 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/066314f1-1ad2-4a24-addd-800d91ade1c1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.278409 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.278325 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.278465 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.278423 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.278563 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.278542 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-web-config\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.279539 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.279519 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-config-volume\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.288645 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.288625 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vglvw\" (UniqueName: \"kubernetes.io/projected/066314f1-1ad2-4a24-addd-800d91ade1c1-kube-api-access-vglvw\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.375892 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.375869 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-oauth-serving-cert\") pod \"console-7bc8589fbf-hmlfg\" (UID: \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\") " pod="openshift-console/console-7bc8589fbf-hmlfg" Sep 09 23:08:27.375985 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.375914 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-console-oauth-config\") pod \"console-7bc8589fbf-hmlfg\" (UID: \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\") " pod="openshift-console/console-7bc8589fbf-hmlfg" Sep 09 23:08:27.376043 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.376028 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-console-config\") pod \"console-7bc8589fbf-hmlfg\" (UID: \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\") " pod="openshift-console/console-7bc8589fbf-hmlfg" Sep 09 23:08:27.376084 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.376065 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-trusted-ca-bundle\") pod \"console-7bc8589fbf-hmlfg\" (UID: \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\") " pod="openshift-console/console-7bc8589fbf-hmlfg" Sep 09 23:08:27.376117 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.376097 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffb9q\" (UniqueName: \"kubernetes.io/projected/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-kube-api-access-ffb9q\") pod \"console-7bc8589fbf-hmlfg\" (UID: \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\") " pod="openshift-console/console-7bc8589fbf-hmlfg" Sep 09 23:08:27.376198 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.376183 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-console-serving-cert\") pod \"console-7bc8589fbf-hmlfg\" (UID: \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\") " pod="openshift-console/console-7bc8589fbf-hmlfg" Sep 09 23:08:27.376256 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.376236 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-service-ca\") pod \"console-7bc8589fbf-hmlfg\" (UID: \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\") " pod="openshift-console/console-7bc8589fbf-hmlfg" Sep 09 23:08:27.477088 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.477064 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-oauth-serving-cert\") pod \"console-7bc8589fbf-hmlfg\" (UID: \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\") " pod="openshift-console/console-7bc8589fbf-hmlfg" Sep 09 23:08:27.477176 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.477093 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-console-oauth-config\") pod \"console-7bc8589fbf-hmlfg\" (UID: \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\") " pod="openshift-console/console-7bc8589fbf-hmlfg" Sep 09 23:08:27.477176 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.477113 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-console-config\") pod \"console-7bc8589fbf-hmlfg\" (UID: \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\") " pod="openshift-console/console-7bc8589fbf-hmlfg" Sep 09 23:08:27.477176 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.477132 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-trusted-ca-bundle\") pod \"console-7bc8589fbf-hmlfg\" (UID: \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\") " pod="openshift-console/console-7bc8589fbf-hmlfg" Sep 09 23:08:27.477281 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.477175 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffb9q\" (UniqueName: \"kubernetes.io/projected/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-kube-api-access-ffb9q\") pod \"console-7bc8589fbf-hmlfg\" (UID: \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\") " pod="openshift-console/console-7bc8589fbf-hmlfg" Sep 09 23:08:27.477281 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.477249 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-console-serving-cert\") pod \"console-7bc8589fbf-hmlfg\" (UID: \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\") " pod="openshift-console/console-7bc8589fbf-hmlfg" Sep 09 23:08:27.477407 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.477288 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-service-ca\") pod \"console-7bc8589fbf-hmlfg\" (UID: \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\") " pod="openshift-console/console-7bc8589fbf-hmlfg" Sep 09 23:08:27.477818 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.477797 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-console-config\") pod \"console-7bc8589fbf-hmlfg\" (UID: \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\") " pod="openshift-console/console-7bc8589fbf-hmlfg" Sep 09 23:08:27.477928 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.477816 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-oauth-serving-cert\") pod \"console-7bc8589fbf-hmlfg\" (UID: \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\") " pod="openshift-console/console-7bc8589fbf-hmlfg" Sep 09 23:08:27.477979 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.477961 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-service-ca\") pod \"console-7bc8589fbf-hmlfg\" (UID: \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\") " pod="openshift-console/console-7bc8589fbf-hmlfg" Sep 09 23:08:27.478129 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.478109 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-trusted-ca-bundle\") pod \"console-7bc8589fbf-hmlfg\" (UID: \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\") " pod="openshift-console/console-7bc8589fbf-hmlfg" Sep 09 23:08:27.479324 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.479299 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-console-oauth-config\") pod \"console-7bc8589fbf-hmlfg\" (UID: \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\") " pod="openshift-console/console-7bc8589fbf-hmlfg" Sep 09 23:08:27.479532 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.479514 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-console-serving-cert\") pod \"console-7bc8589fbf-hmlfg\" (UID: \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\") " pod="openshift-console/console-7bc8589fbf-hmlfg" Sep 09 23:08:27.486582 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.486560 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffb9q\" (UniqueName: \"kubernetes.io/projected/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-kube-api-access-ffb9q\") pod \"console-7bc8589fbf-hmlfg\" (UID: \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\") " pod="openshift-console/console-7bc8589fbf-hmlfg" Sep 09 23:08:27.552564 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.552519 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bc8589fbf-hmlfg" Sep 09 23:08:27.777886 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.777847 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pnrp8" event={"ID":"599fb6e8-09aa-428b-8f1d-9a47ed6eb919","Type":"ContainerStarted","Data":"bfdff3c4c4372d4cdee7a707230ab7dc318035ca76878c00a91a867179b54a48"} Sep 09 23:08:27.779201 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.779176 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.779316 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.779219 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/066314f1-1ad2-4a24-addd-800d91ade1c1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.780546 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.780519 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/066314f1-1ad2-4a24-addd-800d91ade1c1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.784224 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.782422 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:27.822867 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:27.822795 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bc8589fbf-hmlfg"] Sep 09 23:08:27.825897 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:08:27.825875 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda3aa272_ac16_43e1_b187_1f4cc15b2d7f.slice/crio-0bd3c15fbb89fc2fc7eaddf4354fb605f966656109e74c9a71c2be93db569b83 WatchSource:0}: Error finding container 0bd3c15fbb89fc2fc7eaddf4354fb605f966656109e74c9a71c2be93db569b83: Status 404 returned error can't find the container with id 0bd3c15fbb89fc2fc7eaddf4354fb605f966656109e74c9a71c2be93db569b83 Sep 09 23:08:28.013345 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:28.013303 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:08:28.364216 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:28.364061 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:08:28.366784 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:08:28.366747 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod066314f1_1ad2_4a24_addd_800d91ade1c1.slice/crio-5e04d845dfd362bfafbb7fd1883b6da5c62433cb8b422903e2e101f296072615 WatchSource:0}: Error finding container 5e04d845dfd362bfafbb7fd1883b6da5c62433cb8b422903e2e101f296072615: Status 404 returned error can't find the container with id 5e04d845dfd362bfafbb7fd1883b6da5c62433cb8b422903e2e101f296072615 Sep 09 23:08:28.783002 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:28.782960 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"066314f1-1ad2-4a24-addd-800d91ade1c1","Type":"ContainerStarted","Data":"5e04d845dfd362bfafbb7fd1883b6da5c62433cb8b422903e2e101f296072615"} Sep 09 23:08:28.784807 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:28.784780 2575 generic.go:356] "Generic (PLEG): container finished" podID="599fb6e8-09aa-428b-8f1d-9a47ed6eb919" containerID="01c454c3922575536930f73f313f093e3c6683e008e6819b063b659f4862d081" exitCode=0 Sep 09 23:08:28.784949 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:28.784861 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pnrp8" event={"ID":"599fb6e8-09aa-428b-8f1d-9a47ed6eb919","Type":"ContainerDied","Data":"01c454c3922575536930f73f313f093e3c6683e008e6819b063b659f4862d081"} Sep 09 23:08:28.786388 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:28.786368 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bc8589fbf-hmlfg" event={"ID":"da3aa272-ac16-43e1-b187-1f4cc15b2d7f","Type":"ContainerStarted","Data":"0bd3c15fbb89fc2fc7eaddf4354fb605f966656109e74c9a71c2be93db569b83"} Sep 09 23:08:29.793730 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:29.793694 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pnrp8" event={"ID":"599fb6e8-09aa-428b-8f1d-9a47ed6eb919","Type":"ContainerStarted","Data":"eae84f010785c367d6ccaf8922cbbacfdee2ebe0bdf23eebd2989f27e0c1af75"} Sep 09 23:08:29.794218 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:29.793761 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pnrp8" event={"ID":"599fb6e8-09aa-428b-8f1d-9a47ed6eb919","Type":"ContainerStarted","Data":"617eacb567f6bc396d96008b71c12c2fcd9bb0575750c72db9dbe1fa415b91e7"} Sep 09 23:08:29.813517 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:29.813468 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pnrp8" podStartSLOduration=2.650231905 podStartE2EDuration="3.813450267s" totalImagesPullingTime="1.103474458s" totalInitContainerRuntime="59.743904ms" isStatefulPod=true podCreationTimestamp="2026-09-09 23:08:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:29.812455727 +0000 UTC m=+293.470111371" watchObservedRunningTime="2026-09-09 23:08:29.813450267 +0000 UTC m=+293.471105920" Sep 09 23:08:29.834985 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:08:29.834949 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-kgfhj" podUID="d1e3264c-002a-4855-bb40-0c63971351d9" Sep 09 23:08:31.305182 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:31.305150 2575 patch_prober.go:28] interesting pod/image-registry-999868c4f-gkrc9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 09 23:08:31.305603 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:31.305205 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-999868c4f-gkrc9" podUID="71501650-e6bd-414f-b61f-2fa77ab8f45d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 23:08:31.804034 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:31.804003 2575 generic.go:356] "Generic (PLEG): container finished" podID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerID="663c9148ff50e3b4538f3dc30297b3789dce4cb315ed98f8dbf877b186b9dc17" exitCode=0 Sep 09 23:08:31.804187 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:31.804086 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"066314f1-1ad2-4a24-addd-800d91ade1c1","Type":"ContainerDied","Data":"663c9148ff50e3b4538f3dc30297b3789dce4cb315ed98f8dbf877b186b9dc17"} Sep 09 23:08:31.805770 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:31.805741 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bc8589fbf-hmlfg" event={"ID":"da3aa272-ac16-43e1-b187-1f4cc15b2d7f","Type":"ContainerStarted","Data":"1fe8c780c208743b38a8ecbedb6738fc65630c9ac82f8137a8b7855da0f2f695"} Sep 09 23:08:31.852605 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:31.849989 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bc8589fbf-hmlfg" podStartSLOduration=1.934444652 podStartE2EDuration="4.849970942s" totalImagesPullingTime="2.91552629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:08:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:31.847913765 +0000 UTC m=+295.505569409" watchObservedRunningTime="2026-09-09 23:08:31.849970942 +0000 UTC m=+295.507626586" Sep 09 23:08:32.728350 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:32.728306 2575 patch_prober.go:28] interesting pod/image-registry-999868c4f-gkrc9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 09 23:08:32.728720 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:32.728363 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-999868c4f-gkrc9" podUID="71501650-e6bd-414f-b61f-2fa77ab8f45d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 23:08:33.816275 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:33.816199 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"066314f1-1ad2-4a24-addd-800d91ade1c1","Type":"ContainerStarted","Data":"e09ce787e1d51217dd63d85c59201e83f7c27b501583683429e6474d6fb3578a"} Sep 09 23:08:33.816275 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:33.816262 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"066314f1-1ad2-4a24-addd-800d91ade1c1","Type":"ContainerStarted","Data":"e412c2616fae9a77d07f642e5d837085b3d0f3a42ac8d477c41d6047b59e4fb6"} Sep 09 23:08:33.816641 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:33.816288 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"066314f1-1ad2-4a24-addd-800d91ade1c1","Type":"ContainerStarted","Data":"3608f50571f464579c754fab26481a3a93f0214f0dbc334a91eeb144b55c5990"} Sep 09 23:08:33.816641 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:33.816311 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"066314f1-1ad2-4a24-addd-800d91ade1c1","Type":"ContainerStarted","Data":"c5c03e0993ac30bcc9b399bf6a529171438f75d4370ecd9f20c7f4ff180b3fc7"} Sep 09 23:08:33.816641 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:33.816333 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"066314f1-1ad2-4a24-addd-800d91ade1c1","Type":"ContainerStarted","Data":"eb7f4dafc307d81300125f5b8d136af74f2fc9671de7c6de238f2094c8573394"} Sep 09 23:08:34.772225 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:34.772196 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pcppn" Sep 09 23:08:34.823154 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:34.823090 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"066314f1-1ad2-4a24-addd-800d91ade1c1","Type":"ContainerStarted","Data":"d169c23416458098b149e32356ae15f30ecb7dcf07601fd9615e708dd68e2ca2"} Sep 09 23:08:34.848621 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:34.848580 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.990260476 podStartE2EDuration="7.848565377s" totalImagesPullingTime="4.848837553s" totalInitContainerRuntime="9.467348ms" isStatefulPod=false podCreationTimestamp="2026-09-09 23:08:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:34.847162362 +0000 UTC m=+298.504818004" watchObservedRunningTime="2026-09-09 23:08:34.848565377 +0000 UTC m=+298.506221020" Sep 09 23:08:36.731331 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:36.731298 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6gsr_01cc3a72-4b5d-4af7-9db4-219af2288772/ovn-acl-logging/0.log" Sep 09 23:08:36.731773 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:36.731716 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6gsr_01cc3a72-4b5d-4af7-9db4-219af2288772/ovn-acl-logging/0.log" Sep 09 23:08:36.734209 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:36.734192 2575 kubelet.go:1648] "Image garbage collection succeeded" Sep 09 23:08:37.552741 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:37.552708 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bc8589fbf-hmlfg" Sep 09 23:08:37.555408 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:37.552795 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bc8589fbf-hmlfg" Sep 09 23:08:37.557791 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:37.557767 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bc8589fbf-hmlfg" Sep 09 23:08:37.836052 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:37.835975 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bc8589fbf-hmlfg" Sep 09 23:08:40.836509 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:40.836480 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:08:41.304094 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:41.304060 2575 patch_prober.go:28] interesting pod/image-registry-999868c4f-gkrc9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 09 23:08:41.304240 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:41.304107 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-999868c4f-gkrc9" podUID="71501650-e6bd-414f-b61f-2fa77ab8f45d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 23:08:42.728015 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:42.727988 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-999868c4f-gkrc9" Sep 09 23:08:44.064454 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:08:44.064418 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bc8589fbf-hmlfg"] Sep 09 23:09:09.082763 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.082722 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7bc8589fbf-hmlfg" podUID="da3aa272-ac16-43e1-b187-1f4cc15b2d7f" containerName="console" containerID="cri-o://1fe8c780c208743b38a8ecbedb6738fc65630c9ac82f8137a8b7855da0f2f695" gracePeriod=15 Sep 09 23:09:09.326228 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.326206 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bc8589fbf-hmlfg" Sep 09 23:09:09.382133 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.382110 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-console-serving-cert\") pod \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\" (UID: \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\") " Sep 09 23:09:09.382252 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.382157 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-console-config\") pod \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\" (UID: \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\") " Sep 09 23:09:09.382252 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.382178 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-trusted-ca-bundle\") pod \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\" (UID: \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\") " Sep 09 23:09:09.382252 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.382205 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-service-ca\") pod \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\" (UID: \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\") " Sep 09 23:09:09.382252 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.382222 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-oauth-serving-cert\") pod \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\" (UID: \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\") " Sep 09 23:09:09.382252 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.382243 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-console-oauth-config\") pod \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\" (UID: \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\") " Sep 09 23:09:09.382492 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.382283 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffb9q\" (UniqueName: \"kubernetes.io/projected/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-kube-api-access-ffb9q\") pod \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\" (UID: \"da3aa272-ac16-43e1-b187-1f4cc15b2d7f\") " Sep 09 23:09:09.382665 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.382626 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "da3aa272-ac16-43e1-b187-1f4cc15b2d7f" (UID: "da3aa272-ac16-43e1-b187-1f4cc15b2d7f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:09:09.382665 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.382650 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-service-ca" (OuterVolumeSpecName: "service-ca") pod "da3aa272-ac16-43e1-b187-1f4cc15b2d7f" (UID: "da3aa272-ac16-43e1-b187-1f4cc15b2d7f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:09:09.382860 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.382675 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "da3aa272-ac16-43e1-b187-1f4cc15b2d7f" (UID: "da3aa272-ac16-43e1-b187-1f4cc15b2d7f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:09:09.382860 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.382711 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-console-config" (OuterVolumeSpecName: "console-config") pod "da3aa272-ac16-43e1-b187-1f4cc15b2d7f" (UID: "da3aa272-ac16-43e1-b187-1f4cc15b2d7f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:09:09.384410 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.384382 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-kube-api-access-ffb9q" (OuterVolumeSpecName: "kube-api-access-ffb9q") pod "da3aa272-ac16-43e1-b187-1f4cc15b2d7f" (UID: "da3aa272-ac16-43e1-b187-1f4cc15b2d7f"). InnerVolumeSpecName "kube-api-access-ffb9q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:09:09.384410 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.384396 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "da3aa272-ac16-43e1-b187-1f4cc15b2d7f" (UID: "da3aa272-ac16-43e1-b187-1f4cc15b2d7f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:09:09.384532 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.384413 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "da3aa272-ac16-43e1-b187-1f4cc15b2d7f" (UID: "da3aa272-ac16-43e1-b187-1f4cc15b2d7f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:09:09.482931 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.482908 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-console-config\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:09:09.482931 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.482929 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-trusted-ca-bundle\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:09:09.483053 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.482938 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-service-ca\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:09:09.483053 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.482947 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-oauth-serving-cert\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:09:09.483053 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.482954 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-console-oauth-config\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:09:09.483053 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.482962 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffb9q\" (UniqueName: \"kubernetes.io/projected/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-kube-api-access-ffb9q\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:09:09.483053 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.482971 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da3aa272-ac16-43e1-b187-1f4cc15b2d7f-console-serving-cert\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:09:09.935756 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.935719 2575 generic.go:356] "Generic (PLEG): container finished" podID="da3aa272-ac16-43e1-b187-1f4cc15b2d7f" containerID="1fe8c780c208743b38a8ecbedb6738fc65630c9ac82f8137a8b7855da0f2f695" exitCode=0 Sep 09 23:09:09.935950 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.935765 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bc8589fbf-hmlfg" Sep 09 23:09:09.935950 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.935804 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bc8589fbf-hmlfg" event={"ID":"da3aa272-ac16-43e1-b187-1f4cc15b2d7f","Type":"ContainerDied","Data":"1fe8c780c208743b38a8ecbedb6738fc65630c9ac82f8137a8b7855da0f2f695"} Sep 09 23:09:09.935950 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.935877 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bc8589fbf-hmlfg" event={"ID":"da3aa272-ac16-43e1-b187-1f4cc15b2d7f","Type":"ContainerDied","Data":"0bd3c15fbb89fc2fc7eaddf4354fb605f966656109e74c9a71c2be93db569b83"} Sep 09 23:09:09.935950 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.935907 2575 scope.go:117] "RemoveContainer" containerID="1fe8c780c208743b38a8ecbedb6738fc65630c9ac82f8137a8b7855da0f2f695" Sep 09 23:09:09.944282 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.944259 2575 scope.go:117] "RemoveContainer" containerID="1fe8c780c208743b38a8ecbedb6738fc65630c9ac82f8137a8b7855da0f2f695" Sep 09 23:09:09.944548 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:09:09.944527 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fe8c780c208743b38a8ecbedb6738fc65630c9ac82f8137a8b7855da0f2f695\": container with ID starting with 1fe8c780c208743b38a8ecbedb6738fc65630c9ac82f8137a8b7855da0f2f695 not found: ID does not exist" containerID="1fe8c780c208743b38a8ecbedb6738fc65630c9ac82f8137a8b7855da0f2f695" Sep 09 23:09:09.944595 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.944556 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fe8c780c208743b38a8ecbedb6738fc65630c9ac82f8137a8b7855da0f2f695"} err="failed to get container status \"1fe8c780c208743b38a8ecbedb6738fc65630c9ac82f8137a8b7855da0f2f695\": rpc error: code = NotFound desc = could not find container \"1fe8c780c208743b38a8ecbedb6738fc65630c9ac82f8137a8b7855da0f2f695\": container with ID starting with 1fe8c780c208743b38a8ecbedb6738fc65630c9ac82f8137a8b7855da0f2f695 not found: ID does not exist" Sep 09 23:09:09.955001 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.954980 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bc8589fbf-hmlfg"] Sep 09 23:09:09.958030 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:09.958013 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bc8589fbf-hmlfg"] Sep 09 23:09:10.836776 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:10.836741 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da3aa272-ac16-43e1-b187-1f4cc15b2d7f" path="/var/lib/kubelet/pods/da3aa272-ac16-43e1-b187-1f4cc15b2d7f/volumes" Sep 09 23:09:46.348810 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:46.348781 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:09:46.349298 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:46.349189 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerName="alertmanager" containerID="cri-o://eb7f4dafc307d81300125f5b8d136af74f2fc9671de7c6de238f2094c8573394" gracePeriod=120 Sep 09 23:09:46.349298 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:46.349216 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerName="kube-rbac-proxy-metric" containerID="cri-o://e09ce787e1d51217dd63d85c59201e83f7c27b501583683429e6474d6fb3578a" gracePeriod=120 Sep 09 23:09:46.349298 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:46.349233 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerName="kube-rbac-proxy-web" containerID="cri-o://3608f50571f464579c754fab26481a3a93f0214f0dbc334a91eeb144b55c5990" gracePeriod=120 Sep 09 23:09:46.349298 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:46.349271 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerName="kube-rbac-proxy" containerID="cri-o://e412c2616fae9a77d07f642e5d837085b3d0f3a42ac8d477c41d6047b59e4fb6" gracePeriod=120 Sep 09 23:09:46.349497 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:46.349335 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerName="config-reloader" containerID="cri-o://c5c03e0993ac30bcc9b399bf6a529171438f75d4370ecd9f20c7f4ff180b3fc7" gracePeriod=120 Sep 09 23:09:46.349497 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:46.349358 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerName="prom-label-proxy" containerID="cri-o://d169c23416458098b149e32356ae15f30ecb7dcf07601fd9615e708dd68e2ca2" gracePeriod=120 Sep 09 23:09:47.060263 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.060233 2575 generic.go:356] "Generic (PLEG): container finished" podID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerID="d169c23416458098b149e32356ae15f30ecb7dcf07601fd9615e708dd68e2ca2" exitCode=0 Sep 09 23:09:47.060263 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.060257 2575 generic.go:356] "Generic (PLEG): container finished" podID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerID="e412c2616fae9a77d07f642e5d837085b3d0f3a42ac8d477c41d6047b59e4fb6" exitCode=0 Sep 09 23:09:47.060263 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.060267 2575 generic.go:356] "Generic (PLEG): container finished" podID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerID="c5c03e0993ac30bcc9b399bf6a529171438f75d4370ecd9f20c7f4ff180b3fc7" exitCode=0 Sep 09 23:09:47.060495 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.060274 2575 generic.go:356] "Generic (PLEG): container finished" podID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerID="eb7f4dafc307d81300125f5b8d136af74f2fc9671de7c6de238f2094c8573394" exitCode=0 Sep 09 23:09:47.060495 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.060298 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"066314f1-1ad2-4a24-addd-800d91ade1c1","Type":"ContainerDied","Data":"d169c23416458098b149e32356ae15f30ecb7dcf07601fd9615e708dd68e2ca2"} Sep 09 23:09:47.060495 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.060359 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"066314f1-1ad2-4a24-addd-800d91ade1c1","Type":"ContainerDied","Data":"e412c2616fae9a77d07f642e5d837085b3d0f3a42ac8d477c41d6047b59e4fb6"} Sep 09 23:09:47.060495 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.060386 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"066314f1-1ad2-4a24-addd-800d91ade1c1","Type":"ContainerDied","Data":"c5c03e0993ac30bcc9b399bf6a529171438f75d4370ecd9f20c7f4ff180b3fc7"} Sep 09 23:09:47.060495 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.060410 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"066314f1-1ad2-4a24-addd-800d91ade1c1","Type":"ContainerDied","Data":"eb7f4dafc307d81300125f5b8d136af74f2fc9671de7c6de238f2094c8573394"} Sep 09 23:09:47.582698 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.582677 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:47.663207 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.663119 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-cluster-tls-config\") pod \"066314f1-1ad2-4a24-addd-800d91ade1c1\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " Sep 09 23:09:47.663207 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.663154 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/066314f1-1ad2-4a24-addd-800d91ade1c1-metrics-client-ca\") pod \"066314f1-1ad2-4a24-addd-800d91ade1c1\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " Sep 09 23:09:47.663207 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.663180 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/066314f1-1ad2-4a24-addd-800d91ade1c1-tls-assets\") pod \"066314f1-1ad2-4a24-addd-800d91ade1c1\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " Sep 09 23:09:47.663468 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.663364 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/066314f1-1ad2-4a24-addd-800d91ade1c1-alertmanager-main-db\") pod \"066314f1-1ad2-4a24-addd-800d91ade1c1\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " Sep 09 23:09:47.663468 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.663431 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vglvw\" (UniqueName: \"kubernetes.io/projected/066314f1-1ad2-4a24-addd-800d91ade1c1-kube-api-access-vglvw\") pod \"066314f1-1ad2-4a24-addd-800d91ade1c1\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " Sep 09 23:09:47.663569 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.663485 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-web-config\") pod \"066314f1-1ad2-4a24-addd-800d91ade1c1\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " Sep 09 23:09:47.663569 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.663508 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/066314f1-1ad2-4a24-addd-800d91ade1c1-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "066314f1-1ad2-4a24-addd-800d91ade1c1" (UID: "066314f1-1ad2-4a24-addd-800d91ade1c1"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:09:47.663569 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.663515 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-secret-alertmanager-kube-rbac-proxy-web\") pod \"066314f1-1ad2-4a24-addd-800d91ade1c1\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " Sep 09 23:09:47.663569 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.663539 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-secret-alertmanager-kube-rbac-proxy\") pod \"066314f1-1ad2-4a24-addd-800d91ade1c1\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " Sep 09 23:09:47.663767 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.663570 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-secret-alertmanager-main-tls\") pod \"066314f1-1ad2-4a24-addd-800d91ade1c1\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " Sep 09 23:09:47.663767 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.663599 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-config-volume\") pod \"066314f1-1ad2-4a24-addd-800d91ade1c1\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " Sep 09 23:09:47.663767 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.663625 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"066314f1-1ad2-4a24-addd-800d91ade1c1\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " Sep 09 23:09:47.663767 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.663652 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/066314f1-1ad2-4a24-addd-800d91ade1c1-alertmanager-trusted-ca-bundle\") pod \"066314f1-1ad2-4a24-addd-800d91ade1c1\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " Sep 09 23:09:47.663767 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.663687 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/066314f1-1ad2-4a24-addd-800d91ade1c1-config-out\") pod \"066314f1-1ad2-4a24-addd-800d91ade1c1\" (UID: \"066314f1-1ad2-4a24-addd-800d91ade1c1\") " Sep 09 23:09:47.664025 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.663952 2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/066314f1-1ad2-4a24-addd-800d91ade1c1-metrics-client-ca\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:09:47.664235 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.664206 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/066314f1-1ad2-4a24-addd-800d91ade1c1-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "066314f1-1ad2-4a24-addd-800d91ade1c1" (UID: "066314f1-1ad2-4a24-addd-800d91ade1c1"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:09:47.664815 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.664765 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/066314f1-1ad2-4a24-addd-800d91ade1c1-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "066314f1-1ad2-4a24-addd-800d91ade1c1" (UID: "066314f1-1ad2-4a24-addd-800d91ade1c1"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:09:47.667010 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.666971 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/066314f1-1ad2-4a24-addd-800d91ade1c1-kube-api-access-vglvw" (OuterVolumeSpecName: "kube-api-access-vglvw") pod "066314f1-1ad2-4a24-addd-800d91ade1c1" (UID: "066314f1-1ad2-4a24-addd-800d91ade1c1"). InnerVolumeSpecName "kube-api-access-vglvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:09:47.667114 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.667063 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/066314f1-1ad2-4a24-addd-800d91ade1c1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "066314f1-1ad2-4a24-addd-800d91ade1c1" (UID: "066314f1-1ad2-4a24-addd-800d91ade1c1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:09:47.667301 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.667263 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/066314f1-1ad2-4a24-addd-800d91ade1c1-config-out" (OuterVolumeSpecName: "config-out") pod "066314f1-1ad2-4a24-addd-800d91ade1c1" (UID: "066314f1-1ad2-4a24-addd-800d91ade1c1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:09:47.667592 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.667562 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "066314f1-1ad2-4a24-addd-800d91ade1c1" (UID: "066314f1-1ad2-4a24-addd-800d91ade1c1"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:09:47.667920 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.667883 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "066314f1-1ad2-4a24-addd-800d91ade1c1" (UID: "066314f1-1ad2-4a24-addd-800d91ade1c1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:09:47.667997 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.667957 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "066314f1-1ad2-4a24-addd-800d91ade1c1" (UID: "066314f1-1ad2-4a24-addd-800d91ade1c1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:09:47.668204 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.668181 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-config-volume" (OuterVolumeSpecName: "config-volume") pod "066314f1-1ad2-4a24-addd-800d91ade1c1" (UID: "066314f1-1ad2-4a24-addd-800d91ade1c1"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:09:47.668680 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.668657 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "066314f1-1ad2-4a24-addd-800d91ade1c1" (UID: "066314f1-1ad2-4a24-addd-800d91ade1c1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:09:47.670392 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.670317 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "066314f1-1ad2-4a24-addd-800d91ade1c1" (UID: "066314f1-1ad2-4a24-addd-800d91ade1c1"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:09:47.675928 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.675907 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-web-config" (OuterVolumeSpecName: "web-config") pod "066314f1-1ad2-4a24-addd-800d91ade1c1" (UID: "066314f1-1ad2-4a24-addd-800d91ade1c1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:09:47.768902 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.768870 2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-cluster-tls-config\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:09:47.768902 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.768900 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/066314f1-1ad2-4a24-addd-800d91ade1c1-tls-assets\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:09:47.769039 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.768913 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/066314f1-1ad2-4a24-addd-800d91ade1c1-alertmanager-main-db\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:09:47.769039 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.768926 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vglvw\" (UniqueName: \"kubernetes.io/projected/066314f1-1ad2-4a24-addd-800d91ade1c1-kube-api-access-vglvw\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:09:47.769039 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.768938 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-web-config\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:09:47.769039 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.768951 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:09:47.769039 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.768964 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:09:47.769039 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.768976 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-secret-alertmanager-main-tls\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:09:47.769039 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.768988 2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-config-volume\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:09:47.769039 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.769000 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/066314f1-1ad2-4a24-addd-800d91ade1c1-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:09:47.769039 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.769012 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/066314f1-1ad2-4a24-addd-800d91ade1c1-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:09:47.769039 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:47.769024 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/066314f1-1ad2-4a24-addd-800d91ade1c1-config-out\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:09:48.067498 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.067428 2575 generic.go:356] "Generic (PLEG): container finished" podID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerID="e09ce787e1d51217dd63d85c59201e83f7c27b501583683429e6474d6fb3578a" exitCode=0 Sep 09 23:09:48.067498 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.067450 2575 generic.go:356] "Generic (PLEG): container finished" podID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerID="3608f50571f464579c754fab26481a3a93f0214f0dbc334a91eeb144b55c5990" exitCode=0 Sep 09 23:09:48.067498 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.067468 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"066314f1-1ad2-4a24-addd-800d91ade1c1","Type":"ContainerDied","Data":"e09ce787e1d51217dd63d85c59201e83f7c27b501583683429e6474d6fb3578a"} Sep 09 23:09:48.067660 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.067511 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.067660 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.067523 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"066314f1-1ad2-4a24-addd-800d91ade1c1","Type":"ContainerDied","Data":"3608f50571f464579c754fab26481a3a93f0214f0dbc334a91eeb144b55c5990"} Sep 09 23:09:48.067660 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.067551 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"066314f1-1ad2-4a24-addd-800d91ade1c1","Type":"ContainerDied","Data":"5e04d845dfd362bfafbb7fd1883b6da5c62433cb8b422903e2e101f296072615"} Sep 09 23:09:48.067660 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.067580 2575 scope.go:117] "RemoveContainer" containerID="d169c23416458098b149e32356ae15f30ecb7dcf07601fd9615e708dd68e2ca2" Sep 09 23:09:48.075373 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.075353 2575 scope.go:117] "RemoveContainer" containerID="e09ce787e1d51217dd63d85c59201e83f7c27b501583683429e6474d6fb3578a" Sep 09 23:09:48.082361 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.082341 2575 scope.go:117] "RemoveContainer" containerID="e412c2616fae9a77d07f642e5d837085b3d0f3a42ac8d477c41d6047b59e4fb6" Sep 09 23:09:48.091018 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.091001 2575 scope.go:117] "RemoveContainer" containerID="3608f50571f464579c754fab26481a3a93f0214f0dbc334a91eeb144b55c5990" Sep 09 23:09:48.091018 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.091010 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:09:48.095172 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.095154 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:09:48.097271 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.097252 2575 scope.go:117] "RemoveContainer" containerID="c5c03e0993ac30bcc9b399bf6a529171438f75d4370ecd9f20c7f4ff180b3fc7" Sep 09 23:09:48.103573 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.103558 2575 scope.go:117] "RemoveContainer" containerID="eb7f4dafc307d81300125f5b8d136af74f2fc9671de7c6de238f2094c8573394" Sep 09 23:09:48.109922 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.109902 2575 scope.go:117] "RemoveContainer" containerID="663c9148ff50e3b4538f3dc30297b3789dce4cb315ed98f8dbf877b186b9dc17" Sep 09 23:09:48.116085 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.116064 2575 scope.go:117] "RemoveContainer" containerID="d169c23416458098b149e32356ae15f30ecb7dcf07601fd9615e708dd68e2ca2" Sep 09 23:09:48.116349 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:09:48.116332 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d169c23416458098b149e32356ae15f30ecb7dcf07601fd9615e708dd68e2ca2\": container with ID starting with d169c23416458098b149e32356ae15f30ecb7dcf07601fd9615e708dd68e2ca2 not found: ID does not exist" containerID="d169c23416458098b149e32356ae15f30ecb7dcf07601fd9615e708dd68e2ca2" Sep 09 23:09:48.116425 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.116360 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d169c23416458098b149e32356ae15f30ecb7dcf07601fd9615e708dd68e2ca2"} err="failed to get container status \"d169c23416458098b149e32356ae15f30ecb7dcf07601fd9615e708dd68e2ca2\": rpc error: code = NotFound desc = could not find container \"d169c23416458098b149e32356ae15f30ecb7dcf07601fd9615e708dd68e2ca2\": container with ID starting with d169c23416458098b149e32356ae15f30ecb7dcf07601fd9615e708dd68e2ca2 not found: ID does not exist" Sep 09 23:09:48.116425 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.116386 2575 scope.go:117] "RemoveContainer" containerID="e09ce787e1d51217dd63d85c59201e83f7c27b501583683429e6474d6fb3578a" Sep 09 23:09:48.116626 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:09:48.116609 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e09ce787e1d51217dd63d85c59201e83f7c27b501583683429e6474d6fb3578a\": container with ID starting with e09ce787e1d51217dd63d85c59201e83f7c27b501583683429e6474d6fb3578a not found: ID does not exist" containerID="e09ce787e1d51217dd63d85c59201e83f7c27b501583683429e6474d6fb3578a" Sep 09 23:09:48.116674 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.116631 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e09ce787e1d51217dd63d85c59201e83f7c27b501583683429e6474d6fb3578a"} err="failed to get container status \"e09ce787e1d51217dd63d85c59201e83f7c27b501583683429e6474d6fb3578a\": rpc error: code = NotFound desc = could not find container \"e09ce787e1d51217dd63d85c59201e83f7c27b501583683429e6474d6fb3578a\": container with ID starting with e09ce787e1d51217dd63d85c59201e83f7c27b501583683429e6474d6fb3578a not found: ID does not exist" Sep 09 23:09:48.116674 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.116647 2575 scope.go:117] "RemoveContainer" containerID="e412c2616fae9a77d07f642e5d837085b3d0f3a42ac8d477c41d6047b59e4fb6" Sep 09 23:09:48.116877 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:09:48.116858 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e412c2616fae9a77d07f642e5d837085b3d0f3a42ac8d477c41d6047b59e4fb6\": container with ID starting with e412c2616fae9a77d07f642e5d837085b3d0f3a42ac8d477c41d6047b59e4fb6 not found: ID does not exist" containerID="e412c2616fae9a77d07f642e5d837085b3d0f3a42ac8d477c41d6047b59e4fb6" Sep 09 23:09:48.116938 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.116881 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e412c2616fae9a77d07f642e5d837085b3d0f3a42ac8d477c41d6047b59e4fb6"} err="failed to get container status \"e412c2616fae9a77d07f642e5d837085b3d0f3a42ac8d477c41d6047b59e4fb6\": rpc error: code = NotFound desc = could not find container \"e412c2616fae9a77d07f642e5d837085b3d0f3a42ac8d477c41d6047b59e4fb6\": container with ID starting with e412c2616fae9a77d07f642e5d837085b3d0f3a42ac8d477c41d6047b59e4fb6 not found: ID does not exist" Sep 09 23:09:48.116938 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.116895 2575 scope.go:117] "RemoveContainer" containerID="3608f50571f464579c754fab26481a3a93f0214f0dbc334a91eeb144b55c5990" Sep 09 23:09:48.117130 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:09:48.117114 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3608f50571f464579c754fab26481a3a93f0214f0dbc334a91eeb144b55c5990\": container with ID starting with 3608f50571f464579c754fab26481a3a93f0214f0dbc334a91eeb144b55c5990 not found: ID does not exist" containerID="3608f50571f464579c754fab26481a3a93f0214f0dbc334a91eeb144b55c5990" Sep 09 23:09:48.117177 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.117133 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3608f50571f464579c754fab26481a3a93f0214f0dbc334a91eeb144b55c5990"} err="failed to get container status \"3608f50571f464579c754fab26481a3a93f0214f0dbc334a91eeb144b55c5990\": rpc error: code = NotFound desc = could not find container \"3608f50571f464579c754fab26481a3a93f0214f0dbc334a91eeb144b55c5990\": container with ID starting with 3608f50571f464579c754fab26481a3a93f0214f0dbc334a91eeb144b55c5990 not found: ID does not exist" Sep 09 23:09:48.117177 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.117145 2575 scope.go:117] "RemoveContainer" containerID="c5c03e0993ac30bcc9b399bf6a529171438f75d4370ecd9f20c7f4ff180b3fc7" Sep 09 23:09:48.117352 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:09:48.117335 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5c03e0993ac30bcc9b399bf6a529171438f75d4370ecd9f20c7f4ff180b3fc7\": container with ID starting with c5c03e0993ac30bcc9b399bf6a529171438f75d4370ecd9f20c7f4ff180b3fc7 not found: ID does not exist" containerID="c5c03e0993ac30bcc9b399bf6a529171438f75d4370ecd9f20c7f4ff180b3fc7" Sep 09 23:09:48.117417 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.117359 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5c03e0993ac30bcc9b399bf6a529171438f75d4370ecd9f20c7f4ff180b3fc7"} err="failed to get container status \"c5c03e0993ac30bcc9b399bf6a529171438f75d4370ecd9f20c7f4ff180b3fc7\": rpc error: code = NotFound desc = could not find container \"c5c03e0993ac30bcc9b399bf6a529171438f75d4370ecd9f20c7f4ff180b3fc7\": container with ID starting with c5c03e0993ac30bcc9b399bf6a529171438f75d4370ecd9f20c7f4ff180b3fc7 not found: ID does not exist" Sep 09 23:09:48.117417 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.117380 2575 scope.go:117] "RemoveContainer" containerID="eb7f4dafc307d81300125f5b8d136af74f2fc9671de7c6de238f2094c8573394" Sep 09 23:09:48.117588 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:09:48.117573 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb7f4dafc307d81300125f5b8d136af74f2fc9671de7c6de238f2094c8573394\": container with ID starting with eb7f4dafc307d81300125f5b8d136af74f2fc9671de7c6de238f2094c8573394 not found: ID does not exist" containerID="eb7f4dafc307d81300125f5b8d136af74f2fc9671de7c6de238f2094c8573394" Sep 09 23:09:48.117627 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.117591 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb7f4dafc307d81300125f5b8d136af74f2fc9671de7c6de238f2094c8573394"} err="failed to get container status \"eb7f4dafc307d81300125f5b8d136af74f2fc9671de7c6de238f2094c8573394\": rpc error: code = NotFound desc = could not find container \"eb7f4dafc307d81300125f5b8d136af74f2fc9671de7c6de238f2094c8573394\": container with ID starting with eb7f4dafc307d81300125f5b8d136af74f2fc9671de7c6de238f2094c8573394 not found: ID does not exist" Sep 09 23:09:48.117627 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.117604 2575 scope.go:117] "RemoveContainer" containerID="663c9148ff50e3b4538f3dc30297b3789dce4cb315ed98f8dbf877b186b9dc17" Sep 09 23:09:48.117860 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:09:48.117837 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"663c9148ff50e3b4538f3dc30297b3789dce4cb315ed98f8dbf877b186b9dc17\": container with ID starting with 663c9148ff50e3b4538f3dc30297b3789dce4cb315ed98f8dbf877b186b9dc17 not found: ID does not exist" containerID="663c9148ff50e3b4538f3dc30297b3789dce4cb315ed98f8dbf877b186b9dc17" Sep 09 23:09:48.117928 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.117865 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"663c9148ff50e3b4538f3dc30297b3789dce4cb315ed98f8dbf877b186b9dc17"} err="failed to get container status \"663c9148ff50e3b4538f3dc30297b3789dce4cb315ed98f8dbf877b186b9dc17\": rpc error: code = NotFound desc = could not find container \"663c9148ff50e3b4538f3dc30297b3789dce4cb315ed98f8dbf877b186b9dc17\": container with ID starting with 663c9148ff50e3b4538f3dc30297b3789dce4cb315ed98f8dbf877b186b9dc17 not found: ID does not exist" Sep 09 23:09:48.117928 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.117881 2575 scope.go:117] "RemoveContainer" containerID="d169c23416458098b149e32356ae15f30ecb7dcf07601fd9615e708dd68e2ca2" Sep 09 23:09:48.118183 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.118149 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d169c23416458098b149e32356ae15f30ecb7dcf07601fd9615e708dd68e2ca2"} err="failed to get container status \"d169c23416458098b149e32356ae15f30ecb7dcf07601fd9615e708dd68e2ca2\": rpc error: code = NotFound desc = could not find container \"d169c23416458098b149e32356ae15f30ecb7dcf07601fd9615e708dd68e2ca2\": container with ID starting with d169c23416458098b149e32356ae15f30ecb7dcf07601fd9615e708dd68e2ca2 not found: ID does not exist" Sep 09 23:09:48.118183 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.118179 2575 scope.go:117] "RemoveContainer" containerID="e09ce787e1d51217dd63d85c59201e83f7c27b501583683429e6474d6fb3578a" Sep 09 23:09:48.118583 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.118555 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e09ce787e1d51217dd63d85c59201e83f7c27b501583683429e6474d6fb3578a"} err="failed to get container status \"e09ce787e1d51217dd63d85c59201e83f7c27b501583683429e6474d6fb3578a\": rpc error: code = NotFound desc = could not find container \"e09ce787e1d51217dd63d85c59201e83f7c27b501583683429e6474d6fb3578a\": container with ID starting with e09ce787e1d51217dd63d85c59201e83f7c27b501583683429e6474d6fb3578a not found: ID does not exist" Sep 09 23:09:48.118583 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.118574 2575 scope.go:117] "RemoveContainer" containerID="e412c2616fae9a77d07f642e5d837085b3d0f3a42ac8d477c41d6047b59e4fb6" Sep 09 23:09:48.118923 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.118894 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e412c2616fae9a77d07f642e5d837085b3d0f3a42ac8d477c41d6047b59e4fb6"} err="failed to get container status \"e412c2616fae9a77d07f642e5d837085b3d0f3a42ac8d477c41d6047b59e4fb6\": rpc error: code = NotFound desc = could not find container \"e412c2616fae9a77d07f642e5d837085b3d0f3a42ac8d477c41d6047b59e4fb6\": container with ID starting with e412c2616fae9a77d07f642e5d837085b3d0f3a42ac8d477c41d6047b59e4fb6 not found: ID does not exist" Sep 09 23:09:48.118923 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.118923 2575 scope.go:117] "RemoveContainer" containerID="3608f50571f464579c754fab26481a3a93f0214f0dbc334a91eeb144b55c5990" Sep 09 23:09:48.119190 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.119145 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3608f50571f464579c754fab26481a3a93f0214f0dbc334a91eeb144b55c5990"} err="failed to get container status \"3608f50571f464579c754fab26481a3a93f0214f0dbc334a91eeb144b55c5990\": rpc error: code = NotFound desc = could not find container \"3608f50571f464579c754fab26481a3a93f0214f0dbc334a91eeb144b55c5990\": container with ID starting with 3608f50571f464579c754fab26481a3a93f0214f0dbc334a91eeb144b55c5990 not found: ID does not exist" Sep 09 23:09:48.119190 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.119165 2575 scope.go:117] "RemoveContainer" containerID="c5c03e0993ac30bcc9b399bf6a529171438f75d4370ecd9f20c7f4ff180b3fc7" Sep 09 23:09:48.119394 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.119375 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5c03e0993ac30bcc9b399bf6a529171438f75d4370ecd9f20c7f4ff180b3fc7"} err="failed to get container status \"c5c03e0993ac30bcc9b399bf6a529171438f75d4370ecd9f20c7f4ff180b3fc7\": rpc error: code = NotFound desc = could not find container \"c5c03e0993ac30bcc9b399bf6a529171438f75d4370ecd9f20c7f4ff180b3fc7\": container with ID starting with c5c03e0993ac30bcc9b399bf6a529171438f75d4370ecd9f20c7f4ff180b3fc7 not found: ID does not exist" Sep 09 23:09:48.119437 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.119395 2575 scope.go:117] "RemoveContainer" containerID="eb7f4dafc307d81300125f5b8d136af74f2fc9671de7c6de238f2094c8573394" Sep 09 23:09:48.119437 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.119395 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:09:48.119629 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.119616 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerName="kube-rbac-proxy" Sep 09 23:09:48.119629 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.119629 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerName="kube-rbac-proxy" Sep 09 23:09:48.119700 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.119634 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb7f4dafc307d81300125f5b8d136af74f2fc9671de7c6de238f2094c8573394"} err="failed to get container status \"eb7f4dafc307d81300125f5b8d136af74f2fc9671de7c6de238f2094c8573394\": rpc error: code = NotFound desc = could not find container \"eb7f4dafc307d81300125f5b8d136af74f2fc9671de7c6de238f2094c8573394\": container with ID starting with eb7f4dafc307d81300125f5b8d136af74f2fc9671de7c6de238f2094c8573394 not found: ID does not exist" Sep 09 23:09:48.119700 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.119655 2575 scope.go:117] "RemoveContainer" containerID="663c9148ff50e3b4538f3dc30297b3789dce4cb315ed98f8dbf877b186b9dc17" Sep 09 23:09:48.119700 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.119642 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerName="init-config-reloader" Sep 09 23:09:48.119700 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.119700 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerName="init-config-reloader" Sep 09 23:09:48.119867 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.119710 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerName="config-reloader" Sep 09 23:09:48.119867 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.119717 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerName="config-reloader" Sep 09 23:09:48.119867 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.119723 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerName="kube-rbac-proxy-web" Sep 09 23:09:48.119867 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.119729 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerName="kube-rbac-proxy-web" Sep 09 23:09:48.119867 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.119751 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerName="alertmanager" Sep 09 23:09:48.119867 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.119758 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerName="alertmanager" Sep 09 23:09:48.119867 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.119764 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerName="kube-rbac-proxy-metric" Sep 09 23:09:48.119867 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.119771 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerName="kube-rbac-proxy-metric" Sep 09 23:09:48.119867 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.119780 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerName="prom-label-proxy" Sep 09 23:09:48.119867 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.119787 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerName="prom-label-proxy" Sep 09 23:09:48.119867 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.119796 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da3aa272-ac16-43e1-b187-1f4cc15b2d7f" containerName="console" Sep 09 23:09:48.119867 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.119805 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="da3aa272-ac16-43e1-b187-1f4cc15b2d7f" containerName="console" Sep 09 23:09:48.120252 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.119898 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerName="prom-label-proxy" Sep 09 23:09:48.120252 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.119913 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="da3aa272-ac16-43e1-b187-1f4cc15b2d7f" containerName="console" Sep 09 23:09:48.120252 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.119907 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"663c9148ff50e3b4538f3dc30297b3789dce4cb315ed98f8dbf877b186b9dc17"} err="failed to get container status \"663c9148ff50e3b4538f3dc30297b3789dce4cb315ed98f8dbf877b186b9dc17\": rpc error: code = NotFound desc = could not find container \"663c9148ff50e3b4538f3dc30297b3789dce4cb315ed98f8dbf877b186b9dc17\": container with ID starting with 663c9148ff50e3b4538f3dc30297b3789dce4cb315ed98f8dbf877b186b9dc17 not found: ID does not exist" Sep 09 23:09:48.120252 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.119921 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerName="alertmanager" Sep 09 23:09:48.120252 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.119930 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerName="kube-rbac-proxy-web" Sep 09 23:09:48.120252 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.119939 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerName="config-reloader" Sep 09 23:09:48.120252 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.119946 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerName="kube-rbac-proxy" Sep 09 23:09:48.120252 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.119951 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="066314f1-1ad2-4a24-addd-800d91ade1c1" containerName="kube-rbac-proxy-metric" Sep 09 23:09:48.124555 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.124538 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.127090 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.127074 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 09 23:09:48.127212 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.127196 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 09 23:09:48.127283 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.127224 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 09 23:09:48.127283 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.127242 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 09 23:09:48.127515 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.127498 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 09 23:09:48.127569 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.127538 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jpn5l\"" Sep 09 23:09:48.127728 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.127706 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 09 23:09:48.127728 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.127716 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 09 23:09:48.127887 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.127766 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 09 23:09:48.132599 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.132579 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 09 23:09:48.137396 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.137315 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:09:48.272104 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.272074 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5bda1a58-b126-4f1e-8693-d232c6647bee-web-config\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.272104 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.272104 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5bda1a58-b126-4f1e-8693-d232c6647bee-config-volume\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.272270 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.272121 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5bda1a58-b126-4f1e-8693-d232c6647bee-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.272270 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.272137 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blhq2\" (UniqueName: \"kubernetes.io/projected/5bda1a58-b126-4f1e-8693-d232c6647bee-kube-api-access-blhq2\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.272270 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.272152 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5bda1a58-b126-4f1e-8693-d232c6647bee-config-out\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.272270 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.272207 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5bda1a58-b126-4f1e-8693-d232c6647bee-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.272270 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.272233 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5bda1a58-b126-4f1e-8693-d232c6647bee-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.272270 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.272263 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5bda1a58-b126-4f1e-8693-d232c6647bee-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.272471 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.272278 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5bda1a58-b126-4f1e-8693-d232c6647bee-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.272471 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.272296 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5bda1a58-b126-4f1e-8693-d232c6647bee-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.272471 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.272312 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5bda1a58-b126-4f1e-8693-d232c6647bee-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.272471 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.272345 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5bda1a58-b126-4f1e-8693-d232c6647bee-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.272471 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.272382 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bda1a58-b126-4f1e-8693-d232c6647bee-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.373444 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.373421 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bda1a58-b126-4f1e-8693-d232c6647bee-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.373544 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.373457 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5bda1a58-b126-4f1e-8693-d232c6647bee-web-config\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.373544 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.373474 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5bda1a58-b126-4f1e-8693-d232c6647bee-config-volume\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.373544 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.373490 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5bda1a58-b126-4f1e-8693-d232c6647bee-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.373705 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.373685 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blhq2\" (UniqueName: \"kubernetes.io/projected/5bda1a58-b126-4f1e-8693-d232c6647bee-kube-api-access-blhq2\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.373742 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.373725 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5bda1a58-b126-4f1e-8693-d232c6647bee-config-out\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.373787 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.373761 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5bda1a58-b126-4f1e-8693-d232c6647bee-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.374147 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.374117 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5bda1a58-b126-4f1e-8693-d232c6647bee-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.374257 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.374165 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5bda1a58-b126-4f1e-8693-d232c6647bee-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.374257 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.374192 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5bda1a58-b126-4f1e-8693-d232c6647bee-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.374405 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.374380 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5bda1a58-b126-4f1e-8693-d232c6647bee-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.374473 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.374411 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5bda1a58-b126-4f1e-8693-d232c6647bee-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.374473 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.374443 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5bda1a58-b126-4f1e-8693-d232c6647bee-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.374582 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.374516 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bda1a58-b126-4f1e-8693-d232c6647bee-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.376308 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.376283 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5bda1a58-b126-4f1e-8693-d232c6647bee-config-out\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.376445 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.376421 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5bda1a58-b126-4f1e-8693-d232c6647bee-config-volume\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.376766 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.376584 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5bda1a58-b126-4f1e-8693-d232c6647bee-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.376766 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.376611 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5bda1a58-b126-4f1e-8693-d232c6647bee-web-config\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.376766 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.376608 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5bda1a58-b126-4f1e-8693-d232c6647bee-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.376766 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.376719 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5bda1a58-b126-4f1e-8693-d232c6647bee-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.376985 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.376814 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5bda1a58-b126-4f1e-8693-d232c6647bee-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.377159 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.377140 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5bda1a58-b126-4f1e-8693-d232c6647bee-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.377198 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.377155 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5bda1a58-b126-4f1e-8693-d232c6647bee-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.377280 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.377266 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5bda1a58-b126-4f1e-8693-d232c6647bee-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.378397 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.378382 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5bda1a58-b126-4f1e-8693-d232c6647bee-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.380822 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.380805 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blhq2\" (UniqueName: \"kubernetes.io/projected/5bda1a58-b126-4f1e-8693-d232c6647bee-kube-api-access-blhq2\") pod \"alertmanager-main-0\" (UID: \"5bda1a58-b126-4f1e-8693-d232c6647bee\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.433435 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.433408 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:09:48.708399 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.708376 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:09:48.709372 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:09:48.709349 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bda1a58_b126_4f1e_8693_d232c6647bee.slice/crio-c9c7f6633a66c19e4501997bda2be340973ed464c60a1bf99afde7be381b1d19 WatchSource:0}: Error finding container c9c7f6633a66c19e4501997bda2be340973ed464c60a1bf99afde7be381b1d19: Status 404 returned error can't find the container with id c9c7f6633a66c19e4501997bda2be340973ed464c60a1bf99afde7be381b1d19 Sep 09 23:09:48.836978 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:48.836951 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="066314f1-1ad2-4a24-addd-800d91ade1c1" path="/var/lib/kubelet/pods/066314f1-1ad2-4a24-addd-800d91ade1c1/volumes" Sep 09 23:09:49.073168 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:49.073086 2575 generic.go:356] "Generic (PLEG): container finished" podID="5bda1a58-b126-4f1e-8693-d232c6647bee" containerID="fbbc9682bd6f2ff8bd73a51342a14f8d78e2ec7db3eb007ef5871f1e26a8e7e6" exitCode=0 Sep 09 23:09:49.073168 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:49.073155 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5bda1a58-b126-4f1e-8693-d232c6647bee","Type":"ContainerDied","Data":"fbbc9682bd6f2ff8bd73a51342a14f8d78e2ec7db3eb007ef5871f1e26a8e7e6"} Sep 09 23:09:49.073317 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:49.073221 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5bda1a58-b126-4f1e-8693-d232c6647bee","Type":"ContainerStarted","Data":"c9c7f6633a66c19e4501997bda2be340973ed464c60a1bf99afde7be381b1d19"} Sep 09 23:09:50.080026 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.079988 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5bda1a58-b126-4f1e-8693-d232c6647bee","Type":"ContainerStarted","Data":"5b980978e39e8d235304d4147448a07203d9383cd02a05e5bb696815ce4a6828"} Sep 09 23:09:50.080370 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.080074 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5bda1a58-b126-4f1e-8693-d232c6647bee","Type":"ContainerStarted","Data":"c2671f100131a911e0096e8589f4c72f700780496e74b2003bc9ca91d18d6bfc"} Sep 09 23:09:50.080370 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.080106 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5bda1a58-b126-4f1e-8693-d232c6647bee","Type":"ContainerStarted","Data":"fb55450131b16d117ef43561b52fdfb30d4e6ee333e298f5cd71e2645de04461"} Sep 09 23:09:50.080370 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.080129 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5bda1a58-b126-4f1e-8693-d232c6647bee","Type":"ContainerStarted","Data":"6b56a30e3588affd3290b3976260895746f7b70ce579120005bf3e0a04235cfd"} Sep 09 23:09:50.080370 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.080151 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5bda1a58-b126-4f1e-8693-d232c6647bee","Type":"ContainerStarted","Data":"7770f1d37973e121dbe9ef19e73b3133550b070624d99fc31b1a437db47fe772"} Sep 09 23:09:50.080370 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.080174 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5bda1a58-b126-4f1e-8693-d232c6647bee","Type":"ContainerStarted","Data":"f27192b9a9ab03eac1d2431b366bf92ca5a106a5e33b3531c934a984fa56e266"} Sep 09 23:09:50.105129 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.105081 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.09017287 podStartE2EDuration="2.105067108s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.894238ms" isStatefulPod=false podCreationTimestamp="2026-09-09 23:09:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:50.103280767 +0000 UTC m=+373.760936410" watchObservedRunningTime="2026-09-09 23:09:50.105067108 +0000 UTC m=+373.762722752" Sep 09 23:09:50.363190 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.363116 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-684f677f45-qbn44"] Sep 09 23:09:50.366336 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.366319 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-684f677f45-qbn44" Sep 09 23:09:50.368787 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.368762 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-4gqpk\"" Sep 09 23:09:50.368922 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.368793 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 09 23:09:50.368922 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.368792 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 09 23:09:50.368922 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.368878 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 09 23:09:50.369111 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.369095 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 09 23:09:50.369111 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.369105 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 09 23:09:50.373127 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.373023 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 09 23:09:50.385721 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.385695 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-684f677f45-qbn44"] Sep 09 23:09:50.491047 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.491025 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/119d76db-2644-435e-9f03-8ebf7db62b7a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-684f677f45-qbn44\" (UID: \"119d76db-2644-435e-9f03-8ebf7db62b7a\") " pod="openshift-monitoring/telemeter-client-684f677f45-qbn44" Sep 09 23:09:50.491148 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.491053 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5lqp\" (UniqueName: \"kubernetes.io/projected/119d76db-2644-435e-9f03-8ebf7db62b7a-kube-api-access-z5lqp\") pod \"telemeter-client-684f677f45-qbn44\" (UID: \"119d76db-2644-435e-9f03-8ebf7db62b7a\") " pod="openshift-monitoring/telemeter-client-684f677f45-qbn44" Sep 09 23:09:50.491148 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.491075 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/119d76db-2644-435e-9f03-8ebf7db62b7a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-684f677f45-qbn44\" (UID: \"119d76db-2644-435e-9f03-8ebf7db62b7a\") " pod="openshift-monitoring/telemeter-client-684f677f45-qbn44" Sep 09 23:09:50.491148 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.491095 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/119d76db-2644-435e-9f03-8ebf7db62b7a-telemeter-client-tls\") pod \"telemeter-client-684f677f45-qbn44\" (UID: \"119d76db-2644-435e-9f03-8ebf7db62b7a\") " pod="openshift-monitoring/telemeter-client-684f677f45-qbn44" Sep 09 23:09:50.491148 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.491120 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/119d76db-2644-435e-9f03-8ebf7db62b7a-federate-client-tls\") pod \"telemeter-client-684f677f45-qbn44\" (UID: \"119d76db-2644-435e-9f03-8ebf7db62b7a\") " pod="openshift-monitoring/telemeter-client-684f677f45-qbn44" Sep 09 23:09:50.491289 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.491173 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/119d76db-2644-435e-9f03-8ebf7db62b7a-metrics-client-ca\") pod \"telemeter-client-684f677f45-qbn44\" (UID: \"119d76db-2644-435e-9f03-8ebf7db62b7a\") " pod="openshift-monitoring/telemeter-client-684f677f45-qbn44" Sep 09 23:09:50.491289 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.491240 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/119d76db-2644-435e-9f03-8ebf7db62b7a-serving-certs-ca-bundle\") pod \"telemeter-client-684f677f45-qbn44\" (UID: \"119d76db-2644-435e-9f03-8ebf7db62b7a\") " pod="openshift-monitoring/telemeter-client-684f677f45-qbn44" Sep 09 23:09:50.491289 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.491269 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/119d76db-2644-435e-9f03-8ebf7db62b7a-secret-telemeter-client\") pod \"telemeter-client-684f677f45-qbn44\" (UID: \"119d76db-2644-435e-9f03-8ebf7db62b7a\") " pod="openshift-monitoring/telemeter-client-684f677f45-qbn44" Sep 09 23:09:50.591973 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.591945 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/119d76db-2644-435e-9f03-8ebf7db62b7a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-684f677f45-qbn44\" (UID: \"119d76db-2644-435e-9f03-8ebf7db62b7a\") " pod="openshift-monitoring/telemeter-client-684f677f45-qbn44" Sep 09 23:09:50.592082 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.591978 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5lqp\" (UniqueName: \"kubernetes.io/projected/119d76db-2644-435e-9f03-8ebf7db62b7a-kube-api-access-z5lqp\") pod \"telemeter-client-684f677f45-qbn44\" (UID: \"119d76db-2644-435e-9f03-8ebf7db62b7a\") " pod="openshift-monitoring/telemeter-client-684f677f45-qbn44" Sep 09 23:09:50.592082 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.592012 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/119d76db-2644-435e-9f03-8ebf7db62b7a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-684f677f45-qbn44\" (UID: \"119d76db-2644-435e-9f03-8ebf7db62b7a\") " pod="openshift-monitoring/telemeter-client-684f677f45-qbn44" Sep 09 23:09:50.592224 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.592199 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/119d76db-2644-435e-9f03-8ebf7db62b7a-telemeter-client-tls\") pod \"telemeter-client-684f677f45-qbn44\" (UID: \"119d76db-2644-435e-9f03-8ebf7db62b7a\") " pod="openshift-monitoring/telemeter-client-684f677f45-qbn44" Sep 09 23:09:50.592278 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.592242 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/119d76db-2644-435e-9f03-8ebf7db62b7a-federate-client-tls\") pod \"telemeter-client-684f677f45-qbn44\" (UID: \"119d76db-2644-435e-9f03-8ebf7db62b7a\") " pod="openshift-monitoring/telemeter-client-684f677f45-qbn44" Sep 09 23:09:50.592332 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.592274 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/119d76db-2644-435e-9f03-8ebf7db62b7a-metrics-client-ca\") pod \"telemeter-client-684f677f45-qbn44\" (UID: \"119d76db-2644-435e-9f03-8ebf7db62b7a\") " pod="openshift-monitoring/telemeter-client-684f677f45-qbn44" Sep 09 23:09:50.592332 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.592309 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/119d76db-2644-435e-9f03-8ebf7db62b7a-serving-certs-ca-bundle\") pod \"telemeter-client-684f677f45-qbn44\" (UID: \"119d76db-2644-435e-9f03-8ebf7db62b7a\") " pod="openshift-monitoring/telemeter-client-684f677f45-qbn44" Sep 09 23:09:50.592456 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.592430 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/119d76db-2644-435e-9f03-8ebf7db62b7a-secret-telemeter-client\") pod \"telemeter-client-684f677f45-qbn44\" (UID: \"119d76db-2644-435e-9f03-8ebf7db62b7a\") " pod="openshift-monitoring/telemeter-client-684f677f45-qbn44" Sep 09 23:09:50.593008 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.592985 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/119d76db-2644-435e-9f03-8ebf7db62b7a-metrics-client-ca\") pod \"telemeter-client-684f677f45-qbn44\" (UID: \"119d76db-2644-435e-9f03-8ebf7db62b7a\") " pod="openshift-monitoring/telemeter-client-684f677f45-qbn44" Sep 09 23:09:50.593008 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.593003 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/119d76db-2644-435e-9f03-8ebf7db62b7a-serving-certs-ca-bundle\") pod \"telemeter-client-684f677f45-qbn44\" (UID: \"119d76db-2644-435e-9f03-8ebf7db62b7a\") " pod="openshift-monitoring/telemeter-client-684f677f45-qbn44" Sep 09 23:09:50.593167 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.593041 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/119d76db-2644-435e-9f03-8ebf7db62b7a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-684f677f45-qbn44\" (UID: \"119d76db-2644-435e-9f03-8ebf7db62b7a\") " pod="openshift-monitoring/telemeter-client-684f677f45-qbn44" Sep 09 23:09:50.594600 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.594570 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/119d76db-2644-435e-9f03-8ebf7db62b7a-telemeter-client-tls\") pod \"telemeter-client-684f677f45-qbn44\" (UID: \"119d76db-2644-435e-9f03-8ebf7db62b7a\") " pod="openshift-monitoring/telemeter-client-684f677f45-qbn44" Sep 09 23:09:50.594670 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.594619 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/119d76db-2644-435e-9f03-8ebf7db62b7a-federate-client-tls\") pod \"telemeter-client-684f677f45-qbn44\" (UID: \"119d76db-2644-435e-9f03-8ebf7db62b7a\") " pod="openshift-monitoring/telemeter-client-684f677f45-qbn44" Sep 09 23:09:50.594803 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.594784 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/119d76db-2644-435e-9f03-8ebf7db62b7a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-684f677f45-qbn44\" (UID: \"119d76db-2644-435e-9f03-8ebf7db62b7a\") " pod="openshift-monitoring/telemeter-client-684f677f45-qbn44" Sep 09 23:09:50.595103 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.595086 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/119d76db-2644-435e-9f03-8ebf7db62b7a-secret-telemeter-client\") pod \"telemeter-client-684f677f45-qbn44\" (UID: \"119d76db-2644-435e-9f03-8ebf7db62b7a\") " pod="openshift-monitoring/telemeter-client-684f677f45-qbn44" Sep 09 23:09:50.599004 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.598987 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5lqp\" (UniqueName: \"kubernetes.io/projected/119d76db-2644-435e-9f03-8ebf7db62b7a-kube-api-access-z5lqp\") pod \"telemeter-client-684f677f45-qbn44\" (UID: \"119d76db-2644-435e-9f03-8ebf7db62b7a\") " pod="openshift-monitoring/telemeter-client-684f677f45-qbn44" Sep 09 23:09:50.676193 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.676168 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-684f677f45-qbn44" Sep 09 23:09:50.693597 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.693575 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs\") pod \"network-metrics-daemon-kgfhj\" (UID: \"d1e3264c-002a-4855-bb40-0c63971351d9\") " pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:09:50.695718 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.695697 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d1e3264c-002a-4855-bb40-0c63971351d9-metrics-certs\") pod \"network-metrics-daemon-kgfhj\" (UID: \"d1e3264c-002a-4855-bb40-0c63971351d9\") " pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:09:50.739325 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.739301 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-64srt\"" Sep 09 23:09:50.748190 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.748170 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgfhj" Sep 09 23:09:50.947862 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.947823 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-684f677f45-qbn44"] Sep 09 23:09:50.950064 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:09:50.950038 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod119d76db_2644_435e_9f03_8ebf7db62b7a.slice/crio-f0c1610fd8c44661dacaac10bf7ee2451a527607733bd7245fcb34f601334ea4 WatchSource:0}: Error finding container f0c1610fd8c44661dacaac10bf7ee2451a527607733bd7245fcb34f601334ea4: Status 404 returned error can't find the container with id f0c1610fd8c44661dacaac10bf7ee2451a527607733bd7245fcb34f601334ea4 Sep 09 23:09:50.951992 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:50.951976 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:09:51.014168 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:51.014140 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kgfhj"] Sep 09 23:09:51.016804 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:09:51.016783 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1e3264c_002a_4855_bb40_0c63971351d9.slice/crio-d5d6a708a57c58d056add3195b7517b36bdd5eceeb85fa844d3b067d4c921656 WatchSource:0}: Error finding container d5d6a708a57c58d056add3195b7517b36bdd5eceeb85fa844d3b067d4c921656: Status 404 returned error can't find the container with id d5d6a708a57c58d056add3195b7517b36bdd5eceeb85fa844d3b067d4c921656 Sep 09 23:09:51.084610 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:51.084574 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kgfhj" event={"ID":"d1e3264c-002a-4855-bb40-0c63971351d9","Type":"ContainerStarted","Data":"d5d6a708a57c58d056add3195b7517b36bdd5eceeb85fa844d3b067d4c921656"} Sep 09 23:09:51.085752 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:51.085723 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-684f677f45-qbn44" event={"ID":"119d76db-2644-435e-9f03-8ebf7db62b7a","Type":"ContainerStarted","Data":"f0c1610fd8c44661dacaac10bf7ee2451a527607733bd7245fcb34f601334ea4"} Sep 09 23:09:53.097132 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:53.097101 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kgfhj" event={"ID":"d1e3264c-002a-4855-bb40-0c63971351d9","Type":"ContainerStarted","Data":"c7f3b5d3e233bafabe25bc5a8ad34b3b3c127af6b32ea0ec2596f4fd5fb22c81"} Sep 09 23:09:53.097485 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:53.097163 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kgfhj" event={"ID":"d1e3264c-002a-4855-bb40-0c63971351d9","Type":"ContainerStarted","Data":"57a5d3938bc70a3f27a342062530e0cda16e3d0470c5e77e9b6df1f64871bd90"} Sep 09 23:09:53.099278 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:53.099254 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-684f677f45-qbn44" event={"ID":"119d76db-2644-435e-9f03-8ebf7db62b7a","Type":"ContainerStarted","Data":"db73d430bf598e7d63dfd74a7ba99b88fcc588df9fe387560616d7856324df61"} Sep 09 23:09:53.099374 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:53.099305 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-684f677f45-qbn44" event={"ID":"119d76db-2644-435e-9f03-8ebf7db62b7a","Type":"ContainerStarted","Data":"3916566670b3ef3c7187d71d9f1e240ce706af1d1335b171585cf7028ff3ff00"} Sep 09 23:09:53.099374 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:53.099338 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-684f677f45-qbn44" event={"ID":"119d76db-2644-435e-9f03-8ebf7db62b7a","Type":"ContainerStarted","Data":"64be8cb8146a9a7f462262bbc981a07b741ef97b310d7d30aa6483005ce34e23"} Sep 09 23:09:53.111732 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:53.111692 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kgfhj" podStartSLOduration=375.045900749 podStartE2EDuration="6m16.111680186s" totalImagesPullingTime="1.065779437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:03:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:53.111507315 +0000 UTC m=+376.769162960" watchObservedRunningTime="2026-09-09 23:09:53.111680186 +0000 UTC m=+376.769335830" Sep 09 23:09:53.130102 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:09:53.130036 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-684f677f45-qbn44" podStartSLOduration=1.204255568 podStartE2EDuration="3.130025375s" totalImagesPullingTime="1.925769807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:09:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:53.128342386 +0000 UTC m=+376.785998030" watchObservedRunningTime="2026-09-09 23:09:53.130025375 +0000 UTC m=+376.787681020" Sep 09 23:12:35.728434 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:35.728360 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ng8q6"] Sep 09 23:12:35.731343 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:35.731327 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ng8q6" Sep 09 23:12:35.733932 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:35.733909 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 09 23:12:35.734698 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:35.734680 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-sdbqt\"" Sep 09 23:12:35.734742 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:35.734694 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 09 23:12:35.738578 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:35.738557 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ng8q6"] Sep 09 23:12:35.823883 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:35.823851 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk7q7\" (UniqueName: \"kubernetes.io/projected/951995b8-3f87-46f8-b4b7-6a42df2ffd16-kube-api-access-dk7q7\") pod \"cert-manager-cainjector-559cdd8c87-ng8q6\" (UID: \"951995b8-3f87-46f8-b4b7-6a42df2ffd16\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ng8q6" Sep 09 23:12:35.824004 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:35.823888 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/951995b8-3f87-46f8-b4b7-6a42df2ffd16-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ng8q6\" (UID: \"951995b8-3f87-46f8-b4b7-6a42df2ffd16\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ng8q6" Sep 09 23:12:35.924798 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:35.924769 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk7q7\" (UniqueName: \"kubernetes.io/projected/951995b8-3f87-46f8-b4b7-6a42df2ffd16-kube-api-access-dk7q7\") pod \"cert-manager-cainjector-559cdd8c87-ng8q6\" (UID: \"951995b8-3f87-46f8-b4b7-6a42df2ffd16\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ng8q6" Sep 09 23:12:35.924798 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:35.924801 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/951995b8-3f87-46f8-b4b7-6a42df2ffd16-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ng8q6\" (UID: \"951995b8-3f87-46f8-b4b7-6a42df2ffd16\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ng8q6" Sep 09 23:12:35.933744 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:35.933713 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk7q7\" (UniqueName: \"kubernetes.io/projected/951995b8-3f87-46f8-b4b7-6a42df2ffd16-kube-api-access-dk7q7\") pod \"cert-manager-cainjector-559cdd8c87-ng8q6\" (UID: \"951995b8-3f87-46f8-b4b7-6a42df2ffd16\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ng8q6" Sep 09 23:12:35.933744 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:35.933721 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/951995b8-3f87-46f8-b4b7-6a42df2ffd16-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ng8q6\" (UID: \"951995b8-3f87-46f8-b4b7-6a42df2ffd16\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ng8q6" Sep 09 23:12:36.041347 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:36.041291 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ng8q6" Sep 09 23:12:36.308049 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:36.307974 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ng8q6"] Sep 09 23:12:36.311057 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:12:36.311032 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod951995b8_3f87_46f8_b4b7_6a42df2ffd16.slice/crio-2d368e2a6dbc6916b4e349ba8beafde01e73fee6138dadd69de0c0fb1baa616b WatchSource:0}: Error finding container 2d368e2a6dbc6916b4e349ba8beafde01e73fee6138dadd69de0c0fb1baa616b: Status 404 returned error can't find the container with id 2d368e2a6dbc6916b4e349ba8beafde01e73fee6138dadd69de0c0fb1baa616b Sep 09 23:12:36.655131 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:36.655100 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ng8q6" event={"ID":"951995b8-3f87-46f8-b4b7-6a42df2ffd16","Type":"ContainerStarted","Data":"2d368e2a6dbc6916b4e349ba8beafde01e73fee6138dadd69de0c0fb1baa616b"} Sep 09 23:12:39.669281 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:39.669242 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ng8q6" event={"ID":"951995b8-3f87-46f8-b4b7-6a42df2ffd16","Type":"ContainerStarted","Data":"016e448dab8f45c350bb94b537ab6a333655ce248ee9f60478971318e9c9c65b"} Sep 09 23:12:39.683918 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:39.683865 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ng8q6" podStartSLOduration=1.738889351 podStartE2EDuration="4.683850326s" totalImagesPullingTime="2.944960975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:12:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:12:39.682730484 +0000 UTC m=+543.340386128" watchObservedRunningTime="2026-09-09 23:12:39.683850326 +0000 UTC m=+543.341505967" Sep 09 23:12:47.341395 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:47.341362 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v2jll"] Sep 09 23:12:47.344681 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:47.344666 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v2jll" Sep 09 23:12:47.346933 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:47.346906 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-t67k4\"" Sep 09 23:12:47.347053 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:47.347033 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:12:47.347916 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:47.347901 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 09 23:12:47.352257 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:47.352233 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v2jll"] Sep 09 23:12:47.410301 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:47.410275 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16fe679d-67ba-4fed-af2a-2e7a51eb6ff3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-v2jll\" (UID: \"16fe679d-67ba-4fed-af2a-2e7a51eb6ff3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v2jll" Sep 09 23:12:47.410447 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:47.410331 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5pd8\" (UniqueName: \"kubernetes.io/projected/16fe679d-67ba-4fed-af2a-2e7a51eb6ff3-kube-api-access-s5pd8\") pod \"openshift-lws-operator-fd8ccff4c-v2jll\" (UID: \"16fe679d-67ba-4fed-af2a-2e7a51eb6ff3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v2jll" Sep 09 23:12:47.511378 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:47.511346 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16fe679d-67ba-4fed-af2a-2e7a51eb6ff3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-v2jll\" (UID: \"16fe679d-67ba-4fed-af2a-2e7a51eb6ff3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v2jll" Sep 09 23:12:47.511539 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:47.511413 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5pd8\" (UniqueName: \"kubernetes.io/projected/16fe679d-67ba-4fed-af2a-2e7a51eb6ff3-kube-api-access-s5pd8\") pod \"openshift-lws-operator-fd8ccff4c-v2jll\" (UID: \"16fe679d-67ba-4fed-af2a-2e7a51eb6ff3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v2jll" Sep 09 23:12:47.511690 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:47.511671 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16fe679d-67ba-4fed-af2a-2e7a51eb6ff3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-v2jll\" (UID: \"16fe679d-67ba-4fed-af2a-2e7a51eb6ff3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v2jll" Sep 09 23:12:47.522638 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:47.522614 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5pd8\" (UniqueName: \"kubernetes.io/projected/16fe679d-67ba-4fed-af2a-2e7a51eb6ff3-kube-api-access-s5pd8\") pod \"openshift-lws-operator-fd8ccff4c-v2jll\" (UID: \"16fe679d-67ba-4fed-af2a-2e7a51eb6ff3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v2jll" Sep 09 23:12:47.653910 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:47.653877 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v2jll" Sep 09 23:12:47.921957 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:47.921883 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v2jll"] Sep 09 23:12:47.925036 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:12:47.925010 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod16fe679d_67ba_4fed_af2a_2e7a51eb6ff3.slice/crio-24ef0302956161cf488e25f45a7b0ce6f1d6d5cb532d744f140903ec014e64ca WatchSource:0}: Error finding container 24ef0302956161cf488e25f45a7b0ce6f1d6d5cb532d744f140903ec014e64ca: Status 404 returned error can't find the container with id 24ef0302956161cf488e25f45a7b0ce6f1d6d5cb532d744f140903ec014e64ca Sep 09 23:12:48.701759 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:48.701721 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v2jll" event={"ID":"16fe679d-67ba-4fed-af2a-2e7a51eb6ff3","Type":"ContainerStarted","Data":"24ef0302956161cf488e25f45a7b0ce6f1d6d5cb532d744f140903ec014e64ca"} Sep 09 23:12:50.712589 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:50.712548 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v2jll" event={"ID":"16fe679d-67ba-4fed-af2a-2e7a51eb6ff3","Type":"ContainerStarted","Data":"6de2f8fb1d3c6a39b61a4ca14eab64c3cf6a7e9f3d0edeb19787e55c34d4c7f0"} Sep 09 23:12:50.726882 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:12:50.726815 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v2jll" podStartSLOduration=1.03542132 podStartE2EDuration="3.726798898s" totalImagesPullingTime="2.691377578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:12:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:12:50.725951532 +0000 UTC m=+554.383607175" watchObservedRunningTime="2026-09-09 23:12:50.726798898 +0000 UTC m=+554.384454542" Sep 09 23:13:05.670168 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:05.670136 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76cbb89f58-qj7xp"] Sep 09 23:13:05.673043 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:05.673027 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-qj7xp" Sep 09 23:13:05.676108 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:05.676087 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 09 23:13:05.676345 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:05.676326 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 09 23:13:05.676426 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:05.676375 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 09 23:13:05.682006 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:05.681984 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jprld\"" Sep 09 23:13:05.682112 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:05.682039 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 09 23:13:05.705753 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:05.705726 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76cbb89f58-qj7xp"] Sep 09 23:13:05.755130 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:05.755101 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2e7e9710-b655-4cbf-92ed-fb537580361c-manifests\") pod \"opendatahub-operator-controller-manager-76cbb89f58-qj7xp\" (UID: \"2e7e9710-b655-4cbf-92ed-fb537580361c\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-qj7xp" Sep 09 23:13:05.755263 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:05.755139 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e7e9710-b655-4cbf-92ed-fb537580361c-webhook-cert\") pod \"opendatahub-operator-controller-manager-76cbb89f58-qj7xp\" (UID: \"2e7e9710-b655-4cbf-92ed-fb537580361c\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-qj7xp" Sep 09 23:13:05.755263 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:05.755217 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvgc8\" (UniqueName: \"kubernetes.io/projected/2e7e9710-b655-4cbf-92ed-fb537580361c-kube-api-access-tvgc8\") pod \"opendatahub-operator-controller-manager-76cbb89f58-qj7xp\" (UID: \"2e7e9710-b655-4cbf-92ed-fb537580361c\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-qj7xp" Sep 09 23:13:05.755263 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:05.755250 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e7e9710-b655-4cbf-92ed-fb537580361c-tmp\") pod \"opendatahub-operator-controller-manager-76cbb89f58-qj7xp\" (UID: \"2e7e9710-b655-4cbf-92ed-fb537580361c\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-qj7xp" Sep 09 23:13:05.755372 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:05.755306 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2e7e9710-b655-4cbf-92ed-fb537580361c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76cbb89f58-qj7xp\" (UID: \"2e7e9710-b655-4cbf-92ed-fb537580361c\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-qj7xp" Sep 09 23:13:05.855983 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:05.855949 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2e7e9710-b655-4cbf-92ed-fb537580361c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76cbb89f58-qj7xp\" (UID: \"2e7e9710-b655-4cbf-92ed-fb537580361c\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-qj7xp" Sep 09 23:13:05.856137 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:05.855989 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2e7e9710-b655-4cbf-92ed-fb537580361c-manifests\") pod \"opendatahub-operator-controller-manager-76cbb89f58-qj7xp\" (UID: \"2e7e9710-b655-4cbf-92ed-fb537580361c\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-qj7xp" Sep 09 23:13:05.856137 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:05.856013 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e7e9710-b655-4cbf-92ed-fb537580361c-webhook-cert\") pod \"opendatahub-operator-controller-manager-76cbb89f58-qj7xp\" (UID: \"2e7e9710-b655-4cbf-92ed-fb537580361c\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-qj7xp" Sep 09 23:13:05.856137 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:05.856055 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvgc8\" (UniqueName: \"kubernetes.io/projected/2e7e9710-b655-4cbf-92ed-fb537580361c-kube-api-access-tvgc8\") pod \"opendatahub-operator-controller-manager-76cbb89f58-qj7xp\" (UID: \"2e7e9710-b655-4cbf-92ed-fb537580361c\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-qj7xp" Sep 09 23:13:05.856137 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:05.856078 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e7e9710-b655-4cbf-92ed-fb537580361c-tmp\") pod \"opendatahub-operator-controller-manager-76cbb89f58-qj7xp\" (UID: \"2e7e9710-b655-4cbf-92ed-fb537580361c\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-qj7xp" Sep 09 23:13:05.856425 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:05.856402 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2e7e9710-b655-4cbf-92ed-fb537580361c-manifests\") pod \"opendatahub-operator-controller-manager-76cbb89f58-qj7xp\" (UID: \"2e7e9710-b655-4cbf-92ed-fb537580361c\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-qj7xp" Sep 09 23:13:05.858375 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:05.858351 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e7e9710-b655-4cbf-92ed-fb537580361c-tmp\") pod \"opendatahub-operator-controller-manager-76cbb89f58-qj7xp\" (UID: \"2e7e9710-b655-4cbf-92ed-fb537580361c\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-qj7xp" Sep 09 23:13:05.858506 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:05.858480 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e7e9710-b655-4cbf-92ed-fb537580361c-webhook-cert\") pod \"opendatahub-operator-controller-manager-76cbb89f58-qj7xp\" (UID: \"2e7e9710-b655-4cbf-92ed-fb537580361c\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-qj7xp" Sep 09 23:13:05.858681 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:05.858661 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2e7e9710-b655-4cbf-92ed-fb537580361c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76cbb89f58-qj7xp\" (UID: \"2e7e9710-b655-4cbf-92ed-fb537580361c\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-qj7xp" Sep 09 23:13:05.863701 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:05.863679 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvgc8\" (UniqueName: \"kubernetes.io/projected/2e7e9710-b655-4cbf-92ed-fb537580361c-kube-api-access-tvgc8\") pod \"opendatahub-operator-controller-manager-76cbb89f58-qj7xp\" (UID: \"2e7e9710-b655-4cbf-92ed-fb537580361c\") " pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-qj7xp" Sep 09 23:13:05.987844 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:05.987758 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-qj7xp" Sep 09 23:13:06.261724 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:06.261678 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76cbb89f58-qj7xp"] Sep 09 23:13:06.264640 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:13:06.264612 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e7e9710_b655_4cbf_92ed_fb537580361c.slice/crio-1e54b14e54060df1be2b57e513e7e026fe3ddd6300de236ce9ef19111b7eae8c WatchSource:0}: Error finding container 1e54b14e54060df1be2b57e513e7e026fe3ddd6300de236ce9ef19111b7eae8c: Status 404 returned error can't find the container with id 1e54b14e54060df1be2b57e513e7e026fe3ddd6300de236ce9ef19111b7eae8c Sep 09 23:13:06.772771 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:06.772740 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-qj7xp" event={"ID":"2e7e9710-b655-4cbf-92ed-fb537580361c","Type":"ContainerStarted","Data":"1e54b14e54060df1be2b57e513e7e026fe3ddd6300de236ce9ef19111b7eae8c"} Sep 09 23:13:09.786588 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:09.786511 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-qj7xp" event={"ID":"2e7e9710-b655-4cbf-92ed-fb537580361c","Type":"ContainerStarted","Data":"0d84ab1af8eb5971638d3d77b024a56dcaaaea17e31b1f1a31072964e0edc6f3"} Sep 09 23:13:10.791241 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:10.791199 2575 generic.go:356] "Generic (PLEG): container finished" podID="2e7e9710-b655-4cbf-92ed-fb537580361c" containerID="0d84ab1af8eb5971638d3d77b024a56dcaaaea17e31b1f1a31072964e0edc6f3" exitCode=0 Sep 09 23:13:10.791618 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:10.791279 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-qj7xp" event={"ID":"2e7e9710-b655-4cbf-92ed-fb537580361c","Type":"ContainerDied","Data":"0d84ab1af8eb5971638d3d77b024a56dcaaaea17e31b1f1a31072964e0edc6f3"} Sep 09 23:13:11.796968 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:11.796929 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-qj7xp" event={"ID":"2e7e9710-b655-4cbf-92ed-fb537580361c","Type":"ContainerStarted","Data":"3067fb42b1d6df0ad778773727cdeecb9f1456ab3a179032b9b625c6e448198e"} Sep 09 23:13:11.797351 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:11.797041 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-qj7xp" Sep 09 23:13:11.817103 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:11.817054 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-qj7xp" podStartSLOduration=2.16419585 podStartE2EDuration="6.817039644s" totalImagesPullingTime="3.60898013s" totalInitContainerRuntime="1.043863664s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:13:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:11.815560854 +0000 UTC m=+575.473216497" watchObservedRunningTime="2026-09-09 23:13:11.817039644 +0000 UTC m=+575.474695288" Sep 09 23:13:22.804044 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:22.804014 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-76cbb89f58-qj7xp" Sep 09 23:13:25.171603 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:25.171568 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-55cf6889dc-pvrff"] Sep 09 23:13:25.180234 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:25.180213 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55cf6889dc-pvrff" Sep 09 23:13:25.182964 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:25.182944 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 09 23:13:25.183453 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:25.183429 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 09 23:13:25.183453 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:25.183442 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-cprw4\"" Sep 09 23:13:25.183611 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:25.183453 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 09 23:13:25.183611 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:25.183454 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 09 23:13:25.185817 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:25.185798 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55cf6889dc-pvrff"] Sep 09 23:13:25.200543 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:25.200524 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59371077-489c-4b85-b97e-0c8b1bc841f6-tmp\") pod \"kube-auth-proxy-55cf6889dc-pvrff\" (UID: \"59371077-489c-4b85-b97e-0c8b1bc841f6\") " pod="openshift-ingress/kube-auth-proxy-55cf6889dc-pvrff" Sep 09 23:13:25.200697 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:25.200551 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wdqq\" (UniqueName: \"kubernetes.io/projected/59371077-489c-4b85-b97e-0c8b1bc841f6-kube-api-access-2wdqq\") pod \"kube-auth-proxy-55cf6889dc-pvrff\" (UID: \"59371077-489c-4b85-b97e-0c8b1bc841f6\") " pod="openshift-ingress/kube-auth-proxy-55cf6889dc-pvrff" Sep 09 23:13:25.200697 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:25.200572 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59371077-489c-4b85-b97e-0c8b1bc841f6-tls-certs\") pod \"kube-auth-proxy-55cf6889dc-pvrff\" (UID: \"59371077-489c-4b85-b97e-0c8b1bc841f6\") " pod="openshift-ingress/kube-auth-proxy-55cf6889dc-pvrff" Sep 09 23:13:25.301487 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:25.301455 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59371077-489c-4b85-b97e-0c8b1bc841f6-tmp\") pod \"kube-auth-proxy-55cf6889dc-pvrff\" (UID: \"59371077-489c-4b85-b97e-0c8b1bc841f6\") " pod="openshift-ingress/kube-auth-proxy-55cf6889dc-pvrff" Sep 09 23:13:25.301487 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:25.301491 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wdqq\" (UniqueName: \"kubernetes.io/projected/59371077-489c-4b85-b97e-0c8b1bc841f6-kube-api-access-2wdqq\") pod \"kube-auth-proxy-55cf6889dc-pvrff\" (UID: \"59371077-489c-4b85-b97e-0c8b1bc841f6\") " pod="openshift-ingress/kube-auth-proxy-55cf6889dc-pvrff" Sep 09 23:13:25.301706 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:25.301517 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59371077-489c-4b85-b97e-0c8b1bc841f6-tls-certs\") pod \"kube-auth-proxy-55cf6889dc-pvrff\" (UID: \"59371077-489c-4b85-b97e-0c8b1bc841f6\") " pod="openshift-ingress/kube-auth-proxy-55cf6889dc-pvrff" Sep 09 23:13:25.303848 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:25.303810 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59371077-489c-4b85-b97e-0c8b1bc841f6-tmp\") pod \"kube-auth-proxy-55cf6889dc-pvrff\" (UID: \"59371077-489c-4b85-b97e-0c8b1bc841f6\") " pod="openshift-ingress/kube-auth-proxy-55cf6889dc-pvrff" Sep 09 23:13:25.304087 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:25.304069 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59371077-489c-4b85-b97e-0c8b1bc841f6-tls-certs\") pod \"kube-auth-proxy-55cf6889dc-pvrff\" (UID: \"59371077-489c-4b85-b97e-0c8b1bc841f6\") " pod="openshift-ingress/kube-auth-proxy-55cf6889dc-pvrff" Sep 09 23:13:25.309199 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:25.309177 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wdqq\" (UniqueName: \"kubernetes.io/projected/59371077-489c-4b85-b97e-0c8b1bc841f6-kube-api-access-2wdqq\") pod \"kube-auth-proxy-55cf6889dc-pvrff\" (UID: \"59371077-489c-4b85-b97e-0c8b1bc841f6\") " pod="openshift-ingress/kube-auth-proxy-55cf6889dc-pvrff" Sep 09 23:13:25.491506 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:25.491425 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55cf6889dc-pvrff" Sep 09 23:13:25.760112 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:25.760033 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55cf6889dc-pvrff"] Sep 09 23:13:25.762937 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:13:25.762908 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59371077_489c_4b85_b97e_0c8b1bc841f6.slice/crio-15f582c0b74eac39ca3d5b7ba372214db550d2961f1d9f9eb48d1e89fbd5e49c WatchSource:0}: Error finding container 15f582c0b74eac39ca3d5b7ba372214db550d2961f1d9f9eb48d1e89fbd5e49c: Status 404 returned error can't find the container with id 15f582c0b74eac39ca3d5b7ba372214db550d2961f1d9f9eb48d1e89fbd5e49c Sep 09 23:13:25.850514 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:25.850476 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55cf6889dc-pvrff" event={"ID":"59371077-489c-4b85-b97e-0c8b1bc841f6","Type":"ContainerStarted","Data":"15f582c0b74eac39ca3d5b7ba372214db550d2961f1d9f9eb48d1e89fbd5e49c"} Sep 09 23:13:26.351488 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:26.351456 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5"] Sep 09 23:13:26.355837 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:26.355812 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" Sep 09 23:13:26.360057 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:26.360036 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 09 23:13:26.360322 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:26.360307 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 09 23:13:26.360387 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:26.360308 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 09 23:13:26.360444 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:26.360312 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 09 23:13:26.360444 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:26.360331 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-c2phr\"" Sep 09 23:13:26.397330 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:26.397301 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5"] Sep 09 23:13:26.410142 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:26.410113 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/36418912-a713-48f1-b85e-0c01ac012d55-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-w6th5\" (UID: \"36418912-a713-48f1-b85e-0c01ac012d55\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" Sep 09 23:13:26.410323 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:26.410170 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/36418912-a713-48f1-b85e-0c01ac012d55-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-w6th5\" (UID: \"36418912-a713-48f1-b85e-0c01ac012d55\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" Sep 09 23:13:26.410323 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:26.410236 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/36418912-a713-48f1-b85e-0c01ac012d55-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-w6th5\" (UID: \"36418912-a713-48f1-b85e-0c01ac012d55\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" Sep 09 23:13:26.410323 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:26.410312 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/36418912-a713-48f1-b85e-0c01ac012d55-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-w6th5\" (UID: \"36418912-a713-48f1-b85e-0c01ac012d55\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" Sep 09 23:13:26.410515 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:26.410404 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/36418912-a713-48f1-b85e-0c01ac012d55-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-w6th5\" (UID: \"36418912-a713-48f1-b85e-0c01ac012d55\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" Sep 09 23:13:26.410515 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:26.410462 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36418912-a713-48f1-b85e-0c01ac012d55-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-w6th5\" (UID: \"36418912-a713-48f1-b85e-0c01ac012d55\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" Sep 09 23:13:26.410515 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:26.410486 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqmdv\" (UniqueName: \"kubernetes.io/projected/36418912-a713-48f1-b85e-0c01ac012d55-kube-api-access-dqmdv\") pod \"istiod-openshift-gateway-7b7995d5cd-w6th5\" (UID: \"36418912-a713-48f1-b85e-0c01ac012d55\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" Sep 09 23:13:26.511430 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:26.511392 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/36418912-a713-48f1-b85e-0c01ac012d55-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-w6th5\" (UID: \"36418912-a713-48f1-b85e-0c01ac012d55\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" Sep 09 23:13:26.511617 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:26.511456 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36418912-a713-48f1-b85e-0c01ac012d55-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-w6th5\" (UID: \"36418912-a713-48f1-b85e-0c01ac012d55\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" Sep 09 23:13:26.511617 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:26.511479 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqmdv\" (UniqueName: \"kubernetes.io/projected/36418912-a713-48f1-b85e-0c01ac012d55-kube-api-access-dqmdv\") pod \"istiod-openshift-gateway-7b7995d5cd-w6th5\" (UID: \"36418912-a713-48f1-b85e-0c01ac012d55\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" Sep 09 23:13:26.511617 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:26.511525 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/36418912-a713-48f1-b85e-0c01ac012d55-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-w6th5\" (UID: \"36418912-a713-48f1-b85e-0c01ac012d55\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" Sep 09 23:13:26.511617 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:26.511574 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/36418912-a713-48f1-b85e-0c01ac012d55-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-w6th5\" (UID: \"36418912-a713-48f1-b85e-0c01ac012d55\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" Sep 09 23:13:26.511617 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:26.511599 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/36418912-a713-48f1-b85e-0c01ac012d55-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-w6th5\" (UID: \"36418912-a713-48f1-b85e-0c01ac012d55\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" Sep 09 23:13:26.511908 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:26.511621 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/36418912-a713-48f1-b85e-0c01ac012d55-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-w6th5\" (UID: \"36418912-a713-48f1-b85e-0c01ac012d55\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" Sep 09 23:13:26.512265 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:26.512240 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/36418912-a713-48f1-b85e-0c01ac012d55-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-w6th5\" (UID: \"36418912-a713-48f1-b85e-0c01ac012d55\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" Sep 09 23:13:26.514439 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:26.514411 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/36418912-a713-48f1-b85e-0c01ac012d55-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-w6th5\" (UID: \"36418912-a713-48f1-b85e-0c01ac012d55\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" Sep 09 23:13:26.514962 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:26.514922 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/36418912-a713-48f1-b85e-0c01ac012d55-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-w6th5\" (UID: \"36418912-a713-48f1-b85e-0c01ac012d55\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" Sep 09 23:13:26.515763 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:26.515724 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/36418912-a713-48f1-b85e-0c01ac012d55-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-w6th5\" (UID: \"36418912-a713-48f1-b85e-0c01ac012d55\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" Sep 09 23:13:26.516074 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:26.516052 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/36418912-a713-48f1-b85e-0c01ac012d55-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-w6th5\" (UID: \"36418912-a713-48f1-b85e-0c01ac012d55\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" Sep 09 23:13:26.519983 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:26.519939 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqmdv\" (UniqueName: \"kubernetes.io/projected/36418912-a713-48f1-b85e-0c01ac012d55-kube-api-access-dqmdv\") pod \"istiod-openshift-gateway-7b7995d5cd-w6th5\" (UID: \"36418912-a713-48f1-b85e-0c01ac012d55\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" Sep 09 23:13:26.520366 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:26.520343 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36418912-a713-48f1-b85e-0c01ac012d55-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-w6th5\" (UID: \"36418912-a713-48f1-b85e-0c01ac012d55\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" Sep 09 23:13:26.664914 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:26.664878 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" Sep 09 23:13:26.954134 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:26.954051 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5"] Sep 09 23:13:26.957510 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:13:26.957480 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36418912_a713_48f1_b85e_0c01ac012d55.slice/crio-787f8fa23708fa55845dda43df17866c0431b62f2f90b0685db7e8814bb9f9de WatchSource:0}: Error finding container 787f8fa23708fa55845dda43df17866c0431b62f2f90b0685db7e8814bb9f9de: Status 404 returned error can't find the container with id 787f8fa23708fa55845dda43df17866c0431b62f2f90b0685db7e8814bb9f9de Sep 09 23:13:27.861557 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:27.861520 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" event={"ID":"36418912-a713-48f1-b85e-0c01ac012d55","Type":"ContainerStarted","Data":"787f8fa23708fa55845dda43df17866c0431b62f2f90b0685db7e8814bb9f9de"} Sep 09 23:13:28.868192 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:28.868154 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55cf6889dc-pvrff" event={"ID":"59371077-489c-4b85-b97e-0c8b1bc841f6","Type":"ContainerStarted","Data":"5774904b0ece6818dfecfa1122cf38c1c84a4809e4d165e7e9663a08a88ea233"} Sep 09 23:13:28.886041 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:28.885944 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-55cf6889dc-pvrff" podStartSLOduration=1.019539507 podStartE2EDuration="3.885918806s" totalImagesPullingTime="2.866379299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:13:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:28.88570044 +0000 UTC m=+592.543356085" watchObservedRunningTime="2026-09-09 23:13:28.885918806 +0000 UTC m=+592.543574450" Sep 09 23:13:30.406969 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:30.406914 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 09 23:13:30.407243 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:30.407003 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 09 23:13:30.878572 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:30.878539 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" event={"ID":"36418912-a713-48f1-b85e-0c01ac012d55","Type":"ContainerStarted","Data":"f97ae005baff862e25879be665646307122bb9d8c9f91012321471036f5cfa48"} Sep 09 23:13:30.878746 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:30.878700 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" Sep 09 23:13:30.907466 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:30.907406 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" podStartSLOduration=1.460509526 podStartE2EDuration="4.907385667s" totalImagesPullingTime="3.446876141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:13:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:30.906236042 +0000 UTC m=+594.563891687" watchObservedRunningTime="2026-09-09 23:13:30.907385667 +0000 UTC m=+594.565041312" Sep 09 23:13:31.884565 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:31.884537 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" Sep 09 23:13:36.758491 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:36.758461 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6gsr_01cc3a72-4b5d-4af7-9db4-219af2288772/ovn-acl-logging/0.log" Sep 09 23:13:36.759192 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:36.759172 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6gsr_01cc3a72-4b5d-4af7-9db4-219af2288772/ovn-acl-logging/0.log" Sep 09 23:13:42.386676 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:42.386644 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzv9l"] Sep 09 23:13:42.392788 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:42.392771 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzv9l" Sep 09 23:13:42.401126 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:42.401098 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzv9l"] Sep 09 23:13:42.443456 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:42.443425 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f396d0c5-8a49-4317-a69c-dea326896137-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-tzv9l\" (UID: \"f396d0c5-8a49-4317-a69c-dea326896137\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzv9l" Sep 09 23:13:42.443580 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:42.443462 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57gkp\" (UniqueName: \"kubernetes.io/projected/f396d0c5-8a49-4317-a69c-dea326896137-kube-api-access-57gkp\") pod \"istiod-openshift-gateway-5677ccb49b-tzv9l\" (UID: \"f396d0c5-8a49-4317-a69c-dea326896137\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzv9l" Sep 09 23:13:42.443580 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:42.443569 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f396d0c5-8a49-4317-a69c-dea326896137-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-tzv9l\" (UID: \"f396d0c5-8a49-4317-a69c-dea326896137\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzv9l" Sep 09 23:13:42.443692 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:42.443600 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f396d0c5-8a49-4317-a69c-dea326896137-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-tzv9l\" (UID: \"f396d0c5-8a49-4317-a69c-dea326896137\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzv9l" Sep 09 23:13:42.443692 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:42.443627 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f396d0c5-8a49-4317-a69c-dea326896137-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-tzv9l\" (UID: \"f396d0c5-8a49-4317-a69c-dea326896137\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzv9l" Sep 09 23:13:42.443692 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:42.443651 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f396d0c5-8a49-4317-a69c-dea326896137-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-tzv9l\" (UID: \"f396d0c5-8a49-4317-a69c-dea326896137\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzv9l" Sep 09 23:13:42.443817 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:42.443692 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f396d0c5-8a49-4317-a69c-dea326896137-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-tzv9l\" (UID: \"f396d0c5-8a49-4317-a69c-dea326896137\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzv9l" Sep 09 23:13:42.544706 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:42.544671 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f396d0c5-8a49-4317-a69c-dea326896137-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-tzv9l\" (UID: \"f396d0c5-8a49-4317-a69c-dea326896137\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzv9l" Sep 09 23:13:42.544706 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:42.544708 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f396d0c5-8a49-4317-a69c-dea326896137-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-tzv9l\" (UID: \"f396d0c5-8a49-4317-a69c-dea326896137\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzv9l" Sep 09 23:13:42.544876 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:42.544725 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f396d0c5-8a49-4317-a69c-dea326896137-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-tzv9l\" (UID: \"f396d0c5-8a49-4317-a69c-dea326896137\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzv9l" Sep 09 23:13:42.544876 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:42.544753 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f396d0c5-8a49-4317-a69c-dea326896137-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-tzv9l\" (UID: \"f396d0c5-8a49-4317-a69c-dea326896137\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzv9l" Sep 09 23:13:42.544876 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:42.544789 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f396d0c5-8a49-4317-a69c-dea326896137-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-tzv9l\" (UID: \"f396d0c5-8a49-4317-a69c-dea326896137\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzv9l" Sep 09 23:13:42.544876 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:42.544814 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57gkp\" (UniqueName: \"kubernetes.io/projected/f396d0c5-8a49-4317-a69c-dea326896137-kube-api-access-57gkp\") pod \"istiod-openshift-gateway-5677ccb49b-tzv9l\" (UID: \"f396d0c5-8a49-4317-a69c-dea326896137\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzv9l" Sep 09 23:13:42.545022 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:42.544905 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f396d0c5-8a49-4317-a69c-dea326896137-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-tzv9l\" (UID: \"f396d0c5-8a49-4317-a69c-dea326896137\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzv9l" Sep 09 23:13:42.545557 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:42.545528 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f396d0c5-8a49-4317-a69c-dea326896137-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-tzv9l\" (UID: \"f396d0c5-8a49-4317-a69c-dea326896137\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzv9l" Sep 09 23:13:42.546980 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:42.546953 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f396d0c5-8a49-4317-a69c-dea326896137-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-tzv9l\" (UID: \"f396d0c5-8a49-4317-a69c-dea326896137\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzv9l" Sep 09 23:13:42.547129 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:42.547109 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f396d0c5-8a49-4317-a69c-dea326896137-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-tzv9l\" (UID: \"f396d0c5-8a49-4317-a69c-dea326896137\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzv9l" Sep 09 23:13:42.547185 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:42.547141 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f396d0c5-8a49-4317-a69c-dea326896137-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-tzv9l\" (UID: \"f396d0c5-8a49-4317-a69c-dea326896137\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzv9l" Sep 09 23:13:42.547185 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:42.547176 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f396d0c5-8a49-4317-a69c-dea326896137-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-tzv9l\" (UID: \"f396d0c5-8a49-4317-a69c-dea326896137\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzv9l" Sep 09 23:13:42.553964 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:42.553941 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f396d0c5-8a49-4317-a69c-dea326896137-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-tzv9l\" (UID: \"f396d0c5-8a49-4317-a69c-dea326896137\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzv9l" Sep 09 23:13:42.556041 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:42.556021 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57gkp\" (UniqueName: \"kubernetes.io/projected/f396d0c5-8a49-4317-a69c-dea326896137-kube-api-access-57gkp\") pod \"istiod-openshift-gateway-5677ccb49b-tzv9l\" (UID: \"f396d0c5-8a49-4317-a69c-dea326896137\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzv9l" Sep 09 23:13:42.702631 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:42.702574 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzv9l" Sep 09 23:13:42.988693 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:42.988669 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzv9l"] Sep 09 23:13:42.991647 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:13:42.991620 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf396d0c5_8a49_4317_a69c_dea326896137.slice/crio-6dfc901711aa5991d4fe4a5bb6bd5aee98b08b1bc6cca96c0d3ed8cca5c58757 WatchSource:0}: Error finding container 6dfc901711aa5991d4fe4a5bb6bd5aee98b08b1bc6cca96c0d3ed8cca5c58757: Status 404 returned error can't find the container with id 6dfc901711aa5991d4fe4a5bb6bd5aee98b08b1bc6cca96c0d3ed8cca5c58757 Sep 09 23:13:42.993748 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:42.993715 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 09 23:13:42.993843 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:42.993773 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 09 23:13:43.933615 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:43.933580 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzv9l" event={"ID":"f396d0c5-8a49-4317-a69c-dea326896137","Type":"ContainerStarted","Data":"a4d97f7ce400afab42d8043fbb929decff1ce7c0ee2a65026e366fd8bbaa88ab"} Sep 09 23:13:43.934004 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:43.933706 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzv9l" Sep 09 23:13:43.934004 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:43.933743 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzv9l" event={"ID":"f396d0c5-8a49-4317-a69c-dea326896137","Type":"ContainerStarted","Data":"6dfc901711aa5991d4fe4a5bb6bd5aee98b08b1bc6cca96c0d3ed8cca5c58757"} Sep 09 23:13:43.976665 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:43.976624 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzv9l" podStartSLOduration=1.976608581 podStartE2EDuration="1.976608581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:13:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:43.97362186 +0000 UTC m=+607.631277504" watchObservedRunningTime="2026-09-09 23:13:43.976608581 +0000 UTC m=+607.634264225" Sep 09 23:13:44.939725 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:44.939696 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzv9l" Sep 09 23:13:45.001250 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.001216 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5"] Sep 09 23:13:45.001651 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.001619 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" podUID="36418912-a713-48f1-b85e-0c01ac012d55" containerName="discovery" containerID="cri-o://f97ae005baff862e25879be665646307122bb9d8c9f91012321471036f5cfa48" gracePeriod=30 Sep 09 23:13:45.243219 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.243194 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" Sep 09 23:13:45.367859 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.367794 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/36418912-a713-48f1-b85e-0c01ac012d55-istio-kubeconfig\") pod \"36418912-a713-48f1-b85e-0c01ac012d55\" (UID: \"36418912-a713-48f1-b85e-0c01ac012d55\") " Sep 09 23:13:45.367995 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.367870 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqmdv\" (UniqueName: \"kubernetes.io/projected/36418912-a713-48f1-b85e-0c01ac012d55-kube-api-access-dqmdv\") pod \"36418912-a713-48f1-b85e-0c01ac012d55\" (UID: \"36418912-a713-48f1-b85e-0c01ac012d55\") " Sep 09 23:13:45.367995 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.367916 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/36418912-a713-48f1-b85e-0c01ac012d55-local-certs\") pod \"36418912-a713-48f1-b85e-0c01ac012d55\" (UID: \"36418912-a713-48f1-b85e-0c01ac012d55\") " Sep 09 23:13:45.367995 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.367965 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/36418912-a713-48f1-b85e-0c01ac012d55-istio-csr-ca-configmap\") pod \"36418912-a713-48f1-b85e-0c01ac012d55\" (UID: \"36418912-a713-48f1-b85e-0c01ac012d55\") " Sep 09 23:13:45.367995 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.367993 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/36418912-a713-48f1-b85e-0c01ac012d55-istio-csr-dns-cert\") pod \"36418912-a713-48f1-b85e-0c01ac012d55\" (UID: \"36418912-a713-48f1-b85e-0c01ac012d55\") " Sep 09 23:13:45.368201 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.368013 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36418912-a713-48f1-b85e-0c01ac012d55-istio-token\") pod \"36418912-a713-48f1-b85e-0c01ac012d55\" (UID: \"36418912-a713-48f1-b85e-0c01ac012d55\") " Sep 09 23:13:45.368201 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.368051 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/36418912-a713-48f1-b85e-0c01ac012d55-cacerts\") pod \"36418912-a713-48f1-b85e-0c01ac012d55\" (UID: \"36418912-a713-48f1-b85e-0c01ac012d55\") " Sep 09 23:13:45.368373 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.368345 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36418912-a713-48f1-b85e-0c01ac012d55-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "36418912-a713-48f1-b85e-0c01ac012d55" (UID: "36418912-a713-48f1-b85e-0c01ac012d55"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:13:45.370328 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.370301 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36418912-a713-48f1-b85e-0c01ac012d55-cacerts" (OuterVolumeSpecName: "cacerts") pod "36418912-a713-48f1-b85e-0c01ac012d55" (UID: "36418912-a713-48f1-b85e-0c01ac012d55"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:13:45.370328 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.370311 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36418912-a713-48f1-b85e-0c01ac012d55-istio-token" (OuterVolumeSpecName: "istio-token") pod "36418912-a713-48f1-b85e-0c01ac012d55" (UID: "36418912-a713-48f1-b85e-0c01ac012d55"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:13:45.370496 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.370447 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36418912-a713-48f1-b85e-0c01ac012d55-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "36418912-a713-48f1-b85e-0c01ac012d55" (UID: "36418912-a713-48f1-b85e-0c01ac012d55"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:13:45.370496 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.370483 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36418912-a713-48f1-b85e-0c01ac012d55-local-certs" (OuterVolumeSpecName: "local-certs") pod "36418912-a713-48f1-b85e-0c01ac012d55" (UID: "36418912-a713-48f1-b85e-0c01ac012d55"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:13:45.370897 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.370528 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36418912-a713-48f1-b85e-0c01ac012d55-kube-api-access-dqmdv" (OuterVolumeSpecName: "kube-api-access-dqmdv") pod "36418912-a713-48f1-b85e-0c01ac012d55" (UID: "36418912-a713-48f1-b85e-0c01ac012d55"). InnerVolumeSpecName "kube-api-access-dqmdv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:13:45.370897 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.370531 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36418912-a713-48f1-b85e-0c01ac012d55-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "36418912-a713-48f1-b85e-0c01ac012d55" (UID: "36418912-a713-48f1-b85e-0c01ac012d55"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:13:45.469080 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.469055 2575 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/36418912-a713-48f1-b85e-0c01ac012d55-istio-kubeconfig\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:13:45.469080 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.469078 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqmdv\" (UniqueName: \"kubernetes.io/projected/36418912-a713-48f1-b85e-0c01ac012d55-kube-api-access-dqmdv\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:13:45.469209 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.469087 2575 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/36418912-a713-48f1-b85e-0c01ac012d55-local-certs\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:13:45.469209 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.469096 2575 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/36418912-a713-48f1-b85e-0c01ac012d55-istio-csr-ca-configmap\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:13:45.469209 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.469105 2575 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/36418912-a713-48f1-b85e-0c01ac012d55-istio-csr-dns-cert\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:13:45.469209 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.469116 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36418912-a713-48f1-b85e-0c01ac012d55-istio-token\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:13:45.469209 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.469126 2575 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/36418912-a713-48f1-b85e-0c01ac012d55-cacerts\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:13:45.942875 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.942819 2575 generic.go:356] "Generic (PLEG): container finished" podID="36418912-a713-48f1-b85e-0c01ac012d55" containerID="f97ae005baff862e25879be665646307122bb9d8c9f91012321471036f5cfa48" exitCode=0 Sep 09 23:13:45.942875 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.942861 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" event={"ID":"36418912-a713-48f1-b85e-0c01ac012d55","Type":"ContainerDied","Data":"f97ae005baff862e25879be665646307122bb9d8c9f91012321471036f5cfa48"} Sep 09 23:13:45.943306 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.942906 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" event={"ID":"36418912-a713-48f1-b85e-0c01ac012d55","Type":"ContainerDied","Data":"787f8fa23708fa55845dda43df17866c0431b62f2f90b0685db7e8814bb9f9de"} Sep 09 23:13:45.943306 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.942931 2575 scope.go:117] "RemoveContainer" containerID="f97ae005baff862e25879be665646307122bb9d8c9f91012321471036f5cfa48" Sep 09 23:13:45.943306 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.942871 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5" Sep 09 23:13:45.951296 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.951282 2575 scope.go:117] "RemoveContainer" containerID="f97ae005baff862e25879be665646307122bb9d8c9f91012321471036f5cfa48" Sep 09 23:13:45.951557 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:13:45.951536 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f97ae005baff862e25879be665646307122bb9d8c9f91012321471036f5cfa48\": container with ID starting with f97ae005baff862e25879be665646307122bb9d8c9f91012321471036f5cfa48 not found: ID does not exist" containerID="f97ae005baff862e25879be665646307122bb9d8c9f91012321471036f5cfa48" Sep 09 23:13:45.951624 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.951567 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f97ae005baff862e25879be665646307122bb9d8c9f91012321471036f5cfa48"} err="failed to get container status \"f97ae005baff862e25879be665646307122bb9d8c9f91012321471036f5cfa48\": rpc error: code = NotFound desc = could not find container \"f97ae005baff862e25879be665646307122bb9d8c9f91012321471036f5cfa48\": container with ID starting with f97ae005baff862e25879be665646307122bb9d8c9f91012321471036f5cfa48 not found: ID does not exist" Sep 09 23:13:45.967258 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.967227 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5"] Sep 09 23:13:45.993031 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:45.993007 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w6th5"] Sep 09 23:13:46.838536 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:13:46.838501 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36418912-a713-48f1-b85e-0c01ac012d55" path="/var/lib/kubelet/pods/36418912-a713-48f1-b85e-0c01ac012d55/volumes" Sep 09 23:14:52.002980 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:52.002950 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mmzjt"] Sep 09 23:14:52.003394 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:52.003238 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36418912-a713-48f1-b85e-0c01ac012d55" containerName="discovery" Sep 09 23:14:52.003394 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:52.003249 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="36418912-a713-48f1-b85e-0c01ac012d55" containerName="discovery" Sep 09 23:14:52.003394 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:52.003304 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="36418912-a713-48f1-b85e-0c01ac012d55" containerName="discovery" Sep 09 23:14:52.005579 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:52.005562 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mmzjt" Sep 09 23:14:52.008002 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:52.007974 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-4w2dk\"" Sep 09 23:14:52.008138 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:52.008034 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 09 23:14:52.009060 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:52.009040 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 09 23:14:52.023377 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:52.023354 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mmzjt"] Sep 09 23:14:52.058789 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:52.058757 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8vp4\" (UniqueName: \"kubernetes.io/projected/6f1d90e0-07d9-401d-a0ec-ff7fc191f971-kube-api-access-c8vp4\") pod \"limitador-operator-controller-manager-74495c69f8-mmzjt\" (UID: \"6f1d90e0-07d9-401d-a0ec-ff7fc191f971\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mmzjt" Sep 09 23:14:52.160013 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:52.159980 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8vp4\" (UniqueName: \"kubernetes.io/projected/6f1d90e0-07d9-401d-a0ec-ff7fc191f971-kube-api-access-c8vp4\") pod \"limitador-operator-controller-manager-74495c69f8-mmzjt\" (UID: \"6f1d90e0-07d9-401d-a0ec-ff7fc191f971\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mmzjt" Sep 09 23:14:52.170822 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:52.170792 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8vp4\" (UniqueName: \"kubernetes.io/projected/6f1d90e0-07d9-401d-a0ec-ff7fc191f971-kube-api-access-c8vp4\") pod \"limitador-operator-controller-manager-74495c69f8-mmzjt\" (UID: \"6f1d90e0-07d9-401d-a0ec-ff7fc191f971\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mmzjt" Sep 09 23:14:52.315613 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:52.315533 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mmzjt" Sep 09 23:14:52.583547 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:52.583513 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mmzjt"] Sep 09 23:14:52.586415 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:14:52.586390 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f1d90e0_07d9_401d_a0ec_ff7fc191f971.slice/crio-4c6b26efce8122fa9a46cd863e5c4442da09cb5c54b96052e5d0a90252ffc382 WatchSource:0}: Error finding container 4c6b26efce8122fa9a46cd863e5c4442da09cb5c54b96052e5d0a90252ffc382: Status 404 returned error can't find the container with id 4c6b26efce8122fa9a46cd863e5c4442da09cb5c54b96052e5d0a90252ffc382 Sep 09 23:14:52.588664 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:52.588643 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:14:53.226406 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:53.226370 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mmzjt" event={"ID":"6f1d90e0-07d9-401d-a0ec-ff7fc191f971","Type":"ContainerStarted","Data":"4c6b26efce8122fa9a46cd863e5c4442da09cb5c54b96052e5d0a90252ffc382"} Sep 09 23:14:55.237722 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:55.237653 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mmzjt" event={"ID":"6f1d90e0-07d9-401d-a0ec-ff7fc191f971","Type":"ContainerStarted","Data":"ffe67d35a12e2e3c53db78db0932f2458352957af45e630a566b92ea01c3f29b"} Sep 09 23:14:55.238126 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:55.237887 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mmzjt" Sep 09 23:14:55.258523 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:55.258475 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mmzjt" podStartSLOduration=1.7982786229999999 podStartE2EDuration="4.258462102s" totalImagesPullingTime="2.460183479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:14:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:14:55.257099184 +0000 UTC m=+678.914754842" watchObservedRunningTime="2026-09-09 23:14:55.258462102 +0000 UTC m=+678.916117746" Sep 09 23:14:58.429979 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:58.429949 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqqcr"] Sep 09 23:14:58.432030 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:58.432009 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqqcr" Sep 09 23:14:58.434507 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:58.434488 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5h6zz\"" Sep 09 23:14:58.447240 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:58.447215 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqqcr"] Sep 09 23:14:58.510991 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:58.510966 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk5xb\" (UniqueName: \"kubernetes.io/projected/e893fe1f-6d24-4ae0-a802-92ccad9903f8-kube-api-access-jk5xb\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nqqcr\" (UID: \"e893fe1f-6d24-4ae0-a802-92ccad9903f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqqcr" Sep 09 23:14:58.511083 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:58.511007 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e893fe1f-6d24-4ae0-a802-92ccad9903f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nqqcr\" (UID: \"e893fe1f-6d24-4ae0-a802-92ccad9903f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqqcr" Sep 09 23:14:58.612154 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:58.612120 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e893fe1f-6d24-4ae0-a802-92ccad9903f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nqqcr\" (UID: \"e893fe1f-6d24-4ae0-a802-92ccad9903f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqqcr" Sep 09 23:14:58.612288 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:58.612190 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk5xb\" (UniqueName: \"kubernetes.io/projected/e893fe1f-6d24-4ae0-a802-92ccad9903f8-kube-api-access-jk5xb\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nqqcr\" (UID: \"e893fe1f-6d24-4ae0-a802-92ccad9903f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqqcr" Sep 09 23:14:58.612482 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:58.612462 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e893fe1f-6d24-4ae0-a802-92ccad9903f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nqqcr\" (UID: \"e893fe1f-6d24-4ae0-a802-92ccad9903f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqqcr" Sep 09 23:14:58.623287 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:58.623259 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk5xb\" (UniqueName: \"kubernetes.io/projected/e893fe1f-6d24-4ae0-a802-92ccad9903f8-kube-api-access-jk5xb\") pod \"kuadrant-operator-controller-manager-76f8f686bf-nqqcr\" (UID: \"e893fe1f-6d24-4ae0-a802-92ccad9903f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqqcr" Sep 09 23:14:58.742003 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:58.741934 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqqcr" Sep 09 23:14:59.015102 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:59.015032 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqqcr"] Sep 09 23:14:59.019025 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:14:59.018997 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode893fe1f_6d24_4ae0_a802_92ccad9903f8.slice/crio-7c7128d9bc53c40d2df9b9fa9a5327658906295ba68d709a034209e950f2d654 WatchSource:0}: Error finding container 7c7128d9bc53c40d2df9b9fa9a5327658906295ba68d709a034209e950f2d654: Status 404 returned error can't find the container with id 7c7128d9bc53c40d2df9b9fa9a5327658906295ba68d709a034209e950f2d654 Sep 09 23:14:59.256379 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:14:59.256347 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqqcr" event={"ID":"e893fe1f-6d24-4ae0-a802-92ccad9903f8","Type":"ContainerStarted","Data":"7c7128d9bc53c40d2df9b9fa9a5327658906295ba68d709a034209e950f2d654"} Sep 09 23:15:04.280429 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:04.280389 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqqcr" event={"ID":"e893fe1f-6d24-4ae0-a802-92ccad9903f8","Type":"ContainerStarted","Data":"3aee826a968af9e97771c4bc71dba75218eebdad338bee452058c770f277a900"} Sep 09 23:15:04.280821 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:04.280488 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqqcr" Sep 09 23:15:04.301529 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:04.301479 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqqcr" podStartSLOduration=1.962659317 podStartE2EDuration="6.301464827s" totalImagesPullingTime="4.33880551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:15:04.29978 +0000 UTC m=+687.957435645" watchObservedRunningTime="2026-09-09 23:15:04.301464827 +0000 UTC m=+687.959120470" Sep 09 23:15:06.244048 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:06.244022 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mmzjt" Sep 09 23:15:15.287456 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:15.287425 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqqcr" Sep 09 23:15:16.371512 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:16.369249 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-nlxxg"] Sep 09 23:15:16.374404 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:16.374377 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-nlxxg" Sep 09 23:15:16.385619 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:16.385594 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-nlxxg"] Sep 09 23:15:16.461655 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:16.461620 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ea73578-3cf2-45bd-8d42-3a0d8869f1c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-nlxxg\" (UID: \"3ea73578-3cf2-45bd-8d42-3a0d8869f1c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-nlxxg" Sep 09 23:15:16.461871 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:16.461684 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmhdh\" (UniqueName: \"kubernetes.io/projected/3ea73578-3cf2-45bd-8d42-3a0d8869f1c4-kube-api-access-xmhdh\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-nlxxg\" (UID: \"3ea73578-3cf2-45bd-8d42-3a0d8869f1c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-nlxxg" Sep 09 23:15:16.563141 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:16.563097 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ea73578-3cf2-45bd-8d42-3a0d8869f1c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-nlxxg\" (UID: \"3ea73578-3cf2-45bd-8d42-3a0d8869f1c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-nlxxg" Sep 09 23:15:16.563141 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:16.563145 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmhdh\" (UniqueName: \"kubernetes.io/projected/3ea73578-3cf2-45bd-8d42-3a0d8869f1c4-kube-api-access-xmhdh\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-nlxxg\" (UID: \"3ea73578-3cf2-45bd-8d42-3a0d8869f1c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-nlxxg" Sep 09 23:15:16.563489 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:16.563467 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ea73578-3cf2-45bd-8d42-3a0d8869f1c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-nlxxg\" (UID: \"3ea73578-3cf2-45bd-8d42-3a0d8869f1c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-nlxxg" Sep 09 23:15:16.573734 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:16.573702 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmhdh\" (UniqueName: \"kubernetes.io/projected/3ea73578-3cf2-45bd-8d42-3a0d8869f1c4-kube-api-access-xmhdh\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-nlxxg\" (UID: \"3ea73578-3cf2-45bd-8d42-3a0d8869f1c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-nlxxg" Sep 09 23:15:16.602211 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:16.602180 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-nlxxg"] Sep 09 23:15:16.602441 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:16.602429 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-nlxxg" Sep 09 23:15:16.641380 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:16.641305 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-cdmwp"] Sep 09 23:15:16.644917 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:16.644896 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-cdmwp" Sep 09 23:15:16.667930 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:16.667906 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-cdmwp"] Sep 09 23:15:16.765298 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:16.765261 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8bf6\" (UniqueName: \"kubernetes.io/projected/7839c77c-7a34-43a2-8baa-c957c8d20101-kube-api-access-z8bf6\") pod \"kuadrant-operator-controller-manager-5f685c496f-cdmwp\" (UID: \"7839c77c-7a34-43a2-8baa-c957c8d20101\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-cdmwp" Sep 09 23:15:16.765467 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:16.765315 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7839c77c-7a34-43a2-8baa-c957c8d20101-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-cdmwp\" (UID: \"7839c77c-7a34-43a2-8baa-c957c8d20101\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-cdmwp" Sep 09 23:15:16.865966 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:16.865929 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7839c77c-7a34-43a2-8baa-c957c8d20101-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-cdmwp\" (UID: \"7839c77c-7a34-43a2-8baa-c957c8d20101\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-cdmwp" Sep 09 23:15:16.866136 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:16.866025 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8bf6\" (UniqueName: \"kubernetes.io/projected/7839c77c-7a34-43a2-8baa-c957c8d20101-kube-api-access-z8bf6\") pod \"kuadrant-operator-controller-manager-5f685c496f-cdmwp\" (UID: \"7839c77c-7a34-43a2-8baa-c957c8d20101\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-cdmwp" Sep 09 23:15:16.866302 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:16.866271 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7839c77c-7a34-43a2-8baa-c957c8d20101-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-cdmwp\" (UID: \"7839c77c-7a34-43a2-8baa-c957c8d20101\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-cdmwp" Sep 09 23:15:16.872485 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:16.872457 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-nlxxg"] Sep 09 23:15:16.875412 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:16.875391 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8bf6\" (UniqueName: \"kubernetes.io/projected/7839c77c-7a34-43a2-8baa-c957c8d20101-kube-api-access-z8bf6\") pod \"kuadrant-operator-controller-manager-5f685c496f-cdmwp\" (UID: \"7839c77c-7a34-43a2-8baa-c957c8d20101\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-cdmwp" Sep 09 23:15:16.875975 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:15:16.875954 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ea73578_3cf2_45bd_8d42_3a0d8869f1c4.slice/crio-0d6f3c0da0116d8b8f7c7dba5728c649085a5dc87d4a64aa6fddcd2e351f127e WatchSource:0}: Error finding container 0d6f3c0da0116d8b8f7c7dba5728c649085a5dc87d4a64aa6fddcd2e351f127e: Status 404 returned error can't find the container with id 0d6f3c0da0116d8b8f7c7dba5728c649085a5dc87d4a64aa6fddcd2e351f127e Sep 09 23:15:16.958245 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:16.958209 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-cdmwp" Sep 09 23:15:17.237331 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.237306 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-cdmwp"] Sep 09 23:15:17.239576 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:15:17.239549 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7839c77c_7a34_43a2_8baa_c957c8d20101.slice/crio-ce416e79ca4ca057cff8c2d7e8fd318e52bdf10d36002ae9e478366a2d62d108 WatchSource:0}: Error finding container ce416e79ca4ca057cff8c2d7e8fd318e52bdf10d36002ae9e478366a2d62d108: Status 404 returned error can't find the container with id ce416e79ca4ca057cff8c2d7e8fd318e52bdf10d36002ae9e478366a2d62d108 Sep 09 23:15:17.338559 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.338517 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-nlxxg" event={"ID":"3ea73578-3cf2-45bd-8d42-3a0d8869f1c4","Type":"ContainerStarted","Data":"e690d300cb7ae1f48f5a3760d7cca73ad0d5be7cc06df8eb311a36b633938088"} Sep 09 23:15:17.338559 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.338549 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-nlxxg" podUID="3ea73578-3cf2-45bd-8d42-3a0d8869f1c4" containerName="manager" containerID="cri-o://e690d300cb7ae1f48f5a3760d7cca73ad0d5be7cc06df8eb311a36b633938088" gracePeriod=10 Sep 09 23:15:17.338794 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.338582 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-nlxxg" event={"ID":"3ea73578-3cf2-45bd-8d42-3a0d8869f1c4","Type":"ContainerStarted","Data":"0d6f3c0da0116d8b8f7c7dba5728c649085a5dc87d4a64aa6fddcd2e351f127e"} Sep 09 23:15:17.338794 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.338611 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-nlxxg" Sep 09 23:15:17.340315 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.340294 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-cdmwp" event={"ID":"7839c77c-7a34-43a2-8baa-c957c8d20101","Type":"ContainerStarted","Data":"d59ea0d6c80a8a1c0384c201b66be18f9d8b503065a9c6239a540c7649e006e5"} Sep 09 23:15:17.340417 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.340335 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-cdmwp" event={"ID":"7839c77c-7a34-43a2-8baa-c957c8d20101","Type":"ContainerStarted","Data":"ce416e79ca4ca057cff8c2d7e8fd318e52bdf10d36002ae9e478366a2d62d108"} Sep 09 23:15:17.340453 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.340423 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-cdmwp" Sep 09 23:15:17.355950 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.355905 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-nlxxg" podStartSLOduration=1.355890168 podStartE2EDuration="1.355890168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:15:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:15:17.354625422 +0000 UTC m=+701.012281066" watchObservedRunningTime="2026-09-09 23:15:17.355890168 +0000 UTC m=+701.013545812" Sep 09 23:15:17.371306 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.371265 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-cdmwp" podStartSLOduration=1.371251217 podStartE2EDuration="1.371251217s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:15:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:15:17.369939137 +0000 UTC m=+701.027594786" watchObservedRunningTime="2026-09-09 23:15:17.371251217 +0000 UTC m=+701.028906861" Sep 09 23:15:17.422392 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.422364 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-cdmwp"] Sep 09 23:15:17.439570 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.439541 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-cdmwp"] Sep 09 23:15:17.443096 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.442687 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b6hlc"] Sep 09 23:15:17.443229 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.443180 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7839c77c-7a34-43a2-8baa-c957c8d20101" containerName="manager" Sep 09 23:15:17.443229 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.443199 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7839c77c-7a34-43a2-8baa-c957c8d20101" containerName="manager" Sep 09 23:15:17.443336 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.443274 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7839c77c-7a34-43a2-8baa-c957c8d20101" containerName="manager" Sep 09 23:15:17.446260 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.446240 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b6hlc" Sep 09 23:15:17.452243 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.452214 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-nlxxg"] Sep 09 23:15:17.461591 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.461562 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b6hlc"] Sep 09 23:15:17.466420 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.466396 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-nlxxg"] Sep 09 23:15:17.480005 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.479977 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqqcr"] Sep 09 23:15:17.480216 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.480189 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqqcr" podUID="e893fe1f-6d24-4ae0-a802-92ccad9903f8" containerName="manager" containerID="cri-o://3aee826a968af9e97771c4bc71dba75218eebdad338bee452058c770f277a900" gracePeriod=2 Sep 09 23:15:17.482422 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:17.482373 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-nqqcr\" is forbidden: User \"system:node:ip-10-0-140-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-137.ec2.internal' and this object" podUID="e893fe1f-6d24-4ae0-a802-92ccad9903f8" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqqcr" Sep 09 23:15:17.485571 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.485421 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqqcr"] Sep 09 23:15:17.497613 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.496669 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mmzjt"] Sep 09 23:15:17.497807 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.497703 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mmzjt" podUID="6f1d90e0-07d9-401d-a0ec-ff7fc191f971" containerName="manager" containerID="cri-o://ffe67d35a12e2e3c53db78db0932f2458352957af45e630a566b92ea01c3f29b" gracePeriod=2 Sep 09 23:15:17.499930 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:17.499899 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-nqqcr\" is forbidden: User \"system:node:ip-10-0-140-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-137.ec2.internal' and this object" podUID="e893fe1f-6d24-4ae0-a802-92ccad9903f8" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqqcr" Sep 09 23:15:17.505086 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.505059 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mfc64"] Sep 09 23:15:17.505510 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.505490 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ea73578-3cf2-45bd-8d42-3a0d8869f1c4" containerName="manager" Sep 09 23:15:17.505609 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.505511 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ea73578-3cf2-45bd-8d42-3a0d8869f1c4" containerName="manager" Sep 09 23:15:17.505609 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.505543 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e893fe1f-6d24-4ae0-a802-92ccad9903f8" containerName="manager" Sep 09 23:15:17.505609 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.505551 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e893fe1f-6d24-4ae0-a802-92ccad9903f8" containerName="manager" Sep 09 23:15:17.505760 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.505621 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ea73578-3cf2-45bd-8d42-3a0d8869f1c4" containerName="manager" Sep 09 23:15:17.505760 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.505636 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e893fe1f-6d24-4ae0-a802-92ccad9903f8" containerName="manager" Sep 09 23:15:17.508574 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.508554 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mmzjt"] Sep 09 23:15:17.508687 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.508649 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mfc64" Sep 09 23:15:17.510874 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:17.510820 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-nqqcr\" is forbidden: User \"system:node:ip-10-0-140-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-137.ec2.internal' and this object" podUID="e893fe1f-6d24-4ae0-a802-92ccad9903f8" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqqcr" Sep 09 23:15:17.516733 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.516705 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-f86rg"] Sep 09 23:15:17.517326 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.517159 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f1d90e0-07d9-401d-a0ec-ff7fc191f971" containerName="manager" Sep 09 23:15:17.517326 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.517178 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f1d90e0-07d9-401d-a0ec-ff7fc191f971" containerName="manager" Sep 09 23:15:17.517326 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.517291 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f1d90e0-07d9-401d-a0ec-ff7fc191f971" containerName="manager" Sep 09 23:15:17.521167 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.521147 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mfc64"] Sep 09 23:15:17.521270 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.521243 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f86rg" Sep 09 23:15:17.533737 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.533709 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-f86rg"] Sep 09 23:15:17.543876 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:17.543841 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mmzjt\" is forbidden: User \"system:node:ip-10-0-140-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-137.ec2.internal' and this object" podUID="6f1d90e0-07d9-401d-a0ec-ff7fc191f971" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mmzjt" Sep 09 23:15:17.545729 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:17.545698 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-nqqcr\" is forbidden: User \"system:node:ip-10-0-140-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-137.ec2.internal' and this object" podUID="e893fe1f-6d24-4ae0-a802-92ccad9903f8" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqqcr" Sep 09 23:15:17.547432 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:17.547405 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mmzjt\" is forbidden: User \"system:node:ip-10-0-140-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-137.ec2.internal' and this object" podUID="6f1d90e0-07d9-401d-a0ec-ff7fc191f971" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mmzjt" Sep 09 23:15:17.571355 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.571325 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghwxn\" (UniqueName: \"kubernetes.io/projected/3642e02d-c236-4ba5-aeed-5591ee0e6193-kube-api-access-ghwxn\") pod \"kuadrant-operator-controller-manager-5f685c496f-b6hlc\" (UID: \"3642e02d-c236-4ba5-aeed-5591ee0e6193\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b6hlc" Sep 09 23:15:17.571525 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.571366 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3642e02d-c236-4ba5-aeed-5591ee0e6193-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-b6hlc\" (UID: \"3642e02d-c236-4ba5-aeed-5591ee0e6193\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b6hlc" Sep 09 23:15:17.633280 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.633256 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-nlxxg" Sep 09 23:15:17.635288 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:17.635228 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mmzjt\" is forbidden: User \"system:node:ip-10-0-140-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-137.ec2.internal' and this object" podUID="6f1d90e0-07d9-401d-a0ec-ff7fc191f971" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mmzjt" Sep 09 23:15:17.637140 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:17.637080 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-nlxxg\" is forbidden: User \"system:node:ip-10-0-140-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-137.ec2.internal' and this object" podUID="3ea73578-3cf2-45bd-8d42-3a0d8869f1c4" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-nlxxg" Sep 09 23:15:17.638697 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:17.638666 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-nqqcr\" is forbidden: User \"system:node:ip-10-0-140-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-137.ec2.internal' and this object" podUID="e893fe1f-6d24-4ae0-a802-92ccad9903f8" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqqcr" Sep 09 23:15:17.672397 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.672345 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghwxn\" (UniqueName: \"kubernetes.io/projected/3642e02d-c236-4ba5-aeed-5591ee0e6193-kube-api-access-ghwxn\") pod \"kuadrant-operator-controller-manager-5f685c496f-b6hlc\" (UID: \"3642e02d-c236-4ba5-aeed-5591ee0e6193\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b6hlc" Sep 09 23:15:17.672467 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.672397 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88jzk\" (UniqueName: \"kubernetes.io/projected/a109b0f1-fb55-4afd-8b0a-b64bb7948f98-kube-api-access-88jzk\") pod \"limitador-operator-controller-manager-74495c69f8-f86rg\" (UID: \"a109b0f1-fb55-4afd-8b0a-b64bb7948f98\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f86rg" Sep 09 23:15:17.672467 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.672431 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3642e02d-c236-4ba5-aeed-5591ee0e6193-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-b6hlc\" (UID: \"3642e02d-c236-4ba5-aeed-5591ee0e6193\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b6hlc" Sep 09 23:15:17.672534 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.672473 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqjkb\" (UniqueName: \"kubernetes.io/projected/15254481-b0f2-419b-a1c6-f303f9c0fa12-kube-api-access-zqjkb\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mfc64\" (UID: \"15254481-b0f2-419b-a1c6-f303f9c0fa12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mfc64" Sep 09 23:15:17.672612 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.672594 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15254481-b0f2-419b-a1c6-f303f9c0fa12-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mfc64\" (UID: \"15254481-b0f2-419b-a1c6-f303f9c0fa12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mfc64" Sep 09 23:15:17.672821 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.672802 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3642e02d-c236-4ba5-aeed-5591ee0e6193-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-b6hlc\" (UID: \"3642e02d-c236-4ba5-aeed-5591ee0e6193\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b6hlc" Sep 09 23:15:17.682080 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.682056 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghwxn\" (UniqueName: \"kubernetes.io/projected/3642e02d-c236-4ba5-aeed-5591ee0e6193-kube-api-access-ghwxn\") pod \"kuadrant-operator-controller-manager-5f685c496f-b6hlc\" (UID: \"3642e02d-c236-4ba5-aeed-5591ee0e6193\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b6hlc" Sep 09 23:15:17.748621 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.748555 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqqcr" Sep 09 23:15:17.750851 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:17.750809 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-nqqcr\" is forbidden: User \"system:node:ip-10-0-140-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-137.ec2.internal' and this object" podUID="e893fe1f-6d24-4ae0-a802-92ccad9903f8" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqqcr" Sep 09 23:15:17.751201 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.751181 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mmzjt" Sep 09 23:15:17.753320 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:17.753298 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mmzjt\" is forbidden: User \"system:node:ip-10-0-140-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-137.ec2.internal' and this object" podUID="6f1d90e0-07d9-401d-a0ec-ff7fc191f971" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mmzjt" Sep 09 23:15:17.755010 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:17.754988 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-nlxxg\" is forbidden: User \"system:node:ip-10-0-140-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-137.ec2.internal' and this object" podUID="3ea73578-3cf2-45bd-8d42-3a0d8869f1c4" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-nlxxg" Sep 09 23:15:17.756928 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:17.756907 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-nqqcr\" is forbidden: User \"system:node:ip-10-0-140-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-137.ec2.internal' and this object" podUID="e893fe1f-6d24-4ae0-a802-92ccad9903f8" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqqcr" Sep 09 23:15:17.758474 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:17.758452 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mmzjt\" is forbidden: User \"system:node:ip-10-0-140-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-137.ec2.internal' and this object" podUID="6f1d90e0-07d9-401d-a0ec-ff7fc191f971" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mmzjt" Sep 09 23:15:17.760230 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:17.760211 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-nlxxg\" is forbidden: User \"system:node:ip-10-0-140-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-137.ec2.internal' and this object" podUID="3ea73578-3cf2-45bd-8d42-3a0d8869f1c4" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-nlxxg" Sep 09 23:15:17.773068 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.773052 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ea73578-3cf2-45bd-8d42-3a0d8869f1c4-extensions-socket-volume\") pod \"3ea73578-3cf2-45bd-8d42-3a0d8869f1c4\" (UID: \"3ea73578-3cf2-45bd-8d42-3a0d8869f1c4\") " Sep 09 23:15:17.773139 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.773115 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmhdh\" (UniqueName: \"kubernetes.io/projected/3ea73578-3cf2-45bd-8d42-3a0d8869f1c4-kube-api-access-xmhdh\") pod \"3ea73578-3cf2-45bd-8d42-3a0d8869f1c4\" (UID: \"3ea73578-3cf2-45bd-8d42-3a0d8869f1c4\") " Sep 09 23:15:17.773315 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.773300 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88jzk\" (UniqueName: \"kubernetes.io/projected/a109b0f1-fb55-4afd-8b0a-b64bb7948f98-kube-api-access-88jzk\") pod \"limitador-operator-controller-manager-74495c69f8-f86rg\" (UID: \"a109b0f1-fb55-4afd-8b0a-b64bb7948f98\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f86rg" Sep 09 23:15:17.773378 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.773362 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqjkb\" (UniqueName: \"kubernetes.io/projected/15254481-b0f2-419b-a1c6-f303f9c0fa12-kube-api-access-zqjkb\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mfc64\" (UID: \"15254481-b0f2-419b-a1c6-f303f9c0fa12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mfc64" Sep 09 23:15:17.773444 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.773406 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15254481-b0f2-419b-a1c6-f303f9c0fa12-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mfc64\" (UID: \"15254481-b0f2-419b-a1c6-f303f9c0fa12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mfc64" Sep 09 23:15:17.773500 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.773476 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ea73578-3cf2-45bd-8d42-3a0d8869f1c4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3ea73578-3cf2-45bd-8d42-3a0d8869f1c4" (UID: "3ea73578-3cf2-45bd-8d42-3a0d8869f1c4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:15:17.773781 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.773763 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15254481-b0f2-419b-a1c6-f303f9c0fa12-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mfc64\" (UID: \"15254481-b0f2-419b-a1c6-f303f9c0fa12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mfc64" Sep 09 23:15:17.775195 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.775174 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ea73578-3cf2-45bd-8d42-3a0d8869f1c4-kube-api-access-xmhdh" (OuterVolumeSpecName: "kube-api-access-xmhdh") pod "3ea73578-3cf2-45bd-8d42-3a0d8869f1c4" (UID: "3ea73578-3cf2-45bd-8d42-3a0d8869f1c4"). InnerVolumeSpecName "kube-api-access-xmhdh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:15:17.780582 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.780557 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88jzk\" (UniqueName: \"kubernetes.io/projected/a109b0f1-fb55-4afd-8b0a-b64bb7948f98-kube-api-access-88jzk\") pod \"limitador-operator-controller-manager-74495c69f8-f86rg\" (UID: \"a109b0f1-fb55-4afd-8b0a-b64bb7948f98\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f86rg" Sep 09 23:15:17.780656 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.780608 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqjkb\" (UniqueName: \"kubernetes.io/projected/15254481-b0f2-419b-a1c6-f303f9c0fa12-kube-api-access-zqjkb\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mfc64\" (UID: \"15254481-b0f2-419b-a1c6-f303f9c0fa12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mfc64" Sep 09 23:15:17.799589 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.799569 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b6hlc" Sep 09 23:15:17.874247 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.874218 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e893fe1f-6d24-4ae0-a802-92ccad9903f8-extensions-socket-volume\") pod \"e893fe1f-6d24-4ae0-a802-92ccad9903f8\" (UID: \"e893fe1f-6d24-4ae0-a802-92ccad9903f8\") " Sep 09 23:15:17.874394 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.874287 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jk5xb\" (UniqueName: \"kubernetes.io/projected/e893fe1f-6d24-4ae0-a802-92ccad9903f8-kube-api-access-jk5xb\") pod \"e893fe1f-6d24-4ae0-a802-92ccad9903f8\" (UID: \"e893fe1f-6d24-4ae0-a802-92ccad9903f8\") " Sep 09 23:15:17.874394 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.874372 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8vp4\" (UniqueName: \"kubernetes.io/projected/6f1d90e0-07d9-401d-a0ec-ff7fc191f971-kube-api-access-c8vp4\") pod \"6f1d90e0-07d9-401d-a0ec-ff7fc191f971\" (UID: \"6f1d90e0-07d9-401d-a0ec-ff7fc191f971\") " Sep 09 23:15:17.874616 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.874598 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ea73578-3cf2-45bd-8d42-3a0d8869f1c4-extensions-socket-volume\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:15:17.874661 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.874629 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmhdh\" (UniqueName: \"kubernetes.io/projected/3ea73578-3cf2-45bd-8d42-3a0d8869f1c4-kube-api-access-xmhdh\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:15:17.874661 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.874596 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e893fe1f-6d24-4ae0-a802-92ccad9903f8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e893fe1f-6d24-4ae0-a802-92ccad9903f8" (UID: "e893fe1f-6d24-4ae0-a802-92ccad9903f8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:15:17.876574 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.876542 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f1d90e0-07d9-401d-a0ec-ff7fc191f971-kube-api-access-c8vp4" (OuterVolumeSpecName: "kube-api-access-c8vp4") pod "6f1d90e0-07d9-401d-a0ec-ff7fc191f971" (UID: "6f1d90e0-07d9-401d-a0ec-ff7fc191f971"). InnerVolumeSpecName "kube-api-access-c8vp4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:15:17.876704 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.876574 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e893fe1f-6d24-4ae0-a802-92ccad9903f8-kube-api-access-jk5xb" (OuterVolumeSpecName: "kube-api-access-jk5xb") pod "e893fe1f-6d24-4ae0-a802-92ccad9903f8" (UID: "e893fe1f-6d24-4ae0-a802-92ccad9903f8"). InnerVolumeSpecName "kube-api-access-jk5xb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:15:17.920910 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.920875 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mfc64" Sep 09 23:15:17.928770 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.928749 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f86rg" Sep 09 23:15:17.977217 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.977192 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jk5xb\" (UniqueName: \"kubernetes.io/projected/e893fe1f-6d24-4ae0-a802-92ccad9903f8-kube-api-access-jk5xb\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:15:17.977316 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.977220 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8vp4\" (UniqueName: \"kubernetes.io/projected/6f1d90e0-07d9-401d-a0ec-ff7fc191f971-kube-api-access-c8vp4\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:15:17.977316 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:17.977235 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e893fe1f-6d24-4ae0-a802-92ccad9903f8-extensions-socket-volume\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:15:18.099367 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.099341 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b6hlc"] Sep 09 23:15:18.100733 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:15:18.100702 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3642e02d_c236_4ba5_aeed_5591ee0e6193.slice/crio-ba17ff23e8fd2d025351fe9dc3212e8f2ee67b2c82f1a635c9ed46960f16e5d3 WatchSource:0}: Error finding container ba17ff23e8fd2d025351fe9dc3212e8f2ee67b2c82f1a635c9ed46960f16e5d3: Status 404 returned error can't find the container with id ba17ff23e8fd2d025351fe9dc3212e8f2ee67b2c82f1a635c9ed46960f16e5d3 Sep 09 23:15:18.196486 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.196465 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mfc64"] Sep 09 23:15:18.198397 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:15:18.198374 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15254481_b0f2_419b_a1c6_f303f9c0fa12.slice/crio-fd5cc546f12261e28ead364627e9d7cf760fad30c9d7ccf6e3d385a65118e72e WatchSource:0}: Error finding container fd5cc546f12261e28ead364627e9d7cf760fad30c9d7ccf6e3d385a65118e72e: Status 404 returned error can't find the container with id fd5cc546f12261e28ead364627e9d7cf760fad30c9d7ccf6e3d385a65118e72e Sep 09 23:15:18.203376 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.203356 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-f86rg"] Sep 09 23:15:18.205343 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:15:18.205322 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda109b0f1_fb55_4afd_8b0a_b64bb7948f98.slice/crio-38678c46b6b9e3d5016012dca78343e04cb46513adf1bab70dd201f19ba73be9 WatchSource:0}: Error finding container 38678c46b6b9e3d5016012dca78343e04cb46513adf1bab70dd201f19ba73be9: Status 404 returned error can't find the container with id 38678c46b6b9e3d5016012dca78343e04cb46513adf1bab70dd201f19ba73be9 Sep 09 23:15:18.347064 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.347020 2575 generic.go:356] "Generic (PLEG): container finished" podID="e893fe1f-6d24-4ae0-a802-92ccad9903f8" containerID="3aee826a968af9e97771c4bc71dba75218eebdad338bee452058c770f277a900" exitCode=0 Sep 09 23:15:18.347284 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.347073 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqqcr" Sep 09 23:15:18.347284 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.347112 2575 scope.go:117] "RemoveContainer" containerID="3aee826a968af9e97771c4bc71dba75218eebdad338bee452058c770f277a900" Sep 09 23:15:18.349214 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.349186 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f86rg" event={"ID":"a109b0f1-fb55-4afd-8b0a-b64bb7948f98","Type":"ContainerStarted","Data":"bf41537cd929b66557d31a5e5e8919f4b26a369acb008d43355bd3fc4c4f2fde"} Sep 09 23:15:18.349328 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:18.349263 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-nqqcr\" is forbidden: User \"system:node:ip-10-0-140-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-137.ec2.internal' and this object" podUID="e893fe1f-6d24-4ae0-a802-92ccad9903f8" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqqcr" Sep 09 23:15:18.349328 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.349278 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f86rg" event={"ID":"a109b0f1-fb55-4afd-8b0a-b64bb7948f98","Type":"ContainerStarted","Data":"38678c46b6b9e3d5016012dca78343e04cb46513adf1bab70dd201f19ba73be9"} Sep 09 23:15:18.349328 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.349312 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f86rg" Sep 09 23:15:18.351158 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:18.351135 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mmzjt\" is forbidden: User \"system:node:ip-10-0-140-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-137.ec2.internal' and this object" podUID="6f1d90e0-07d9-401d-a0ec-ff7fc191f971" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mmzjt" Sep 09 23:15:18.351472 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.351446 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b6hlc" event={"ID":"3642e02d-c236-4ba5-aeed-5591ee0e6193","Type":"ContainerStarted","Data":"a4ed92a29247aba51a991a854c4ebdc355d5a290e3be50c86ae63912d3b87b52"} Sep 09 23:15:18.351576 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.351495 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b6hlc" event={"ID":"3642e02d-c236-4ba5-aeed-5591ee0e6193","Type":"ContainerStarted","Data":"ba17ff23e8fd2d025351fe9dc3212e8f2ee67b2c82f1a635c9ed46960f16e5d3"} Sep 09 23:15:18.351642 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.351602 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b6hlc" Sep 09 23:15:18.352976 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:18.352947 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-nlxxg\" is forbidden: User \"system:node:ip-10-0-140-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-137.ec2.internal' and this object" podUID="3ea73578-3cf2-45bd-8d42-3a0d8869f1c4" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-nlxxg" Sep 09 23:15:18.353495 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.353472 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mfc64" event={"ID":"15254481-b0f2-419b-a1c6-f303f9c0fa12","Type":"ContainerStarted","Data":"02016f9a3dcd145b28c058d713fa329e9851096e7dc1b6d157a93f115b69fa76"} Sep 09 23:15:18.353605 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.353514 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mfc64" event={"ID":"15254481-b0f2-419b-a1c6-f303f9c0fa12","Type":"ContainerStarted","Data":"fd5cc546f12261e28ead364627e9d7cf760fad30c9d7ccf6e3d385a65118e72e"} Sep 09 23:15:18.353605 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.353561 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mfc64" Sep 09 23:15:18.354650 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:18.354623 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mmzjt\" is forbidden: User \"system:node:ip-10-0-140-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-137.ec2.internal' and this object" podUID="6f1d90e0-07d9-401d-a0ec-ff7fc191f971" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mmzjt" Sep 09 23:15:18.354958 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.354933 2575 generic.go:356] "Generic (PLEG): container finished" podID="6f1d90e0-07d9-401d-a0ec-ff7fc191f971" containerID="ffe67d35a12e2e3c53db78db0932f2458352957af45e630a566b92ea01c3f29b" exitCode=0 Sep 09 23:15:18.355065 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.354970 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mmzjt" Sep 09 23:15:18.356524 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.356502 2575 generic.go:356] "Generic (PLEG): container finished" podID="3ea73578-3cf2-45bd-8d42-3a0d8869f1c4" containerID="e690d300cb7ae1f48f5a3760d7cca73ad0d5be7cc06df8eb311a36b633938088" exitCode=0 Sep 09 23:15:18.356639 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.356537 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-nlxxg" Sep 09 23:15:18.356898 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:18.356880 2575 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-cdmwp" container="manager" Sep 09 23:15:18.358029 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.357871 2575 scope.go:117] "RemoveContainer" containerID="3aee826a968af9e97771c4bc71dba75218eebdad338bee452058c770f277a900" Sep 09 23:15:18.358265 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:18.358239 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3aee826a968af9e97771c4bc71dba75218eebdad338bee452058c770f277a900\": container with ID starting with 3aee826a968af9e97771c4bc71dba75218eebdad338bee452058c770f277a900 not found: ID does not exist" containerID="3aee826a968af9e97771c4bc71dba75218eebdad338bee452058c770f277a900" Sep 09 23:15:18.358403 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.358378 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aee826a968af9e97771c4bc71dba75218eebdad338bee452058c770f277a900"} err="failed to get container status \"3aee826a968af9e97771c4bc71dba75218eebdad338bee452058c770f277a900\": rpc error: code = NotFound desc = could not find container \"3aee826a968af9e97771c4bc71dba75218eebdad338bee452058c770f277a900\": container with ID starting with 3aee826a968af9e97771c4bc71dba75218eebdad338bee452058c770f277a900 not found: ID does not exist" Sep 09 23:15:18.358505 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.358485 2575 scope.go:117] "RemoveContainer" containerID="ffe67d35a12e2e3c53db78db0932f2458352957af45e630a566b92ea01c3f29b" Sep 09 23:15:18.368293 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.368278 2575 scope.go:117] "RemoveContainer" containerID="ffe67d35a12e2e3c53db78db0932f2458352957af45e630a566b92ea01c3f29b" Sep 09 23:15:18.368621 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:18.368575 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffe67d35a12e2e3c53db78db0932f2458352957af45e630a566b92ea01c3f29b\": container with ID starting with ffe67d35a12e2e3c53db78db0932f2458352957af45e630a566b92ea01c3f29b not found: ID does not exist" containerID="ffe67d35a12e2e3c53db78db0932f2458352957af45e630a566b92ea01c3f29b" Sep 09 23:15:18.368621 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.368600 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffe67d35a12e2e3c53db78db0932f2458352957af45e630a566b92ea01c3f29b"} err="failed to get container status \"ffe67d35a12e2e3c53db78db0932f2458352957af45e630a566b92ea01c3f29b\": rpc error: code = NotFound desc = could not find container \"ffe67d35a12e2e3c53db78db0932f2458352957af45e630a566b92ea01c3f29b\": container with ID starting with ffe67d35a12e2e3c53db78db0932f2458352957af45e630a566b92ea01c3f29b not found: ID does not exist" Sep 09 23:15:18.368784 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.368632 2575 scope.go:117] "RemoveContainer" containerID="e690d300cb7ae1f48f5a3760d7cca73ad0d5be7cc06df8eb311a36b633938088" Sep 09 23:15:18.373645 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.373607 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f86rg" podStartSLOduration=1.373594319 podStartE2EDuration="1.373594319s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:15:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:15:18.372245863 +0000 UTC m=+702.029901507" watchObservedRunningTime="2026-09-09 23:15:18.373594319 +0000 UTC m=+702.031249963" Sep 09 23:15:18.374148 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:18.374117 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-nlxxg\" is forbidden: User \"system:node:ip-10-0-140-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-137.ec2.internal' and this object" podUID="3ea73578-3cf2-45bd-8d42-3a0d8869f1c4" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-nlxxg" Sep 09 23:15:18.379791 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.379775 2575 scope.go:117] "RemoveContainer" containerID="e690d300cb7ae1f48f5a3760d7cca73ad0d5be7cc06df8eb311a36b633938088" Sep 09 23:15:18.380145 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:18.380124 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e690d300cb7ae1f48f5a3760d7cca73ad0d5be7cc06df8eb311a36b633938088\": container with ID starting with e690d300cb7ae1f48f5a3760d7cca73ad0d5be7cc06df8eb311a36b633938088 not found: ID does not exist" containerID="e690d300cb7ae1f48f5a3760d7cca73ad0d5be7cc06df8eb311a36b633938088" Sep 09 23:15:18.380229 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.380152 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e690d300cb7ae1f48f5a3760d7cca73ad0d5be7cc06df8eb311a36b633938088"} err="failed to get container status \"e690d300cb7ae1f48f5a3760d7cca73ad0d5be7cc06df8eb311a36b633938088\": rpc error: code = NotFound desc = could not find container \"e690d300cb7ae1f48f5a3760d7cca73ad0d5be7cc06df8eb311a36b633938088\": container with ID starting with e690d300cb7ae1f48f5a3760d7cca73ad0d5be7cc06df8eb311a36b633938088 not found: ID does not exist" Sep 09 23:15:18.383413 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:18.383389 2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ea73578_3cf2_45bd_8d42_3a0d8869f1c4.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode893fe1f_6d24_4ae0_a802_92ccad9903f8.slice\": RecentStats: unable to find data in memory cache]" Sep 09 23:15:18.393430 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.393393 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b6hlc" podStartSLOduration=1.393379237 podStartE2EDuration="1.393379237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:15:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:15:18.392471952 +0000 UTC m=+702.050127597" watchObservedRunningTime="2026-09-09 23:15:18.393379237 +0000 UTC m=+702.051034880" Sep 09 23:15:18.394346 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:18.394320 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-nqqcr\" is forbidden: User \"system:node:ip-10-0-140-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-137.ec2.internal' and this object" podUID="e893fe1f-6d24-4ae0-a802-92ccad9903f8" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqqcr" Sep 09 23:15:18.396143 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:18.396116 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mmzjt\" is forbidden: User \"system:node:ip-10-0-140-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-137.ec2.internal' and this object" podUID="6f1d90e0-07d9-401d-a0ec-ff7fc191f971" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mmzjt" Sep 09 23:15:18.397954 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:18.397933 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-nlxxg\" is forbidden: User \"system:node:ip-10-0-140-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-137.ec2.internal' and this object" podUID="3ea73578-3cf2-45bd-8d42-3a0d8869f1c4" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-nlxxg" Sep 09 23:15:18.399788 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:18.399770 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-cdmwp\" is forbidden: User \"system:node:ip-10-0-140-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-137.ec2.internal' and this object" podUID="7839c77c-7a34-43a2-8baa-c957c8d20101" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-cdmwp" Sep 09 23:15:18.401342 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:18.401326 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-nqqcr\" is forbidden: User \"system:node:ip-10-0-140-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-137.ec2.internal' and this object" podUID="e893fe1f-6d24-4ae0-a802-92ccad9903f8" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-nqqcr" Sep 09 23:15:18.423584 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.423525 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mfc64" podStartSLOduration=1.423506752 podStartE2EDuration="1.423506752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:15:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:15:18.422093569 +0000 UTC m=+702.079749214" watchObservedRunningTime="2026-09-09 23:15:18.423506752 +0000 UTC m=+702.081162395" Sep 09 23:15:18.838948 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.838912 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ea73578-3cf2-45bd-8d42-3a0d8869f1c4" path="/var/lib/kubelet/pods/3ea73578-3cf2-45bd-8d42-3a0d8869f1c4/volumes" Sep 09 23:15:18.839253 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.839241 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f1d90e0-07d9-401d-a0ec-ff7fc191f971" path="/var/lib/kubelet/pods/6f1d90e0-07d9-401d-a0ec-ff7fc191f971/volumes" Sep 09 23:15:18.839546 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:18.839535 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e893fe1f-6d24-4ae0-a802-92ccad9903f8" path="/var/lib/kubelet/pods/e893fe1f-6d24-4ae0-a802-92ccad9903f8/volumes" Sep 09 23:15:19.364933 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:19.364892 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-cdmwp" podUID="7839c77c-7a34-43a2-8baa-c957c8d20101" containerName="manager" containerID="cri-o://d59ea0d6c80a8a1c0384c201b66be18f9d8b503065a9c6239a540c7649e006e5" gracePeriod=2 Sep 09 23:15:19.597929 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:19.597908 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-cdmwp" Sep 09 23:15:19.792054 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:19.792021 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8bf6\" (UniqueName: \"kubernetes.io/projected/7839c77c-7a34-43a2-8baa-c957c8d20101-kube-api-access-z8bf6\") pod \"7839c77c-7a34-43a2-8baa-c957c8d20101\" (UID: \"7839c77c-7a34-43a2-8baa-c957c8d20101\") " Sep 09 23:15:19.792197 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:19.792154 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7839c77c-7a34-43a2-8baa-c957c8d20101-extensions-socket-volume\") pod \"7839c77c-7a34-43a2-8baa-c957c8d20101\" (UID: \"7839c77c-7a34-43a2-8baa-c957c8d20101\") " Sep 09 23:15:19.792427 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:19.792398 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7839c77c-7a34-43a2-8baa-c957c8d20101-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7839c77c-7a34-43a2-8baa-c957c8d20101" (UID: "7839c77c-7a34-43a2-8baa-c957c8d20101"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:15:19.794066 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:19.794044 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7839c77c-7a34-43a2-8baa-c957c8d20101-kube-api-access-z8bf6" (OuterVolumeSpecName: "kube-api-access-z8bf6") pod "7839c77c-7a34-43a2-8baa-c957c8d20101" (UID: "7839c77c-7a34-43a2-8baa-c957c8d20101"). InnerVolumeSpecName "kube-api-access-z8bf6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:15:19.893010 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:19.892973 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7839c77c-7a34-43a2-8baa-c957c8d20101-extensions-socket-volume\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:15:19.893010 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:19.893002 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8bf6\" (UniqueName: \"kubernetes.io/projected/7839c77c-7a34-43a2-8baa-c957c8d20101-kube-api-access-z8bf6\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:15:20.373417 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:20.373384 2575 generic.go:356] "Generic (PLEG): container finished" podID="7839c77c-7a34-43a2-8baa-c957c8d20101" containerID="d59ea0d6c80a8a1c0384c201b66be18f9d8b503065a9c6239a540c7649e006e5" exitCode=2 Sep 09 23:15:20.373573 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:20.373430 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-cdmwp" Sep 09 23:15:20.373573 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:20.373445 2575 scope.go:117] "RemoveContainer" containerID="d59ea0d6c80a8a1c0384c201b66be18f9d8b503065a9c6239a540c7649e006e5" Sep 09 23:15:20.375491 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:20.375461 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-cdmwp\" is forbidden: User \"system:node:ip-10-0-140-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-137.ec2.internal' and this object" podUID="7839c77c-7a34-43a2-8baa-c957c8d20101" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-cdmwp" Sep 09 23:15:20.381591 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:20.381575 2575 scope.go:117] "RemoveContainer" containerID="d59ea0d6c80a8a1c0384c201b66be18f9d8b503065a9c6239a540c7649e006e5" Sep 09 23:15:20.381874 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:20.381857 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d59ea0d6c80a8a1c0384c201b66be18f9d8b503065a9c6239a540c7649e006e5\": container with ID starting with d59ea0d6c80a8a1c0384c201b66be18f9d8b503065a9c6239a540c7649e006e5 not found: ID does not exist" containerID="d59ea0d6c80a8a1c0384c201b66be18f9d8b503065a9c6239a540c7649e006e5" Sep 09 23:15:20.381923 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:20.381883 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d59ea0d6c80a8a1c0384c201b66be18f9d8b503065a9c6239a540c7649e006e5"} err="failed to get container status \"d59ea0d6c80a8a1c0384c201b66be18f9d8b503065a9c6239a540c7649e006e5\": rpc error: code = NotFound desc = could not find container \"d59ea0d6c80a8a1c0384c201b66be18f9d8b503065a9c6239a540c7649e006e5\": container with ID starting with d59ea0d6c80a8a1c0384c201b66be18f9d8b503065a9c6239a540c7649e006e5 not found: ID does not exist" Sep 09 23:15:20.383030 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:20.383004 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-cdmwp\" is forbidden: User \"system:node:ip-10-0-140-137.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-137.ec2.internal' and this object" podUID="7839c77c-7a34-43a2-8baa-c957c8d20101" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-cdmwp" Sep 09 23:15:20.839231 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:20.839137 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7839c77c-7a34-43a2-8baa-c957c8d20101" path="/var/lib/kubelet/pods/7839c77c-7a34-43a2-8baa-c957c8d20101/volumes" Sep 09 23:15:29.369321 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:29.369247 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b6hlc" Sep 09 23:15:29.369321 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:29.369322 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f86rg" Sep 09 23:15:29.369921 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:29.369355 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mfc64" Sep 09 23:15:29.465788 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:29.465755 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mfc64"] Sep 09 23:15:29.465984 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:29.465954 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mfc64" podUID="15254481-b0f2-419b-a1c6-f303f9c0fa12" containerName="manager" containerID="cri-o://02016f9a3dcd145b28c058d713fa329e9851096e7dc1b6d157a93f115b69fa76" gracePeriod=10 Sep 09 23:15:29.716392 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:29.716362 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mfc64" Sep 09 23:15:29.750434 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:29.750403 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l6vmr"] Sep 09 23:15:29.750749 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:29.750735 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15254481-b0f2-419b-a1c6-f303f9c0fa12" containerName="manager" Sep 09 23:15:29.750804 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:29.750751 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="15254481-b0f2-419b-a1c6-f303f9c0fa12" containerName="manager" Sep 09 23:15:29.750804 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:29.750798 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="15254481-b0f2-419b-a1c6-f303f9c0fa12" containerName="manager" Sep 09 23:15:29.752950 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:29.752926 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l6vmr" Sep 09 23:15:29.757943 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:29.757912 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15254481-b0f2-419b-a1c6-f303f9c0fa12-extensions-socket-volume\") pod \"15254481-b0f2-419b-a1c6-f303f9c0fa12\" (UID: \"15254481-b0f2-419b-a1c6-f303f9c0fa12\") " Sep 09 23:15:29.758089 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:29.757962 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqjkb\" (UniqueName: \"kubernetes.io/projected/15254481-b0f2-419b-a1c6-f303f9c0fa12-kube-api-access-zqjkb\") pod \"15254481-b0f2-419b-a1c6-f303f9c0fa12\" (UID: \"15254481-b0f2-419b-a1c6-f303f9c0fa12\") " Sep 09 23:15:29.758152 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:29.758129 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc235191-fe7e-4ebf-8fc0-a664a8736634-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-l6vmr\" (UID: \"bc235191-fe7e-4ebf-8fc0-a664a8736634\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l6vmr" Sep 09 23:15:29.758287 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:29.758233 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnqm4\" (UniqueName: \"kubernetes.io/projected/bc235191-fe7e-4ebf-8fc0-a664a8736634-kube-api-access-vnqm4\") pod \"kuadrant-operator-controller-manager-5769f99d9f-l6vmr\" (UID: \"bc235191-fe7e-4ebf-8fc0-a664a8736634\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l6vmr" Sep 09 23:15:29.758391 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:29.758368 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15254481-b0f2-419b-a1c6-f303f9c0fa12-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "15254481-b0f2-419b-a1c6-f303f9c0fa12" (UID: "15254481-b0f2-419b-a1c6-f303f9c0fa12"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:15:29.760748 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:29.760720 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15254481-b0f2-419b-a1c6-f303f9c0fa12-kube-api-access-zqjkb" (OuterVolumeSpecName: "kube-api-access-zqjkb") pod "15254481-b0f2-419b-a1c6-f303f9c0fa12" (UID: "15254481-b0f2-419b-a1c6-f303f9c0fa12"). InnerVolumeSpecName "kube-api-access-zqjkb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:15:29.767069 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:29.767050 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l6vmr"] Sep 09 23:15:29.858614 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:29.858579 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc235191-fe7e-4ebf-8fc0-a664a8736634-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-l6vmr\" (UID: \"bc235191-fe7e-4ebf-8fc0-a664a8736634\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l6vmr" Sep 09 23:15:29.858779 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:29.858627 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnqm4\" (UniqueName: \"kubernetes.io/projected/bc235191-fe7e-4ebf-8fc0-a664a8736634-kube-api-access-vnqm4\") pod \"kuadrant-operator-controller-manager-5769f99d9f-l6vmr\" (UID: \"bc235191-fe7e-4ebf-8fc0-a664a8736634\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l6vmr" Sep 09 23:15:29.858779 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:29.858666 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15254481-b0f2-419b-a1c6-f303f9c0fa12-extensions-socket-volume\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:15:29.858779 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:29.858677 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqjkb\" (UniqueName: \"kubernetes.io/projected/15254481-b0f2-419b-a1c6-f303f9c0fa12-kube-api-access-zqjkb\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:15:29.859011 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:29.858992 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc235191-fe7e-4ebf-8fc0-a664a8736634-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-l6vmr\" (UID: \"bc235191-fe7e-4ebf-8fc0-a664a8736634\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l6vmr" Sep 09 23:15:29.871306 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:29.871276 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnqm4\" (UniqueName: \"kubernetes.io/projected/bc235191-fe7e-4ebf-8fc0-a664a8736634-kube-api-access-vnqm4\") pod \"kuadrant-operator-controller-manager-5769f99d9f-l6vmr\" (UID: \"bc235191-fe7e-4ebf-8fc0-a664a8736634\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l6vmr" Sep 09 23:15:30.069970 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:30.069886 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l6vmr" Sep 09 23:15:30.345388 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:30.345362 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l6vmr"] Sep 09 23:15:30.347763 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:15:30.347736 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc235191_fe7e_4ebf_8fc0_a664a8736634.slice/crio-66c886223891ab92093e305b6e023c3fe59b36576233390ffe6e4fd498372136 WatchSource:0}: Error finding container 66c886223891ab92093e305b6e023c3fe59b36576233390ffe6e4fd498372136: Status 404 returned error can't find the container with id 66c886223891ab92093e305b6e023c3fe59b36576233390ffe6e4fd498372136 Sep 09 23:15:30.421598 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:30.421568 2575 generic.go:356] "Generic (PLEG): container finished" podID="15254481-b0f2-419b-a1c6-f303f9c0fa12" containerID="02016f9a3dcd145b28c058d713fa329e9851096e7dc1b6d157a93f115b69fa76" exitCode=0 Sep 09 23:15:30.422065 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:30.421619 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mfc64" Sep 09 23:15:30.422065 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:30.421647 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mfc64" event={"ID":"15254481-b0f2-419b-a1c6-f303f9c0fa12","Type":"ContainerDied","Data":"02016f9a3dcd145b28c058d713fa329e9851096e7dc1b6d157a93f115b69fa76"} Sep 09 23:15:30.422065 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:30.421717 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mfc64" event={"ID":"15254481-b0f2-419b-a1c6-f303f9c0fa12","Type":"ContainerDied","Data":"fd5cc546f12261e28ead364627e9d7cf760fad30c9d7ccf6e3d385a65118e72e"} Sep 09 23:15:30.422065 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:30.421752 2575 scope.go:117] "RemoveContainer" containerID="02016f9a3dcd145b28c058d713fa329e9851096e7dc1b6d157a93f115b69fa76" Sep 09 23:15:30.423778 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:30.423754 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l6vmr" event={"ID":"bc235191-fe7e-4ebf-8fc0-a664a8736634","Type":"ContainerStarted","Data":"6462ae4dad8584960917963650c4028d1798d80d78a05b5f3d2c393562e3c293"} Sep 09 23:15:30.423917 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:30.423804 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l6vmr" event={"ID":"bc235191-fe7e-4ebf-8fc0-a664a8736634","Type":"ContainerStarted","Data":"66c886223891ab92093e305b6e023c3fe59b36576233390ffe6e4fd498372136"} Sep 09 23:15:30.423917 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:30.423857 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l6vmr" Sep 09 23:15:30.430997 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:30.430982 2575 scope.go:117] "RemoveContainer" containerID="02016f9a3dcd145b28c058d713fa329e9851096e7dc1b6d157a93f115b69fa76" Sep 09 23:15:30.431287 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:30.431266 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02016f9a3dcd145b28c058d713fa329e9851096e7dc1b6d157a93f115b69fa76\": container with ID starting with 02016f9a3dcd145b28c058d713fa329e9851096e7dc1b6d157a93f115b69fa76 not found: ID does not exist" containerID="02016f9a3dcd145b28c058d713fa329e9851096e7dc1b6d157a93f115b69fa76" Sep 09 23:15:30.431355 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:30.431294 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02016f9a3dcd145b28c058d713fa329e9851096e7dc1b6d157a93f115b69fa76"} err="failed to get container status \"02016f9a3dcd145b28c058d713fa329e9851096e7dc1b6d157a93f115b69fa76\": rpc error: code = NotFound desc = could not find container \"02016f9a3dcd145b28c058d713fa329e9851096e7dc1b6d157a93f115b69fa76\": container with ID starting with 02016f9a3dcd145b28c058d713fa329e9851096e7dc1b6d157a93f115b69fa76 not found: ID does not exist" Sep 09 23:15:30.447860 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:30.447802 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l6vmr" podStartSLOduration=1.447786592 podStartE2EDuration="1.447786592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:15:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:15:30.446379267 +0000 UTC m=+714.104034912" watchObservedRunningTime="2026-09-09 23:15:30.447786592 +0000 UTC m=+714.105442236" Sep 09 23:15:30.462716 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:30.462690 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mfc64"] Sep 09 23:15:30.465974 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:30.465954 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mfc64"] Sep 09 23:15:30.838243 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:30.838206 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15254481-b0f2-419b-a1c6-f303f9c0fa12" path="/var/lib/kubelet/pods/15254481-b0f2-419b-a1c6-f303f9c0fa12/volumes" Sep 09 23:15:41.431760 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:41.431729 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-l6vmr" Sep 09 23:15:41.508084 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:41.508053 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b6hlc"] Sep 09 23:15:41.508308 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:41.508283 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b6hlc" podUID="3642e02d-c236-4ba5-aeed-5591ee0e6193" containerName="manager" containerID="cri-o://a4ed92a29247aba51a991a854c4ebdc355d5a290e3be50c86ae63912d3b87b52" gracePeriod=10 Sep 09 23:15:41.747995 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:41.747974 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b6hlc" Sep 09 23:15:41.852386 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:41.852353 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghwxn\" (UniqueName: \"kubernetes.io/projected/3642e02d-c236-4ba5-aeed-5591ee0e6193-kube-api-access-ghwxn\") pod \"3642e02d-c236-4ba5-aeed-5591ee0e6193\" (UID: \"3642e02d-c236-4ba5-aeed-5591ee0e6193\") " Sep 09 23:15:41.852523 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:41.852396 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3642e02d-c236-4ba5-aeed-5591ee0e6193-extensions-socket-volume\") pod \"3642e02d-c236-4ba5-aeed-5591ee0e6193\" (UID: \"3642e02d-c236-4ba5-aeed-5591ee0e6193\") " Sep 09 23:15:41.852792 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:41.852766 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3642e02d-c236-4ba5-aeed-5591ee0e6193-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3642e02d-c236-4ba5-aeed-5591ee0e6193" (UID: "3642e02d-c236-4ba5-aeed-5591ee0e6193"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:15:41.854415 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:41.854393 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3642e02d-c236-4ba5-aeed-5591ee0e6193-kube-api-access-ghwxn" (OuterVolumeSpecName: "kube-api-access-ghwxn") pod "3642e02d-c236-4ba5-aeed-5591ee0e6193" (UID: "3642e02d-c236-4ba5-aeed-5591ee0e6193"). InnerVolumeSpecName "kube-api-access-ghwxn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:15:41.953665 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:41.953635 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghwxn\" (UniqueName: \"kubernetes.io/projected/3642e02d-c236-4ba5-aeed-5591ee0e6193-kube-api-access-ghwxn\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:15:41.953665 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:41.953660 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3642e02d-c236-4ba5-aeed-5591ee0e6193-extensions-socket-volume\") on node \"ip-10-0-140-137.ec2.internal\" DevicePath \"\"" Sep 09 23:15:42.481995 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:42.481963 2575 generic.go:356] "Generic (PLEG): container finished" podID="3642e02d-c236-4ba5-aeed-5591ee0e6193" containerID="a4ed92a29247aba51a991a854c4ebdc355d5a290e3be50c86ae63912d3b87b52" exitCode=0 Sep 09 23:15:42.482345 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:42.482011 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b6hlc" Sep 09 23:15:42.482345 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:42.482038 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b6hlc" event={"ID":"3642e02d-c236-4ba5-aeed-5591ee0e6193","Type":"ContainerDied","Data":"a4ed92a29247aba51a991a854c4ebdc355d5a290e3be50c86ae63912d3b87b52"} Sep 09 23:15:42.482345 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:42.482080 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b6hlc" event={"ID":"3642e02d-c236-4ba5-aeed-5591ee0e6193","Type":"ContainerDied","Data":"ba17ff23e8fd2d025351fe9dc3212e8f2ee67b2c82f1a635c9ed46960f16e5d3"} Sep 09 23:15:42.482345 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:42.482101 2575 scope.go:117] "RemoveContainer" containerID="a4ed92a29247aba51a991a854c4ebdc355d5a290e3be50c86ae63912d3b87b52" Sep 09 23:15:42.490455 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:42.490437 2575 scope.go:117] "RemoveContainer" containerID="a4ed92a29247aba51a991a854c4ebdc355d5a290e3be50c86ae63912d3b87b52" Sep 09 23:15:42.490721 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:15:42.490703 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4ed92a29247aba51a991a854c4ebdc355d5a290e3be50c86ae63912d3b87b52\": container with ID starting with a4ed92a29247aba51a991a854c4ebdc355d5a290e3be50c86ae63912d3b87b52 not found: ID does not exist" containerID="a4ed92a29247aba51a991a854c4ebdc355d5a290e3be50c86ae63912d3b87b52" Sep 09 23:15:42.490765 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:42.490733 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4ed92a29247aba51a991a854c4ebdc355d5a290e3be50c86ae63912d3b87b52"} err="failed to get container status \"a4ed92a29247aba51a991a854c4ebdc355d5a290e3be50c86ae63912d3b87b52\": rpc error: code = NotFound desc = could not find container \"a4ed92a29247aba51a991a854c4ebdc355d5a290e3be50c86ae63912d3b87b52\": container with ID starting with a4ed92a29247aba51a991a854c4ebdc355d5a290e3be50c86ae63912d3b87b52 not found: ID does not exist" Sep 09 23:15:42.501609 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:42.501585 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b6hlc"] Sep 09 23:15:42.505240 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:42.505220 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-b6hlc"] Sep 09 23:15:42.837758 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:42.837679 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3642e02d-c236-4ba5-aeed-5591ee0e6193" path="/var/lib/kubelet/pods/3642e02d-c236-4ba5-aeed-5591ee0e6193/volumes" Sep 09 23:15:59.957961 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:59.957921 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-b4tgt"] Sep 09 23:15:59.958341 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:59.958219 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3642e02d-c236-4ba5-aeed-5591ee0e6193" containerName="manager" Sep 09 23:15:59.958341 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:59.958232 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3642e02d-c236-4ba5-aeed-5591ee0e6193" containerName="manager" Sep 09 23:15:59.958341 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:59.958296 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3642e02d-c236-4ba5-aeed-5591ee0e6193" containerName="manager" Sep 09 23:15:59.962516 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:59.962496 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-b4tgt" Sep 09 23:15:59.964587 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:59.964558 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bp97q\"" Sep 09 23:15:59.964690 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:59.964609 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 09 23:15:59.967877 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:59.967855 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-b4tgt"] Sep 09 23:15:59.992542 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:15:59.992518 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-b4tgt"] Sep 09 23:16:00.092186 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:16:00.092156 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d578b89a-0445-4d82-9ef8-6e8a3fb476d0-config-file\") pod \"limitador-limitador-84994f7ffc-b4tgt\" (UID: \"d578b89a-0445-4d82-9ef8-6e8a3fb476d0\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-b4tgt" Sep 09 23:16:00.092186 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:16:00.092188 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lddft\" (UniqueName: \"kubernetes.io/projected/d578b89a-0445-4d82-9ef8-6e8a3fb476d0-kube-api-access-lddft\") pod \"limitador-limitador-84994f7ffc-b4tgt\" (UID: \"d578b89a-0445-4d82-9ef8-6e8a3fb476d0\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-b4tgt" Sep 09 23:16:00.193268 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:16:00.193237 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d578b89a-0445-4d82-9ef8-6e8a3fb476d0-config-file\") pod \"limitador-limitador-84994f7ffc-b4tgt\" (UID: \"d578b89a-0445-4d82-9ef8-6e8a3fb476d0\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-b4tgt" Sep 09 23:16:00.193268 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:16:00.193269 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lddft\" (UniqueName: \"kubernetes.io/projected/d578b89a-0445-4d82-9ef8-6e8a3fb476d0-kube-api-access-lddft\") pod \"limitador-limitador-84994f7ffc-b4tgt\" (UID: \"d578b89a-0445-4d82-9ef8-6e8a3fb476d0\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-b4tgt" Sep 09 23:16:00.193947 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:16:00.193927 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d578b89a-0445-4d82-9ef8-6e8a3fb476d0-config-file\") pod \"limitador-limitador-84994f7ffc-b4tgt\" (UID: \"d578b89a-0445-4d82-9ef8-6e8a3fb476d0\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-b4tgt" Sep 09 23:16:00.200673 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:16:00.200651 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lddft\" (UniqueName: \"kubernetes.io/projected/d578b89a-0445-4d82-9ef8-6e8a3fb476d0-kube-api-access-lddft\") pod \"limitador-limitador-84994f7ffc-b4tgt\" (UID: \"d578b89a-0445-4d82-9ef8-6e8a3fb476d0\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-b4tgt" Sep 09 23:16:00.273263 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:16:00.273203 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-b4tgt" Sep 09 23:16:00.546188 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:16:00.546118 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-b4tgt"] Sep 09 23:16:00.549077 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:16:00.549048 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd578b89a_0445_4d82_9ef8_6e8a3fb476d0.slice/crio-723fd3290d96516870a5ccebfc58007ce3b17d6413c0ecd75f4a3c0732bd71cf WatchSource:0}: Error finding container 723fd3290d96516870a5ccebfc58007ce3b17d6413c0ecd75f4a3c0732bd71cf: Status 404 returned error can't find the container with id 723fd3290d96516870a5ccebfc58007ce3b17d6413c0ecd75f4a3c0732bd71cf Sep 09 23:16:00.562386 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:16:00.562354 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-b4tgt" event={"ID":"d578b89a-0445-4d82-9ef8-6e8a3fb476d0","Type":"ContainerStarted","Data":"723fd3290d96516870a5ccebfc58007ce3b17d6413c0ecd75f4a3c0732bd71cf"} Sep 09 23:16:01.567787 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:16:01.567744 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-b4tgt" event={"ID":"d578b89a-0445-4d82-9ef8-6e8a3fb476d0","Type":"ContainerStarted","Data":"df1ed4310fe28886bbe5618c34c7a82146e9ab1c9259fd8ad6a8e4d83e386a44"} Sep 09 23:16:01.568165 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:16:01.567874 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-b4tgt" Sep 09 23:16:01.583408 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:16:01.583356 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-b4tgt" podStartSLOduration=1.705416929 podStartE2EDuration="2.583340885s" totalImagesPullingTime="877.923956ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:15:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:16:01.581630774 +0000 UTC m=+745.239286446" watchObservedRunningTime="2026-09-09 23:16:01.583340885 +0000 UTC m=+745.240996528" Sep 09 23:16:12.573958 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:16:12.573929 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-b4tgt" Sep 09 23:17:11.317904 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:17:11.317812 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-b4tgt"] Sep 09 23:17:44.572920 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:17:44.572882 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-b4tgt"] Sep 09 23:17:58.162651 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:17:58.162615 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-b4tgt"] Sep 09 23:18:08.890384 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:08.890353 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b"] Sep 09 23:18:08.893607 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:08.893588 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b" Sep 09 23:18:08.897198 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:08.897167 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\"" Sep 09 23:18:08.897305 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:08.897171 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 09 23:18:08.897305 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:08.897209 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jr9l5\"" Sep 09 23:18:08.897493 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:08.897480 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 09 23:18:08.903681 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:08.903662 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b"] Sep 09 23:18:08.981501 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:08.981474 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b\" (UID: \"cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b" Sep 09 23:18:08.981631 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:08.981510 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b\" (UID: \"cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b" Sep 09 23:18:08.981631 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:08.981530 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b\" (UID: \"cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b" Sep 09 23:18:08.981714 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:08.981670 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b\" (UID: \"cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b" Sep 09 23:18:08.981755 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:08.981735 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b\" (UID: \"cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b" Sep 09 23:18:08.981921 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:08.981887 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g6pq\" (UniqueName: \"kubernetes.io/projected/cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3-kube-api-access-4g6pq\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b\" (UID: \"cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b" Sep 09 23:18:09.082489 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:09.082453 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b\" (UID: \"cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b" Sep 09 23:18:09.082489 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:09.082488 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b\" (UID: \"cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b" Sep 09 23:18:09.082698 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:09.082508 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b\" (UID: \"cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b" Sep 09 23:18:09.082698 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:09.082630 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b\" (UID: \"cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b" Sep 09 23:18:09.082698 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:09.082677 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g6pq\" (UniqueName: \"kubernetes.io/projected/cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3-kube-api-access-4g6pq\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b\" (UID: \"cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b" Sep 09 23:18:09.082810 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:09.082742 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b\" (UID: \"cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b" Sep 09 23:18:09.082956 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:09.082932 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b\" (UID: \"cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b" Sep 09 23:18:09.083035 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:09.082983 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b\" (UID: \"cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b" Sep 09 23:18:09.083185 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:09.083164 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b\" (UID: \"cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b" Sep 09 23:18:09.084948 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:09.084931 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b\" (UID: \"cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b" Sep 09 23:18:09.085227 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:09.085206 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b\" (UID: \"cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b" Sep 09 23:18:09.089956 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:09.089931 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g6pq\" (UniqueName: \"kubernetes.io/projected/cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3-kube-api-access-4g6pq\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b\" (UID: \"cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b" Sep 09 23:18:09.204170 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:09.204103 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b" Sep 09 23:18:09.474026 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:09.473875 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b"] Sep 09 23:18:09.476095 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:18:09.476064 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd1f022a_bb3a_4dd2_a8b4_a5dba03e9cd3.slice/crio-35a817c62742a47721c0a4778eb6aeecf7c01fd044592fe6acfd36866705bd6f WatchSource:0}: Error finding container 35a817c62742a47721c0a4778eb6aeecf7c01fd044592fe6acfd36866705bd6f: Status 404 returned error can't find the container with id 35a817c62742a47721c0a4778eb6aeecf7c01fd044592fe6acfd36866705bd6f Sep 09 23:18:09.763474 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:09.763391 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-b4tgt"] Sep 09 23:18:10.109032 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:10.108956 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b" event={"ID":"cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3","Type":"ContainerStarted","Data":"35a817c62742a47721c0a4778eb6aeecf7c01fd044592fe6acfd36866705bd6f"} Sep 09 23:18:11.115627 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:11.115591 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b" event={"ID":"cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3","Type":"ContainerStarted","Data":"7b7fe46dd5f947ecd6f260ae3eb8a986e8ca50f85150f2d824318c021b6a3322"} Sep 09 23:18:11.137130 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:11.137081 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b" podStartSLOduration=2.176294798 podStartE2EDuration="3.137047304s" totalImagesPullingTime="960.752506ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:18:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:18:11.135934872 +0000 UTC m=+874.793590517" watchObservedRunningTime="2026-09-09 23:18:11.137047304 +0000 UTC m=+874.794702938" Sep 09 23:18:19.204431 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:19.204400 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b" Sep 09 23:18:19.204851 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:19.204455 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b" Sep 09 23:18:19.216794 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:19.216772 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b" Sep 09 23:18:20.166721 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:20.166693 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b" Sep 09 23:18:20.667629 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:20.667594 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-b4tgt"] Sep 09 23:18:24.082530 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:24.082496 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn"] Sep 09 23:18:24.087941 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:24.087919 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn" Sep 09 23:18:24.091388 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:24.091349 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Sep 09 23:18:24.093159 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:24.093131 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn"] Sep 09 23:18:24.209666 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:24.209638 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ac3cef6-f4a1-487e-8d37-6c66ac3cc456-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn\" (UID: \"4ac3cef6-f4a1-487e-8d37-6c66ac3cc456\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn" Sep 09 23:18:24.209805 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:24.209696 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pzlx\" (UniqueName: \"kubernetes.io/projected/4ac3cef6-f4a1-487e-8d37-6c66ac3cc456-kube-api-access-7pzlx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn\" (UID: \"4ac3cef6-f4a1-487e-8d37-6c66ac3cc456\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn" Sep 09 23:18:24.209805 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:24.209722 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ac3cef6-f4a1-487e-8d37-6c66ac3cc456-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn\" (UID: \"4ac3cef6-f4a1-487e-8d37-6c66ac3cc456\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn" Sep 09 23:18:24.209805 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:24.209740 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ac3cef6-f4a1-487e-8d37-6c66ac3cc456-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn\" (UID: \"4ac3cef6-f4a1-487e-8d37-6c66ac3cc456\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn" Sep 09 23:18:24.209805 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:24.209757 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ac3cef6-f4a1-487e-8d37-6c66ac3cc456-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn\" (UID: \"4ac3cef6-f4a1-487e-8d37-6c66ac3cc456\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn" Sep 09 23:18:24.209805 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:24.209798 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ac3cef6-f4a1-487e-8d37-6c66ac3cc456-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn\" (UID: \"4ac3cef6-f4a1-487e-8d37-6c66ac3cc456\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn" Sep 09 23:18:24.310169 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:24.310139 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pzlx\" (UniqueName: \"kubernetes.io/projected/4ac3cef6-f4a1-487e-8d37-6c66ac3cc456-kube-api-access-7pzlx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn\" (UID: \"4ac3cef6-f4a1-487e-8d37-6c66ac3cc456\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn" Sep 09 23:18:24.310286 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:24.310176 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ac3cef6-f4a1-487e-8d37-6c66ac3cc456-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn\" (UID: \"4ac3cef6-f4a1-487e-8d37-6c66ac3cc456\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn" Sep 09 23:18:24.310286 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:24.310195 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ac3cef6-f4a1-487e-8d37-6c66ac3cc456-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn\" (UID: \"4ac3cef6-f4a1-487e-8d37-6c66ac3cc456\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn" Sep 09 23:18:24.310286 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:24.310212 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ac3cef6-f4a1-487e-8d37-6c66ac3cc456-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn\" (UID: \"4ac3cef6-f4a1-487e-8d37-6c66ac3cc456\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn" Sep 09 23:18:24.310286 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:24.310245 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ac3cef6-f4a1-487e-8d37-6c66ac3cc456-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn\" (UID: \"4ac3cef6-f4a1-487e-8d37-6c66ac3cc456\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn" Sep 09 23:18:24.310286 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:24.310274 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ac3cef6-f4a1-487e-8d37-6c66ac3cc456-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn\" (UID: \"4ac3cef6-f4a1-487e-8d37-6c66ac3cc456\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn" Sep 09 23:18:24.310607 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:24.310583 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ac3cef6-f4a1-487e-8d37-6c66ac3cc456-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn\" (UID: \"4ac3cef6-f4a1-487e-8d37-6c66ac3cc456\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn" Sep 09 23:18:24.310607 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:24.310596 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ac3cef6-f4a1-487e-8d37-6c66ac3cc456-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn\" (UID: \"4ac3cef6-f4a1-487e-8d37-6c66ac3cc456\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn" Sep 09 23:18:24.310723 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:24.310670 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ac3cef6-f4a1-487e-8d37-6c66ac3cc456-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn\" (UID: \"4ac3cef6-f4a1-487e-8d37-6c66ac3cc456\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn" Sep 09 23:18:24.312472 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:24.312450 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ac3cef6-f4a1-487e-8d37-6c66ac3cc456-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn\" (UID: \"4ac3cef6-f4a1-487e-8d37-6c66ac3cc456\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn" Sep 09 23:18:24.312648 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:24.312632 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ac3cef6-f4a1-487e-8d37-6c66ac3cc456-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn\" (UID: \"4ac3cef6-f4a1-487e-8d37-6c66ac3cc456\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn" Sep 09 23:18:24.317728 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:24.317707 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pzlx\" (UniqueName: \"kubernetes.io/projected/4ac3cef6-f4a1-487e-8d37-6c66ac3cc456-kube-api-access-7pzlx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn\" (UID: \"4ac3cef6-f4a1-487e-8d37-6c66ac3cc456\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn" Sep 09 23:18:24.418506 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:24.418479 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn" Sep 09 23:18:24.687494 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:24.687468 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn"] Sep 09 23:18:24.689906 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:18:24.689881 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ac3cef6_f4a1_487e_8d37_6c66ac3cc456.slice/crio-a1c7bcf181b96be4a1679f6be7fd96cca0dd5ab6b7f3827077eda3daf7530443 WatchSource:0}: Error finding container a1c7bcf181b96be4a1679f6be7fd96cca0dd5ab6b7f3827077eda3daf7530443: Status 404 returned error can't find the container with id a1c7bcf181b96be4a1679f6be7fd96cca0dd5ab6b7f3827077eda3daf7530443 Sep 09 23:18:25.178703 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:25.178669 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn" event={"ID":"4ac3cef6-f4a1-487e-8d37-6c66ac3cc456","Type":"ContainerStarted","Data":"c522324807d7020c730e3fee14d882c7460557481aad93774068c3b4c0852541"} Sep 09 23:18:25.179115 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:25.178720 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn" event={"ID":"4ac3cef6-f4a1-487e-8d37-6c66ac3cc456","Type":"ContainerStarted","Data":"a1c7bcf181b96be4a1679f6be7fd96cca0dd5ab6b7f3827077eda3daf7530443"} Sep 09 23:18:25.193495 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:25.193450 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn" podStartSLOduration=1.011391313 podStartE2EDuration="1.193436721s" totalImagesPullingTime="182.045408ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:18:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:18:25.192515586 +0000 UTC m=+888.850171247" watchObservedRunningTime="2026-09-09 23:18:25.193436721 +0000 UTC m=+888.851092364" Sep 09 23:18:25.670243 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:25.670210 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-b4tgt"] Sep 09 23:18:33.390336 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:33.390305 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw"] Sep 09 23:18:33.393627 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:33.393604 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:18:33.396267 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:33.396247 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Sep 09 23:18:33.405304 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:33.405281 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw"] Sep 09 23:18:33.577885 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:33.577854 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/278a680b-ea5b-4bc0-b490-ee083c586baf-dshm\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw\" (UID: \"278a680b-ea5b-4bc0-b490-ee083c586baf\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:18:33.577885 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:33.577889 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/278a680b-ea5b-4bc0-b490-ee083c586baf-model-cache\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw\" (UID: \"278a680b-ea5b-4bc0-b490-ee083c586baf\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:18:33.578079 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:33.577964 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/278a680b-ea5b-4bc0-b490-ee083c586baf-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw\" (UID: \"278a680b-ea5b-4bc0-b490-ee083c586baf\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:18:33.578079 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:33.577994 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vphc4\" (UniqueName: \"kubernetes.io/projected/278a680b-ea5b-4bc0-b490-ee083c586baf-kube-api-access-vphc4\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw\" (UID: \"278a680b-ea5b-4bc0-b490-ee083c586baf\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:18:33.578079 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:33.578045 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/278a680b-ea5b-4bc0-b490-ee083c586baf-home\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw\" (UID: \"278a680b-ea5b-4bc0-b490-ee083c586baf\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:18:33.578079 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:33.578076 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/278a680b-ea5b-4bc0-b490-ee083c586baf-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw\" (UID: \"278a680b-ea5b-4bc0-b490-ee083c586baf\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:18:33.678579 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:33.678504 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/278a680b-ea5b-4bc0-b490-ee083c586baf-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw\" (UID: \"278a680b-ea5b-4bc0-b490-ee083c586baf\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:18:33.678579 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:33.678536 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vphc4\" (UniqueName: \"kubernetes.io/projected/278a680b-ea5b-4bc0-b490-ee083c586baf-kube-api-access-vphc4\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw\" (UID: \"278a680b-ea5b-4bc0-b490-ee083c586baf\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:18:33.678579 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:33.678568 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/278a680b-ea5b-4bc0-b490-ee083c586baf-home\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw\" (UID: \"278a680b-ea5b-4bc0-b490-ee083c586baf\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:18:33.678863 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:33.678592 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/278a680b-ea5b-4bc0-b490-ee083c586baf-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw\" (UID: \"278a680b-ea5b-4bc0-b490-ee083c586baf\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:18:33.678863 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:33.678615 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/278a680b-ea5b-4bc0-b490-ee083c586baf-dshm\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw\" (UID: \"278a680b-ea5b-4bc0-b490-ee083c586baf\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:18:33.678863 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:33.678631 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/278a680b-ea5b-4bc0-b490-ee083c586baf-model-cache\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw\" (UID: \"278a680b-ea5b-4bc0-b490-ee083c586baf\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:18:33.678990 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:33.678931 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/278a680b-ea5b-4bc0-b490-ee083c586baf-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw\" (UID: \"278a680b-ea5b-4bc0-b490-ee083c586baf\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:18:33.679032 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:33.678981 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/278a680b-ea5b-4bc0-b490-ee083c586baf-model-cache\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw\" (UID: \"278a680b-ea5b-4bc0-b490-ee083c586baf\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:18:33.679065 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:33.679039 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/278a680b-ea5b-4bc0-b490-ee083c586baf-home\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw\" (UID: \"278a680b-ea5b-4bc0-b490-ee083c586baf\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:18:33.680953 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:33.680932 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/278a680b-ea5b-4bc0-b490-ee083c586baf-dshm\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw\" (UID: \"278a680b-ea5b-4bc0-b490-ee083c586baf\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:18:33.681201 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:33.681184 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/278a680b-ea5b-4bc0-b490-ee083c586baf-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw\" (UID: \"278a680b-ea5b-4bc0-b490-ee083c586baf\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:18:33.685906 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:33.685886 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vphc4\" (UniqueName: \"kubernetes.io/projected/278a680b-ea5b-4bc0-b490-ee083c586baf-kube-api-access-vphc4\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw\" (UID: \"278a680b-ea5b-4bc0-b490-ee083c586baf\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:18:33.705751 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:33.705728 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:18:33.975146 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:33.975118 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw"] Sep 09 23:18:33.977039 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:18:33.977007 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod278a680b_ea5b_4bc0_b490_ee083c586baf.slice/crio-0af2b1b9cda39938953c40621e13b440a295dd650b453610d9294960ce0e093a WatchSource:0}: Error finding container 0af2b1b9cda39938953c40621e13b440a295dd650b453610d9294960ce0e093a: Status 404 returned error can't find the container with id 0af2b1b9cda39938953c40621e13b440a295dd650b453610d9294960ce0e093a Sep 09 23:18:34.224062 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:34.223996 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" event={"ID":"278a680b-ea5b-4bc0-b490-ee083c586baf","Type":"ContainerStarted","Data":"73275d3fe5b9cc45ee179754675166435f2edef9efb72a813ff53cf8927343eb"} Sep 09 23:18:34.224159 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:34.224066 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" event={"ID":"278a680b-ea5b-4bc0-b490-ee083c586baf","Type":"ContainerStarted","Data":"0af2b1b9cda39938953c40621e13b440a295dd650b453610d9294960ce0e093a"} Sep 09 23:18:34.239792 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:34.239744 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" podStartSLOduration=1.057315513 podStartE2EDuration="1.239724155s" totalImagesPullingTime="182.408642ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:18:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:18:34.238256816 +0000 UTC m=+897.895912459" watchObservedRunningTime="2026-09-09 23:18:34.239724155 +0000 UTC m=+897.897379799" Sep 09 23:18:34.418735 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:34.418699 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn" Sep 09 23:18:34.419205 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:34.418799 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn" Sep 09 23:18:34.431553 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:34.431525 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn" Sep 09 23:18:35.169450 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:35.169416 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-b4tgt"] Sep 09 23:18:35.229975 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:35.229939 2575 generic.go:356] "Generic (PLEG): container finished" podID="278a680b-ea5b-4bc0-b490-ee083c586baf" containerID="73275d3fe5b9cc45ee179754675166435f2edef9efb72a813ff53cf8927343eb" exitCode=0 Sep 09 23:18:35.230140 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:35.230023 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" event={"ID":"278a680b-ea5b-4bc0-b490-ee083c586baf","Type":"ContainerDied","Data":"73275d3fe5b9cc45ee179754675166435f2edef9efb72a813ff53cf8927343eb"} Sep 09 23:18:35.230290 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:35.230277 2575 scope.go:117] "RemoveContainer" containerID="73275d3fe5b9cc45ee179754675166435f2edef9efb72a813ff53cf8927343eb" Sep 09 23:18:35.241625 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:35.241606 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn" Sep 09 23:18:36.236546 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:36.236498 2575 generic.go:356] "Generic (PLEG): container finished" podID="278a680b-ea5b-4bc0-b490-ee083c586baf" containerID="a6aa9dda31e24327101455bcd7a6917ccb0fd2b83a5e53881988ff8681918bd4" exitCode=0 Sep 09 23:18:36.237007 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:36.236550 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" event={"ID":"278a680b-ea5b-4bc0-b490-ee083c586baf","Type":"ContainerDied","Data":"a6aa9dda31e24327101455bcd7a6917ccb0fd2b83a5e53881988ff8681918bd4"} Sep 09 23:18:36.237007 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:36.236614 2575 scope.go:117] "RemoveContainer" containerID="73275d3fe5b9cc45ee179754675166435f2edef9efb72a813ff53cf8927343eb" Sep 09 23:18:36.237007 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:36.236929 2575 scope.go:117] "RemoveContainer" containerID="a6aa9dda31e24327101455bcd7a6917ccb0fd2b83a5e53881988ff8681918bd4" Sep 09 23:18:36.237164 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:18:36.237137 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw_llm(278a680b-ea5b-4bc0-b490-ee083c586baf)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" podUID="278a680b-ea5b-4bc0-b490-ee083c586baf" Sep 09 23:18:36.786255 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:36.786230 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6gsr_01cc3a72-4b5d-4af7-9db4-219af2288772/ovn-acl-logging/0.log" Sep 09 23:18:36.786424 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:36.786357 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6gsr_01cc3a72-4b5d-4af7-9db4-219af2288772/ovn-acl-logging/0.log" Sep 09 23:18:37.242486 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:37.242454 2575 scope.go:117] "RemoveContainer" containerID="a6aa9dda31e24327101455bcd7a6917ccb0fd2b83a5e53881988ff8681918bd4" Sep 09 23:18:37.242956 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:18:37.242658 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw_llm(278a680b-ea5b-4bc0-b490-ee083c586baf)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" podUID="278a680b-ea5b-4bc0-b490-ee083c586baf" Sep 09 23:18:43.466539 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:43.466503 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-b4tgt"] Sep 09 23:18:43.706204 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:43.706168 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:18:43.706387 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:43.706230 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:18:43.706387 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:43.706250 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:18:43.706387 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:43.706268 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:18:43.706688 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:43.706671 2575 scope.go:117] "RemoveContainer" containerID="a6aa9dda31e24327101455bcd7a6917ccb0fd2b83a5e53881988ff8681918bd4" Sep 09 23:18:43.706909 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:18:43.706886 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw_llm(278a680b-ea5b-4bc0-b490-ee083c586baf)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" podUID="278a680b-ea5b-4bc0-b490-ee083c586baf" Sep 09 23:18:56.836249 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:56.836214 2575 scope.go:117] "RemoveContainer" containerID="a6aa9dda31e24327101455bcd7a6917ccb0fd2b83a5e53881988ff8681918bd4" Sep 09 23:18:57.333024 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:57.332989 2575 generic.go:356] "Generic (PLEG): container finished" podID="278a680b-ea5b-4bc0-b490-ee083c586baf" containerID="85d6cca1505aad5a3c5806a8a4242d743d43d284412f10ae1500d8875802f799" exitCode=0 Sep 09 23:18:57.333174 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:57.333066 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" event={"ID":"278a680b-ea5b-4bc0-b490-ee083c586baf","Type":"ContainerDied","Data":"85d6cca1505aad5a3c5806a8a4242d743d43d284412f10ae1500d8875802f799"} Sep 09 23:18:57.333174 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:57.333131 2575 scope.go:117] "RemoveContainer" containerID="a6aa9dda31e24327101455bcd7a6917ccb0fd2b83a5e53881988ff8681918bd4" Sep 09 23:18:57.333439 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:18:57.333419 2575 scope.go:117] "RemoveContainer" containerID="85d6cca1505aad5a3c5806a8a4242d743d43d284412f10ae1500d8875802f799" Sep 09 23:18:57.333620 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:18:57.333603 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw_llm(278a680b-ea5b-4bc0-b490-ee083c586baf)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" podUID="278a680b-ea5b-4bc0-b490-ee083c586baf" Sep 09 23:19:03.706335 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:19:03.706293 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:19:03.706721 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:19:03.706357 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:19:03.706721 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:19:03.706376 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:19:03.706721 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:19:03.706388 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:19:03.706721 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:19:03.706679 2575 scope.go:117] "RemoveContainer" containerID="85d6cca1505aad5a3c5806a8a4242d743d43d284412f10ae1500d8875802f799" Sep 09 23:19:03.706882 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:19:03.706847 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw_llm(278a680b-ea5b-4bc0-b490-ee083c586baf)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" podUID="278a680b-ea5b-4bc0-b490-ee083c586baf" Sep 09 23:19:14.833311 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:19:14.833281 2575 scope.go:117] "RemoveContainer" containerID="85d6cca1505aad5a3c5806a8a4242d743d43d284412f10ae1500d8875802f799" Sep 09 23:19:14.833898 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:19:14.833448 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw_llm(278a680b-ea5b-4bc0-b490-ee083c586baf)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" podUID="278a680b-ea5b-4bc0-b490-ee083c586baf" Sep 09 23:19:26.839717 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:19:26.839686 2575 scope.go:117] "RemoveContainer" containerID="85d6cca1505aad5a3c5806a8a4242d743d43d284412f10ae1500d8875802f799" Sep 09 23:19:27.469840 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:19:27.469795 2575 generic.go:356] "Generic (PLEG): container finished" podID="278a680b-ea5b-4bc0-b490-ee083c586baf" containerID="22eb40244433133906ffdffafbc4c721a0b5860a1e592617e66e5255c72f5e0b" exitCode=0 Sep 09 23:19:27.469992 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:19:27.469881 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" event={"ID":"278a680b-ea5b-4bc0-b490-ee083c586baf","Type":"ContainerDied","Data":"22eb40244433133906ffdffafbc4c721a0b5860a1e592617e66e5255c72f5e0b"} Sep 09 23:19:27.469992 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:19:27.469942 2575 scope.go:117] "RemoveContainer" containerID="85d6cca1505aad5a3c5806a8a4242d743d43d284412f10ae1500d8875802f799" Sep 09 23:19:27.470293 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:19:27.470272 2575 scope.go:117] "RemoveContainer" containerID="22eb40244433133906ffdffafbc4c721a0b5860a1e592617e66e5255c72f5e0b" Sep 09 23:19:27.470483 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:19:27.470465 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw_llm(278a680b-ea5b-4bc0-b490-ee083c586baf)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" podUID="278a680b-ea5b-4bc0-b490-ee083c586baf" Sep 09 23:19:33.705973 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:19:33.705942 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:19:33.706343 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:19:33.705997 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:19:33.706343 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:19:33.706013 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:19:33.706343 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:19:33.706026 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:19:33.706343 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:19:33.706310 2575 scope.go:117] "RemoveContainer" containerID="22eb40244433133906ffdffafbc4c721a0b5860a1e592617e66e5255c72f5e0b" Sep 09 23:19:33.706487 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:19:33.706461 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw_llm(278a680b-ea5b-4bc0-b490-ee083c586baf)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" podUID="278a680b-ea5b-4bc0-b490-ee083c586baf" Sep 09 23:19:47.833452 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:19:47.833419 2575 scope.go:117] "RemoveContainer" containerID="22eb40244433133906ffdffafbc4c721a0b5860a1e592617e66e5255c72f5e0b" Sep 09 23:19:47.834069 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:19:47.833583 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw_llm(278a680b-ea5b-4bc0-b490-ee083c586baf)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" podUID="278a680b-ea5b-4bc0-b490-ee083c586baf" Sep 09 23:20:00.833482 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:20:00.833409 2575 scope.go:117] "RemoveContainer" containerID="22eb40244433133906ffdffafbc4c721a0b5860a1e592617e66e5255c72f5e0b" Sep 09 23:20:00.833912 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:20:00.833593 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw_llm(278a680b-ea5b-4bc0-b490-ee083c586baf)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" podUID="278a680b-ea5b-4bc0-b490-ee083c586baf" Sep 09 23:20:14.832512 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:20:14.832480 2575 scope.go:117] "RemoveContainer" containerID="22eb40244433133906ffdffafbc4c721a0b5860a1e592617e66e5255c72f5e0b" Sep 09 23:20:14.832907 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:20:14.832776 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:20:15.690288 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:20:15.690253 2575 generic.go:356] "Generic (PLEG): container finished" podID="278a680b-ea5b-4bc0-b490-ee083c586baf" containerID="d7417eae7123769f7c0ae60ad024ac34f35f58d22dc844c662519c90dde233e2" exitCode=0 Sep 09 23:20:15.690464 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:20:15.690320 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" event={"ID":"278a680b-ea5b-4bc0-b490-ee083c586baf","Type":"ContainerDied","Data":"d7417eae7123769f7c0ae60ad024ac34f35f58d22dc844c662519c90dde233e2"} Sep 09 23:20:15.690464 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:20:15.690378 2575 scope.go:117] "RemoveContainer" containerID="22eb40244433133906ffdffafbc4c721a0b5860a1e592617e66e5255c72f5e0b" Sep 09 23:20:15.690714 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:20:15.690685 2575 scope.go:117] "RemoveContainer" containerID="d7417eae7123769f7c0ae60ad024ac34f35f58d22dc844c662519c90dde233e2" Sep 09 23:20:15.690922 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:20:15.690902 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw_llm(278a680b-ea5b-4bc0-b490-ee083c586baf)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" podUID="278a680b-ea5b-4bc0-b490-ee083c586baf" Sep 09 23:20:23.706560 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:20:23.706525 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:20:23.707053 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:20:23.706586 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:20:23.707053 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:20:23.706603 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:20:23.707053 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:20:23.706616 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:20:23.707053 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:20:23.706928 2575 scope.go:117] "RemoveContainer" containerID="d7417eae7123769f7c0ae60ad024ac34f35f58d22dc844c662519c90dde233e2" Sep 09 23:20:23.707185 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:20:23.707085 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw_llm(278a680b-ea5b-4bc0-b490-ee083c586baf)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" podUID="278a680b-ea5b-4bc0-b490-ee083c586baf" Sep 09 23:20:37.832405 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:20:37.832375 2575 scope.go:117] "RemoveContainer" containerID="d7417eae7123769f7c0ae60ad024ac34f35f58d22dc844c662519c90dde233e2" Sep 09 23:20:37.832808 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:20:37.832550 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw_llm(278a680b-ea5b-4bc0-b490-ee083c586baf)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" podUID="278a680b-ea5b-4bc0-b490-ee083c586baf" Sep 09 23:20:49.832646 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:20:49.832611 2575 scope.go:117] "RemoveContainer" containerID="d7417eae7123769f7c0ae60ad024ac34f35f58d22dc844c662519c90dde233e2" Sep 09 23:20:49.833100 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:20:49.832862 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw_llm(278a680b-ea5b-4bc0-b490-ee083c586baf)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" podUID="278a680b-ea5b-4bc0-b490-ee083c586baf" Sep 09 23:21:00.833479 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:21:00.833442 2575 scope.go:117] "RemoveContainer" containerID="d7417eae7123769f7c0ae60ad024ac34f35f58d22dc844c662519c90dde233e2" Sep 09 23:21:00.833952 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:21:00.833673 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw_llm(278a680b-ea5b-4bc0-b490-ee083c586baf)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" podUID="278a680b-ea5b-4bc0-b490-ee083c586baf" Sep 09 23:21:13.832623 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:21:13.832589 2575 scope.go:117] "RemoveContainer" containerID="d7417eae7123769f7c0ae60ad024ac34f35f58d22dc844c662519c90dde233e2" Sep 09 23:21:13.833114 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:21:13.832756 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw_llm(278a680b-ea5b-4bc0-b490-ee083c586baf)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" podUID="278a680b-ea5b-4bc0-b490-ee083c586baf" Sep 09 23:21:24.833139 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:21:24.833106 2575 scope.go:117] "RemoveContainer" containerID="d7417eae7123769f7c0ae60ad024ac34f35f58d22dc844c662519c90dde233e2" Sep 09 23:21:24.833502 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:21:24.833334 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw_llm(278a680b-ea5b-4bc0-b490-ee083c586baf)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" podUID="278a680b-ea5b-4bc0-b490-ee083c586baf" Sep 09 23:21:37.832642 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:21:37.832564 2575 scope.go:117] "RemoveContainer" containerID="d7417eae7123769f7c0ae60ad024ac34f35f58d22dc844c662519c90dde233e2" Sep 09 23:21:39.056700 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:21:39.056664 2575 generic.go:356] "Generic (PLEG): container finished" podID="278a680b-ea5b-4bc0-b490-ee083c586baf" containerID="85f3cb3f3eb2a3070cd40148ea0b49853b69aeb35d956fd55a1fd15d3b90ed0b" exitCode=0 Sep 09 23:21:39.057168 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:21:39.056728 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" event={"ID":"278a680b-ea5b-4bc0-b490-ee083c586baf","Type":"ContainerDied","Data":"85f3cb3f3eb2a3070cd40148ea0b49853b69aeb35d956fd55a1fd15d3b90ed0b"} Sep 09 23:21:39.057168 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:21:39.056783 2575 scope.go:117] "RemoveContainer" containerID="d7417eae7123769f7c0ae60ad024ac34f35f58d22dc844c662519c90dde233e2" Sep 09 23:21:39.057168 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:21:39.057124 2575 scope.go:117] "RemoveContainer" containerID="85f3cb3f3eb2a3070cd40148ea0b49853b69aeb35d956fd55a1fd15d3b90ed0b" Sep 09 23:21:39.057333 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:21:39.057308 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw_llm(278a680b-ea5b-4bc0-b490-ee083c586baf)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" podUID="278a680b-ea5b-4bc0-b490-ee083c586baf" Sep 09 23:21:43.706031 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:21:43.705997 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:21:43.706372 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:21:43.706099 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:21:43.706372 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:21:43.706128 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:21:43.706372 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:21:43.706143 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" Sep 09 23:21:43.706498 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:21:43.706472 2575 scope.go:117] "RemoveContainer" containerID="85f3cb3f3eb2a3070cd40148ea0b49853b69aeb35d956fd55a1fd15d3b90ed0b" Sep 09 23:21:43.706659 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:21:43.706640 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw_llm(278a680b-ea5b-4bc0-b490-ee083c586baf)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" podUID="278a680b-ea5b-4bc0-b490-ee083c586baf" Sep 09 23:21:54.833506 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:21:54.833473 2575 scope.go:117] "RemoveContainer" containerID="85f3cb3f3eb2a3070cd40148ea0b49853b69aeb35d956fd55a1fd15d3b90ed0b" Sep 09 23:21:54.833997 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:21:54.833623 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw_llm(278a680b-ea5b-4bc0-b490-ee083c586baf)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" podUID="278a680b-ea5b-4bc0-b490-ee083c586baf" Sep 09 23:22:07.832849 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:07.832797 2575 scope.go:117] "RemoveContainer" containerID="85f3cb3f3eb2a3070cd40148ea0b49853b69aeb35d956fd55a1fd15d3b90ed0b" Sep 09 23:22:07.833302 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:22:07.833049 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw_llm(278a680b-ea5b-4bc0-b490-ee083c586baf)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" podUID="278a680b-ea5b-4bc0-b490-ee083c586baf" Sep 09 23:22:19.832429 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:19.832399 2575 scope.go:117] "RemoveContainer" containerID="85f3cb3f3eb2a3070cd40148ea0b49853b69aeb35d956fd55a1fd15d3b90ed0b" Sep 09 23:22:19.832802 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:22:19.832570 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw_llm(278a680b-ea5b-4bc0-b490-ee083c586baf)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" podUID="278a680b-ea5b-4bc0-b490-ee083c586baf" Sep 09 23:22:24.124578 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:24.124529 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw_278a680b-ea5b-4bc0-b490-ee083c586baf/main/5.log" Sep 09 23:22:24.242963 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:24.242936 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw_278a680b-ea5b-4bc0-b490-ee083c586baf/main/5.log" Sep 09 23:22:31.153162 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:31.153133 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76cbb89f58-qj7xp_2e7e9710-b655-4cbf-92ed-fb537580361c/copy-manifests/0.log" Sep 09 23:22:31.159145 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:31.159113 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76cbb89f58-qj7xp_2e7e9710-b655-4cbf-92ed-fb537580361c/manager/0.log" Sep 09 23:22:32.933407 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:32.933381 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-l6vmr_bc235191-fe7e-4ebf-8fc0-a664a8736634/manager/0.log" Sep 09 23:22:33.035068 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:33.035031 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-b4tgt_d578b89a-0445-4d82-9ef8-6e8a3fb476d0/limitador/0.log" Sep 09 23:22:33.147439 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:33.147417 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-f86rg_a109b0f1-fb55-4afd-8b0a-b64bb7948f98/manager/0.log" Sep 09 23:22:33.610154 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:33.610115 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-tzv9l_f396d0c5-8a49-4317-a69c-dea326896137/discovery/0.log" Sep 09 23:22:33.825802 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:33.825773 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55cf6889dc-pvrff_59371077-489c-4b85-b97e-0c8b1bc841f6/kube-auth-proxy/0.log" Sep 09 23:22:34.804173 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:34.804143 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-thg2b_cd1f022a-bb3a-4dd2-a8b4-a5dba03e9cd3/main/0.log" Sep 09 23:22:34.833327 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:34.833307 2575 scope.go:117] "RemoveContainer" containerID="85f3cb3f3eb2a3070cd40148ea0b49853b69aeb35d956fd55a1fd15d3b90ed0b" Sep 09 23:22:34.833480 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:22:34.833461 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw_llm(278a680b-ea5b-4bc0-b490-ee083c586baf)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" podUID="278a680b-ea5b-4bc0-b490-ee083c586baf" Sep 09 23:22:35.024365 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:35.024336 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsnrqn_4ac3cef6-f4a1-487e-8d37-6c66ac3cc456/main/0.log" Sep 09 23:22:35.129496 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:35.129475 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw_278a680b-ea5b-4bc0-b490-ee083c586baf/main/5.log" Sep 09 23:22:43.783167 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:43.783138 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2smzh_cd6cb31a-9cc7-4e2a-9ab7-019055393d6c/global-pull-secret-syncer/0.log" Sep 09 23:22:43.922771 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:43.922730 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gf774_a3234f19-0f18-483b-9f8e-0e5d00969664/konnectivity-agent/0.log" Sep 09 23:22:43.995332 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:43.995307 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-137.ec2.internal_3aa92973b9fc245d1f83164656b4e586/haproxy/0.log" Sep 09 23:22:45.833077 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:45.833044 2575 scope.go:117] "RemoveContainer" containerID="85f3cb3f3eb2a3070cd40148ea0b49853b69aeb35d956fd55a1fd15d3b90ed0b" Sep 09 23:22:45.833442 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:22:45.833248 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw_llm(278a680b-ea5b-4bc0-b490-ee083c586baf)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" podUID="278a680b-ea5b-4bc0-b490-ee083c586baf" Sep 09 23:22:48.286042 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:48.286003 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-l6vmr_bc235191-fe7e-4ebf-8fc0-a664a8736634/manager/0.log" Sep 09 23:22:48.329972 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:48.329947 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-b4tgt_d578b89a-0445-4d82-9ef8-6e8a3fb476d0/limitador/0.log" Sep 09 23:22:48.360517 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:48.360493 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-f86rg_a109b0f1-fb55-4afd-8b0a-b64bb7948f98/manager/0.log" Sep 09 23:22:50.184450 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:50.184422 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5bda1a58-b126-4f1e-8693-d232c6647bee/alertmanager/0.log" Sep 09 23:22:50.208460 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:50.208439 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5bda1a58-b126-4f1e-8693-d232c6647bee/config-reloader/0.log" Sep 09 23:22:50.231087 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:50.231058 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5bda1a58-b126-4f1e-8693-d232c6647bee/kube-rbac-proxy-web/0.log" Sep 09 23:22:50.249921 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:50.249900 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5bda1a58-b126-4f1e-8693-d232c6647bee/kube-rbac-proxy/0.log" Sep 09 23:22:50.269622 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:50.269604 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5bda1a58-b126-4f1e-8693-d232c6647bee/kube-rbac-proxy-metric/0.log" Sep 09 23:22:50.288088 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:50.288071 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5bda1a58-b126-4f1e-8693-d232c6647bee/prom-label-proxy/0.log" Sep 09 23:22:50.311900 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:50.311881 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5bda1a58-b126-4f1e-8693-d232c6647bee/init-config-reloader/0.log" Sep 09 23:22:50.725314 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:50.725287 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pnrp8_599fb6e8-09aa-428b-8f1d-9a47ed6eb919/node-exporter/0.log" Sep 09 23:22:50.749710 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:50.749687 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pnrp8_599fb6e8-09aa-428b-8f1d-9a47ed6eb919/kube-rbac-proxy/0.log" Sep 09 23:22:50.768462 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:50.768445 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pnrp8_599fb6e8-09aa-428b-8f1d-9a47ed6eb919/init-textfile/0.log" Sep 09 23:22:51.110428 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:51.110370 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-684f677f45-qbn44_119d76db-2644-435e-9f03-8ebf7db62b7a/telemeter-client/0.log" Sep 09 23:22:51.130137 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:51.130118 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-684f677f45-qbn44_119d76db-2644-435e-9f03-8ebf7db62b7a/reload/0.log" Sep 09 23:22:51.149018 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:51.149004 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-684f677f45-qbn44_119d76db-2644-435e-9f03-8ebf7db62b7a/kube-rbac-proxy/0.log" Sep 09 23:22:54.718028 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:54.717991 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4rw5c/perf-node-gather-daemonset-d5qhp"] Sep 09 23:22:54.721609 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:54.721584 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-d5qhp" Sep 09 23:22:54.723955 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:54.723937 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4rw5c\"/\"kube-root-ca.crt\"" Sep 09 23:22:54.723955 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:54.723941 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4rw5c\"/\"openshift-service-ca.crt\"" Sep 09 23:22:54.724727 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:54.724712 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4rw5c\"/\"default-dockercfg-ltxmt\"" Sep 09 23:22:54.727729 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:54.727700 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4rw5c/perf-node-gather-daemonset-d5qhp"] Sep 09 23:22:54.863439 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:54.863408 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24b82472-36c4-4898-b45b-be1e1ba44e09-sys\") pod \"perf-node-gather-daemonset-d5qhp\" (UID: \"24b82472-36c4-4898-b45b-be1e1ba44e09\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-d5qhp" Sep 09 23:22:54.863577 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:54.863460 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/24b82472-36c4-4898-b45b-be1e1ba44e09-lib-modules\") pod \"perf-node-gather-daemonset-d5qhp\" (UID: \"24b82472-36c4-4898-b45b-be1e1ba44e09\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-d5qhp" Sep 09 23:22:54.863577 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:54.863490 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/24b82472-36c4-4898-b45b-be1e1ba44e09-proc\") pod \"perf-node-gather-daemonset-d5qhp\" (UID: \"24b82472-36c4-4898-b45b-be1e1ba44e09\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-d5qhp" Sep 09 23:22:54.863577 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:54.863516 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q9np\" (UniqueName: \"kubernetes.io/projected/24b82472-36c4-4898-b45b-be1e1ba44e09-kube-api-access-9q9np\") pod \"perf-node-gather-daemonset-d5qhp\" (UID: \"24b82472-36c4-4898-b45b-be1e1ba44e09\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-d5qhp" Sep 09 23:22:54.863682 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:54.863576 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/24b82472-36c4-4898-b45b-be1e1ba44e09-podres\") pod \"perf-node-gather-daemonset-d5qhp\" (UID: \"24b82472-36c4-4898-b45b-be1e1ba44e09\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-d5qhp" Sep 09 23:22:54.964735 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:54.964706 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/24b82472-36c4-4898-b45b-be1e1ba44e09-podres\") pod \"perf-node-gather-daemonset-d5qhp\" (UID: \"24b82472-36c4-4898-b45b-be1e1ba44e09\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-d5qhp" Sep 09 23:22:54.964895 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:54.964758 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24b82472-36c4-4898-b45b-be1e1ba44e09-sys\") pod \"perf-node-gather-daemonset-d5qhp\" (UID: \"24b82472-36c4-4898-b45b-be1e1ba44e09\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-d5qhp" Sep 09 23:22:54.964895 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:54.964789 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/24b82472-36c4-4898-b45b-be1e1ba44e09-lib-modules\") pod \"perf-node-gather-daemonset-d5qhp\" (UID: \"24b82472-36c4-4898-b45b-be1e1ba44e09\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-d5qhp" Sep 09 23:22:54.964895 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:54.964806 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/24b82472-36c4-4898-b45b-be1e1ba44e09-proc\") pod \"perf-node-gather-daemonset-d5qhp\" (UID: \"24b82472-36c4-4898-b45b-be1e1ba44e09\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-d5qhp" Sep 09 23:22:54.964895 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:54.964822 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q9np\" (UniqueName: \"kubernetes.io/projected/24b82472-36c4-4898-b45b-be1e1ba44e09-kube-api-access-9q9np\") pod \"perf-node-gather-daemonset-d5qhp\" (UID: \"24b82472-36c4-4898-b45b-be1e1ba44e09\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-d5qhp" Sep 09 23:22:54.965043 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:54.964901 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/24b82472-36c4-4898-b45b-be1e1ba44e09-podres\") pod \"perf-node-gather-daemonset-d5qhp\" (UID: \"24b82472-36c4-4898-b45b-be1e1ba44e09\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-d5qhp" Sep 09 23:22:54.965043 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:54.964930 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24b82472-36c4-4898-b45b-be1e1ba44e09-sys\") pod \"perf-node-gather-daemonset-d5qhp\" (UID: \"24b82472-36c4-4898-b45b-be1e1ba44e09\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-d5qhp" Sep 09 23:22:54.965043 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:54.964939 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/24b82472-36c4-4898-b45b-be1e1ba44e09-lib-modules\") pod \"perf-node-gather-daemonset-d5qhp\" (UID: \"24b82472-36c4-4898-b45b-be1e1ba44e09\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-d5qhp" Sep 09 23:22:54.965043 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:54.964914 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/24b82472-36c4-4898-b45b-be1e1ba44e09-proc\") pod \"perf-node-gather-daemonset-d5qhp\" (UID: \"24b82472-36c4-4898-b45b-be1e1ba44e09\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-d5qhp" Sep 09 23:22:54.971875 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:54.971805 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q9np\" (UniqueName: \"kubernetes.io/projected/24b82472-36c4-4898-b45b-be1e1ba44e09-kube-api-access-9q9np\") pod \"perf-node-gather-daemonset-d5qhp\" (UID: \"24b82472-36c4-4898-b45b-be1e1ba44e09\") " pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-d5qhp" Sep 09 23:22:55.031816 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:55.031792 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-d5qhp" Sep 09 23:22:55.300141 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:55.300115 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4rw5c/perf-node-gather-daemonset-d5qhp"] Sep 09 23:22:55.302591 ip-10-0-140-137 kubenswrapper[2575]: W0909 23:22:55.302562 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod24b82472_36c4_4898_b45b_be1e1ba44e09.slice/crio-859d95bb64dcdf6d9dbfe8fdc5a4b925e1f5b21338fb8d15c82ab43eb9c606b6 WatchSource:0}: Error finding container 859d95bb64dcdf6d9dbfe8fdc5a4b925e1f5b21338fb8d15c82ab43eb9c606b6: Status 404 returned error can't find the container with id 859d95bb64dcdf6d9dbfe8fdc5a4b925e1f5b21338fb8d15c82ab43eb9c606b6 Sep 09 23:22:55.396849 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:55.396813 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-d5qhp" event={"ID":"24b82472-36c4-4898-b45b-be1e1ba44e09","Type":"ContainerStarted","Data":"eab5845859492eec0a7a9f3a7ea53318d1bb103af7d4353c83fafdf13cec19ce"} Sep 09 23:22:55.396955 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:55.396874 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-d5qhp" event={"ID":"24b82472-36c4-4898-b45b-be1e1ba44e09","Type":"ContainerStarted","Data":"859d95bb64dcdf6d9dbfe8fdc5a4b925e1f5b21338fb8d15c82ab43eb9c606b6"} Sep 09 23:22:55.396955 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:55.396902 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-d5qhp" Sep 09 23:22:55.411280 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:55.411239 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-d5qhp" podStartSLOduration=1.411225017 podStartE2EDuration="1.411225017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:22:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:22:55.409933825 +0000 UTC m=+1159.067589470" watchObservedRunningTime="2026-09-09 23:22:55.411225017 +0000 UTC m=+1159.068880661" Sep 09 23:22:55.958120 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:55.958095 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pcppn_26ae1701-512d-437e-9a23-22871cfbc0fe/dns/0.log" Sep 09 23:22:55.978348 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:55.978307 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pcppn_26ae1701-512d-437e-9a23-22871cfbc0fe/kube-rbac-proxy/0.log" Sep 09 23:22:56.062809 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:56.062788 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-httmw_de1b41b8-0f82-4297-a438-e47b0e1e683a/dns-node-resolver/0.log" Sep 09 23:22:56.578006 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:56.577982 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-999868c4f-gkrc9_71501650-e6bd-414f-b61f-2fa77ab8f45d/registry/0.log" Sep 09 23:22:56.639379 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:56.639359 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w4qwh_1f8dd862-bb98-45c7-b5a9-4c5575d06ad8/node-ca/0.log" Sep 09 23:22:57.573083 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:57.573058 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-tzv9l_f396d0c5-8a49-4317-a69c-dea326896137/discovery/0.log" Sep 09 23:22:57.613220 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:57.613194 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55cf6889dc-pvrff_59371077-489c-4b85-b97e-0c8b1bc841f6/kube-auth-proxy/0.log" Sep 09 23:22:58.364853 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:58.364802 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rs28s_43889511-11da-4b62-a69b-abf53121b273/serve-healthcheck-canary/0.log" Sep 09 23:22:58.966801 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:58.966729 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vc7g4_1534082f-bb94-49ff-8515-5be4bb6d9167/kube-rbac-proxy/0.log" Sep 09 23:22:58.985289 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:58.985265 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vc7g4_1534082f-bb94-49ff-8515-5be4bb6d9167/exporter/0.log" Sep 09 23:22:59.004180 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:59.004157 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vc7g4_1534082f-bb94-49ff-8515-5be4bb6d9167/extractor/0.log" Sep 09 23:22:59.832615 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:22:59.832569 2575 scope.go:117] "RemoveContainer" containerID="85f3cb3f3eb2a3070cd40148ea0b49853b69aeb35d956fd55a1fd15d3b90ed0b" Sep 09 23:22:59.832776 ip-10-0-140-137 kubenswrapper[2575]: E0909 23:22:59.832746 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw_llm(278a680b-ea5b-4bc0-b490-ee083c586baf)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-4p7lw" podUID="278a680b-ea5b-4bc0-b490-ee083c586baf" Sep 09 23:23:01.359520 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:23:01.359488 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76cbb89f58-qj7xp_2e7e9710-b655-4cbf-92ed-fb537580361c/manager/0.log" Sep 09 23:23:01.379408 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:23:01.379387 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76cbb89f58-qj7xp_2e7e9710-b655-4cbf-92ed-fb537580361c/copy-manifests/0.log" Sep 09 23:23:01.412241 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:23:01.412201 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4rw5c/perf-node-gather-daemonset-d5qhp" Sep 09 23:23:02.600208 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:23:02.600175 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-v2jll_16fe679d-67ba-4fed-af2a-2e7a51eb6ff3/openshift-lws-operator/0.log" Sep 09 23:23:05.384744 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:23:05.384716 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-tzv9l_f396d0c5-8a49-4317-a69c-dea326896137/discovery/0.log" Sep 09 23:23:05.407411 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:23:05.407387 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55cf6889dc-pvrff_59371077-489c-4b85-b97e-0c8b1bc841f6/kube-auth-proxy/0.log" Sep 09 23:23:06.751849 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:23:06.751798 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-tzv9l_f396d0c5-8a49-4317-a69c-dea326896137/discovery/0.log" Sep 09 23:23:06.783663 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:23:06.783635 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55cf6889dc-pvrff_59371077-489c-4b85-b97e-0c8b1bc841f6/kube-auth-proxy/0.log" Sep 09 23:23:08.106891 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:23:08.106862 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-hhvwl_d2d517b8-af90-4ae1-a7a3-3d1c1eb2ea6c/migrator/0.log" Sep 09 23:23:08.127610 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:23:08.127582 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-hhvwl_d2d517b8-af90-4ae1-a7a3-3d1c1eb2ea6c/graceful-termination/0.log" Sep 09 23:23:09.456003 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:23:09.455976 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8g29j_a3181805-89ae-4090-9e2e-4a15a4f32439/kube-multus-additional-cni-plugins/0.log" Sep 09 23:23:09.477225 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:23:09.477202 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8g29j_a3181805-89ae-4090-9e2e-4a15a4f32439/egress-router-binary-copy/0.log" Sep 09 23:23:09.495283 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:23:09.495265 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8g29j_a3181805-89ae-4090-9e2e-4a15a4f32439/cni-plugins/0.log" Sep 09 23:23:09.513490 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:23:09.513459 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8g29j_a3181805-89ae-4090-9e2e-4a15a4f32439/bond-cni-plugin/0.log" Sep 09 23:23:09.531859 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:23:09.531821 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8g29j_a3181805-89ae-4090-9e2e-4a15a4f32439/routeoverride-cni/0.log" Sep 09 23:23:09.550902 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:23:09.550885 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8g29j_a3181805-89ae-4090-9e2e-4a15a4f32439/whereabouts-cni-bincopy/0.log" Sep 09 23:23:09.568990 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:23:09.568972 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8g29j_a3181805-89ae-4090-9e2e-4a15a4f32439/whereabouts-cni/0.log" Sep 09 23:23:09.896751 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:23:09.896724 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rf5t5_a4919899-9165-48b3-aa64-d1de1dcb5d68/kube-multus/0.log" Sep 09 23:23:10.036701 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:23:10.036672 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kgfhj_d1e3264c-002a-4855-bb40-0c63971351d9/network-metrics-daemon/0.log" Sep 09 23:23:10.056688 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:23:10.056665 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kgfhj_d1e3264c-002a-4855-bb40-0c63971351d9/kube-rbac-proxy/0.log" Sep 09 23:23:11.242209 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:23:11.242181 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6gsr_01cc3a72-4b5d-4af7-9db4-219af2288772/ovn-controller/0.log" Sep 09 23:23:11.258212 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:23:11.258188 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6gsr_01cc3a72-4b5d-4af7-9db4-219af2288772/ovn-acl-logging/1.log" Sep 09 23:23:11.258339 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:23:11.258259 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6gsr_01cc3a72-4b5d-4af7-9db4-219af2288772/ovn-acl-logging/0.log" Sep 09 23:23:11.276603 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:23:11.276582 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6gsr_01cc3a72-4b5d-4af7-9db4-219af2288772/kube-rbac-proxy-node/0.log" Sep 09 23:23:11.300405 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:23:11.300383 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6gsr_01cc3a72-4b5d-4af7-9db4-219af2288772/kube-rbac-proxy-ovn-metrics/0.log" Sep 09 23:23:11.314949 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:23:11.314931 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6gsr_01cc3a72-4b5d-4af7-9db4-219af2288772/northd/0.log" Sep 09 23:23:11.332835 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:23:11.332804 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6gsr_01cc3a72-4b5d-4af7-9db4-219af2288772/nbdb/0.log" Sep 09 23:23:11.351549 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:23:11.351530 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6gsr_01cc3a72-4b5d-4af7-9db4-219af2288772/sbdb/0.log" Sep 09 23:23:11.384359 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:23:11.384336 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q6gsr_01cc3a72-4b5d-4af7-9db4-219af2288772/ovnkube-controller/0.log" Sep 09 23:23:12.480009 ip-10-0-140-137 kubenswrapper[2575]: I0909 23:23:12.479980 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-n6b4v_291c484c-874a-4ff5-987c-ef066e122a96/network-check-target-container/0.log"