Sep 19 09:51:40.084010 ip-10-0-142-110 systemd[1]: Starting Kubernetes Kubelet... Sep 19 09:51:40.481630 ip-10-0-142-110 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 19 09:51:40.481630 ip-10-0-142-110 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 19 09:51:40.481630 ip-10-0-142-110 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 19 09:51:40.481630 ip-10-0-142-110 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 19 09:51:40.481630 ip-10-0-142-110 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 19 09:51:40.484123 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.484033 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 19 09:51:40.487651 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487634 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 09:51:40.487690 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487652 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 09:51:40.487690 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487657 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 09:51:40.487690 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487660 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 09:51:40.487690 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487663 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 09:51:40.487690 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487666 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 09:51:40.487690 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487669 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 09:51:40.487690 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487672 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 09:51:40.487690 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487675 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 09:51:40.487690 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487678 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 09:51:40.487690 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487680 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 09:51:40.487690 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487683 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 09:51:40.487690 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487685 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 09:51:40.487690 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487688 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 09:51:40.487690 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487691 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 09:51:40.487690 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487706 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 09:51:40.488062 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487710 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 09:51:40.488062 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487712 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 09:51:40.488062 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487722 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 09:51:40.488062 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487725 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 09:51:40.488062 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487727 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 09:51:40.488062 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487730 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 09:51:40.488062 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487733 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 09:51:40.488062 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487736 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 09:51:40.488062 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487738 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 09:51:40.488062 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487741 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 09:51:40.488062 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487743 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 09:51:40.488062 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487746 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 09:51:40.488062 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487749 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 09:51:40.488062 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487753 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 09:51:40.488062 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487755 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 09:51:40.488062 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487758 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 09:51:40.488062 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487760 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 09:51:40.488062 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487762 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 09:51:40.488062 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487765 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 09:51:40.488062 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487767 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 09:51:40.488540 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487769 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 09:51:40.488540 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487772 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 09:51:40.488540 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487777 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 19 09:51:40.488540 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487780 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 09:51:40.488540 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487782 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 09:51:40.488540 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487785 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 09:51:40.488540 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487787 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 09:51:40.488540 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487790 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 09:51:40.488540 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487793 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 09:51:40.488540 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487795 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 09:51:40.488540 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487798 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 09:51:40.488540 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487800 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 09:51:40.488540 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487802 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 09:51:40.488540 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487806 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 09:51:40.488540 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487810 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 09:51:40.488540 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487813 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 09:51:40.488540 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487817 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 09:51:40.488540 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487820 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 09:51:40.488540 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487823 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 09:51:40.488540 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487825 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 09:51:40.489046 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487829 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 09:51:40.489046 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487831 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 09:51:40.489046 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487834 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 09:51:40.489046 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487836 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 09:51:40.489046 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487839 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 09:51:40.489046 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487842 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 09:51:40.489046 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487845 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 09:51:40.489046 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487847 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 09:51:40.489046 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487850 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 09:51:40.489046 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487852 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 09:51:40.489046 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487855 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 09:51:40.489046 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487857 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 09:51:40.489046 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487860 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 09:51:40.489046 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487862 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 09:51:40.489046 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487865 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 09:51:40.489046 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487873 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 09:51:40.489046 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487875 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 09:51:40.489046 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487878 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 09:51:40.489046 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487880 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 09:51:40.489496 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487882 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 09:51:40.489496 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487885 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 09:51:40.489496 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487887 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 09:51:40.489496 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487890 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 09:51:40.489496 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487892 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 09:51:40.489496 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487894 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 09:51:40.489496 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487906 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 09:51:40.489496 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487909 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 09:51:40.489496 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487911 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 09:51:40.489496 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487914 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 09:51:40.489496 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487917 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 09:51:40.489496 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487919 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 09:51:40.489496 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487922 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 09:51:40.489496 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487924 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 09:51:40.489496 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487927 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 09:51:40.489496 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487929 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 09:51:40.489496 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487932 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 09:51:40.489496 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487934 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 09:51:40.489496 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487937 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 09:51:40.489496 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487939 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 09:51:40.489988 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487941 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 09:51:40.489988 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487944 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 09:51:40.489988 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487947 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 09:51:40.489988 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.487949 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 09:51:40.489988 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488667 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 09:51:40.489988 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488674 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 09:51:40.489988 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488677 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 09:51:40.489988 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488680 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 09:51:40.489988 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488683 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 09:51:40.489988 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488688 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 09:51:40.489988 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488692 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 09:51:40.489988 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488711 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 09:51:40.489988 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488714 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 09:51:40.489988 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488717 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 09:51:40.489988 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488719 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 09:51:40.489988 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488722 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 09:51:40.489988 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488725 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 09:51:40.489988 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488728 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 09:51:40.489988 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488731 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 09:51:40.490454 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488734 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 09:51:40.490454 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488737 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 09:51:40.490454 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488740 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 09:51:40.490454 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488742 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 09:51:40.490454 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488745 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 09:51:40.490454 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488747 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 09:51:40.490454 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488750 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 09:51:40.490454 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488752 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 09:51:40.490454 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488755 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 09:51:40.490454 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488757 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 09:51:40.490454 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488760 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 09:51:40.490454 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488763 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 09:51:40.490454 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488765 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 09:51:40.490454 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488768 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 09:51:40.490454 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488771 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 09:51:40.490454 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488773 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 09:51:40.490454 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488775 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 09:51:40.490454 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488779 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 09:51:40.490454 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488783 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 09:51:40.490454 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488786 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 19 09:51:40.490962 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488788 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 09:51:40.490962 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488791 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 09:51:40.490962 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488794 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 09:51:40.490962 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488797 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 09:51:40.490962 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488800 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 09:51:40.490962 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488804 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 09:51:40.490962 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488807 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 09:51:40.490962 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488810 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 09:51:40.490962 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488813 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 09:51:40.490962 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488816 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 09:51:40.490962 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488819 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 09:51:40.490962 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488822 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 09:51:40.490962 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488825 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 09:51:40.490962 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488827 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 09:51:40.490962 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488830 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 09:51:40.490962 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488833 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 09:51:40.490962 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488836 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 09:51:40.490962 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488838 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 09:51:40.490962 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488841 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 09:51:40.491452 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488843 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 09:51:40.491452 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488846 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 09:51:40.491452 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488848 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 09:51:40.491452 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488850 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 09:51:40.491452 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488853 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 09:51:40.491452 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488855 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 09:51:40.491452 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488858 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 09:51:40.491452 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488860 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 09:51:40.491452 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488862 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 09:51:40.491452 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488865 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 09:51:40.491452 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488867 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 09:51:40.491452 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488870 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 09:51:40.491452 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488872 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 09:51:40.491452 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488874 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 09:51:40.491452 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488877 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 09:51:40.491452 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488879 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 09:51:40.491452 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488882 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 09:51:40.491452 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488884 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 09:51:40.491452 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488887 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 09:51:40.491452 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488889 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 09:51:40.492043 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488892 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 09:51:40.492043 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488894 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 09:51:40.492043 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488897 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 09:51:40.492043 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488900 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 09:51:40.492043 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488903 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 09:51:40.492043 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488906 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 09:51:40.492043 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488908 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 09:51:40.492043 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488911 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 09:51:40.492043 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488913 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 09:51:40.492043 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488916 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 09:51:40.492043 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488918 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 09:51:40.492043 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488921 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 09:51:40.492043 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488923 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 09:51:40.492043 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488925 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 09:51:40.492043 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488928 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 09:51:40.492043 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488930 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 09:51:40.492043 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488933 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 09:51:40.492043 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488935 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 09:51:40.492043 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488937 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 09:51:40.492043 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488940 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 09:51:40.492615 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488942 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 09:51:40.492615 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488945 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 09:51:40.492615 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488947 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 09:51:40.492615 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488949 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 09:51:40.492615 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.488952 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 09:51:40.492615 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489713 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 09:51:40.492615 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489721 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 09:51:40.492615 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489724 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 09:51:40.492615 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489727 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 09:51:40.492615 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489731 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 09:51:40.492615 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489733 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 09:51:40.492615 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489736 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 09:51:40.492615 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489739 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 09:51:40.492615 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489741 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 09:51:40.492615 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489744 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 09:51:40.492615 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489747 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 09:51:40.492615 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489750 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 09:51:40.492615 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489753 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 09:51:40.492615 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489761 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 09:51:40.492615 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489764 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 09:51:40.493175 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489766 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 09:51:40.493175 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489771 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 09:51:40.493175 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489775 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 09:51:40.493175 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489778 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 09:51:40.493175 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489781 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 09:51:40.493175 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489784 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 09:51:40.493175 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489787 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 09:51:40.493175 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489789 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 09:51:40.493175 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489792 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 09:51:40.493175 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489794 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 09:51:40.493175 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489797 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 09:51:40.493175 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489799 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 09:51:40.493175 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489801 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 09:51:40.493175 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489804 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 09:51:40.493175 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489806 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 09:51:40.493175 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489809 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 09:51:40.493175 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489811 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 09:51:40.493175 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489813 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 09:51:40.493175 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489816 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 09:51:40.493175 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489818 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 09:51:40.493772 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489821 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 09:51:40.493772 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489823 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 09:51:40.493772 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489835 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 09:51:40.493772 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489839 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 09:51:40.493772 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489842 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 09:51:40.493772 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489845 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 09:51:40.493772 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489848 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 09:51:40.493772 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489851 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 09:51:40.493772 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489854 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 09:51:40.493772 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489857 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 09:51:40.493772 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489860 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 09:51:40.493772 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489863 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 09:51:40.493772 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489865 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 09:51:40.493772 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489868 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 09:51:40.493772 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489870 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 09:51:40.493772 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489872 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 09:51:40.493772 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489875 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 09:51:40.493772 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489878 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 09:51:40.493772 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489880 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 09:51:40.494291 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489883 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 09:51:40.494291 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489885 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 09:51:40.494291 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489887 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 09:51:40.494291 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489890 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 19 09:51:40.494291 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489892 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 09:51:40.494291 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489895 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 09:51:40.494291 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489897 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 09:51:40.494291 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489900 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 09:51:40.494291 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489904 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 09:51:40.494291 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489907 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 09:51:40.494291 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489909 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 09:51:40.494291 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489912 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 09:51:40.494291 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489914 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 09:51:40.494291 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489918 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 09:51:40.494291 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489920 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 09:51:40.494291 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489922 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 09:51:40.494291 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489931 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 09:51:40.494291 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489934 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 09:51:40.494291 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489936 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 09:51:40.494291 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489939 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 09:51:40.494931 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489941 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 09:51:40.494931 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489944 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 09:51:40.494931 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489946 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 09:51:40.494931 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489949 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 09:51:40.494931 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489952 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 09:51:40.494931 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489954 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 09:51:40.494931 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489957 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 09:51:40.494931 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489959 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 09:51:40.494931 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489961 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 09:51:40.494931 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489964 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 09:51:40.494931 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489968 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 09:51:40.494931 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489971 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 09:51:40.494931 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489973 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 09:51:40.494931 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489976 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 09:51:40.494931 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489978 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 09:51:40.494931 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489981 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 09:51:40.494931 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489983 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 09:51:40.494931 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489986 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 09:51:40.494931 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489988 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 09:51:40.494931 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489991 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 09:51:40.495538 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489993 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 09:51:40.495538 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489996 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 09:51:40.495538 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.489998 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 09:51:40.495538 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490001 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 09:51:40.495538 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490003 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 09:51:40.495538 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490066 2579 flags.go:64] FLAG: --address="0.0.0.0" Sep 19 09:51:40.495538 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490097 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 19 09:51:40.495538 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490102 2579 flags.go:64] FLAG: --anonymous-auth="true" Sep 19 09:51:40.495538 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490106 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 19 09:51:40.495538 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490116 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 19 09:51:40.495538 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490120 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 19 09:51:40.495538 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490124 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 19 09:51:40.495538 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490127 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 19 09:51:40.495538 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490131 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 19 09:51:40.495538 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490134 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 19 09:51:40.495538 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490137 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 19 09:51:40.495538 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490140 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 19 09:51:40.495538 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490143 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 19 09:51:40.495538 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490146 2579 flags.go:64] FLAG: --cgroup-root="" Sep 19 09:51:40.495538 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490149 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 19 09:51:40.495538 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490151 2579 flags.go:64] FLAG: --client-ca-file="" Sep 19 09:51:40.495538 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490154 2579 flags.go:64] FLAG: --cloud-provider="external" Sep 19 09:51:40.495538 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490158 2579 flags.go:64] FLAG: --cluster-dns="[]" Sep 19 09:51:40.496183 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490167 2579 flags.go:64] FLAG: --cluster-domain="" Sep 19 09:51:40.496183 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490170 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 19 09:51:40.496183 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490173 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 19 09:51:40.496183 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490175 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 19 09:51:40.496183 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490178 2579 flags.go:64] FLAG: --container-log-max-files="5" Sep 19 09:51:40.496183 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490182 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 19 09:51:40.496183 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490185 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 19 09:51:40.496183 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490188 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 19 09:51:40.496183 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490190 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 19 09:51:40.496183 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490193 2579 flags.go:64] FLAG: --contention-profiling="false" Sep 19 09:51:40.496183 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490196 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 19 09:51:40.496183 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490199 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 19 09:51:40.496183 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490202 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 19 09:51:40.496183 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490204 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 19 09:51:40.496183 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490208 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 19 09:51:40.496183 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490211 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 19 09:51:40.496183 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490213 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 19 09:51:40.496183 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490216 2579 flags.go:64] FLAG: --enable-load-reader="false" Sep 19 09:51:40.496183 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490219 2579 flags.go:64] FLAG: --enable-server="true" Sep 19 09:51:40.496183 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490227 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 19 09:51:40.496183 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490235 2579 flags.go:64] FLAG: --event-burst="100" Sep 19 09:51:40.496183 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490241 2579 flags.go:64] FLAG: --event-qps="50" Sep 19 09:51:40.496183 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490244 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 19 09:51:40.496183 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490247 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 19 09:51:40.496821 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490250 2579 flags.go:64] FLAG: --eviction-hard="" Sep 19 09:51:40.496821 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490253 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 19 09:51:40.496821 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490257 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 19 09:51:40.496821 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490260 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 19 09:51:40.496821 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490262 2579 flags.go:64] FLAG: --eviction-soft="" Sep 19 09:51:40.496821 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490265 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 19 09:51:40.496821 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490268 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 19 09:51:40.496821 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490272 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 19 09:51:40.496821 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490274 2579 flags.go:64] FLAG: --experimental-mounter-path="" Sep 19 09:51:40.496821 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490277 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 19 09:51:40.496821 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490280 2579 flags.go:64] FLAG: --fail-swap-on="true" Sep 19 09:51:40.496821 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490283 2579 flags.go:64] FLAG: --feature-gates="" Sep 19 09:51:40.496821 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490286 2579 flags.go:64] FLAG: --file-check-frequency="20s" Sep 19 09:51:40.496821 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490289 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 19 09:51:40.496821 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490292 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 19 09:51:40.496821 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490295 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 19 09:51:40.496821 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490298 2579 flags.go:64] FLAG: --healthz-port="10248" Sep 19 09:51:40.496821 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490300 2579 flags.go:64] FLAG: --help="false" Sep 19 09:51:40.496821 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490303 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-142-110.ec2.internal" Sep 19 09:51:40.496821 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490306 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 19 09:51:40.496821 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490309 2579 flags.go:64] FLAG: --http-check-frequency="20s" Sep 19 09:51:40.496821 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490312 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 19 09:51:40.496821 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490315 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 19 09:51:40.496821 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490318 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 19 09:51:40.497414 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490321 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 19 09:51:40.497414 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490323 2579 flags.go:64] FLAG: --image-service-endpoint="" Sep 19 09:51:40.497414 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490326 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 19 09:51:40.497414 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490329 2579 flags.go:64] FLAG: --kube-api-burst="100" Sep 19 09:51:40.497414 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490337 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 19 09:51:40.497414 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490340 2579 flags.go:64] FLAG: --kube-api-qps="50" Sep 19 09:51:40.497414 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490344 2579 flags.go:64] FLAG: --kube-reserved="" Sep 19 09:51:40.497414 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490347 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 19 09:51:40.497414 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490350 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 19 09:51:40.497414 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490353 2579 flags.go:64] FLAG: --kubelet-cgroups="" Sep 19 09:51:40.497414 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490355 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 19 09:51:40.497414 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490358 2579 flags.go:64] FLAG: --lock-file="" Sep 19 09:51:40.497414 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490361 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 19 09:51:40.497414 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490363 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 19 09:51:40.497414 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490366 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 19 09:51:40.497414 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490372 2579 flags.go:64] FLAG: --log-json-split-stream="false" Sep 19 09:51:40.497414 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490375 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 19 09:51:40.497414 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490378 2579 flags.go:64] FLAG: --log-text-split-stream="false" Sep 19 09:51:40.497414 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490380 2579 flags.go:64] FLAG: --logging-format="text" Sep 19 09:51:40.497414 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490383 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 19 09:51:40.497414 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490386 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 19 09:51:40.497414 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490389 2579 flags.go:64] FLAG: --manifest-url="" Sep 19 09:51:40.497414 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490392 2579 flags.go:64] FLAG: --manifest-url-header="" Sep 19 09:51:40.497414 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490396 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 19 09:51:40.497414 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490398 2579 flags.go:64] FLAG: --max-open-files="1000000" Sep 19 09:51:40.498060 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490402 2579 flags.go:64] FLAG: --max-pods="110" Sep 19 09:51:40.498060 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490405 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 19 09:51:40.498060 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490408 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 19 09:51:40.498060 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490410 2579 flags.go:64] FLAG: --memory-manager-policy="None" Sep 19 09:51:40.498060 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490413 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 19 09:51:40.498060 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490416 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 19 09:51:40.498060 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490418 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 19 09:51:40.498060 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490421 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 19 09:51:40.498060 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490428 2579 flags.go:64] FLAG: --node-status-max-images="50" Sep 19 09:51:40.498060 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490431 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 19 09:51:40.498060 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490433 2579 flags.go:64] FLAG: --oom-score-adj="-999" Sep 19 09:51:40.498060 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490436 2579 flags.go:64] FLAG: --pod-cidr="" Sep 19 09:51:40.498060 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490444 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 19 09:51:40.498060 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490450 2579 flags.go:64] FLAG: --pod-manifest-path="" Sep 19 09:51:40.498060 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490453 2579 flags.go:64] FLAG: --pod-max-pids="-1" Sep 19 09:51:40.498060 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490457 2579 flags.go:64] FLAG: --pods-per-core="0" Sep 19 09:51:40.498060 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490459 2579 flags.go:64] FLAG: --port="10250" Sep 19 09:51:40.498060 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490462 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 19 09:51:40.498060 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490465 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b8ff11f968ce3d62" Sep 19 09:51:40.498060 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490468 2579 flags.go:64] FLAG: --qos-reserved="" Sep 19 09:51:40.498060 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490471 2579 flags.go:64] FLAG: --read-only-port="10255" Sep 19 09:51:40.498060 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490474 2579 flags.go:64] FLAG: --register-node="true" Sep 19 09:51:40.498060 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490478 2579 flags.go:64] FLAG: --register-with-taints="" Sep 19 09:51:40.498060 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490484 2579 flags.go:64] FLAG: --registry-burst="10" Sep 19 09:51:40.498634 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490486 2579 flags.go:64] FLAG: --registry-qps="5" Sep 19 09:51:40.498634 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490489 2579 flags.go:64] FLAG: --reserved-cpus="" Sep 19 09:51:40.498634 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490492 2579 flags.go:64] FLAG: --reserved-memory="" Sep 19 09:51:40.498634 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490496 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 19 09:51:40.498634 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490499 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 19 09:51:40.498634 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490502 2579 flags.go:64] FLAG: --rotate-certificates="false" Sep 19 09:51:40.498634 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490504 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 19 09:51:40.498634 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490507 2579 flags.go:64] FLAG: --runonce="false" Sep 19 09:51:40.498634 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490510 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 19 09:51:40.498634 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490513 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 19 09:51:40.498634 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490516 2579 flags.go:64] FLAG: --seccomp-default="false" Sep 19 09:51:40.498634 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490518 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 19 09:51:40.498634 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490521 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 19 09:51:40.498634 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490524 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 19 09:51:40.498634 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490527 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 19 09:51:40.498634 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490530 2579 flags.go:64] FLAG: --storage-driver-password="root" Sep 19 09:51:40.498634 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490532 2579 flags.go:64] FLAG: --storage-driver-secure="false" Sep 19 09:51:40.498634 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490535 2579 flags.go:64] FLAG: --storage-driver-table="stats" Sep 19 09:51:40.498634 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490538 2579 flags.go:64] FLAG: --storage-driver-user="root" Sep 19 09:51:40.498634 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490540 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 19 09:51:40.498634 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490543 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 19 09:51:40.498634 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490547 2579 flags.go:64] FLAG: --system-cgroups="" Sep 19 09:51:40.498634 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490552 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 19 09:51:40.498634 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490557 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 19 09:51:40.498634 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490560 2579 flags.go:64] FLAG: --tls-cert-file="" Sep 19 09:51:40.499452 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490563 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 19 09:51:40.499452 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490567 2579 flags.go:64] FLAG: --tls-min-version="" Sep 19 09:51:40.499452 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490570 2579 flags.go:64] FLAG: --tls-private-key-file="" Sep 19 09:51:40.499452 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490573 2579 flags.go:64] FLAG: --topology-manager-policy="none" Sep 19 09:51:40.499452 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490575 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 19 09:51:40.499452 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490579 2579 flags.go:64] FLAG: --topology-manager-scope="container" Sep 19 09:51:40.499452 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490582 2579 flags.go:64] FLAG: --v="2" Sep 19 09:51:40.499452 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490586 2579 flags.go:64] FLAG: --version="false" Sep 19 09:51:40.499452 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490590 2579 flags.go:64] FLAG: --vmodule="" Sep 19 09:51:40.499452 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490593 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 19 09:51:40.499452 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490596 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 19 09:51:40.499452 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490724 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 09:51:40.499452 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490728 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 09:51:40.499452 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490731 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 09:51:40.499452 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490734 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 09:51:40.499452 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490737 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 09:51:40.499452 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490739 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 09:51:40.499452 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490742 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 09:51:40.499452 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490744 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 09:51:40.499452 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490747 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 09:51:40.499452 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490749 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 09:51:40.499452 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490752 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 09:51:40.500260 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490754 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 09:51:40.500260 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490759 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 09:51:40.500260 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490762 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 09:51:40.500260 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490765 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 09:51:40.500260 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490768 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 09:51:40.500260 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490771 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 09:51:40.500260 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490773 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 09:51:40.500260 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490778 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 09:51:40.500260 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490781 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 09:51:40.500260 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490784 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 09:51:40.500260 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490787 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 09:51:40.500260 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490789 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 09:51:40.500260 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490792 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 09:51:40.500260 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490795 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 09:51:40.500260 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490799 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 09:51:40.500260 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490804 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 09:51:40.500260 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490807 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 09:51:40.500260 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490810 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 09:51:40.500260 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490812 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 09:51:40.500758 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490815 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 09:51:40.500758 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490818 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 09:51:40.500758 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490820 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 09:51:40.500758 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490823 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 09:51:40.500758 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490825 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 09:51:40.500758 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490828 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 09:51:40.500758 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490830 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 09:51:40.500758 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490833 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 09:51:40.500758 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490835 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 09:51:40.500758 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490837 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 09:51:40.500758 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490840 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 09:51:40.500758 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490842 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 09:51:40.500758 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490845 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 09:51:40.500758 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490847 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 09:51:40.500758 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490850 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 09:51:40.500758 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490852 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 09:51:40.500758 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490855 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 09:51:40.500758 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490857 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 09:51:40.500758 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490860 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 09:51:40.500758 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490862 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 09:51:40.501244 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490865 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 09:51:40.501244 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490868 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 09:51:40.501244 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490871 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 09:51:40.501244 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490874 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 19 09:51:40.501244 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490876 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 09:51:40.501244 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490879 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 09:51:40.501244 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490881 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 09:51:40.501244 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490884 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 09:51:40.501244 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490887 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 09:51:40.501244 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490890 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 09:51:40.501244 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490892 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 09:51:40.501244 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490895 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 09:51:40.501244 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490897 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 09:51:40.501244 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490900 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 09:51:40.501244 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490902 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 09:51:40.501244 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490906 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 09:51:40.501244 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490910 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 09:51:40.501244 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490912 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 09:51:40.501244 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490915 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 09:51:40.501742 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490918 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 09:51:40.501742 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490921 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 09:51:40.501742 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490923 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 09:51:40.501742 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490926 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 09:51:40.501742 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490928 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 09:51:40.501742 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490930 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 09:51:40.501742 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490933 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 09:51:40.501742 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490935 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 09:51:40.501742 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490938 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 09:51:40.501742 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490940 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 09:51:40.501742 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490943 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 09:51:40.501742 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490945 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 09:51:40.501742 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490948 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 09:51:40.501742 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490951 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 09:51:40.501742 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490953 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 09:51:40.501742 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490957 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 09:51:40.501742 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490959 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 09:51:40.501742 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490962 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 09:51:40.501742 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490965 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 09:51:40.501742 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490967 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 09:51:40.502217 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490970 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 09:51:40.502217 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490974 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 09:51:40.502217 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490976 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 09:51:40.502217 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490979 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 09:51:40.502217 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490982 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 09:51:40.502217 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490984 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 09:51:40.502217 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490987 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 09:51:40.502217 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490989 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 09:51:40.502217 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490992 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 09:51:40.502217 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.490994 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 09:51:40.502217 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.490999 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 19 09:51:40.502217 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.497892 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 19 09:51:40.502217 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.497908 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 19 09:51:40.502217 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.498514 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 19 09:51:40.502217 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.498521 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 19 09:51:40.502623 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498575 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 09:51:40.502623 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498580 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 09:51:40.502623 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498584 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 09:51:40.502623 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498587 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 09:51:40.502623 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498590 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 09:51:40.502623 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498592 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 09:51:40.502623 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498595 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 09:51:40.502623 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498598 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 09:51:40.502623 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498600 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 09:51:40.502623 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498603 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 09:51:40.502623 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498605 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 09:51:40.502623 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498608 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 09:51:40.502623 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498610 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 09:51:40.502623 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498613 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 09:51:40.502623 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498616 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 09:51:40.502623 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498619 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 09:51:40.502623 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498621 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 09:51:40.502623 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498624 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 09:51:40.502623 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498626 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 09:51:40.502623 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498629 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 09:51:40.503144 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498632 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 09:51:40.503144 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498634 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 09:51:40.503144 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498637 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 09:51:40.503144 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498641 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 09:51:40.503144 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498646 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 09:51:40.503144 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498651 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 09:51:40.503144 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498654 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 09:51:40.503144 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498657 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 09:51:40.503144 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498660 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 09:51:40.503144 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498664 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 09:51:40.503144 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498666 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 09:51:40.503144 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498669 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 09:51:40.503144 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498671 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 09:51:40.503144 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498674 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 09:51:40.503144 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498676 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 09:51:40.503144 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498679 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 09:51:40.503144 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498682 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 09:51:40.503144 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498685 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 09:51:40.503144 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498687 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 09:51:40.503599 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498690 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 09:51:40.503599 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498692 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 09:51:40.503599 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498715 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 09:51:40.503599 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498717 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 09:51:40.503599 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498720 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 09:51:40.503599 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498722 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 09:51:40.503599 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498725 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 09:51:40.503599 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498728 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 09:51:40.503599 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498731 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 09:51:40.503599 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498734 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 09:51:40.503599 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498736 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 09:51:40.503599 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498739 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 09:51:40.503599 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498741 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 09:51:40.503599 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498744 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 09:51:40.503599 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498747 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 09:51:40.503599 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498750 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 09:51:40.503599 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498752 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 09:51:40.503599 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498755 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 09:51:40.503599 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498758 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 09:51:40.503599 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498760 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 09:51:40.504097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498763 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 09:51:40.504097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498766 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 09:51:40.504097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498768 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 09:51:40.504097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498772 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 09:51:40.504097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498775 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 09:51:40.504097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498777 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 09:51:40.504097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498780 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 09:51:40.504097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498783 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 09:51:40.504097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498785 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 09:51:40.504097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498788 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 09:51:40.504097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498790 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 09:51:40.504097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498793 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 09:51:40.504097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498795 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 09:51:40.504097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498798 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 09:51:40.504097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498800 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 09:51:40.504097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498803 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 09:51:40.504097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498807 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 09:51:40.504097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498811 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 09:51:40.504097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498813 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 09:51:40.504097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498816 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 09:51:40.504591 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498819 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 09:51:40.504591 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498822 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 09:51:40.504591 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498824 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 09:51:40.504591 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498827 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 09:51:40.504591 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498829 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 09:51:40.504591 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498832 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 09:51:40.504591 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498835 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 09:51:40.504591 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498837 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 19 09:51:40.504591 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498840 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 09:51:40.504591 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498842 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 09:51:40.504591 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498845 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 09:51:40.504591 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498847 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 09:51:40.504591 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498850 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 09:51:40.504591 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498852 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 09:51:40.504591 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498855 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 09:51:40.504591 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498858 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 09:51:40.504591 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498861 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 09:51:40.504591 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498863 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 09:51:40.504591 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498866 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 09:51:40.504591 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.498868 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 09:51:40.505097 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.498873 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 19 09:51:40.505097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499508 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 19 09:51:40.505097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499531 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 19 09:51:40.505097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499536 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 19 09:51:40.505097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499541 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 19 09:51:40.505097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499546 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 19 09:51:40.505097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499551 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 19 09:51:40.505097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499555 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 19 09:51:40.505097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499560 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 19 09:51:40.505097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499564 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 19 09:51:40.505097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499569 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 19 09:51:40.505097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499574 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 19 09:51:40.505097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499579 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 19 09:51:40.505097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499589 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 19 09:51:40.505097 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499593 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 19 09:51:40.505466 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499598 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 19 09:51:40.505466 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499604 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 19 09:51:40.505466 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499611 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 19 09:51:40.505466 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499615 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 19 09:51:40.505466 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499619 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 19 09:51:40.505466 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499623 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 19 09:51:40.505466 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499628 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 19 09:51:40.505466 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499632 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 19 09:51:40.505466 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499637 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 19 09:51:40.505466 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499641 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 19 09:51:40.505466 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499651 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 19 09:51:40.505466 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499655 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 19 09:51:40.505466 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499659 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 19 09:51:40.505466 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499663 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 19 09:51:40.505466 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499669 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 19 09:51:40.505466 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499673 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 19 09:51:40.505466 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499678 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 19 09:51:40.505466 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499682 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 19 09:51:40.505466 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499686 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 19 09:51:40.505466 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499690 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 19 09:51:40.505984 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499712 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 19 09:51:40.505984 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499716 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 19 09:51:40.505984 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499721 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 19 09:51:40.505984 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499730 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 19 09:51:40.505984 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499734 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 19 09:51:40.505984 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499739 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 19 09:51:40.505984 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499743 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 19 09:51:40.505984 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499748 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 19 09:51:40.505984 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499752 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 19 09:51:40.505984 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499756 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 19 09:51:40.505984 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499760 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 19 09:51:40.505984 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499764 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 19 09:51:40.505984 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499768 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 19 09:51:40.505984 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499773 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 19 09:51:40.505984 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499777 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 19 09:51:40.505984 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499786 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 19 09:51:40.505984 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499791 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 19 09:51:40.505984 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499795 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 19 09:51:40.505984 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499799 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 19 09:51:40.506447 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499803 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 19 09:51:40.506447 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499808 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 19 09:51:40.506447 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499812 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 19 09:51:40.506447 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499816 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 19 09:51:40.506447 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499820 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 19 09:51:40.506447 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499824 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 19 09:51:40.506447 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499827 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 19 09:51:40.506447 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499831 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 19 09:51:40.506447 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499836 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 19 09:51:40.506447 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499845 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 19 09:51:40.506447 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499850 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 19 09:51:40.506447 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499856 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 19 09:51:40.506447 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499860 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 19 09:51:40.506447 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499864 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 19 09:51:40.506447 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499866 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 19 09:51:40.506447 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499869 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 19 09:51:40.506447 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499874 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 19 09:51:40.506447 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499877 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 19 09:51:40.506447 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499881 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 19 09:51:40.506447 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499884 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 19 09:51:40.507030 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499887 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 19 09:51:40.507030 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499890 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 19 09:51:40.507030 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499893 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 19 09:51:40.507030 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499898 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 19 09:51:40.507030 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499902 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 19 09:51:40.507030 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499907 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 19 09:51:40.507030 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499912 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 19 09:51:40.507030 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499916 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 19 09:51:40.507030 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499921 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 19 09:51:40.507030 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499926 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 19 09:51:40.507030 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499930 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 19 09:51:40.507030 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499935 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 19 09:51:40.507030 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499939 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 19 09:51:40.507030 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499944 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 19 09:51:40.507030 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499948 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 19 09:51:40.507030 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499953 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 19 09:51:40.507030 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499962 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 19 09:51:40.507030 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499968 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 19 09:51:40.507030 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499974 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 19 09:51:40.507538 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499979 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 19 09:51:40.507538 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499983 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 19 09:51:40.507538 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499989 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 19 09:51:40.507538 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499993 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 19 09:51:40.507538 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.499998 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 19 09:51:40.507538 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.500002 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 19 09:51:40.507538 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:40.500007 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 19 09:51:40.507538 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.500015 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 19 09:51:40.507538 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.500437 2579 server.go:962] "Client rotation is on, will bootstrap in background" Sep 19 09:51:40.507538 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.502405 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 19 09:51:40.507538 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.503758 2579 server.go:1019] "Starting client certificate rotation" Sep 19 09:51:40.507538 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.503850 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 19 09:51:40.507538 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.503882 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 19 09:51:40.507538 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.505959 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 19 09:51:40.507916 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.507104 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 19 09:51:40.517126 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.517109 2579 log.go:25] "Validated CRI v1 runtime API" Sep 19 09:51:40.520710 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.520679 2579 log.go:25] "Validated CRI v1 image API" Sep 19 09:51:40.521542 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.521528 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 19 09:51:40.526143 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.526122 2579 fs.go:135] Filesystem UUIDs: map[59f874a1-4372-459d-bb97-5056b2179f52:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 80aa0f1c-19f2-40b4-a9e1-0626acd6c546:/dev/nvme0n1p3] Sep 19 09:51:40.526225 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.526141 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 19 09:51:40.531788 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.531653 2579 manager.go:216] Machine: {Timestamp:2026-09-19 09:51:40.529824736 +0000 UTC m=+0.330608023 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102865 MemoryCapacity:32812150784 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ebae1e16f0c2cc282ffada006e8fd SystemUUID:ec2ebae1-e16f-0c2c-c282-ffada006e8fd BootID:ee9a30d5-aeee-4b5b-a926-da766961e581 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406073344 Type:vfs Inodes:4005389 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:cd:b1:b6:ef Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:cd:b1:b6:ef Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:15:1d:5d:1a:81 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812150784 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 19 09:51:40.531788 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.531777 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 19 09:51:40.531934 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.531877 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 19 09:51:40.534666 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.534650 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 19 09:51:40.534916 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.534889 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 19 09:51:40.535087 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.534924 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-110.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 19 09:51:40.535692 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.535683 2579 topology_manager.go:138] "Creating topology manager with none policy" Sep 19 09:51:40.535692 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.535706 2579 container_manager_linux.go:309] "Creating device plugin manager" Sep 19 09:51:40.535774 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.535715 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 19 09:51:40.536440 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.536430 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 19 09:51:40.537658 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.537649 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 19 09:51:40.541737 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.541726 2579 state_mem.go:36] "Initialized new in-memory state store" Sep 19 09:51:40.541854 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.541844 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 19 09:51:40.541894 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.541875 2579 kubelet.go:486] "Attempting to sync node with API server" Sep 19 09:51:40.541894 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.541884 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 19 09:51:40.541957 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.541899 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 19 09:51:40.541957 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.541908 2579 kubelet.go:398] "Adding apiserver pod source" Sep 19 09:51:40.541957 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.541918 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 19 09:51:40.542455 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.542441 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 19 09:51:40.542501 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.542467 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 19 09:51:40.546240 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.546222 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 19 09:51:40.548367 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.548350 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 19 09:51:40.548457 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.548389 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 19 09:51:40.549860 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.549845 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 19 09:51:40.549931 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.549869 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 19 09:51:40.549931 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.549878 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 19 09:51:40.549931 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.549886 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 19 09:51:40.549931 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.549898 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 19 09:51:40.549931 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.549906 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 19 09:51:40.549931 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.549925 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 19 09:51:40.549931 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.549932 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 19 09:51:40.550149 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.549942 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 19 09:51:40.550149 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.549951 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 19 09:51:40.550149 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.549964 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 19 09:51:40.550149 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.549973 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 19 09:51:40.550590 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.550578 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 19 09:51:40.550636 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.550592 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 19 09:51:40.551462 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:40.551436 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 19 09:51:40.551529 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:40.551436 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-110.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 19 09:51:40.552894 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.552874 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-110.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 19 09:51:40.554397 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.554382 2579 server.go:1268] "Started kubelet" Sep 19 09:51:40.554499 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.554456 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 19 09:51:40.554558 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.554515 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 19 09:51:40.554597 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.554440 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 19 09:51:40.555201 ip-10-0-142-110 systemd[1]: Started Kubernetes Kubelet. Sep 19 09:51:40.555687 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.555669 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 19 09:51:40.557121 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.557105 2579 server.go:310] "Adding debug handlers to kubelet server" Sep 19 09:51:40.557469 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.557447 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-799xj" Sep 19 09:51:40.558730 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:40.558662 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 19 09:51:40.560398 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:40.559242 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-110.ec2.internal.18d6b013b173842c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-110.ec2.internal,UID:ip-10-0-142-110.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-110.ec2.internal,},FirstTimestamp:2026-09-19 09:51:40.554355756 +0000 UTC m=+0.355139044,LastTimestamp:2026-09-19 09:51:40.554355756 +0000 UTC m=+0.355139044,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-110.ec2.internal,}" Sep 19 09:51:40.562051 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.562036 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 19 09:51:40.562630 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.562617 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 19 09:51:40.562792 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:40.562764 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-110.ec2.internal\" not found" Sep 19 09:51:40.563161 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.563144 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 19 09:51:40.563161 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.563148 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 19 09:51:40.563299 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.563170 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 19 09:51:40.563299 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.563276 2579 reconstruct.go:97] "Volume reconstruction finished" Sep 19 09:51:40.563299 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.563281 2579 reconciler.go:29] "Reconciler: start to sync state" Sep 19 09:51:40.563589 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.563577 2579 factory.go:55] Registering systemd factory Sep 19 09:51:40.563635 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.563607 2579 factory.go:223] Registration of the systemd container factory successfully Sep 19 09:51:40.563867 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.563852 2579 factory.go:153] Registering CRI-O factory Sep 19 09:51:40.563867 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.563868 2579 factory.go:223] Registration of the crio container factory successfully Sep 19 09:51:40.564018 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.563918 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 19 09:51:40.564018 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.563960 2579 factory.go:103] Registering Raw factory Sep 19 09:51:40.564018 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.563977 2579 manager.go:1196] Started watching for new ooms in manager Sep 19 09:51:40.564375 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.564362 2579 manager.go:349] Starting recovery of all containers Sep 19 09:51:40.565416 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.565397 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-799xj" Sep 19 09:51:40.572441 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.572415 2579 manager.go:354] Recovery completed Sep 19 09:51:40.580524 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.580505 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 09:51:40.581160 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.581145 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 09:51:40.582263 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.582246 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientMemory" Sep 19 09:51:40.582334 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.582276 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 09:51:40.582334 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.582286 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientPID" Sep 19 09:51:40.582511 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:40.582486 2579 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-110.ec2.internal\" not found" node="ip-10-0-142-110.ec2.internal" Sep 19 09:51:40.582920 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.582903 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 19 09:51:40.582973 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.582922 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 19 09:51:40.582973 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.582941 2579 state_mem.go:36] "Initialized new in-memory state store" Sep 19 09:51:40.583039 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.582913 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 09:51:40.583728 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.583714 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientMemory" Sep 19 09:51:40.583793 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.583740 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 09:51:40.583793 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.583753 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientPID" Sep 19 09:51:40.585014 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.585002 2579 policy_none.go:49] "None policy: Start" Sep 19 09:51:40.585052 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.585018 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 19 09:51:40.585052 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.585028 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 19 09:51:40.586920 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.586906 2579 policy_none.go:47] "Start" Sep 19 09:51:40.628294 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.628272 2579 manager.go:337] "Starting Device Plugin manager" Sep 19 09:51:40.643232 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:40.628317 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 19 09:51:40.643232 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.628327 2579 server.go:87] "Starting device plugin registration server" Sep 19 09:51:40.643232 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.628554 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 19 09:51:40.643232 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.628564 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 19 09:51:40.643232 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.628655 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 19 09:51:40.643232 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.628754 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 19 09:51:40.643232 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.628762 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 19 09:51:40.643232 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:40.629335 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 19 09:51:40.643232 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:40.629394 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-110.ec2.internal\" not found" Sep 19 09:51:40.692471 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.692425 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 19 09:51:40.693810 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.693787 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 19 09:51:40.693930 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.693844 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 19 09:51:40.693930 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.693873 2579 kubelet.go:2448] "Starting kubelet main sync loop" Sep 19 09:51:40.693930 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:40.693920 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 19 09:51:40.696282 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.696261 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 09:51:40.729534 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.729499 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 09:51:40.730517 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.730496 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientMemory" Sep 19 09:51:40.730619 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.730535 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 09:51:40.730619 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.730550 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientPID" Sep 19 09:51:40.730619 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.730576 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-110.ec2.internal" Sep 19 09:51:40.738823 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.738776 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-110.ec2.internal" Sep 19 09:51:40.738823 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:40.738800 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-110.ec2.internal\": node \"ip-10-0-142-110.ec2.internal\" not found" Sep 19 09:51:40.752420 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:40.752395 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-110.ec2.internal\" not found" Sep 19 09:51:40.794478 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.794430 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal"] Sep 19 09:51:40.794645 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.794523 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 09:51:40.795594 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.795575 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientMemory" Sep 19 09:51:40.795677 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.795614 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 09:51:40.795677 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.795629 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientPID" Sep 19 09:51:40.798010 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.797997 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 09:51:40.798145 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.798131 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal" Sep 19 09:51:40.798183 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.798161 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 09:51:40.798872 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.798855 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientMemory" Sep 19 09:51:40.798872 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.798870 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientMemory" Sep 19 09:51:40.798968 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.798888 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 09:51:40.798968 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.798891 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 09:51:40.798968 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.798898 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientPID" Sep 19 09:51:40.798968 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.798903 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientPID" Sep 19 09:51:40.801103 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.801087 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal" Sep 19 09:51:40.801190 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.801112 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 19 09:51:40.801843 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.801826 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientMemory" Sep 19 09:51:40.801930 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.801856 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasNoDiskPressure" Sep 19 09:51:40.801930 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.801871 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientPID" Sep 19 09:51:40.825438 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:40.825415 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-110.ec2.internal\" not found" node="ip-10-0-142-110.ec2.internal" Sep 19 09:51:40.830022 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:40.830005 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-110.ec2.internal\" not found" node="ip-10-0-142-110.ec2.internal" Sep 19 09:51:40.852639 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:40.852604 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-110.ec2.internal\" not found" Sep 19 09:51:40.864979 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.864953 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2e40f5fbb603a9d1bc50add58c51c34d-config\") pod \"kube-apiserver-proxy-ip-10-0-142-110.ec2.internal\" (UID: \"2e40f5fbb603a9d1bc50add58c51c34d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal" Sep 19 09:51:40.865077 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.864985 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b20ed8df870b33f385257a035bb630e5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal\" (UID: \"b20ed8df870b33f385257a035bb630e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal" Sep 19 09:51:40.865077 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.865020 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b20ed8df870b33f385257a035bb630e5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal\" (UID: \"b20ed8df870b33f385257a035bb630e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal" Sep 19 09:51:40.953675 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:40.953642 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-110.ec2.internal\" not found" Sep 19 09:51:40.966026 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.965996 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b20ed8df870b33f385257a035bb630e5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal\" (UID: \"b20ed8df870b33f385257a035bb630e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal" Sep 19 09:51:40.966098 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.966031 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b20ed8df870b33f385257a035bb630e5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal\" (UID: \"b20ed8df870b33f385257a035bb630e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal" Sep 19 09:51:40.966098 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.966047 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2e40f5fbb603a9d1bc50add58c51c34d-config\") pod \"kube-apiserver-proxy-ip-10-0-142-110.ec2.internal\" (UID: \"2e40f5fbb603a9d1bc50add58c51c34d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal" Sep 19 09:51:40.966190 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.966110 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b20ed8df870b33f385257a035bb630e5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal\" (UID: \"b20ed8df870b33f385257a035bb630e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal" Sep 19 09:51:40.966190 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.966120 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2e40f5fbb603a9d1bc50add58c51c34d-config\") pod \"kube-apiserver-proxy-ip-10-0-142-110.ec2.internal\" (UID: \"2e40f5fbb603a9d1bc50add58c51c34d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal" Sep 19 09:51:40.966190 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:40.966126 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b20ed8df870b33f385257a035bb630e5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal\" (UID: \"b20ed8df870b33f385257a035bb630e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal" Sep 19 09:51:41.054499 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:41.054415 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-110.ec2.internal\" not found" Sep 19 09:51:41.128961 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:41.128914 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal" Sep 19 09:51:41.133040 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:41.133018 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal" Sep 19 09:51:41.154782 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:41.154580 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-110.ec2.internal\" not found" Sep 19 09:51:41.255047 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:41.255001 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-110.ec2.internal\" not found" Sep 19 09:51:41.355568 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:41.355514 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-110.ec2.internal\" not found" Sep 19 09:51:41.455962 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:41.455934 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-110.ec2.internal\" not found" Sep 19 09:51:41.503484 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:41.503457 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 19 09:51:41.503921 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:41.503586 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 19 09:51:41.503921 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:41.503622 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 19 09:51:41.556679 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:41.556652 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-110.ec2.internal\" not found" Sep 19 09:51:41.570457 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:41.570431 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-18 09:46:40 +0000 UTC" deadline="2028-04-21 05:59:31.755544236 +0000 UTC" Sep 19 09:51:41.570457 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:41.570456 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13916h7m50.185090689s" Sep 19 09:51:41.656839 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:41.656760 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-110.ec2.internal\" not found" Sep 19 09:51:41.676012 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:41.675989 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 09:51:41.735726 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:41.735647 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e40f5fbb603a9d1bc50add58c51c34d.slice/crio-4dc42609cadeac7ff3350f502bfc9671e7ebd0f4a57a81bc2044ad8557d4e6d6 WatchSource:0}: Error finding container 4dc42609cadeac7ff3350f502bfc9671e7ebd0f4a57a81bc2044ad8557d4e6d6: Status 404 returned error can't find the container with id 4dc42609cadeac7ff3350f502bfc9671e7ebd0f4a57a81bc2044ad8557d4e6d6 Sep 19 09:51:41.735947 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:41.735921 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb20ed8df870b33f385257a035bb630e5.slice/crio-c9147879015fd465a568a46f8956d07a4e85d1c0aa30dcc3c33e1d7940f20e19 WatchSource:0}: Error finding container c9147879015fd465a568a46f8956d07a4e85d1c0aa30dcc3c33e1d7940f20e19: Status 404 returned error can't find the container with id c9147879015fd465a568a46f8956d07a4e85d1c0aa30dcc3c33e1d7940f20e19 Sep 19 09:51:41.741312 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:41.741297 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 19 09:51:41.763379 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:41.763359 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal" Sep 19 09:51:41.770563 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:41.770549 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 19 09:51:41.772074 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:41.772063 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal" Sep 19 09:51:41.780572 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:41.780560 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 19 09:51:41.853707 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:41.853665 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 09:51:42.393294 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.393124 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 09:51:42.472578 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.472409 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 19 09:51:42.543685 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.543653 2579 apiserver.go:52] "Watching apiserver" Sep 19 09:51:42.554357 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.554320 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 19 09:51:42.554844 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.554805 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-sj4wm","openshift-ovn-kubernetes/ovnkube-node-sdnzv","kube-system/konnectivity-agent-rxntx","kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lw4hg","openshift-cluster-node-tuning-operator/tuned-4n8zb","openshift-image-registry/node-ca-mvk4m","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal","openshift-multus/multus-additional-cni-plugins-7cp7g","openshift-network-operator/iptables-alerter-x7lsw","kube-system/global-pull-secret-syncer-42rhb","openshift-dns/node-resolver-sv4k8","openshift-multus/multus-8pk6q","openshift-multus/network-metrics-daemon-cxdbk"] Sep 19 09:51:42.557501 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.557474 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x7lsw" Sep 19 09:51:42.559935 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.559909 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 19 09:51:42.560155 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.560137 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-psbkj\"" Sep 19 09:51:42.560214 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.560197 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 19 09:51:42.560306 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.560147 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 19 09:51:42.560507 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.560491 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.562123 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.562100 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rxntx" Sep 19 09:51:42.562400 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.562381 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 19 09:51:42.563223 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.563063 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 19 09:51:42.563819 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.563510 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 19 09:51:42.563819 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.563553 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 19 09:51:42.563819 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.563623 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 19 09:51:42.563819 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.563696 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-v5mwg\"" Sep 19 09:51:42.564315 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.564287 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 19 09:51:42.564817 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.564483 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:51:42.564817 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:42.564552 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxdbk" podUID="5e7c4050-b0c9-4afe-86a1-e83b1cf46a27" Sep 19 09:51:42.564817 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.564600 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 19 09:51:42.564817 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.564646 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-x5l6n\"" Sep 19 09:51:42.567853 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.567833 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lw4hg" Sep 19 09:51:42.570016 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.569989 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nhwcg\"" Sep 19 09:51:42.570209 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.570194 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 19 09:51:42.570374 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.570359 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 19 09:51:42.570543 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.570521 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 19 09:51:42.570734 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.570711 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.572584 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.572563 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7cp7g" Sep 19 09:51:42.573192 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.572924 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 19 09:51:42.573192 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.572942 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 19 09:51:42.573192 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.573026 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8p9xx\"" Sep 19 09:51:42.575056 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.575038 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hcnlm\"" Sep 19 09:51:42.575139 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.575075 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 19 09:51:42.575258 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.575239 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 19 09:51:42.575616 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.575453 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e7c4050-b0c9-4afe-86a1-e83b1cf46a27-metrics-certs\") pod \"network-metrics-daemon-cxdbk\" (UID: \"5e7c4050-b0c9-4afe-86a1-e83b1cf46a27\") " pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:51:42.575616 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.575488 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/28fb274a-9cae-4f18-a94f-97865ef09f45-iptables-alerter-script\") pod \"iptables-alerter-x7lsw\" (UID: \"28fb274a-9cae-4f18-a94f-97865ef09f45\") " pod="openshift-network-operator/iptables-alerter-x7lsw" Sep 19 09:51:42.575616 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.575513 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28fb274a-9cae-4f18-a94f-97865ef09f45-host-slash\") pod \"iptables-alerter-x7lsw\" (UID: \"28fb274a-9cae-4f18-a94f-97865ef09f45\") " pod="openshift-network-operator/iptables-alerter-x7lsw" Sep 19 09:51:42.575616 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.575535 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhn9s\" (UniqueName: \"kubernetes.io/projected/28fb274a-9cae-4f18-a94f-97865ef09f45-kube-api-access-vhn9s\") pod \"iptables-alerter-x7lsw\" (UID: \"28fb274a-9cae-4f18-a94f-97865ef09f45\") " pod="openshift-network-operator/iptables-alerter-x7lsw" Sep 19 09:51:42.575616 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.575556 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-host-run-netns\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.575926 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.575787 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mvk4m" Sep 19 09:51:42.576434 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.576415 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnct2\" (UniqueName: \"kubernetes.io/projected/5e7c4050-b0c9-4afe-86a1-e83b1cf46a27-kube-api-access-hnct2\") pod \"network-metrics-daemon-cxdbk\" (UID: \"5e7c4050-b0c9-4afe-86a1-e83b1cf46a27\") " pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:51:42.576523 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.576447 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-host-var-lib-cni-bin\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.576523 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.576471 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-host-var-lib-kubelet\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.576523 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.576504 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-hostroot\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.576675 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.576526 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-multus-conf-dir\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.576675 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.576548 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/376e12c4-2b51-4e58-baa4-56f54d631255-multus-daemon-config\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.576675 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.576572 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-host-run-multus-certs\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.576675 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.576595 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-etc-kubernetes\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.576675 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.576642 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-multus-cni-dir\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.577058 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.576669 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/376e12c4-2b51-4e58-baa4-56f54d631255-cni-binary-copy\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.577058 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.576713 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-multus-socket-dir-parent\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.577058 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.576787 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2ecdf95f-237b-41ea-a042-a6a821fab942-agent-certs\") pod \"konnectivity-agent-rxntx\" (UID: \"2ecdf95f-237b-41ea-a042-a6a821fab942\") " pod="kube-system/konnectivity-agent-rxntx" Sep 19 09:51:42.577058 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.576859 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-system-cni-dir\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.577058 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.576904 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-cnibin\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.577058 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.576930 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-host-run-k8s-cni-cncf-io\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.577058 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.576955 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-host-var-lib-cni-multus\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.577058 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.576979 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qspkm\" (UniqueName: \"kubernetes.io/projected/376e12c4-2b51-4e58-baa4-56f54d631255-kube-api-access-qspkm\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.577058 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.577003 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2ecdf95f-237b-41ea-a042-a6a821fab942-konnectivity-ca\") pod \"konnectivity-agent-rxntx\" (UID: \"2ecdf95f-237b-41ea-a042-a6a821fab942\") " pod="kube-system/konnectivity-agent-rxntx" Sep 19 09:51:42.577684 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.577663 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 19 09:51:42.577999 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.577981 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 19 09:51:42.578084 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.578017 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 19 09:51:42.578230 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.578210 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fr2wr\"" Sep 19 09:51:42.578338 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.578317 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 19 09:51:42.578830 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.578809 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.581141 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.580900 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 19 09:51:42.581141 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.580949 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 19 09:51:42.581141 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.580974 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 19 09:51:42.581141 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.580991 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 19 09:51:42.581141 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.580908 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pp45x\"" Sep 19 09:51:42.581447 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.581201 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 19 09:51:42.581447 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.581211 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sj4wm" Sep 19 09:51:42.581447 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:42.581261 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sj4wm" podUID="bf45aeae-2af8-46e2-9c5e-e92f0f2d745d" Sep 19 09:51:42.582125 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.582112 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 19 09:51:42.584204 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.584184 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:51:42.584305 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:42.584248 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42rhb" podUID="a5862d53-93df-4d28-9fb5-48d60ee4a821" Sep 19 09:51:42.586624 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.586599 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sv4k8" Sep 19 09:51:42.588768 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.588731 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 19 09:51:42.588864 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.588816 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bnhwd\"" Sep 19 09:51:42.588864 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.588847 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 19 09:51:42.602962 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.602938 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-f7jqw" Sep 19 09:51:42.610911 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.610891 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-f7jqw" Sep 19 09:51:42.664658 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.664599 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 19 09:51:42.677658 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.677635 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-host\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.677850 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.677668 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/621ae7f4-6b60-4424-95fe-a400cf2f6e01-serviceca\") pod \"node-ca-mvk4m\" (UID: \"621ae7f4-6b60-4424-95fe-a400cf2f6e01\") " pod="openshift-image-registry/node-ca-mvk4m" Sep 19 09:51:42.677850 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.677757 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-host-var-lib-cni-bin\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.677850 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.677804 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-etc-sysconfig\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.678005 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.677867 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-host-var-lib-cni-bin\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.678005 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.677914 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-multus-cni-dir\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.678005 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.677942 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/376e12c4-2b51-4e58-baa4-56f54d631255-cni-binary-copy\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.678005 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.677969 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-host-run-netns\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.678005 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.677999 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-var-lib-openvswitch\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.678225 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678025 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-node-log\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.678225 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678050 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3f1d9116-9add-4252-8f32-cccb1f9ee76f-ovn-node-metrics-cert\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.678225 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678075 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-etc-systemd\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.678225 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678095 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-host-run-k8s-cni-cncf-io\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.678225 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678111 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3a792c07-63a4-43fc-9a3c-649c63c3ad36-device-dir\") pod \"aws-ebs-csi-driver-node-lw4hg\" (UID: \"3a792c07-63a4-43fc-9a3c-649c63c3ad36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lw4hg" Sep 19 09:51:42.678225 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678126 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3a792c07-63a4-43fc-9a3c-649c63c3ad36-etc-selinux\") pod \"aws-ebs-csi-driver-node-lw4hg\" (UID: \"3a792c07-63a4-43fc-9a3c-649c63c3ad36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lw4hg" Sep 19 09:51:42.678225 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678141 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xl9x\" (UniqueName: \"kubernetes.io/projected/3f1d9116-9add-4252-8f32-cccb1f9ee76f-kube-api-access-4xl9x\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.678225 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678156 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-sys\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.678225 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678174 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/28fb274a-9cae-4f18-a94f-97865ef09f45-iptables-alerter-script\") pod \"iptables-alerter-x7lsw\" (UID: \"28fb274a-9cae-4f18-a94f-97865ef09f45\") " pod="openshift-network-operator/iptables-alerter-x7lsw" Sep 19 09:51:42.678225 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678183 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-multus-cni-dir\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.678225 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678189 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-hostroot\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.678225 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678217 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-hostroot\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.678825 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678224 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-host-run-multus-certs\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.678825 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678266 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-host-kubelet\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.678825 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678278 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-host-run-k8s-cni-cncf-io\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.678825 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678290 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdtcj\" (UniqueName: \"kubernetes.io/projected/9db1da1a-1030-4fbe-8222-b10ef157bf76-kube-api-access-mdtcj\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.678825 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678316 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9f6cca46-77e3-4de4-abac-85520c106e82-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7cp7g\" (UID: \"9f6cca46-77e3-4de4-abac-85520c106e82\") " pod="openshift-multus/multus-additional-cni-plugins-7cp7g" Sep 19 09:51:42.678825 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678349 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/621ae7f4-6b60-4424-95fe-a400cf2f6e01-host\") pod \"node-ca-mvk4m\" (UID: \"621ae7f4-6b60-4424-95fe-a400cf2f6e01\") " pod="openshift-image-registry/node-ca-mvk4m" Sep 19 09:51:42.678825 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678365 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-host-run-multus-certs\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.678825 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678377 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3a792c07-63a4-43fc-9a3c-649c63c3ad36-socket-dir\") pod \"aws-ebs-csi-driver-node-lw4hg\" (UID: \"3a792c07-63a4-43fc-9a3c-649c63c3ad36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lw4hg" Sep 19 09:51:42.678825 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678402 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-run-systemd\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.678825 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678427 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-log-socket\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.678825 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678451 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-lib-modules\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.678825 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678478 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-cnibin\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.678825 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678507 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f6cca46-77e3-4de4-abac-85520c106e82-system-cni-dir\") pod \"multus-additional-cni-plugins-7cp7g\" (UID: \"9f6cca46-77e3-4de4-abac-85520c106e82\") " pod="openshift-multus/multus-additional-cni-plugins-7cp7g" Sep 19 09:51:42.678825 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678533 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9f6cca46-77e3-4de4-abac-85520c106e82-cnibin\") pod \"multus-additional-cni-plugins-7cp7g\" (UID: \"9f6cca46-77e3-4de4-abac-85520c106e82\") " pod="openshift-multus/multus-additional-cni-plugins-7cp7g" Sep 19 09:51:42.678825 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678560 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9f6cca46-77e3-4de4-abac-85520c106e82-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7cp7g\" (UID: \"9f6cca46-77e3-4de4-abac-85520c106e82\") " pod="openshift-multus/multus-additional-cni-plugins-7cp7g" Sep 19 09:51:42.678825 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678586 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w7fs\" (UniqueName: \"kubernetes.io/projected/9f6cca46-77e3-4de4-abac-85520c106e82-kube-api-access-4w7fs\") pod \"multus-additional-cni-plugins-7cp7g\" (UID: \"9f6cca46-77e3-4de4-abac-85520c106e82\") " pod="openshift-multus/multus-additional-cni-plugins-7cp7g" Sep 19 09:51:42.679487 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678613 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.679487 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678641 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3f1d9116-9add-4252-8f32-cccb1f9ee76f-ovnkube-config\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.679487 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678678 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3f1d9116-9add-4252-8f32-cccb1f9ee76f-ovnkube-script-lib\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.679487 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678690 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/376e12c4-2b51-4e58-baa4-56f54d631255-cni-binary-copy\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.679487 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678705 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28fb274a-9cae-4f18-a94f-97865ef09f45-host-slash\") pod \"iptables-alerter-x7lsw\" (UID: \"28fb274a-9cae-4f18-a94f-97865ef09f45\") " pod="openshift-network-operator/iptables-alerter-x7lsw" Sep 19 09:51:42.679487 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678732 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-multus-conf-dir\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.679487 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678781 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-etc-kubernetes\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.679487 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678809 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3a792c07-63a4-43fc-9a3c-649c63c3ad36-registration-dir\") pod \"aws-ebs-csi-driver-node-lw4hg\" (UID: \"3a792c07-63a4-43fc-9a3c-649c63c3ad36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lw4hg" Sep 19 09:51:42.679487 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678834 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3a792c07-63a4-43fc-9a3c-649c63c3ad36-sys-fs\") pod \"aws-ebs-csi-driver-node-lw4hg\" (UID: \"3a792c07-63a4-43fc-9a3c-649c63c3ad36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lw4hg" Sep 19 09:51:42.679487 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678858 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5gnq\" (UniqueName: \"kubernetes.io/projected/3a792c07-63a4-43fc-9a3c-649c63c3ad36-kube-api-access-s5gnq\") pod \"aws-ebs-csi-driver-node-lw4hg\" (UID: \"3a792c07-63a4-43fc-9a3c-649c63c3ad36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lw4hg" Sep 19 09:51:42.679487 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678882 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/28fb274a-9cae-4f18-a94f-97865ef09f45-iptables-alerter-script\") pod \"iptables-alerter-x7lsw\" (UID: \"28fb274a-9cae-4f18-a94f-97865ef09f45\") " pod="openshift-network-operator/iptables-alerter-x7lsw" Sep 19 09:51:42.679487 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678884 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-host-slash\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.679487 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678925 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9db1da1a-1030-4fbe-8222-b10ef157bf76-tmp\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.679487 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678983 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-cnibin\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.679487 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.678983 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-host-run-ovn-kubernetes\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.679487 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679003 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-etc-kubernetes\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.679487 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679010 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-multus-conf-dir\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.680218 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679011 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0fab0c31-fc90-48c2-ba03-ba1bf2abe9b1-hosts-file\") pod \"node-resolver-sv4k8\" (UID: \"0fab0c31-fc90-48c2-ba03-ba1bf2abe9b1\") " pod="openshift-dns/node-resolver-sv4k8" Sep 19 09:51:42.680218 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679041 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28fb274a-9cae-4f18-a94f-97865ef09f45-host-slash\") pod \"iptables-alerter-x7lsw\" (UID: \"28fb274a-9cae-4f18-a94f-97865ef09f45\") " pod="openshift-network-operator/iptables-alerter-x7lsw" Sep 19 09:51:42.680218 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679074 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-host-var-lib-kubelet\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.680218 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679092 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8fnj\" (UniqueName: \"kubernetes.io/projected/0fab0c31-fc90-48c2-ba03-ba1bf2abe9b1-kube-api-access-v8fnj\") pod \"node-resolver-sv4k8\" (UID: \"0fab0c31-fc90-48c2-ba03-ba1bf2abe9b1\") " pod="openshift-dns/node-resolver-sv4k8" Sep 19 09:51:42.680218 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679113 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-run-openvswitch\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.680218 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679123 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-host-var-lib-kubelet\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.680218 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679150 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5862d53-93df-4d28-9fb5-48d60ee4a821-original-pull-secret\") pod \"global-pull-secret-syncer-42rhb\" (UID: \"a5862d53-93df-4d28-9fb5-48d60ee4a821\") " pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:51:42.680218 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679166 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-var-lib-kubelet\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.680218 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679188 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-multus-socket-dir-parent\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.680218 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679233 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lbs8\" (UniqueName: \"kubernetes.io/projected/bf45aeae-2af8-46e2-9c5e-e92f0f2d745d-kube-api-access-6lbs8\") pod \"network-check-target-sj4wm\" (UID: \"bf45aeae-2af8-46e2-9c5e-e92f0f2d745d\") " pod="openshift-network-diagnostics/network-check-target-sj4wm" Sep 19 09:51:42.680218 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679257 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3a792c07-63a4-43fc-9a3c-649c63c3ad36-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lw4hg\" (UID: \"3a792c07-63a4-43fc-9a3c-649c63c3ad36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lw4hg" Sep 19 09:51:42.680218 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679282 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-etc-openvswitch\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.680218 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679309 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-run-ovn\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.680218 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679326 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-multus-socket-dir-parent\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.680218 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679344 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a5862d53-93df-4d28-9fb5-48d60ee4a821-dbus\") pod \"global-pull-secret-syncer-42rhb\" (UID: \"a5862d53-93df-4d28-9fb5-48d60ee4a821\") " pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:51:42.680218 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679371 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-etc-kubernetes\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.680218 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679390 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9db1da1a-1030-4fbe-8222-b10ef157bf76-etc-tuned\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.680929 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679404 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fab0c31-fc90-48c2-ba03-ba1bf2abe9b1-tmp-dir\") pod \"node-resolver-sv4k8\" (UID: \"0fab0c31-fc90-48c2-ba03-ba1bf2abe9b1\") " pod="openshift-dns/node-resolver-sv4k8" Sep 19 09:51:42.680929 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679421 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9f6cca46-77e3-4de4-abac-85520c106e82-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7cp7g\" (UID: \"9f6cca46-77e3-4de4-abac-85520c106e82\") " pod="openshift-multus/multus-additional-cni-plugins-7cp7g" Sep 19 09:51:42.680929 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679445 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-systemd-units\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.680929 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679469 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg8f7\" (UniqueName: \"kubernetes.io/projected/621ae7f4-6b60-4424-95fe-a400cf2f6e01-kube-api-access-vg8f7\") pod \"node-ca-mvk4m\" (UID: \"621ae7f4-6b60-4424-95fe-a400cf2f6e01\") " pod="openshift-image-registry/node-ca-mvk4m" Sep 19 09:51:42.680929 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679488 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2ecdf95f-237b-41ea-a042-a6a821fab942-konnectivity-ca\") pod \"konnectivity-agent-rxntx\" (UID: \"2ecdf95f-237b-41ea-a042-a6a821fab942\") " pod="kube-system/konnectivity-agent-rxntx" Sep 19 09:51:42.680929 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679513 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-host-run-netns\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.680929 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679597 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/376e12c4-2b51-4e58-baa4-56f54d631255-multus-daemon-config\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.680929 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679607 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-host-run-netns\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.680929 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679630 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3f1d9116-9add-4252-8f32-cccb1f9ee76f-env-overrides\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.680929 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679649 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnct2\" (UniqueName: \"kubernetes.io/projected/5e7c4050-b0c9-4afe-86a1-e83b1cf46a27-kube-api-access-hnct2\") pod \"network-metrics-daemon-cxdbk\" (UID: \"5e7c4050-b0c9-4afe-86a1-e83b1cf46a27\") " pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:51:42.680929 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679693 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9f6cca46-77e3-4de4-abac-85520c106e82-cni-binary-copy\") pod \"multus-additional-cni-plugins-7cp7g\" (UID: \"9f6cca46-77e3-4de4-abac-85520c106e82\") " pod="openshift-multus/multus-additional-cni-plugins-7cp7g" Sep 19 09:51:42.680929 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679746 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-host-cni-bin\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.680929 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679772 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-run\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.680929 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679802 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2ecdf95f-237b-41ea-a042-a6a821fab942-agent-certs\") pod \"konnectivity-agent-rxntx\" (UID: \"2ecdf95f-237b-41ea-a042-a6a821fab942\") " pod="kube-system/konnectivity-agent-rxntx" Sep 19 09:51:42.680929 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679826 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a5862d53-93df-4d28-9fb5-48d60ee4a821-kubelet-config\") pod \"global-pull-secret-syncer-42rhb\" (UID: \"a5862d53-93df-4d28-9fb5-48d60ee4a821\") " pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:51:42.680929 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679862 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-etc-sysctl-d\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.680929 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.679974 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-system-cni-dir\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.681557 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.680002 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-host-var-lib-cni-multus\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.681557 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.680026 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2ecdf95f-237b-41ea-a042-a6a821fab942-konnectivity-ca\") pod \"konnectivity-agent-rxntx\" (UID: \"2ecdf95f-237b-41ea-a042-a6a821fab942\") " pod="kube-system/konnectivity-agent-rxntx" Sep 19 09:51:42.681557 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.680037 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-etc-modprobe-d\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.681557 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.680064 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qspkm\" (UniqueName: \"kubernetes.io/projected/376e12c4-2b51-4e58-baa4-56f54d631255-kube-api-access-qspkm\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.681557 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.680071 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-system-cni-dir\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.681557 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.680093 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e7c4050-b0c9-4afe-86a1-e83b1cf46a27-metrics-certs\") pod \"network-metrics-daemon-cxdbk\" (UID: \"5e7c4050-b0c9-4afe-86a1-e83b1cf46a27\") " pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:51:42.681557 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.680100 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/376e12c4-2b51-4e58-baa4-56f54d631255-host-var-lib-cni-multus\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.681557 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.680137 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhn9s\" (UniqueName: \"kubernetes.io/projected/28fb274a-9cae-4f18-a94f-97865ef09f45-kube-api-access-vhn9s\") pod \"iptables-alerter-x7lsw\" (UID: \"28fb274a-9cae-4f18-a94f-97865ef09f45\") " pod="openshift-network-operator/iptables-alerter-x7lsw" Sep 19 09:51:42.681557 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:42.680219 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 09:51:42.681557 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.680237 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 19 09:51:42.681557 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.680252 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-host-cni-netd\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.681557 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.680268 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/376e12c4-2b51-4e58-baa4-56f54d631255-multus-daemon-config\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.681557 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:42.680311 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e7c4050-b0c9-4afe-86a1-e83b1cf46a27-metrics-certs podName:5e7c4050-b0c9-4afe-86a1-e83b1cf46a27 nodeName:}" failed. No retries permitted until 2026-09-19 09:51:43.180273756 +0000 UTC m=+2.981057033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e7c4050-b0c9-4afe-86a1-e83b1cf46a27-metrics-certs") pod "network-metrics-daemon-cxdbk" (UID: "5e7c4050-b0c9-4afe-86a1-e83b1cf46a27") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 09:51:42.681557 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.680332 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-etc-sysctl-conf\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.685092 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.685061 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2ecdf95f-237b-41ea-a042-a6a821fab942-agent-certs\") pod \"konnectivity-agent-rxntx\" (UID: \"2ecdf95f-237b-41ea-a042-a6a821fab942\") " pod="kube-system/konnectivity-agent-rxntx" Sep 19 09:51:42.689231 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.689207 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qspkm\" (UniqueName: \"kubernetes.io/projected/376e12c4-2b51-4e58-baa4-56f54d631255-kube-api-access-qspkm\") pod \"multus-8pk6q\" (UID: \"376e12c4-2b51-4e58-baa4-56f54d631255\") " pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.690282 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.690261 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhn9s\" (UniqueName: \"kubernetes.io/projected/28fb274a-9cae-4f18-a94f-97865ef09f45-kube-api-access-vhn9s\") pod \"iptables-alerter-x7lsw\" (UID: \"28fb274a-9cae-4f18-a94f-97865ef09f45\") " pod="openshift-network-operator/iptables-alerter-x7lsw" Sep 19 09:51:42.690861 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.690837 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnct2\" (UniqueName: \"kubernetes.io/projected/5e7c4050-b0c9-4afe-86a1-e83b1cf46a27-kube-api-access-hnct2\") pod \"network-metrics-daemon-cxdbk\" (UID: \"5e7c4050-b0c9-4afe-86a1-e83b1cf46a27\") " pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:51:42.707647 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.707596 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal" event={"ID":"2e40f5fbb603a9d1bc50add58c51c34d","Type":"ContainerStarted","Data":"4dc42609cadeac7ff3350f502bfc9671e7ebd0f4a57a81bc2044ad8557d4e6d6"} Sep 19 09:51:42.708921 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.708898 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal" event={"ID":"b20ed8df870b33f385257a035bb630e5","Type":"ContainerStarted","Data":"c9147879015fd465a568a46f8956d07a4e85d1c0aa30dcc3c33e1d7940f20e19"} Sep 19 09:51:42.781436 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.781401 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fab0c31-fc90-48c2-ba03-ba1bf2abe9b1-tmp-dir\") pod \"node-resolver-sv4k8\" (UID: \"0fab0c31-fc90-48c2-ba03-ba1bf2abe9b1\") " pod="openshift-dns/node-resolver-sv4k8" Sep 19 09:51:42.781436 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.781441 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9f6cca46-77e3-4de4-abac-85520c106e82-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7cp7g\" (UID: \"9f6cca46-77e3-4de4-abac-85520c106e82\") " pod="openshift-multus/multus-additional-cni-plugins-7cp7g" Sep 19 09:51:42.781668 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.781460 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-systemd-units\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.781668 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.781481 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg8f7\" (UniqueName: \"kubernetes.io/projected/621ae7f4-6b60-4424-95fe-a400cf2f6e01-kube-api-access-vg8f7\") pod \"node-ca-mvk4m\" (UID: \"621ae7f4-6b60-4424-95fe-a400cf2f6e01\") " pod="openshift-image-registry/node-ca-mvk4m" Sep 19 09:51:42.781668 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.781507 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3f1d9116-9add-4252-8f32-cccb1f9ee76f-env-overrides\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.781668 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.781532 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9f6cca46-77e3-4de4-abac-85520c106e82-cni-binary-copy\") pod \"multus-additional-cni-plugins-7cp7g\" (UID: \"9f6cca46-77e3-4de4-abac-85520c106e82\") " pod="openshift-multus/multus-additional-cni-plugins-7cp7g" Sep 19 09:51:42.781668 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.781555 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-host-cni-bin\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.781668 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.781577 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-run\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.781668 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.781604 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a5862d53-93df-4d28-9fb5-48d60ee4a821-kubelet-config\") pod \"global-pull-secret-syncer-42rhb\" (UID: \"a5862d53-93df-4d28-9fb5-48d60ee4a821\") " pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:51:42.781668 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.781626 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-etc-sysctl-d\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.781668 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.781655 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-etc-modprobe-d\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.782155 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.781694 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-host-cni-netd\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.782155 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.781720 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-etc-sysctl-conf\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.782155 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.781744 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-host\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.782155 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.781783 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/621ae7f4-6b60-4424-95fe-a400cf2f6e01-serviceca\") pod \"node-ca-mvk4m\" (UID: \"621ae7f4-6b60-4424-95fe-a400cf2f6e01\") " pod="openshift-image-registry/node-ca-mvk4m" Sep 19 09:51:42.782155 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.781784 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fab0c31-fc90-48c2-ba03-ba1bf2abe9b1-tmp-dir\") pod \"node-resolver-sv4k8\" (UID: \"0fab0c31-fc90-48c2-ba03-ba1bf2abe9b1\") " pod="openshift-dns/node-resolver-sv4k8" Sep 19 09:51:42.782155 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.781807 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-etc-sysconfig\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.782155 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.781843 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-host-run-netns\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.782155 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.781868 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-var-lib-openvswitch\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.782155 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.781891 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-node-log\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.782155 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.781917 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3f1d9116-9add-4252-8f32-cccb1f9ee76f-ovn-node-metrics-cert\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.782155 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.781943 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-etc-systemd\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.782155 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.781969 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3a792c07-63a4-43fc-9a3c-649c63c3ad36-device-dir\") pod \"aws-ebs-csi-driver-node-lw4hg\" (UID: \"3a792c07-63a4-43fc-9a3c-649c63c3ad36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lw4hg" Sep 19 09:51:42.782155 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.781995 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3a792c07-63a4-43fc-9a3c-649c63c3ad36-etc-selinux\") pod \"aws-ebs-csi-driver-node-lw4hg\" (UID: \"3a792c07-63a4-43fc-9a3c-649c63c3ad36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lw4hg" Sep 19 09:51:42.782155 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.782019 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xl9x\" (UniqueName: \"kubernetes.io/projected/3f1d9116-9add-4252-8f32-cccb1f9ee76f-kube-api-access-4xl9x\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.782155 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.782042 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-sys\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.782155 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.782073 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-host-kubelet\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.782155 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.782098 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdtcj\" (UniqueName: \"kubernetes.io/projected/9db1da1a-1030-4fbe-8222-b10ef157bf76-kube-api-access-mdtcj\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.782979 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.782105 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9f6cca46-77e3-4de4-abac-85520c106e82-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7cp7g\" (UID: \"9f6cca46-77e3-4de4-abac-85520c106e82\") " pod="openshift-multus/multus-additional-cni-plugins-7cp7g" Sep 19 09:51:42.782979 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.782124 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9f6cca46-77e3-4de4-abac-85520c106e82-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7cp7g\" (UID: \"9f6cca46-77e3-4de4-abac-85520c106e82\") " pod="openshift-multus/multus-additional-cni-plugins-7cp7g" Sep 19 09:51:42.782979 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.781889 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a5862d53-93df-4d28-9fb5-48d60ee4a821-kubelet-config\") pod \"global-pull-secret-syncer-42rhb\" (UID: \"a5862d53-93df-4d28-9fb5-48d60ee4a821\") " pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:51:42.782979 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.782149 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/621ae7f4-6b60-4424-95fe-a400cf2f6e01-host\") pod \"node-ca-mvk4m\" (UID: \"621ae7f4-6b60-4424-95fe-a400cf2f6e01\") " pod="openshift-image-registry/node-ca-mvk4m" Sep 19 09:51:42.782979 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.782173 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3a792c07-63a4-43fc-9a3c-649c63c3ad36-socket-dir\") pod \"aws-ebs-csi-driver-node-lw4hg\" (UID: \"3a792c07-63a4-43fc-9a3c-649c63c3ad36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lw4hg" Sep 19 09:51:42.782979 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.782193 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-run-systemd\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.782979 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.782214 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-log-socket\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.782979 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.782241 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-lib-modules\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.782979 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.782265 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f6cca46-77e3-4de4-abac-85520c106e82-system-cni-dir\") pod \"multus-additional-cni-plugins-7cp7g\" (UID: \"9f6cca46-77e3-4de4-abac-85520c106e82\") " pod="openshift-multus/multus-additional-cni-plugins-7cp7g" Sep 19 09:51:42.782979 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.782277 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-etc-sysctl-d\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.782979 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.782289 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9f6cca46-77e3-4de4-abac-85520c106e82-cnibin\") pod \"multus-additional-cni-plugins-7cp7g\" (UID: \"9f6cca46-77e3-4de4-abac-85520c106e82\") " pod="openshift-multus/multus-additional-cni-plugins-7cp7g" Sep 19 09:51:42.782979 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.782327 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3f1d9116-9add-4252-8f32-cccb1f9ee76f-env-overrides\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.782979 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.782338 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9f6cca46-77e3-4de4-abac-85520c106e82-cnibin\") pod \"multus-additional-cni-plugins-7cp7g\" (UID: \"9f6cca46-77e3-4de4-abac-85520c106e82\") " pod="openshift-multus/multus-additional-cni-plugins-7cp7g" Sep 19 09:51:42.782979 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.782359 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-etc-modprobe-d\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.782979 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.782413 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-host\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.782979 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.782744 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-host-run-netns\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.782979 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.782817 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-etc-sysconfig\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.783497 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.782829 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/621ae7f4-6b60-4424-95fe-a400cf2f6e01-serviceca\") pod \"node-ca-mvk4m\" (UID: \"621ae7f4-6b60-4424-95fe-a400cf2f6e01\") " pod="openshift-image-registry/node-ca-mvk4m" Sep 19 09:51:42.783497 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.782848 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9f6cca46-77e3-4de4-abac-85520c106e82-cni-binary-copy\") pod \"multus-additional-cni-plugins-7cp7g\" (UID: \"9f6cca46-77e3-4de4-abac-85520c106e82\") " pod="openshift-multus/multus-additional-cni-plugins-7cp7g" Sep 19 09:51:42.783497 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.782862 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-var-lib-openvswitch\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.783497 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.782878 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-node-log\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.783497 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.782903 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-host-kubelet\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.783497 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.781921 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-systemd-units\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.783497 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.782926 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-run\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.783497 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.782955 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-host-cni-bin\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.783497 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.782979 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9f6cca46-77e3-4de4-abac-85520c106e82-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7cp7g\" (UID: \"9f6cca46-77e3-4de4-abac-85520c106e82\") " pod="openshift-multus/multus-additional-cni-plugins-7cp7g" Sep 19 09:51:42.783497 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.782996 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-etc-sysctl-conf\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.783497 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783008 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w7fs\" (UniqueName: \"kubernetes.io/projected/9f6cca46-77e3-4de4-abac-85520c106e82-kube-api-access-4w7fs\") pod \"multus-additional-cni-plugins-7cp7g\" (UID: \"9f6cca46-77e3-4de4-abac-85520c106e82\") " pod="openshift-multus/multus-additional-cni-plugins-7cp7g" Sep 19 09:51:42.783497 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783132 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-etc-systemd\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.783497 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783177 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3a792c07-63a4-43fc-9a3c-649c63c3ad36-device-dir\") pod \"aws-ebs-csi-driver-node-lw4hg\" (UID: \"3a792c07-63a4-43fc-9a3c-649c63c3ad36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lw4hg" Sep 19 09:51:42.783497 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783149 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.783497 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783229 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-sys\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.783497 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783236 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3f1d9116-9add-4252-8f32-cccb1f9ee76f-ovnkube-config\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.783497 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783266 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-run-systemd\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.784152 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783283 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3f1d9116-9add-4252-8f32-cccb1f9ee76f-ovnkube-script-lib\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.784152 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783306 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3a792c07-63a4-43fc-9a3c-649c63c3ad36-registration-dir\") pod \"aws-ebs-csi-driver-node-lw4hg\" (UID: \"3a792c07-63a4-43fc-9a3c-649c63c3ad36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lw4hg" Sep 19 09:51:42.784152 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783328 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3a792c07-63a4-43fc-9a3c-649c63c3ad36-sys-fs\") pod \"aws-ebs-csi-driver-node-lw4hg\" (UID: \"3a792c07-63a4-43fc-9a3c-649c63c3ad36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lw4hg" Sep 19 09:51:42.784152 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783347 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5gnq\" (UniqueName: \"kubernetes.io/projected/3a792c07-63a4-43fc-9a3c-649c63c3ad36-kube-api-access-s5gnq\") pod \"aws-ebs-csi-driver-node-lw4hg\" (UID: \"3a792c07-63a4-43fc-9a3c-649c63c3ad36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lw4hg" Sep 19 09:51:42.784152 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783362 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-host-slash\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.784152 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783377 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9db1da1a-1030-4fbe-8222-b10ef157bf76-tmp\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.784152 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783392 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-host-run-ovn-kubernetes\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.784152 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783407 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-log-socket\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.784152 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783412 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0fab0c31-fc90-48c2-ba03-ba1bf2abe9b1-hosts-file\") pod \"node-resolver-sv4k8\" (UID: \"0fab0c31-fc90-48c2-ba03-ba1bf2abe9b1\") " pod="openshift-dns/node-resolver-sv4k8" Sep 19 09:51:42.784152 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783440 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0fab0c31-fc90-48c2-ba03-ba1bf2abe9b1-hosts-file\") pod \"node-resolver-sv4k8\" (UID: \"0fab0c31-fc90-48c2-ba03-ba1bf2abe9b1\") " pod="openshift-dns/node-resolver-sv4k8" Sep 19 09:51:42.784152 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783472 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/621ae7f4-6b60-4424-95fe-a400cf2f6e01-host\") pod \"node-ca-mvk4m\" (UID: \"621ae7f4-6b60-4424-95fe-a400cf2f6e01\") " pod="openshift-image-registry/node-ca-mvk4m" Sep 19 09:51:42.784152 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783470 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8fnj\" (UniqueName: \"kubernetes.io/projected/0fab0c31-fc90-48c2-ba03-ba1bf2abe9b1-kube-api-access-v8fnj\") pod \"node-resolver-sv4k8\" (UID: \"0fab0c31-fc90-48c2-ba03-ba1bf2abe9b1\") " pod="openshift-dns/node-resolver-sv4k8" Sep 19 09:51:42.784152 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783498 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-run-openvswitch\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.784152 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783519 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5862d53-93df-4d28-9fb5-48d60ee4a821-original-pull-secret\") pod \"global-pull-secret-syncer-42rhb\" (UID: \"a5862d53-93df-4d28-9fb5-48d60ee4a821\") " pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:51:42.784152 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783536 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-var-lib-kubelet\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.784152 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783552 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lbs8\" (UniqueName: \"kubernetes.io/projected/bf45aeae-2af8-46e2-9c5e-e92f0f2d745d-kube-api-access-6lbs8\") pod \"network-check-target-sj4wm\" (UID: \"bf45aeae-2af8-46e2-9c5e-e92f0f2d745d\") " pod="openshift-network-diagnostics/network-check-target-sj4wm" Sep 19 09:51:42.784152 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783567 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3a792c07-63a4-43fc-9a3c-649c63c3ad36-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lw4hg\" (UID: \"3a792c07-63a4-43fc-9a3c-649c63c3ad36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lw4hg" Sep 19 09:51:42.785005 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783604 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-etc-openvswitch\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.785005 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783624 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-run-ovn\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.785005 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783639 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a5862d53-93df-4d28-9fb5-48d60ee4a821-dbus\") pod \"global-pull-secret-syncer-42rhb\" (UID: \"a5862d53-93df-4d28-9fb5-48d60ee4a821\") " pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:51:42.785005 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783635 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9f6cca46-77e3-4de4-abac-85520c106e82-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7cp7g\" (UID: \"9f6cca46-77e3-4de4-abac-85520c106e82\") " pod="openshift-multus/multus-additional-cni-plugins-7cp7g" Sep 19 09:51:42.785005 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783658 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-etc-kubernetes\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.785005 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783683 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9db1da1a-1030-4fbe-8222-b10ef157bf76-etc-tuned\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.785005 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783715 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f6cca46-77e3-4de4-abac-85520c106e82-system-cni-dir\") pod \"multus-additional-cni-plugins-7cp7g\" (UID: \"9f6cca46-77e3-4de4-abac-85520c106e82\") " pod="openshift-multus/multus-additional-cni-plugins-7cp7g" Sep 19 09:51:42.785005 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783717 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3f1d9116-9add-4252-8f32-cccb1f9ee76f-ovnkube-config\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.785005 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783782 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3a792c07-63a4-43fc-9a3c-649c63c3ad36-socket-dir\") pod \"aws-ebs-csi-driver-node-lw4hg\" (UID: \"3a792c07-63a4-43fc-9a3c-649c63c3ad36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lw4hg" Sep 19 09:51:42.785005 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783816 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-host-cni-netd\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.785005 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783836 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3a792c07-63a4-43fc-9a3c-649c63c3ad36-registration-dir\") pod \"aws-ebs-csi-driver-node-lw4hg\" (UID: \"3a792c07-63a4-43fc-9a3c-649c63c3ad36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lw4hg" Sep 19 09:51:42.785005 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783850 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-host-run-ovn-kubernetes\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.785005 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783885 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3a792c07-63a4-43fc-9a3c-649c63c3ad36-sys-fs\") pod \"aws-ebs-csi-driver-node-lw4hg\" (UID: \"3a792c07-63a4-43fc-9a3c-649c63c3ad36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lw4hg" Sep 19 09:51:42.785005 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783949 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9f6cca46-77e3-4de4-abac-85520c106e82-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7cp7g\" (UID: \"9f6cca46-77e3-4de4-abac-85520c106e82\") " pod="openshift-multus/multus-additional-cni-plugins-7cp7g" Sep 19 09:51:42.785005 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783963 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.785005 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.783969 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3a792c07-63a4-43fc-9a3c-649c63c3ad36-etc-selinux\") pod \"aws-ebs-csi-driver-node-lw4hg\" (UID: \"3a792c07-63a4-43fc-9a3c-649c63c3ad36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lw4hg" Sep 19 09:51:42.785005 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.784033 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-etc-openvswitch\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.785851 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.784042 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3a792c07-63a4-43fc-9a3c-649c63c3ad36-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lw4hg\" (UID: \"3a792c07-63a4-43fc-9a3c-649c63c3ad36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lw4hg" Sep 19 09:51:42.785851 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.784078 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-run-openvswitch\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.785851 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.784098 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a5862d53-93df-4d28-9fb5-48d60ee4a821-dbus\") pod \"global-pull-secret-syncer-42rhb\" (UID: \"a5862d53-93df-4d28-9fb5-48d60ee4a821\") " pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:51:42.785851 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.784116 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-host-slash\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.785851 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.784149 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3f1d9116-9add-4252-8f32-cccb1f9ee76f-run-ovn\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.785851 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:42.784189 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 09:51:42.785851 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.784200 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-etc-kubernetes\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.785851 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:42.784242 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5862d53-93df-4d28-9fb5-48d60ee4a821-original-pull-secret podName:a5862d53-93df-4d28-9fb5-48d60ee4a821 nodeName:}" failed. No retries permitted until 2026-09-19 09:51:43.284224313 +0000 UTC m=+3.085007605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5862d53-93df-4d28-9fb5-48d60ee4a821-original-pull-secret") pod "global-pull-secret-syncer-42rhb" (UID: "a5862d53-93df-4d28-9fb5-48d60ee4a821") : object "kube-system"/"original-pull-secret" not registered Sep 19 09:51:42.785851 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.784254 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-var-lib-kubelet\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.785851 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.784340 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9db1da1a-1030-4fbe-8222-b10ef157bf76-lib-modules\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.785851 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.784451 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3f1d9116-9add-4252-8f32-cccb1f9ee76f-ovnkube-script-lib\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.785851 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.785341 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3f1d9116-9add-4252-8f32-cccb1f9ee76f-ovn-node-metrics-cert\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.786449 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.786344 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9db1da1a-1030-4fbe-8222-b10ef157bf76-etc-tuned\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.786527 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.786505 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9db1da1a-1030-4fbe-8222-b10ef157bf76-tmp\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.796360 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:42.796337 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 09:51:42.796464 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:42.796365 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 09:51:42.796464 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:42.796381 2579 projected.go:196] Error preparing data for projected volume kube-api-access-6lbs8 for pod openshift-network-diagnostics/network-check-target-sj4wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 09:51:42.796464 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:42.796447 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf45aeae-2af8-46e2-9c5e-e92f0f2d745d-kube-api-access-6lbs8 podName:bf45aeae-2af8-46e2-9c5e-e92f0f2d745d nodeName:}" failed. No retries permitted until 2026-09-19 09:51:43.296434086 +0000 UTC m=+3.097217386 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6lbs8" (UniqueName: "kubernetes.io/projected/bf45aeae-2af8-46e2-9c5e-e92f0f2d745d-kube-api-access-6lbs8") pod "network-check-target-sj4wm" (UID: "bf45aeae-2af8-46e2-9c5e-e92f0f2d745d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 09:51:42.799638 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.799590 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5gnq\" (UniqueName: \"kubernetes.io/projected/3a792c07-63a4-43fc-9a3c-649c63c3ad36-kube-api-access-s5gnq\") pod \"aws-ebs-csi-driver-node-lw4hg\" (UID: \"3a792c07-63a4-43fc-9a3c-649c63c3ad36\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lw4hg" Sep 19 09:51:42.800220 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.800194 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w7fs\" (UniqueName: \"kubernetes.io/projected/9f6cca46-77e3-4de4-abac-85520c106e82-kube-api-access-4w7fs\") pod \"multus-additional-cni-plugins-7cp7g\" (UID: \"9f6cca46-77e3-4de4-abac-85520c106e82\") " pod="openshift-multus/multus-additional-cni-plugins-7cp7g" Sep 19 09:51:42.800365 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.800327 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8fnj\" (UniqueName: \"kubernetes.io/projected/0fab0c31-fc90-48c2-ba03-ba1bf2abe9b1-kube-api-access-v8fnj\") pod \"node-resolver-sv4k8\" (UID: \"0fab0c31-fc90-48c2-ba03-ba1bf2abe9b1\") " pod="openshift-dns/node-resolver-sv4k8" Sep 19 09:51:42.801104 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.800671 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdtcj\" (UniqueName: \"kubernetes.io/projected/9db1da1a-1030-4fbe-8222-b10ef157bf76-kube-api-access-mdtcj\") pod \"tuned-4n8zb\" (UID: \"9db1da1a-1030-4fbe-8222-b10ef157bf76\") " pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.801104 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.801064 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xl9x\" (UniqueName: \"kubernetes.io/projected/3f1d9116-9add-4252-8f32-cccb1f9ee76f-kube-api-access-4xl9x\") pod \"ovnkube-node-sdnzv\" (UID: \"3f1d9116-9add-4252-8f32-cccb1f9ee76f\") " pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.801554 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.801533 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg8f7\" (UniqueName: \"kubernetes.io/projected/621ae7f4-6b60-4424-95fe-a400cf2f6e01-kube-api-access-vg8f7\") pod \"node-ca-mvk4m\" (UID: \"621ae7f4-6b60-4424-95fe-a400cf2f6e01\") " pod="openshift-image-registry/node-ca-mvk4m" Sep 19 09:51:42.872574 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.872534 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x7lsw" Sep 19 09:51:42.881060 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.881027 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8pk6q" Sep 19 09:51:42.889813 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.889790 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rxntx" Sep 19 09:51:42.897551 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.897527 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lw4hg" Sep 19 09:51:42.905393 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.905370 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" Sep 19 09:51:42.914145 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.914128 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7cp7g" Sep 19 09:51:42.921950 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.921930 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mvk4m" Sep 19 09:51:42.930755 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.930734 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:51:42.937409 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:42.937385 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sv4k8" Sep 19 09:51:43.186750 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:43.186653 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e7c4050-b0c9-4afe-86a1-e83b1cf46a27-metrics-certs\") pod \"network-metrics-daemon-cxdbk\" (UID: \"5e7c4050-b0c9-4afe-86a1-e83b1cf46a27\") " pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:51:43.186911 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:43.186818 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 09:51:43.186911 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:43.186884 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e7c4050-b0c9-4afe-86a1-e83b1cf46a27-metrics-certs podName:5e7c4050-b0c9-4afe-86a1-e83b1cf46a27 nodeName:}" failed. No retries permitted until 2026-09-19 09:51:44.186864174 +0000 UTC m=+3.987647471 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e7c4050-b0c9-4afe-86a1-e83b1cf46a27-metrics-certs") pod "network-metrics-daemon-cxdbk" (UID: "5e7c4050-b0c9-4afe-86a1-e83b1cf46a27") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 09:51:43.287439 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:43.287406 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5862d53-93df-4d28-9fb5-48d60ee4a821-original-pull-secret\") pod \"global-pull-secret-syncer-42rhb\" (UID: \"a5862d53-93df-4d28-9fb5-48d60ee4a821\") " pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:51:43.287599 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:43.287537 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 09:51:43.287650 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:43.287601 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5862d53-93df-4d28-9fb5-48d60ee4a821-original-pull-secret podName:a5862d53-93df-4d28-9fb5-48d60ee4a821 nodeName:}" failed. No retries permitted until 2026-09-19 09:51:44.287582383 +0000 UTC m=+4.088365658 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5862d53-93df-4d28-9fb5-48d60ee4a821-original-pull-secret") pod "global-pull-secret-syncer-42rhb" (UID: "a5862d53-93df-4d28-9fb5-48d60ee4a821") : object "kube-system"/"original-pull-secret" not registered Sep 19 09:51:43.388652 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:43.388535 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lbs8\" (UniqueName: \"kubernetes.io/projected/bf45aeae-2af8-46e2-9c5e-e92f0f2d745d-kube-api-access-6lbs8\") pod \"network-check-target-sj4wm\" (UID: \"bf45aeae-2af8-46e2-9c5e-e92f0f2d745d\") " pod="openshift-network-diagnostics/network-check-target-sj4wm" Sep 19 09:51:43.388830 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:43.388713 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 09:51:43.388830 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:43.388743 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 09:51:43.388830 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:43.388756 2579 projected.go:196] Error preparing data for projected volume kube-api-access-6lbs8 for pod openshift-network-diagnostics/network-check-target-sj4wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 09:51:43.388830 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:43.388816 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf45aeae-2af8-46e2-9c5e-e92f0f2d745d-kube-api-access-6lbs8 podName:bf45aeae-2af8-46e2-9c5e-e92f0f2d745d nodeName:}" failed. No retries permitted until 2026-09-19 09:51:44.388798331 +0000 UTC m=+4.189581607 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6lbs8" (UniqueName: "kubernetes.io/projected/bf45aeae-2af8-46e2-9c5e-e92f0f2d745d-kube-api-access-6lbs8") pod "network-check-target-sj4wm" (UID: "bf45aeae-2af8-46e2-9c5e-e92f0f2d745d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 09:51:43.614334 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:43.614165 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-18 09:46:42 +0000 UTC" deadline="2028-05-26 01:18:20.682949477 +0000 UTC" Sep 19 09:51:43.614334 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:43.614195 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14751h26m37.068758025s" Sep 19 09:51:43.614886 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:43.614339 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod621ae7f4_6b60_4424_95fe_a400cf2f6e01.slice/crio-1ef9dd3c917e98f2cbcd052359531a1561d5a5ac7e75000d3fcc2b1baa521033 WatchSource:0}: Error finding container 1ef9dd3c917e98f2cbcd052359531a1561d5a5ac7e75000d3fcc2b1baa521033: Status 404 returned error can't find the container with id 1ef9dd3c917e98f2cbcd052359531a1561d5a5ac7e75000d3fcc2b1baa521033 Sep 19 09:51:43.619077 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:43.619053 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fab0c31_fc90_48c2_ba03_ba1bf2abe9b1.slice/crio-939222da578a9205a0308157312e4558078110f41b529811df11d1d07cdfa1e3 WatchSource:0}: Error finding container 939222da578a9205a0308157312e4558078110f41b529811df11d1d07cdfa1e3: Status 404 returned error can't find the container with id 939222da578a9205a0308157312e4558078110f41b529811df11d1d07cdfa1e3 Sep 19 09:51:43.619640 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:43.619610 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9db1da1a_1030_4fbe_8222_b10ef157bf76.slice/crio-f3f000dee8f4319601bcf1e50e37b2915ce7dc7ba05de55a709f5ca693d3311c WatchSource:0}: Error finding container f3f000dee8f4319601bcf1e50e37b2915ce7dc7ba05de55a709f5ca693d3311c: Status 404 returned error can't find the container with id f3f000dee8f4319601bcf1e50e37b2915ce7dc7ba05de55a709f5ca693d3311c Sep 19 09:51:43.620436 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:43.620413 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a792c07_63a4_43fc_9a3c_649c63c3ad36.slice/crio-e39bb4f2278b6a9f3547901628c39e5f0c53b027c4b6a41887c29cd9d882d4cf WatchSource:0}: Error finding container e39bb4f2278b6a9f3547901628c39e5f0c53b027c4b6a41887c29cd9d882d4cf: Status 404 returned error can't find the container with id e39bb4f2278b6a9f3547901628c39e5f0c53b027c4b6a41887c29cd9d882d4cf Sep 19 09:51:43.640886 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:43.640861 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28fb274a_9cae_4f18_a94f_97865ef09f45.slice/crio-21648587e69aede48de2d63dbb107bcad2c40dce234886630eff24fe5110600a WatchSource:0}: Error finding container 21648587e69aede48de2d63dbb107bcad2c40dce234886630eff24fe5110600a: Status 404 returned error can't find the container with id 21648587e69aede48de2d63dbb107bcad2c40dce234886630eff24fe5110600a Sep 19 09:51:43.641680 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:43.641608 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ecdf95f_237b_41ea_a042_a6a821fab942.slice/crio-0e5b68ab8484c77953f35e6aff9993f0c529ba8c6e6c4ed126e09b9fa5864cf7 WatchSource:0}: Error finding container 0e5b68ab8484c77953f35e6aff9993f0c529ba8c6e6c4ed126e09b9fa5864cf7: Status 404 returned error can't find the container with id 0e5b68ab8484c77953f35e6aff9993f0c529ba8c6e6c4ed126e09b9fa5864cf7 Sep 19 09:51:43.645912 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:51:43.645893 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f1d9116_9add_4252_8f32_cccb1f9ee76f.slice/crio-a7f5fbfca0040d8508fa38aef2080c185c301f632c6c117627e90020ce9622b6 WatchSource:0}: Error finding container a7f5fbfca0040d8508fa38aef2080c185c301f632c6c117627e90020ce9622b6: Status 404 returned error can't find the container with id a7f5fbfca0040d8508fa38aef2080c185c301f632c6c117627e90020ce9622b6 Sep 19 09:51:43.711867 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:43.711836 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" event={"ID":"3f1d9116-9add-4252-8f32-cccb1f9ee76f","Type":"ContainerStarted","Data":"a7f5fbfca0040d8508fa38aef2080c185c301f632c6c117627e90020ce9622b6"} Sep 19 09:51:43.713064 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:43.713036 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cp7g" event={"ID":"9f6cca46-77e3-4de4-abac-85520c106e82","Type":"ContainerStarted","Data":"5a42f2daf8187a85faf9fbb2308c5cb7acd6c2ee96efc0a8c7136ff01eb30b78"} Sep 19 09:51:43.717347 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:43.717317 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rxntx" event={"ID":"2ecdf95f-237b-41ea-a042-a6a821fab942","Type":"ContainerStarted","Data":"0e5b68ab8484c77953f35e6aff9993f0c529ba8c6e6c4ed126e09b9fa5864cf7"} Sep 19 09:51:43.718489 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:43.718463 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x7lsw" event={"ID":"28fb274a-9cae-4f18-a94f-97865ef09f45","Type":"ContainerStarted","Data":"21648587e69aede48de2d63dbb107bcad2c40dce234886630eff24fe5110600a"} Sep 19 09:51:43.719520 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:43.719500 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sv4k8" event={"ID":"0fab0c31-fc90-48c2-ba03-ba1bf2abe9b1","Type":"ContainerStarted","Data":"939222da578a9205a0308157312e4558078110f41b529811df11d1d07cdfa1e3"} Sep 19 09:51:43.720691 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:43.720670 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8pk6q" event={"ID":"376e12c4-2b51-4e58-baa4-56f54d631255","Type":"ContainerStarted","Data":"1e274b9948e4d78325f48796b953052ff00d4473b6c2fd794fe4723749a2a6ba"} Sep 19 09:51:43.721815 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:43.721757 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lw4hg" event={"ID":"3a792c07-63a4-43fc-9a3c-649c63c3ad36","Type":"ContainerStarted","Data":"e39bb4f2278b6a9f3547901628c39e5f0c53b027c4b6a41887c29cd9d882d4cf"} Sep 19 09:51:43.724108 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:43.724060 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" event={"ID":"9db1da1a-1030-4fbe-8222-b10ef157bf76","Type":"ContainerStarted","Data":"f3f000dee8f4319601bcf1e50e37b2915ce7dc7ba05de55a709f5ca693d3311c"} Sep 19 09:51:43.726170 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:43.726148 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mvk4m" event={"ID":"621ae7f4-6b60-4424-95fe-a400cf2f6e01","Type":"ContainerStarted","Data":"1ef9dd3c917e98f2cbcd052359531a1561d5a5ac7e75000d3fcc2b1baa521033"} Sep 19 09:51:44.194899 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:44.194583 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e7c4050-b0c9-4afe-86a1-e83b1cf46a27-metrics-certs\") pod \"network-metrics-daemon-cxdbk\" (UID: \"5e7c4050-b0c9-4afe-86a1-e83b1cf46a27\") " pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:51:44.194899 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:44.194847 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 09:51:44.195122 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:44.194931 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e7c4050-b0c9-4afe-86a1-e83b1cf46a27-metrics-certs podName:5e7c4050-b0c9-4afe-86a1-e83b1cf46a27 nodeName:}" failed. No retries permitted until 2026-09-19 09:51:46.194907796 +0000 UTC m=+5.995691167 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e7c4050-b0c9-4afe-86a1-e83b1cf46a27-metrics-certs") pod "network-metrics-daemon-cxdbk" (UID: "5e7c4050-b0c9-4afe-86a1-e83b1cf46a27") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 09:51:44.296205 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:44.296167 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5862d53-93df-4d28-9fb5-48d60ee4a821-original-pull-secret\") pod \"global-pull-secret-syncer-42rhb\" (UID: \"a5862d53-93df-4d28-9fb5-48d60ee4a821\") " pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:51:44.296389 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:44.296315 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 09:51:44.296389 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:44.296375 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5862d53-93df-4d28-9fb5-48d60ee4a821-original-pull-secret podName:a5862d53-93df-4d28-9fb5-48d60ee4a821 nodeName:}" failed. No retries permitted until 2026-09-19 09:51:46.29635847 +0000 UTC m=+6.097141761 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5862d53-93df-4d28-9fb5-48d60ee4a821-original-pull-secret") pod "global-pull-secret-syncer-42rhb" (UID: "a5862d53-93df-4d28-9fb5-48d60ee4a821") : object "kube-system"/"original-pull-secret" not registered Sep 19 09:51:44.397221 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:44.397180 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lbs8\" (UniqueName: \"kubernetes.io/projected/bf45aeae-2af8-46e2-9c5e-e92f0f2d745d-kube-api-access-6lbs8\") pod \"network-check-target-sj4wm\" (UID: \"bf45aeae-2af8-46e2-9c5e-e92f0f2d745d\") " pod="openshift-network-diagnostics/network-check-target-sj4wm" Sep 19 09:51:44.397408 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:44.397360 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 09:51:44.397408 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:44.397379 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 09:51:44.397408 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:44.397391 2579 projected.go:196] Error preparing data for projected volume kube-api-access-6lbs8 for pod openshift-network-diagnostics/network-check-target-sj4wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 09:51:44.397570 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:44.397450 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf45aeae-2af8-46e2-9c5e-e92f0f2d745d-kube-api-access-6lbs8 podName:bf45aeae-2af8-46e2-9c5e-e92f0f2d745d nodeName:}" failed. No retries permitted until 2026-09-19 09:51:46.397431828 +0000 UTC m=+6.198215110 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6lbs8" (UniqueName: "kubernetes.io/projected/bf45aeae-2af8-46e2-9c5e-e92f0f2d745d-kube-api-access-6lbs8") pod "network-check-target-sj4wm" (UID: "bf45aeae-2af8-46e2-9c5e-e92f0f2d745d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 09:51:44.614636 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:44.614523 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-18 09:46:42 +0000 UTC" deadline="2028-06-25 08:10:34.985216878 +0000 UTC" Sep 19 09:51:44.614636 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:44.614585 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15478h18m50.370635251s" Sep 19 09:51:44.697075 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:44.697042 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:51:44.697245 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:44.697183 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxdbk" podUID="5e7c4050-b0c9-4afe-86a1-e83b1cf46a27" Sep 19 09:51:44.697317 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:44.697267 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sj4wm" Sep 19 09:51:44.697372 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:44.697344 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sj4wm" podUID="bf45aeae-2af8-46e2-9c5e-e92f0f2d745d" Sep 19 09:51:44.697425 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:44.697399 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:51:44.697476 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:44.697461 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42rhb" podUID="a5862d53-93df-4d28-9fb5-48d60ee4a821" Sep 19 09:51:44.746155 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:44.746123 2579 generic.go:356] "Generic (PLEG): container finished" podID="b20ed8df870b33f385257a035bb630e5" containerID="82bdfc39cc2f0505f872136b254c1b20351b42004adbeec818f068e7d4854cde" exitCode=0 Sep 19 09:51:44.746332 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:44.746223 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal" event={"ID":"b20ed8df870b33f385257a035bb630e5","Type":"ContainerDied","Data":"82bdfc39cc2f0505f872136b254c1b20351b42004adbeec818f068e7d4854cde"} Sep 19 09:51:44.768149 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:44.768117 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal" event={"ID":"2e40f5fbb603a9d1bc50add58c51c34d","Type":"ContainerStarted","Data":"00945fef640aca0999f68b330fb9b73a83a197e9a8eef058b4af20ed71207245"} Sep 19 09:51:45.783307 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:45.782773 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal" event={"ID":"b20ed8df870b33f385257a035bb630e5","Type":"ContainerStarted","Data":"a9325177ae55989b85a9f4b267bb2479590d108cbbc5d4a75b7f9746eb47bb62"} Sep 19 09:51:45.799224 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:45.798208 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal" podStartSLOduration=4.798187295 podStartE2EDuration="4.798187295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 09:51:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:51:44.781883718 +0000 UTC m=+4.582667016" watchObservedRunningTime="2026-09-19 09:51:45.798187295 +0000 UTC m=+5.598970593" Sep 19 09:51:46.214758 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:46.214219 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e7c4050-b0c9-4afe-86a1-e83b1cf46a27-metrics-certs\") pod \"network-metrics-daemon-cxdbk\" (UID: \"5e7c4050-b0c9-4afe-86a1-e83b1cf46a27\") " pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:51:46.214758 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:46.214361 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 09:51:46.214758 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:46.214425 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e7c4050-b0c9-4afe-86a1-e83b1cf46a27-metrics-certs podName:5e7c4050-b0c9-4afe-86a1-e83b1cf46a27 nodeName:}" failed. No retries permitted until 2026-09-19 09:51:50.214406807 +0000 UTC m=+10.015190104 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e7c4050-b0c9-4afe-86a1-e83b1cf46a27-metrics-certs") pod "network-metrics-daemon-cxdbk" (UID: "5e7c4050-b0c9-4afe-86a1-e83b1cf46a27") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 09:51:46.315600 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:46.315045 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5862d53-93df-4d28-9fb5-48d60ee4a821-original-pull-secret\") pod \"global-pull-secret-syncer-42rhb\" (UID: \"a5862d53-93df-4d28-9fb5-48d60ee4a821\") " pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:51:46.315600 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:46.315204 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 09:51:46.315600 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:46.315266 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5862d53-93df-4d28-9fb5-48d60ee4a821-original-pull-secret podName:a5862d53-93df-4d28-9fb5-48d60ee4a821 nodeName:}" failed. No retries permitted until 2026-09-19 09:51:50.315247828 +0000 UTC m=+10.116031173 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5862d53-93df-4d28-9fb5-48d60ee4a821-original-pull-secret") pod "global-pull-secret-syncer-42rhb" (UID: "a5862d53-93df-4d28-9fb5-48d60ee4a821") : object "kube-system"/"original-pull-secret" not registered Sep 19 09:51:46.416424 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:46.415811 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lbs8\" (UniqueName: \"kubernetes.io/projected/bf45aeae-2af8-46e2-9c5e-e92f0f2d745d-kube-api-access-6lbs8\") pod \"network-check-target-sj4wm\" (UID: \"bf45aeae-2af8-46e2-9c5e-e92f0f2d745d\") " pod="openshift-network-diagnostics/network-check-target-sj4wm" Sep 19 09:51:46.416424 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:46.416013 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 09:51:46.416424 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:46.416033 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 09:51:46.416424 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:46.416045 2579 projected.go:196] Error preparing data for projected volume kube-api-access-6lbs8 for pod openshift-network-diagnostics/network-check-target-sj4wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 09:51:46.416424 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:46.416100 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf45aeae-2af8-46e2-9c5e-e92f0f2d745d-kube-api-access-6lbs8 podName:bf45aeae-2af8-46e2-9c5e-e92f0f2d745d nodeName:}" failed. No retries permitted until 2026-09-19 09:51:50.416082804 +0000 UTC m=+10.216866085 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6lbs8" (UniqueName: "kubernetes.io/projected/bf45aeae-2af8-46e2-9c5e-e92f0f2d745d-kube-api-access-6lbs8") pod "network-check-target-sj4wm" (UID: "bf45aeae-2af8-46e2-9c5e-e92f0f2d745d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 09:51:46.696770 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:46.694796 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:51:46.696770 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:46.694818 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:51:46.696770 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:46.694921 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42rhb" podUID="a5862d53-93df-4d28-9fb5-48d60ee4a821" Sep 19 09:51:46.696770 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:46.694990 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sj4wm" Sep 19 09:51:46.696770 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:46.695079 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sj4wm" podUID="bf45aeae-2af8-46e2-9c5e-e92f0f2d745d" Sep 19 09:51:46.696770 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:46.695174 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxdbk" podUID="5e7c4050-b0c9-4afe-86a1-e83b1cf46a27" Sep 19 09:51:48.696424 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:48.694427 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:51:48.696424 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:48.694603 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxdbk" podUID="5e7c4050-b0c9-4afe-86a1-e83b1cf46a27" Sep 19 09:51:48.696424 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:48.695070 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sj4wm" Sep 19 09:51:48.696424 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:48.695195 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sj4wm" podUID="bf45aeae-2af8-46e2-9c5e-e92f0f2d745d" Sep 19 09:51:48.696424 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:48.695290 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:51:48.696424 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:48.695413 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42rhb" podUID="a5862d53-93df-4d28-9fb5-48d60ee4a821" Sep 19 09:51:50.249171 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:50.249129 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e7c4050-b0c9-4afe-86a1-e83b1cf46a27-metrics-certs\") pod \"network-metrics-daemon-cxdbk\" (UID: \"5e7c4050-b0c9-4afe-86a1-e83b1cf46a27\") " pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:51:50.249588 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:50.249272 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 09:51:50.249588 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:50.249333 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e7c4050-b0c9-4afe-86a1-e83b1cf46a27-metrics-certs podName:5e7c4050-b0c9-4afe-86a1-e83b1cf46a27 nodeName:}" failed. No retries permitted until 2026-09-19 09:51:58.24931438 +0000 UTC m=+18.050097661 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e7c4050-b0c9-4afe-86a1-e83b1cf46a27-metrics-certs") pod "network-metrics-daemon-cxdbk" (UID: "5e7c4050-b0c9-4afe-86a1-e83b1cf46a27") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 09:51:50.350118 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:50.350079 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5862d53-93df-4d28-9fb5-48d60ee4a821-original-pull-secret\") pod \"global-pull-secret-syncer-42rhb\" (UID: \"a5862d53-93df-4d28-9fb5-48d60ee4a821\") " pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:51:50.350308 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:50.350224 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 09:51:50.350308 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:50.350290 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5862d53-93df-4d28-9fb5-48d60ee4a821-original-pull-secret podName:a5862d53-93df-4d28-9fb5-48d60ee4a821 nodeName:}" failed. No retries permitted until 2026-09-19 09:51:58.350271308 +0000 UTC m=+18.151054598 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5862d53-93df-4d28-9fb5-48d60ee4a821-original-pull-secret") pod "global-pull-secret-syncer-42rhb" (UID: "a5862d53-93df-4d28-9fb5-48d60ee4a821") : object "kube-system"/"original-pull-secret" not registered Sep 19 09:51:50.451141 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:50.450572 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lbs8\" (UniqueName: \"kubernetes.io/projected/bf45aeae-2af8-46e2-9c5e-e92f0f2d745d-kube-api-access-6lbs8\") pod \"network-check-target-sj4wm\" (UID: \"bf45aeae-2af8-46e2-9c5e-e92f0f2d745d\") " pod="openshift-network-diagnostics/network-check-target-sj4wm" Sep 19 09:51:50.451141 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:50.450740 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 09:51:50.451141 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:50.450762 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 09:51:50.451141 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:50.450775 2579 projected.go:196] Error preparing data for projected volume kube-api-access-6lbs8 for pod openshift-network-diagnostics/network-check-target-sj4wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 09:51:50.451141 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:50.450833 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf45aeae-2af8-46e2-9c5e-e92f0f2d745d-kube-api-access-6lbs8 podName:bf45aeae-2af8-46e2-9c5e-e92f0f2d745d nodeName:}" failed. No retries permitted until 2026-09-19 09:51:58.450817585 +0000 UTC m=+18.251600860 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6lbs8" (UniqueName: "kubernetes.io/projected/bf45aeae-2af8-46e2-9c5e-e92f0f2d745d-kube-api-access-6lbs8") pod "network-check-target-sj4wm" (UID: "bf45aeae-2af8-46e2-9c5e-e92f0f2d745d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 09:51:50.695203 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:50.695124 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:51:50.695203 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:50.695155 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sj4wm" Sep 19 09:51:50.695415 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:50.695124 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:51:50.695415 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:50.695246 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxdbk" podUID="5e7c4050-b0c9-4afe-86a1-e83b1cf46a27" Sep 19 09:51:50.695415 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:50.695307 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42rhb" podUID="a5862d53-93df-4d28-9fb5-48d60ee4a821" Sep 19 09:51:50.695415 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:50.695370 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sj4wm" podUID="bf45aeae-2af8-46e2-9c5e-e92f0f2d745d" Sep 19 09:51:52.694751 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:52.694713 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:51:52.695213 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:52.694866 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxdbk" podUID="5e7c4050-b0c9-4afe-86a1-e83b1cf46a27" Sep 19 09:51:52.695289 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:52.695273 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sj4wm" Sep 19 09:51:52.695397 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:52.695366 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sj4wm" podUID="bf45aeae-2af8-46e2-9c5e-e92f0f2d745d" Sep 19 09:51:52.695534 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:52.695516 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:51:52.695651 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:52.695627 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42rhb" podUID="a5862d53-93df-4d28-9fb5-48d60ee4a821" Sep 19 09:51:54.694854 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:54.694819 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sj4wm" Sep 19 09:51:54.695285 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:54.694825 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:51:54.695285 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:54.694947 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sj4wm" podUID="bf45aeae-2af8-46e2-9c5e-e92f0f2d745d" Sep 19 09:51:54.695285 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:54.694975 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:51:54.695285 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:54.695137 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42rhb" podUID="a5862d53-93df-4d28-9fb5-48d60ee4a821" Sep 19 09:51:54.695285 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:54.695239 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxdbk" podUID="5e7c4050-b0c9-4afe-86a1-e83b1cf46a27" Sep 19 09:51:56.695000 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:56.694963 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:51:56.695476 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:56.694963 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:51:56.695476 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:56.695101 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sj4wm" Sep 19 09:51:56.695476 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:56.695093 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42rhb" podUID="a5862d53-93df-4d28-9fb5-48d60ee4a821" Sep 19 09:51:56.695476 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:56.695237 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxdbk" podUID="5e7c4050-b0c9-4afe-86a1-e83b1cf46a27" Sep 19 09:51:56.695476 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:56.695299 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sj4wm" podUID="bf45aeae-2af8-46e2-9c5e-e92f0f2d745d" Sep 19 09:51:58.309886 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:58.309856 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e7c4050-b0c9-4afe-86a1-e83b1cf46a27-metrics-certs\") pod \"network-metrics-daemon-cxdbk\" (UID: \"5e7c4050-b0c9-4afe-86a1-e83b1cf46a27\") " pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:51:58.310278 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:58.309999 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 09:51:58.310278 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:58.310072 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e7c4050-b0c9-4afe-86a1-e83b1cf46a27-metrics-certs podName:5e7c4050-b0c9-4afe-86a1-e83b1cf46a27 nodeName:}" failed. No retries permitted until 2026-09-19 09:52:14.310049035 +0000 UTC m=+34.110832312 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e7c4050-b0c9-4afe-86a1-e83b1cf46a27-metrics-certs") pod "network-metrics-daemon-cxdbk" (UID: "5e7c4050-b0c9-4afe-86a1-e83b1cf46a27") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 09:51:58.410713 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:58.410663 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5862d53-93df-4d28-9fb5-48d60ee4a821-original-pull-secret\") pod \"global-pull-secret-syncer-42rhb\" (UID: \"a5862d53-93df-4d28-9fb5-48d60ee4a821\") " pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:51:58.410879 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:58.410827 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 09:51:58.410957 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:58.410902 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5862d53-93df-4d28-9fb5-48d60ee4a821-original-pull-secret podName:a5862d53-93df-4d28-9fb5-48d60ee4a821 nodeName:}" failed. No retries permitted until 2026-09-19 09:52:14.41088229 +0000 UTC m=+34.211665584 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5862d53-93df-4d28-9fb5-48d60ee4a821-original-pull-secret") pod "global-pull-secret-syncer-42rhb" (UID: "a5862d53-93df-4d28-9fb5-48d60ee4a821") : object "kube-system"/"original-pull-secret" not registered Sep 19 09:51:58.511178 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:58.511147 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lbs8\" (UniqueName: \"kubernetes.io/projected/bf45aeae-2af8-46e2-9c5e-e92f0f2d745d-kube-api-access-6lbs8\") pod \"network-check-target-sj4wm\" (UID: \"bf45aeae-2af8-46e2-9c5e-e92f0f2d745d\") " pod="openshift-network-diagnostics/network-check-target-sj4wm" Sep 19 09:51:58.511362 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:58.511341 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 09:51:58.511413 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:58.511369 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 09:51:58.511413 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:58.511382 2579 projected.go:196] Error preparing data for projected volume kube-api-access-6lbs8 for pod openshift-network-diagnostics/network-check-target-sj4wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 09:51:58.511492 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:58.511445 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf45aeae-2af8-46e2-9c5e-e92f0f2d745d-kube-api-access-6lbs8 podName:bf45aeae-2af8-46e2-9c5e-e92f0f2d745d nodeName:}" failed. No retries permitted until 2026-09-19 09:52:14.511424745 +0000 UTC m=+34.312208023 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6lbs8" (UniqueName: "kubernetes.io/projected/bf45aeae-2af8-46e2-9c5e-e92f0f2d745d-kube-api-access-6lbs8") pod "network-check-target-sj4wm" (UID: "bf45aeae-2af8-46e2-9c5e-e92f0f2d745d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 09:51:58.695141 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:58.695056 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:51:58.695297 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:58.695067 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:51:58.695297 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:51:58.695200 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sj4wm" Sep 19 09:51:58.695297 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:58.695195 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42rhb" podUID="a5862d53-93df-4d28-9fb5-48d60ee4a821" Sep 19 09:51:58.695465 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:58.695313 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxdbk" podUID="5e7c4050-b0c9-4afe-86a1-e83b1cf46a27" Sep 19 09:51:58.695465 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:51:58.695383 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sj4wm" podUID="bf45aeae-2af8-46e2-9c5e-e92f0f2d745d" Sep 19 09:52:00.696065 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:00.696027 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:52:00.696542 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:00.696135 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:52:00.696542 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:00.696163 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42rhb" podUID="a5862d53-93df-4d28-9fb5-48d60ee4a821" Sep 19 09:52:00.696542 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:00.696275 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sj4wm" Sep 19 09:52:00.696542 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:00.696294 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxdbk" podUID="5e7c4050-b0c9-4afe-86a1-e83b1cf46a27" Sep 19 09:52:00.696542 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:00.696350 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sj4wm" podUID="bf45aeae-2af8-46e2-9c5e-e92f0f2d745d" Sep 19 09:52:01.817135 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:01.816899 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8pk6q" event={"ID":"376e12c4-2b51-4e58-baa4-56f54d631255","Type":"ContainerStarted","Data":"b6f33676e35980d3418640f58db807609883144133bf6712ef30b01ff2118e44"} Sep 19 09:52:01.818927 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:01.818895 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lw4hg" event={"ID":"3a792c07-63a4-43fc-9a3c-649c63c3ad36","Type":"ContainerStarted","Data":"f67acdde19e10f5091ee48feb9a5d94f2cc496a633aa613b8b66713282583a68"} Sep 19 09:52:01.820588 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:01.820555 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" event={"ID":"9db1da1a-1030-4fbe-8222-b10ef157bf76","Type":"ContainerStarted","Data":"8ee185a56c9dfbf9c0fbe65e695667a56eafde5f0cb0a3da794fb89a1dc7603b"} Sep 19 09:52:01.822241 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:01.822208 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mvk4m" event={"ID":"621ae7f4-6b60-4424-95fe-a400cf2f6e01","Type":"ContainerStarted","Data":"c07be5828eb41fc3767da8d1f2b18da13f916c0bcddeed688a44ab004d5cba77"} Sep 19 09:52:01.823859 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:01.823833 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" event={"ID":"3f1d9116-9add-4252-8f32-cccb1f9ee76f","Type":"ContainerStarted","Data":"1f938cab9d28587d952ff1230ea35e5ae0ba1abf4082fee1de316b9ebd742177"} Sep 19 09:52:01.825451 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:01.825417 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cp7g" event={"ID":"9f6cca46-77e3-4de4-abac-85520c106e82","Type":"ContainerStarted","Data":"d9d10599f2d13a8db51dfb63d5c1fecfa167aba79a7588bc5a2751180462e538"} Sep 19 09:52:01.826989 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:01.826966 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rxntx" event={"ID":"2ecdf95f-237b-41ea-a042-a6a821fab942","Type":"ContainerStarted","Data":"d12f1350d285047b15ac554a0809f64732917dd32e64cd80cc181aec470f73f9"} Sep 19 09:52:01.832999 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:01.832954 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal" podStartSLOduration=20.832936071 podStartE2EDuration="20.832936071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 09:51:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:51:45.799196137 +0000 UTC m=+5.599979435" watchObservedRunningTime="2026-09-19 09:52:01.832936071 +0000 UTC m=+21.633719368" Sep 19 09:52:01.833307 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:01.833275 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8pk6q" podStartSLOduration=4.133251145 podStartE2EDuration="21.833265191s" totalImagesPullingTime="17.700014046s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 09:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:52:01.832725389 +0000 UTC m=+21.633508691" watchObservedRunningTime="2026-09-19 09:52:01.833265191 +0000 UTC m=+21.634048488" Sep 19 09:52:01.837928 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:01.837855 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sv4k8" event={"ID":"0fab0c31-fc90-48c2-ba03-ba1bf2abe9b1","Type":"ContainerStarted","Data":"72fc25d24f52b2c4f3fe86ae343221b5e925c54aad9271782cce031f042d22c6"} Sep 19 09:52:01.848982 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:01.848935 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rxntx" podStartSLOduration=4.23850744 podStartE2EDuration="21.848918218s" totalImagesPullingTime="17.610410778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:52:01.848805685 +0000 UTC m=+21.649588994" watchObservedRunningTime="2026-09-19 09:52:01.848918218 +0000 UTC m=+21.649701515" Sep 19 09:52:01.864788 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:01.864679 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4n8zb" podStartSLOduration=4.19452562 podStartE2EDuration="21.86466374s" totalImagesPullingTime="17.67013812s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 09:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:52:01.864232944 +0000 UTC m=+21.665016243" watchObservedRunningTime="2026-09-19 09:52:01.86466374 +0000 UTC m=+21.665447036" Sep 19 09:52:01.914110 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:01.914067 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sv4k8" podStartSLOduration=4.300261538 podStartE2EDuration="21.91405021s" totalImagesPullingTime="17.613788672s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 09:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:52:01.913814921 +0000 UTC m=+21.714598217" watchObservedRunningTime="2026-09-19 09:52:01.91405021 +0000 UTC m=+21.714833504" Sep 19 09:52:01.914529 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:01.914507 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mvk4m" podStartSLOduration=4.223307227 podStartE2EDuration="21.914500397s" totalImagesPullingTime="17.69119317s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 09:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:52:01.898373518 +0000 UTC m=+21.699156815" watchObservedRunningTime="2026-09-19 09:52:01.914500397 +0000 UTC m=+21.715283723" Sep 19 09:52:02.695338 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:02.695097 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sj4wm" Sep 19 09:52:02.695496 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:02.695102 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:52:02.695496 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:02.695438 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sj4wm" podUID="bf45aeae-2af8-46e2-9c5e-e92f0f2d745d" Sep 19 09:52:02.695496 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:02.695153 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:52:02.695496 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:02.695479 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42rhb" podUID="a5862d53-93df-4d28-9fb5-48d60ee4a821" Sep 19 09:52:02.695739 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:02.695590 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxdbk" podUID="5e7c4050-b0c9-4afe-86a1-e83b1cf46a27" Sep 19 09:52:02.823974 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:02.823951 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 19 09:52:02.841758 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:02.841726 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lw4hg" event={"ID":"3a792c07-63a4-43fc-9a3c-649c63c3ad36","Type":"ContainerStarted","Data":"9051dd889205ea7e9ad059fc5f74e5cd36698b624a14b05e8d3bd1898d1f2d9c"} Sep 19 09:52:02.846177 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:02.846154 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sdnzv_3f1d9116-9add-4252-8f32-cccb1f9ee76f/ovn-acl-logging/0.log" Sep 19 09:52:02.846545 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:02.846513 2579 generic.go:356] "Generic (PLEG): container finished" podID="3f1d9116-9add-4252-8f32-cccb1f9ee76f" containerID="1e44a49e65b79b7871fb10b2c791f3b6259b3fa492b0c5a1c19815447c680b35" exitCode=1 Sep 19 09:52:02.846752 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:02.846540 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" event={"ID":"3f1d9116-9add-4252-8f32-cccb1f9ee76f","Type":"ContainerStarted","Data":"c01d4cb45a4e6f5850f1477efa195cbb26267b6f5f2c5e8a8782d6ea10bbcb98"} Sep 19 09:52:02.846752 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:02.846639 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" event={"ID":"3f1d9116-9add-4252-8f32-cccb1f9ee76f","Type":"ContainerStarted","Data":"0053a73012feeb4cb43698509602d081b0d679c78ea0b68f607cee72e5ba86bd"} Sep 19 09:52:02.846752 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:02.846675 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" event={"ID":"3f1d9116-9add-4252-8f32-cccb1f9ee76f","Type":"ContainerStarted","Data":"deb377a62776bf65ed370748b991244c1ee004f8a33ef800becd7b3222afa2e2"} Sep 19 09:52:02.846752 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:02.846722 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" event={"ID":"3f1d9116-9add-4252-8f32-cccb1f9ee76f","Type":"ContainerStarted","Data":"3c3a7a11c66701dc9acb24ee8d804ba7de5aa2a30931890b2089d4501b267b47"} Sep 19 09:52:02.846752 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:02.846751 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" event={"ID":"3f1d9116-9add-4252-8f32-cccb1f9ee76f","Type":"ContainerDied","Data":"1e44a49e65b79b7871fb10b2c791f3b6259b3fa492b0c5a1c19815447c680b35"} Sep 19 09:52:02.848109 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:02.848090 2579 generic.go:356] "Generic (PLEG): container finished" podID="9f6cca46-77e3-4de4-abac-85520c106e82" containerID="d9d10599f2d13a8db51dfb63d5c1fecfa167aba79a7588bc5a2751180462e538" exitCode=0 Sep 19 09:52:02.848186 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:02.848152 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cp7g" event={"ID":"9f6cca46-77e3-4de4-abac-85520c106e82","Type":"ContainerDied","Data":"d9d10599f2d13a8db51dfb63d5c1fecfa167aba79a7588bc5a2751180462e538"} Sep 19 09:52:02.849782 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:02.849755 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x7lsw" event={"ID":"28fb274a-9cae-4f18-a94f-97865ef09f45","Type":"ContainerStarted","Data":"bfad2fd8d49d9aa0d11bd8fec3d823dc1c51ee75da0f41edcbb3c3b553e5787a"} Sep 19 09:52:02.882160 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:02.882105 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-x7lsw" podStartSLOduration=5.214455422 podStartE2EDuration="22.882090724s" totalImagesPullingTime="17.667635302s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 09:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:52:02.881941077 +0000 UTC m=+22.682724374" watchObservedRunningTime="2026-09-19 09:52:02.882090724 +0000 UTC m=+22.682874022" Sep 19 09:52:03.645909 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:03.645783 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-19T09:52:02.823970449Z","UUID":"3cd3aaac-5be9-4a62-8554-8bad457392ee","Handler":null,"Name":"","Endpoint":""} Sep 19 09:52:03.647835 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:03.647809 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 19 09:52:03.647957 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:03.647852 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 19 09:52:03.814311 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:03.814282 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rxntx" Sep 19 09:52:03.814957 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:03.814934 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rxntx" Sep 19 09:52:03.855348 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:03.855303 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rxntx" Sep 19 09:52:03.856066 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:03.856051 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rxntx" Sep 19 09:52:04.694404 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:04.694382 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:52:04.694549 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:04.694419 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sj4wm" Sep 19 09:52:04.694549 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:04.694382 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:52:04.694549 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:04.694508 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxdbk" podUID="5e7c4050-b0c9-4afe-86a1-e83b1cf46a27" Sep 19 09:52:04.694727 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:04.694602 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42rhb" podUID="a5862d53-93df-4d28-9fb5-48d60ee4a821" Sep 19 09:52:04.694727 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:04.694676 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sj4wm" podUID="bf45aeae-2af8-46e2-9c5e-e92f0f2d745d" Sep 19 09:52:04.860536 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:04.860224 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lw4hg" event={"ID":"3a792c07-63a4-43fc-9a3c-649c63c3ad36","Type":"ContainerStarted","Data":"cb92858278c826a5a5172f1f4fbf4c213e703d61ad059b7cde86c46e1b999280"} Sep 19 09:52:04.863917 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:04.863894 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sdnzv_3f1d9116-9add-4252-8f32-cccb1f9ee76f/ovn-acl-logging/0.log" Sep 19 09:52:04.864319 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:04.864292 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" event={"ID":"3f1d9116-9add-4252-8f32-cccb1f9ee76f","Type":"ContainerStarted","Data":"f9c1f7529f61772b9bfadfa70d20f1d4c81af6ee4a09d05f35d25a6351a50458"} Sep 19 09:52:04.877490 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:04.877433 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lw4hg" podStartSLOduration=5.236184037 podStartE2EDuration="24.877419339s" totalImagesPullingTime="19.641235302s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 09:51:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:52:04.876686578 +0000 UTC m=+24.677469891" watchObservedRunningTime="2026-09-19 09:52:04.877419339 +0000 UTC m=+24.678202636" Sep 19 09:52:06.694460 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:06.694426 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sj4wm" Sep 19 09:52:06.694460 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:06.694450 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:52:06.695160 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:06.694427 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:52:06.695160 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:06.694533 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sj4wm" podUID="bf45aeae-2af8-46e2-9c5e-e92f0f2d745d" Sep 19 09:52:06.695160 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:06.694633 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxdbk" podUID="5e7c4050-b0c9-4afe-86a1-e83b1cf46a27" Sep 19 09:52:06.695160 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:06.694746 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42rhb" podUID="a5862d53-93df-4d28-9fb5-48d60ee4a821" Sep 19 09:52:07.874419 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:07.874260 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sdnzv_3f1d9116-9add-4252-8f32-cccb1f9ee76f/ovn-acl-logging/0.log" Sep 19 09:52:07.875135 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:07.874809 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" event={"ID":"3f1d9116-9add-4252-8f32-cccb1f9ee76f","Type":"ContainerStarted","Data":"b7aea9b002bc5c245bf9dd541f608c8c538d0119ae6102a8748317ed7bed0190"} Sep 19 09:52:07.875196 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:07.875138 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:52:07.875237 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:07.875204 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:52:07.875237 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:07.875232 2579 scope.go:117] "RemoveContainer" containerID="1e44a49e65b79b7871fb10b2c791f3b6259b3fa492b0c5a1c19815447c680b35" Sep 19 09:52:07.876893 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:07.876867 2579 generic.go:356] "Generic (PLEG): container finished" podID="9f6cca46-77e3-4de4-abac-85520c106e82" containerID="49944b6aba0d4449955ce35acf45408ff7a123f9a2cc086305cdfbb9a5c7f989" exitCode=0 Sep 19 09:52:07.876973 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:07.876930 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cp7g" event={"ID":"9f6cca46-77e3-4de4-abac-85520c106e82","Type":"ContainerDied","Data":"49944b6aba0d4449955ce35acf45408ff7a123f9a2cc086305cdfbb9a5c7f989"} Sep 19 09:52:07.894928 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:07.894906 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:52:08.694050 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:08.694024 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:52:08.694169 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:08.694024 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:52:08.694169 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:08.694123 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42rhb" podUID="a5862d53-93df-4d28-9fb5-48d60ee4a821" Sep 19 09:52:08.694266 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:08.694024 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sj4wm" Sep 19 09:52:08.694266 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:08.694220 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxdbk" podUID="5e7c4050-b0c9-4afe-86a1-e83b1cf46a27" Sep 19 09:52:08.694335 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:08.694269 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sj4wm" podUID="bf45aeae-2af8-46e2-9c5e-e92f0f2d745d" Sep 19 09:52:08.751839 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:08.751806 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-42rhb"] Sep 19 09:52:08.754807 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:08.754775 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sj4wm"] Sep 19 09:52:08.755548 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:08.755526 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cxdbk"] Sep 19 09:52:08.883441 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:08.883292 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sdnzv_3f1d9116-9add-4252-8f32-cccb1f9ee76f/ovn-acl-logging/0.log" Sep 19 09:52:08.883886 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:08.883859 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" event={"ID":"3f1d9116-9add-4252-8f32-cccb1f9ee76f","Type":"ContainerStarted","Data":"1be1f54420cbbd74e274d2c845ef70fc97b65764628300192b7652dd19d93b30"} Sep 19 09:52:08.884141 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:08.884111 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:52:08.886159 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:08.886138 2579 generic.go:356] "Generic (PLEG): container finished" podID="9f6cca46-77e3-4de4-abac-85520c106e82" containerID="2eed330445b22cce27de62eac1f74653998c64f79bdb1c4ea0824ded663c92ac" exitCode=0 Sep 19 09:52:08.886251 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:08.886213 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cp7g" event={"ID":"9f6cca46-77e3-4de4-abac-85520c106e82","Type":"ContainerDied","Data":"2eed330445b22cce27de62eac1f74653998c64f79bdb1c4ea0824ded663c92ac"} Sep 19 09:52:08.886251 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:08.886237 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:52:08.886360 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:08.886266 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:52:08.886360 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:08.886346 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42rhb" podUID="a5862d53-93df-4d28-9fb5-48d60ee4a821" Sep 19 09:52:08.886447 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:08.886392 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sj4wm" Sep 19 09:52:08.886514 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:08.886492 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sj4wm" podUID="bf45aeae-2af8-46e2-9c5e-e92f0f2d745d" Sep 19 09:52:08.886596 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:08.886578 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxdbk" podUID="5e7c4050-b0c9-4afe-86a1-e83b1cf46a27" Sep 19 09:52:08.906048 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:08.906022 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:52:08.911285 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:08.911244 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" podStartSLOduration=10.871430533 podStartE2EDuration="28.911231908s" totalImagesPullingTime="18.039801375s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 09:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:52:08.910250973 +0000 UTC m=+28.711034273" watchObservedRunningTime="2026-09-19 09:52:08.911231908 +0000 UTC m=+28.712015202" Sep 19 09:52:09.891382 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:09.891297 2579 generic.go:356] "Generic (PLEG): container finished" podID="9f6cca46-77e3-4de4-abac-85520c106e82" containerID="07cfb3850acf0c82d1b527bcb5001e0aaf2ab262800b9c52f1f1334b06e86977" exitCode=0 Sep 19 09:52:09.891793 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:09.891384 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cp7g" event={"ID":"9f6cca46-77e3-4de4-abac-85520c106e82","Type":"ContainerDied","Data":"07cfb3850acf0c82d1b527bcb5001e0aaf2ab262800b9c52f1f1334b06e86977"} Sep 19 09:52:10.695097 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:10.695060 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:52:10.695254 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:10.695139 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42rhb" podUID="a5862d53-93df-4d28-9fb5-48d60ee4a821" Sep 19 09:52:10.695343 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:10.695244 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:52:10.695403 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:10.695381 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxdbk" podUID="5e7c4050-b0c9-4afe-86a1-e83b1cf46a27" Sep 19 09:52:10.695444 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:10.695401 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sj4wm" Sep 19 09:52:10.695480 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:10.695452 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sj4wm" podUID="bf45aeae-2af8-46e2-9c5e-e92f0f2d745d" Sep 19 09:52:12.694577 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:12.694539 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sj4wm" Sep 19 09:52:12.695374 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:12.694539 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:52:12.695374 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:12.694661 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sj4wm" podUID="bf45aeae-2af8-46e2-9c5e-e92f0f2d745d" Sep 19 09:52:12.695374 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:12.694750 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxdbk" podUID="5e7c4050-b0c9-4afe-86a1-e83b1cf46a27" Sep 19 09:52:12.695374 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:12.694538 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:52:12.695374 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:12.694842 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-42rhb" podUID="a5862d53-93df-4d28-9fb5-48d60ee4a821" Sep 19 09:52:14.329421 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.329376 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e7c4050-b0c9-4afe-86a1-e83b1cf46a27-metrics-certs\") pod \"network-metrics-daemon-cxdbk\" (UID: \"5e7c4050-b0c9-4afe-86a1-e83b1cf46a27\") " pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:52:14.329823 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:14.329488 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 09:52:14.329823 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:14.329559 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e7c4050-b0c9-4afe-86a1-e83b1cf46a27-metrics-certs podName:5e7c4050-b0c9-4afe-86a1-e83b1cf46a27 nodeName:}" failed. No retries permitted until 2026-09-19 09:52:46.329538377 +0000 UTC m=+66.130321655 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e7c4050-b0c9-4afe-86a1-e83b1cf46a27-metrics-certs") pod "network-metrics-daemon-cxdbk" (UID: "5e7c4050-b0c9-4afe-86a1-e83b1cf46a27") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 19 09:52:14.430670 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.430635 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5862d53-93df-4d28-9fb5-48d60ee4a821-original-pull-secret\") pod \"global-pull-secret-syncer-42rhb\" (UID: \"a5862d53-93df-4d28-9fb5-48d60ee4a821\") " pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:52:14.430838 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:14.430787 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 19 09:52:14.430883 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:14.430845 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5862d53-93df-4d28-9fb5-48d60ee4a821-original-pull-secret podName:a5862d53-93df-4d28-9fb5-48d60ee4a821 nodeName:}" failed. No retries permitted until 2026-09-19 09:52:46.430831816 +0000 UTC m=+66.231615118 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5862d53-93df-4d28-9fb5-48d60ee4a821-original-pull-secret") pod "global-pull-secret-syncer-42rhb" (UID: "a5862d53-93df-4d28-9fb5-48d60ee4a821") : object "kube-system"/"original-pull-secret" not registered Sep 19 09:52:14.452124 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.452103 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeReady" Sep 19 09:52:14.452235 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.452224 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 19 09:52:14.495599 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.495537 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gs4nm"] Sep 19 09:52:14.497490 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.497405 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gs4nm" Sep 19 09:52:14.498603 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.498575 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-t6sbm"] Sep 19 09:52:14.499965 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.499943 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-drp4f\"" Sep 19 09:52:14.500073 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.499992 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 19 09:52:14.500073 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.500008 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 19 09:52:14.500400 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.500385 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t6sbm" Sep 19 09:52:14.502347 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.502327 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 19 09:52:14.502460 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.502334 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 19 09:52:14.502460 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.502378 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 19 09:52:14.502570 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.502487 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cnmxt\"" Sep 19 09:52:14.506345 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.506328 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gs4nm"] Sep 19 09:52:14.509489 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.509468 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t6sbm"] Sep 19 09:52:14.531267 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.531239 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lbs8\" (UniqueName: \"kubernetes.io/projected/bf45aeae-2af8-46e2-9c5e-e92f0f2d745d-kube-api-access-6lbs8\") pod \"network-check-target-sj4wm\" (UID: \"bf45aeae-2af8-46e2-9c5e-e92f0f2d745d\") " pod="openshift-network-diagnostics/network-check-target-sj4wm" Sep 19 09:52:14.531385 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:14.531372 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 19 09:52:14.531433 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:14.531392 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 19 09:52:14.531433 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:14.531401 2579 projected.go:196] Error preparing data for projected volume kube-api-access-6lbs8 for pod openshift-network-diagnostics/network-check-target-sj4wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 09:52:14.531499 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:14.531449 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf45aeae-2af8-46e2-9c5e-e92f0f2d745d-kube-api-access-6lbs8 podName:bf45aeae-2af8-46e2-9c5e-e92f0f2d745d nodeName:}" failed. No retries permitted until 2026-09-19 09:52:46.531432747 +0000 UTC m=+66.332216042 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6lbs8" (UniqueName: "kubernetes.io/projected/bf45aeae-2af8-46e2-9c5e-e92f0f2d745d-kube-api-access-6lbs8") pod "network-check-target-sj4wm" (UID: "bf45aeae-2af8-46e2-9c5e-e92f0f2d745d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 19 09:52:14.632038 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.632007 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zvf6\" (UniqueName: \"kubernetes.io/projected/bebbf67e-4435-4df9-be91-7de185c1aa50-kube-api-access-4zvf6\") pod \"ingress-canary-t6sbm\" (UID: \"bebbf67e-4435-4df9-be91-7de185c1aa50\") " pod="openshift-ingress-canary/ingress-canary-t6sbm" Sep 19 09:52:14.632038 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.632038 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0ee7f42d-5d82-4976-a8ea-42571ec0a331-config-volume\") pod \"dns-default-gs4nm\" (UID: \"0ee7f42d-5d82-4976-a8ea-42571ec0a331\") " pod="openshift-dns/dns-default-gs4nm" Sep 19 09:52:14.632257 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.632065 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ee7f42d-5d82-4976-a8ea-42571ec0a331-tmp-dir\") pod \"dns-default-gs4nm\" (UID: \"0ee7f42d-5d82-4976-a8ea-42571ec0a331\") " pod="openshift-dns/dns-default-gs4nm" Sep 19 09:52:14.632257 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.632086 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ee7f42d-5d82-4976-a8ea-42571ec0a331-metrics-tls\") pod \"dns-default-gs4nm\" (UID: \"0ee7f42d-5d82-4976-a8ea-42571ec0a331\") " pod="openshift-dns/dns-default-gs4nm" Sep 19 09:52:14.632257 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.632140 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrx5g\" (UniqueName: \"kubernetes.io/projected/0ee7f42d-5d82-4976-a8ea-42571ec0a331-kube-api-access-vrx5g\") pod \"dns-default-gs4nm\" (UID: \"0ee7f42d-5d82-4976-a8ea-42571ec0a331\") " pod="openshift-dns/dns-default-gs4nm" Sep 19 09:52:14.632257 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.632182 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bebbf67e-4435-4df9-be91-7de185c1aa50-cert\") pod \"ingress-canary-t6sbm\" (UID: \"bebbf67e-4435-4df9-be91-7de185c1aa50\") " pod="openshift-ingress-canary/ingress-canary-t6sbm" Sep 19 09:52:14.694450 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.694422 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:52:14.694532 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.694424 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sj4wm" Sep 19 09:52:14.694612 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.694599 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:52:14.696837 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.696816 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 19 09:52:14.697294 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.697272 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 19 09:52:14.697294 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.697293 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 19 09:52:14.697469 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.697274 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bcv4q\"" Sep 19 09:52:14.697469 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.697319 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mh4r4\"" Sep 19 09:52:14.697469 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.697304 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 19 09:52:14.732953 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.732924 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zvf6\" (UniqueName: \"kubernetes.io/projected/bebbf67e-4435-4df9-be91-7de185c1aa50-kube-api-access-4zvf6\") pod \"ingress-canary-t6sbm\" (UID: \"bebbf67e-4435-4df9-be91-7de185c1aa50\") " pod="openshift-ingress-canary/ingress-canary-t6sbm" Sep 19 09:52:14.733064 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.732958 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0ee7f42d-5d82-4976-a8ea-42571ec0a331-config-volume\") pod \"dns-default-gs4nm\" (UID: \"0ee7f42d-5d82-4976-a8ea-42571ec0a331\") " pod="openshift-dns/dns-default-gs4nm" Sep 19 09:52:14.733064 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.732997 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ee7f42d-5d82-4976-a8ea-42571ec0a331-tmp-dir\") pod \"dns-default-gs4nm\" (UID: \"0ee7f42d-5d82-4976-a8ea-42571ec0a331\") " pod="openshift-dns/dns-default-gs4nm" Sep 19 09:52:14.733064 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.733032 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ee7f42d-5d82-4976-a8ea-42571ec0a331-metrics-tls\") pod \"dns-default-gs4nm\" (UID: \"0ee7f42d-5d82-4976-a8ea-42571ec0a331\") " pod="openshift-dns/dns-default-gs4nm" Sep 19 09:52:14.733064 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.733054 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrx5g\" (UniqueName: \"kubernetes.io/projected/0ee7f42d-5d82-4976-a8ea-42571ec0a331-kube-api-access-vrx5g\") pod \"dns-default-gs4nm\" (UID: \"0ee7f42d-5d82-4976-a8ea-42571ec0a331\") " pod="openshift-dns/dns-default-gs4nm" Sep 19 09:52:14.733265 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.733079 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bebbf67e-4435-4df9-be91-7de185c1aa50-cert\") pod \"ingress-canary-t6sbm\" (UID: \"bebbf67e-4435-4df9-be91-7de185c1aa50\") " pod="openshift-ingress-canary/ingress-canary-t6sbm" Sep 19 09:52:14.733265 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:14.733154 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 09:52:14.733265 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:14.733233 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ee7f42d-5d82-4976-a8ea-42571ec0a331-metrics-tls podName:0ee7f42d-5d82-4976-a8ea-42571ec0a331 nodeName:}" failed. No retries permitted until 2026-09-19 09:52:15.23321261 +0000 UTC m=+35.033995913 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ee7f42d-5d82-4976-a8ea-42571ec0a331-metrics-tls") pod "dns-default-gs4nm" (UID: "0ee7f42d-5d82-4976-a8ea-42571ec0a331") : secret "dns-default-metrics-tls" not found Sep 19 09:52:14.733407 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.733353 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ee7f42d-5d82-4976-a8ea-42571ec0a331-tmp-dir\") pod \"dns-default-gs4nm\" (UID: \"0ee7f42d-5d82-4976-a8ea-42571ec0a331\") " pod="openshift-dns/dns-default-gs4nm" Sep 19 09:52:14.733555 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.733538 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0ee7f42d-5d82-4976-a8ea-42571ec0a331-config-volume\") pod \"dns-default-gs4nm\" (UID: \"0ee7f42d-5d82-4976-a8ea-42571ec0a331\") " pod="openshift-dns/dns-default-gs4nm" Sep 19 09:52:14.737384 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.737214 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bebbf67e-4435-4df9-be91-7de185c1aa50-cert\") pod \"ingress-canary-t6sbm\" (UID: \"bebbf67e-4435-4df9-be91-7de185c1aa50\") " pod="openshift-ingress-canary/ingress-canary-t6sbm" Sep 19 09:52:14.741128 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.741109 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrx5g\" (UniqueName: \"kubernetes.io/projected/0ee7f42d-5d82-4976-a8ea-42571ec0a331-kube-api-access-vrx5g\") pod \"dns-default-gs4nm\" (UID: \"0ee7f42d-5d82-4976-a8ea-42571ec0a331\") " pod="openshift-dns/dns-default-gs4nm" Sep 19 09:52:14.741672 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.741656 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zvf6\" (UniqueName: \"kubernetes.io/projected/bebbf67e-4435-4df9-be91-7de185c1aa50-kube-api-access-4zvf6\") pod \"ingress-canary-t6sbm\" (UID: \"bebbf67e-4435-4df9-be91-7de185c1aa50\") " pod="openshift-ingress-canary/ingress-canary-t6sbm" Sep 19 09:52:14.814545 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.814472 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t6sbm" Sep 19 09:52:14.906509 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.906481 2579 generic.go:356] "Generic (PLEG): container finished" podID="9f6cca46-77e3-4de4-abac-85520c106e82" containerID="01baa840e574ccbbeacdfee258d4f082c950e61a6077bbd04b797f203bcfc116" exitCode=0 Sep 19 09:52:14.906858 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:14.906530 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cp7g" event={"ID":"9f6cca46-77e3-4de4-abac-85520c106e82","Type":"ContainerDied","Data":"01baa840e574ccbbeacdfee258d4f082c950e61a6077bbd04b797f203bcfc116"} Sep 19 09:52:15.095445 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:52:15.095415 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbebbf67e_4435_4df9_be91_7de185c1aa50.slice/crio-ee369d1cf233e5ad8afc7be4d47e1cf71017c91ef2895f2878de7cc1d349884f WatchSource:0}: Error finding container ee369d1cf233e5ad8afc7be4d47e1cf71017c91ef2895f2878de7cc1d349884f: Status 404 returned error can't find the container with id ee369d1cf233e5ad8afc7be4d47e1cf71017c91ef2895f2878de7cc1d349884f Sep 19 09:52:15.100828 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:15.100801 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t6sbm"] Sep 19 09:52:15.238629 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:15.238590 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ee7f42d-5d82-4976-a8ea-42571ec0a331-metrics-tls\") pod \"dns-default-gs4nm\" (UID: \"0ee7f42d-5d82-4976-a8ea-42571ec0a331\") " pod="openshift-dns/dns-default-gs4nm" Sep 19 09:52:15.238818 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:15.238781 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 09:52:15.238862 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:15.238856 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ee7f42d-5d82-4976-a8ea-42571ec0a331-metrics-tls podName:0ee7f42d-5d82-4976-a8ea-42571ec0a331 nodeName:}" failed. No retries permitted until 2026-09-19 09:52:16.238837035 +0000 UTC m=+36.039620331 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ee7f42d-5d82-4976-a8ea-42571ec0a331-metrics-tls") pod "dns-default-gs4nm" (UID: "0ee7f42d-5d82-4976-a8ea-42571ec0a331") : secret "dns-default-metrics-tls" not found Sep 19 09:52:15.609232 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:15.609198 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-ntl98"] Sep 19 09:52:15.612345 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:15.612323 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-ntl98" Sep 19 09:52:15.614499 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:15.614474 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 19 09:52:15.614607 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:15.614534 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 19 09:52:15.614607 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:15.614572 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-tvgpj\"" Sep 19 09:52:15.620561 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:15.620452 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-ntl98"] Sep 19 09:52:15.742741 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:15.742663 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4hlg\" (UniqueName: \"kubernetes.io/projected/ff023f49-9478-46c5-9aff-b3c083494a7b-kube-api-access-c4hlg\") pod \"migrator-76794cbd6c-ntl98\" (UID: \"ff023f49-9478-46c5-9aff-b3c083494a7b\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-ntl98" Sep 19 09:52:15.843743 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:15.843690 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4hlg\" (UniqueName: \"kubernetes.io/projected/ff023f49-9478-46c5-9aff-b3c083494a7b-kube-api-access-c4hlg\") pod \"migrator-76794cbd6c-ntl98\" (UID: \"ff023f49-9478-46c5-9aff-b3c083494a7b\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-ntl98" Sep 19 09:52:15.853458 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:15.853431 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4hlg\" (UniqueName: \"kubernetes.io/projected/ff023f49-9478-46c5-9aff-b3c083494a7b-kube-api-access-c4hlg\") pod \"migrator-76794cbd6c-ntl98\" (UID: \"ff023f49-9478-46c5-9aff-b3c083494a7b\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-ntl98" Sep 19 09:52:15.913540 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:15.913465 2579 generic.go:356] "Generic (PLEG): container finished" podID="9f6cca46-77e3-4de4-abac-85520c106e82" containerID="9ab8c2e0fe0b410c08e85e18dcee2bd6d4762f3264676eab3523564b66c6e0a4" exitCode=0 Sep 19 09:52:15.913683 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:15.913556 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cp7g" event={"ID":"9f6cca46-77e3-4de4-abac-85520c106e82","Type":"ContainerDied","Data":"9ab8c2e0fe0b410c08e85e18dcee2bd6d4762f3264676eab3523564b66c6e0a4"} Sep 19 09:52:15.915296 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:15.915270 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t6sbm" event={"ID":"bebbf67e-4435-4df9-be91-7de185c1aa50","Type":"ContainerStarted","Data":"ee369d1cf233e5ad8afc7be4d47e1cf71017c91ef2895f2878de7cc1d349884f"} Sep 19 09:52:15.922937 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:15.922915 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-ntl98" Sep 19 09:52:16.130425 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:16.130190 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-77xzw"] Sep 19 09:52:16.133482 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:16.133459 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-77xzw" Sep 19 09:52:16.135876 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:16.135851 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qhw8x\"" Sep 19 09:52:16.136427 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:16.136337 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 19 09:52:16.136604 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:16.136580 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 19 09:52:16.136604 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:16.136601 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 19 09:52:16.136841 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:16.136816 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 19 09:52:16.145393 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:16.145374 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-77xzw"] Sep 19 09:52:16.209809 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:16.209782 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-ntl98"] Sep 19 09:52:16.213595 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:52:16.213567 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff023f49_9478_46c5_9aff_b3c083494a7b.slice/crio-5d2a227f5a56aef0b15e455fc3d7c9ceaae9604e15e32be39310e9de94fb7462 WatchSource:0}: Error finding container 5d2a227f5a56aef0b15e455fc3d7c9ceaae9604e15e32be39310e9de94fb7462: Status 404 returned error can't find the container with id 5d2a227f5a56aef0b15e455fc3d7c9ceaae9604e15e32be39310e9de94fb7462 Sep 19 09:52:16.246713 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:16.246675 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdslk\" (UniqueName: \"kubernetes.io/projected/81331dd3-3166-4168-afbb-76e0bb7f012d-kube-api-access-xdslk\") pod \"insights-runtime-extractor-77xzw\" (UID: \"81331dd3-3166-4168-afbb-76e0bb7f012d\") " pod="openshift-insights/insights-runtime-extractor-77xzw" Sep 19 09:52:16.246827 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:16.246751 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/81331dd3-3166-4168-afbb-76e0bb7f012d-data-volume\") pod \"insights-runtime-extractor-77xzw\" (UID: \"81331dd3-3166-4168-afbb-76e0bb7f012d\") " pod="openshift-insights/insights-runtime-extractor-77xzw" Sep 19 09:52:16.246827 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:16.246777 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/81331dd3-3166-4168-afbb-76e0bb7f012d-crio-socket\") pod \"insights-runtime-extractor-77xzw\" (UID: \"81331dd3-3166-4168-afbb-76e0bb7f012d\") " pod="openshift-insights/insights-runtime-extractor-77xzw" Sep 19 09:52:16.246827 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:16.246807 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81331dd3-3166-4168-afbb-76e0bb7f012d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-77xzw\" (UID: \"81331dd3-3166-4168-afbb-76e0bb7f012d\") " pod="openshift-insights/insights-runtime-extractor-77xzw" Sep 19 09:52:16.246965 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:16.246838 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81331dd3-3166-4168-afbb-76e0bb7f012d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-77xzw\" (UID: \"81331dd3-3166-4168-afbb-76e0bb7f012d\") " pod="openshift-insights/insights-runtime-extractor-77xzw" Sep 19 09:52:16.246965 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:16.246896 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ee7f42d-5d82-4976-a8ea-42571ec0a331-metrics-tls\") pod \"dns-default-gs4nm\" (UID: \"0ee7f42d-5d82-4976-a8ea-42571ec0a331\") " pod="openshift-dns/dns-default-gs4nm" Sep 19 09:52:16.247053 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:16.247000 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 09:52:16.247101 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:16.247071 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ee7f42d-5d82-4976-a8ea-42571ec0a331-metrics-tls podName:0ee7f42d-5d82-4976-a8ea-42571ec0a331 nodeName:}" failed. No retries permitted until 2026-09-19 09:52:18.247049169 +0000 UTC m=+38.047832458 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ee7f42d-5d82-4976-a8ea-42571ec0a331-metrics-tls") pod "dns-default-gs4nm" (UID: "0ee7f42d-5d82-4976-a8ea-42571ec0a331") : secret "dns-default-metrics-tls" not found Sep 19 09:52:16.347714 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:16.347644 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdslk\" (UniqueName: \"kubernetes.io/projected/81331dd3-3166-4168-afbb-76e0bb7f012d-kube-api-access-xdslk\") pod \"insights-runtime-extractor-77xzw\" (UID: \"81331dd3-3166-4168-afbb-76e0bb7f012d\") " pod="openshift-insights/insights-runtime-extractor-77xzw" Sep 19 09:52:16.347714 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:16.347708 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/81331dd3-3166-4168-afbb-76e0bb7f012d-data-volume\") pod \"insights-runtime-extractor-77xzw\" (UID: \"81331dd3-3166-4168-afbb-76e0bb7f012d\") " pod="openshift-insights/insights-runtime-extractor-77xzw" Sep 19 09:52:16.347937 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:16.347746 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/81331dd3-3166-4168-afbb-76e0bb7f012d-crio-socket\") pod \"insights-runtime-extractor-77xzw\" (UID: \"81331dd3-3166-4168-afbb-76e0bb7f012d\") " pod="openshift-insights/insights-runtime-extractor-77xzw" Sep 19 09:52:16.347937 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:16.347778 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81331dd3-3166-4168-afbb-76e0bb7f012d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-77xzw\" (UID: \"81331dd3-3166-4168-afbb-76e0bb7f012d\") " pod="openshift-insights/insights-runtime-extractor-77xzw" Sep 19 09:52:16.347937 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:16.347801 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81331dd3-3166-4168-afbb-76e0bb7f012d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-77xzw\" (UID: \"81331dd3-3166-4168-afbb-76e0bb7f012d\") " pod="openshift-insights/insights-runtime-extractor-77xzw" Sep 19 09:52:16.347937 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:16.347866 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 19 09:52:16.347937 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:16.347899 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 19 09:52:16.347937 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:16.347929 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/81331dd3-3166-4168-afbb-76e0bb7f012d-kube-rbac-proxy-cm podName:81331dd3-3166-4168-afbb-76e0bb7f012d nodeName:}" failed. No retries permitted until 2026-09-19 09:52:16.847911119 +0000 UTC m=+36.648694417 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/81331dd3-3166-4168-afbb-76e0bb7f012d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-77xzw" (UID: "81331dd3-3166-4168-afbb-76e0bb7f012d") : configmap "kube-rbac-proxy" not found Sep 19 09:52:16.348287 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:16.347945 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81331dd3-3166-4168-afbb-76e0bb7f012d-insights-runtime-extractor-tls podName:81331dd3-3166-4168-afbb-76e0bb7f012d nodeName:}" failed. No retries permitted until 2026-09-19 09:52:16.847937573 +0000 UTC m=+36.648720849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81331dd3-3166-4168-afbb-76e0bb7f012d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-77xzw" (UID: "81331dd3-3166-4168-afbb-76e0bb7f012d") : secret "insights-runtime-extractor-tls" not found Sep 19 09:52:16.348287 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:16.348011 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/81331dd3-3166-4168-afbb-76e0bb7f012d-crio-socket\") pod \"insights-runtime-extractor-77xzw\" (UID: \"81331dd3-3166-4168-afbb-76e0bb7f012d\") " pod="openshift-insights/insights-runtime-extractor-77xzw" Sep 19 09:52:16.348747 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:16.348722 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/81331dd3-3166-4168-afbb-76e0bb7f012d-data-volume\") pod \"insights-runtime-extractor-77xzw\" (UID: \"81331dd3-3166-4168-afbb-76e0bb7f012d\") " pod="openshift-insights/insights-runtime-extractor-77xzw" Sep 19 09:52:16.357062 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:16.357041 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdslk\" (UniqueName: \"kubernetes.io/projected/81331dd3-3166-4168-afbb-76e0bb7f012d-kube-api-access-xdslk\") pod \"insights-runtime-extractor-77xzw\" (UID: \"81331dd3-3166-4168-afbb-76e0bb7f012d\") " pod="openshift-insights/insights-runtime-extractor-77xzw" Sep 19 09:52:16.853360 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:16.853028 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81331dd3-3166-4168-afbb-76e0bb7f012d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-77xzw\" (UID: \"81331dd3-3166-4168-afbb-76e0bb7f012d\") " pod="openshift-insights/insights-runtime-extractor-77xzw" Sep 19 09:52:16.853360 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:16.853151 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81331dd3-3166-4168-afbb-76e0bb7f012d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-77xzw\" (UID: \"81331dd3-3166-4168-afbb-76e0bb7f012d\") " pod="openshift-insights/insights-runtime-extractor-77xzw" Sep 19 09:52:16.853360 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:16.853171 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 19 09:52:16.853360 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:16.853245 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/81331dd3-3166-4168-afbb-76e0bb7f012d-kube-rbac-proxy-cm podName:81331dd3-3166-4168-afbb-76e0bb7f012d nodeName:}" failed. No retries permitted until 2026-09-19 09:52:17.85322435 +0000 UTC m=+37.654007641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/81331dd3-3166-4168-afbb-76e0bb7f012d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-77xzw" (UID: "81331dd3-3166-4168-afbb-76e0bb7f012d") : configmap "kube-rbac-proxy" not found Sep 19 09:52:16.853360 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:16.853267 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 19 09:52:16.853360 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:16.853334 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81331dd3-3166-4168-afbb-76e0bb7f012d-insights-runtime-extractor-tls podName:81331dd3-3166-4168-afbb-76e0bb7f012d nodeName:}" failed. No retries permitted until 2026-09-19 09:52:17.853317702 +0000 UTC m=+37.654100995 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81331dd3-3166-4168-afbb-76e0bb7f012d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-77xzw" (UID: "81331dd3-3166-4168-afbb-76e0bb7f012d") : secret "insights-runtime-extractor-tls" not found Sep 19 09:52:16.922544 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:16.922513 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cp7g" event={"ID":"9f6cca46-77e3-4de4-abac-85520c106e82","Type":"ContainerStarted","Data":"1b2e7e8ec170ef2a554a0cf91c7df31b29c9d82d56b8edd175e6647bb45955b3"} Sep 19 09:52:16.923827 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:16.923804 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-ntl98" event={"ID":"ff023f49-9478-46c5-9aff-b3c083494a7b","Type":"ContainerStarted","Data":"5d2a227f5a56aef0b15e455fc3d7c9ceaae9604e15e32be39310e9de94fb7462"} Sep 19 09:52:16.942212 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:16.942172 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7cp7g" podStartSLOduration=10.159316139 podStartE2EDuration="36.942158078s" totalImagesPullingTime="26.782841939s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 09:51:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:52:16.941379546 +0000 UTC m=+36.742162844" watchObservedRunningTime="2026-09-19 09:52:16.942158078 +0000 UTC m=+36.742941365" Sep 19 09:52:17.864306 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:17.864226 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81331dd3-3166-4168-afbb-76e0bb7f012d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-77xzw\" (UID: \"81331dd3-3166-4168-afbb-76e0bb7f012d\") " pod="openshift-insights/insights-runtime-extractor-77xzw" Sep 19 09:52:17.864306 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:17.864269 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81331dd3-3166-4168-afbb-76e0bb7f012d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-77xzw\" (UID: \"81331dd3-3166-4168-afbb-76e0bb7f012d\") " pod="openshift-insights/insights-runtime-extractor-77xzw" Sep 19 09:52:17.864815 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:17.864335 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 19 09:52:17.864815 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:17.864377 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 19 09:52:17.864815 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:17.864392 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/81331dd3-3166-4168-afbb-76e0bb7f012d-kube-rbac-proxy-cm podName:81331dd3-3166-4168-afbb-76e0bb7f012d nodeName:}" failed. No retries permitted until 2026-09-19 09:52:19.864377723 +0000 UTC m=+39.665161010 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/81331dd3-3166-4168-afbb-76e0bb7f012d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-77xzw" (UID: "81331dd3-3166-4168-afbb-76e0bb7f012d") : configmap "kube-rbac-proxy" not found Sep 19 09:52:17.864815 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:17.864432 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81331dd3-3166-4168-afbb-76e0bb7f012d-insights-runtime-extractor-tls podName:81331dd3-3166-4168-afbb-76e0bb7f012d nodeName:}" failed. No retries permitted until 2026-09-19 09:52:19.864419349 +0000 UTC m=+39.665202624 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81331dd3-3166-4168-afbb-76e0bb7f012d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-77xzw" (UID: "81331dd3-3166-4168-afbb-76e0bb7f012d") : secret "insights-runtime-extractor-tls" not found Sep 19 09:52:17.928963 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:17.928861 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t6sbm" event={"ID":"bebbf67e-4435-4df9-be91-7de185c1aa50","Type":"ContainerStarted","Data":"7767fd89a5f0aac6859bc6f5eaa19b5f188f9cacb8ac62fbc9044c2f2b5e3746"} Sep 19 09:52:17.944288 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:17.944232 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-t6sbm" podStartSLOduration=1.610663787 podStartE2EDuration="3.944217302s" totalImagesPullingTime="2.333553515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:52:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:52:17.943589615 +0000 UTC m=+37.744372923" watchObservedRunningTime="2026-09-19 09:52:17.944217302 +0000 UTC m=+37.745000590" Sep 19 09:52:18.268058 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:18.268021 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ee7f42d-5d82-4976-a8ea-42571ec0a331-metrics-tls\") pod \"dns-default-gs4nm\" (UID: \"0ee7f42d-5d82-4976-a8ea-42571ec0a331\") " pod="openshift-dns/dns-default-gs4nm" Sep 19 09:52:18.268209 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:18.268172 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 09:52:18.268246 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:18.268234 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ee7f42d-5d82-4976-a8ea-42571ec0a331-metrics-tls podName:0ee7f42d-5d82-4976-a8ea-42571ec0a331 nodeName:}" failed. No retries permitted until 2026-09-19 09:52:22.268216978 +0000 UTC m=+42.069000275 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ee7f42d-5d82-4976-a8ea-42571ec0a331-metrics-tls") pod "dns-default-gs4nm" (UID: "0ee7f42d-5d82-4976-a8ea-42571ec0a331") : secret "dns-default-metrics-tls" not found Sep 19 09:52:18.932516 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:18.932301 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-ntl98" event={"ID":"ff023f49-9478-46c5-9aff-b3c083494a7b","Type":"ContainerStarted","Data":"d6ca5d00b04941af29b07b4fc7d37275255608280c19514db97d033464059b5d"} Sep 19 09:52:18.932959 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:18.932538 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-ntl98" event={"ID":"ff023f49-9478-46c5-9aff-b3c083494a7b","Type":"ContainerStarted","Data":"82195e4f9cc421ef8fed16baeee16434ef5f9a7c24d45936b49564f081268570"} Sep 19 09:52:18.947369 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:18.947317 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-ntl98" podStartSLOduration=1.7730495 podStartE2EDuration="3.947298174s" totalImagesPullingTime="2.174248674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:52:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:52:18.946254197 +0000 UTC m=+38.747037505" watchObservedRunningTime="2026-09-19 09:52:18.947298174 +0000 UTC m=+38.748081474" Sep 19 09:52:19.092829 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:19.092803 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sv4k8_0fab0c31-fc90-48c2-ba03-ba1bf2abe9b1/dns-node-resolver/0.log" Sep 19 09:52:19.882062 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:19.882028 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81331dd3-3166-4168-afbb-76e0bb7f012d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-77xzw\" (UID: \"81331dd3-3166-4168-afbb-76e0bb7f012d\") " pod="openshift-insights/insights-runtime-extractor-77xzw" Sep 19 09:52:19.882062 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:19.882069 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81331dd3-3166-4168-afbb-76e0bb7f012d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-77xzw\" (UID: \"81331dd3-3166-4168-afbb-76e0bb7f012d\") " pod="openshift-insights/insights-runtime-extractor-77xzw" Sep 19 09:52:19.882284 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:19.882164 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 19 09:52:19.882284 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:19.882201 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 19 09:52:19.882284 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:19.882212 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/81331dd3-3166-4168-afbb-76e0bb7f012d-kube-rbac-proxy-cm podName:81331dd3-3166-4168-afbb-76e0bb7f012d nodeName:}" failed. No retries permitted until 2026-09-19 09:52:23.882199332 +0000 UTC m=+43.682982620 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/81331dd3-3166-4168-afbb-76e0bb7f012d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-77xzw" (UID: "81331dd3-3166-4168-afbb-76e0bb7f012d") : configmap "kube-rbac-proxy" not found Sep 19 09:52:19.882394 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:19.882332 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81331dd3-3166-4168-afbb-76e0bb7f012d-insights-runtime-extractor-tls podName:81331dd3-3166-4168-afbb-76e0bb7f012d nodeName:}" failed. No retries permitted until 2026-09-19 09:52:23.882316348 +0000 UTC m=+43.683099622 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81331dd3-3166-4168-afbb-76e0bb7f012d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-77xzw" (UID: "81331dd3-3166-4168-afbb-76e0bb7f012d") : secret "insights-runtime-extractor-tls" not found Sep 19 09:52:20.092225 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:20.092201 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mvk4m_621ae7f4-6b60-4424-95fe-a400cf2f6e01/node-ca/0.log" Sep 19 09:52:20.892452 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:20.892424 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t6sbm_bebbf67e-4435-4df9-be91-7de185c1aa50/serve-healthcheck-canary/0.log" Sep 19 09:52:21.096195 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:21.096167 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-ntl98_ff023f49-9478-46c5-9aff-b3c083494a7b/migrator/0.log" Sep 19 09:52:21.292045 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:21.292020 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-ntl98_ff023f49-9478-46c5-9aff-b3c083494a7b/graceful-termination/0.log" Sep 19 09:52:22.299016 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:22.298982 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ee7f42d-5d82-4976-a8ea-42571ec0a331-metrics-tls\") pod \"dns-default-gs4nm\" (UID: \"0ee7f42d-5d82-4976-a8ea-42571ec0a331\") " pod="openshift-dns/dns-default-gs4nm" Sep 19 09:52:22.299365 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:22.299148 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 19 09:52:22.299365 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:22.299215 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ee7f42d-5d82-4976-a8ea-42571ec0a331-metrics-tls podName:0ee7f42d-5d82-4976-a8ea-42571ec0a331 nodeName:}" failed. No retries permitted until 2026-09-19 09:52:30.299199155 +0000 UTC m=+50.099982446 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0ee7f42d-5d82-4976-a8ea-42571ec0a331-metrics-tls") pod "dns-default-gs4nm" (UID: "0ee7f42d-5d82-4976-a8ea-42571ec0a331") : secret "dns-default-metrics-tls" not found Sep 19 09:52:23.908407 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:23.908371 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81331dd3-3166-4168-afbb-76e0bb7f012d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-77xzw\" (UID: \"81331dd3-3166-4168-afbb-76e0bb7f012d\") " pod="openshift-insights/insights-runtime-extractor-77xzw" Sep 19 09:52:23.908886 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:23.908416 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81331dd3-3166-4168-afbb-76e0bb7f012d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-77xzw\" (UID: \"81331dd3-3166-4168-afbb-76e0bb7f012d\") " pod="openshift-insights/insights-runtime-extractor-77xzw" Sep 19 09:52:23.908886 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:23.908504 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 19 09:52:23.908886 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:52:23.908565 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81331dd3-3166-4168-afbb-76e0bb7f012d-insights-runtime-extractor-tls podName:81331dd3-3166-4168-afbb-76e0bb7f012d nodeName:}" failed. No retries permitted until 2026-09-19 09:52:31.908551135 +0000 UTC m=+51.709334422 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/81331dd3-3166-4168-afbb-76e0bb7f012d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-77xzw" (UID: "81331dd3-3166-4168-afbb-76e0bb7f012d") : secret "insights-runtime-extractor-tls" not found Sep 19 09:52:23.909106 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:23.909087 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/81331dd3-3166-4168-afbb-76e0bb7f012d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-77xzw\" (UID: \"81331dd3-3166-4168-afbb-76e0bb7f012d\") " pod="openshift-insights/insights-runtime-extractor-77xzw" Sep 19 09:52:30.352596 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:30.352556 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ee7f42d-5d82-4976-a8ea-42571ec0a331-metrics-tls\") pod \"dns-default-gs4nm\" (UID: \"0ee7f42d-5d82-4976-a8ea-42571ec0a331\") " pod="openshift-dns/dns-default-gs4nm" Sep 19 09:52:30.355869 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:30.355832 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ee7f42d-5d82-4976-a8ea-42571ec0a331-metrics-tls\") pod \"dns-default-gs4nm\" (UID: \"0ee7f42d-5d82-4976-a8ea-42571ec0a331\") " pod="openshift-dns/dns-default-gs4nm" Sep 19 09:52:30.408684 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:30.408652 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gs4nm" Sep 19 09:52:30.693006 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:30.692968 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gs4nm"] Sep 19 09:52:30.695999 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:52:30.695959 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ee7f42d_5d82_4976_a8ea_42571ec0a331.slice/crio-868719ea98fcc56fc816a0cc6f0fb313fb0ab0a19655fc7b0d75f17c37277512 WatchSource:0}: Error finding container 868719ea98fcc56fc816a0cc6f0fb313fb0ab0a19655fc7b0d75f17c37277512: Status 404 returned error can't find the container with id 868719ea98fcc56fc816a0cc6f0fb313fb0ab0a19655fc7b0d75f17c37277512 Sep 19 09:52:30.960845 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:30.960765 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gs4nm" event={"ID":"0ee7f42d-5d82-4976-a8ea-42571ec0a331","Type":"ContainerStarted","Data":"868719ea98fcc56fc816a0cc6f0fb313fb0ab0a19655fc7b0d75f17c37277512"} Sep 19 09:52:31.966453 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:31.966424 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81331dd3-3166-4168-afbb-76e0bb7f012d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-77xzw\" (UID: \"81331dd3-3166-4168-afbb-76e0bb7f012d\") " pod="openshift-insights/insights-runtime-extractor-77xzw" Sep 19 09:52:31.968799 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:31.968779 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/81331dd3-3166-4168-afbb-76e0bb7f012d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-77xzw\" (UID: \"81331dd3-3166-4168-afbb-76e0bb7f012d\") " pod="openshift-insights/insights-runtime-extractor-77xzw" Sep 19 09:52:32.046073 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:32.046040 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-77xzw" Sep 19 09:52:32.781367 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:32.781296 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-77xzw"] Sep 19 09:52:32.814810 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:52:32.814768 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81331dd3_3166_4168_afbb_76e0bb7f012d.slice/crio-d3a38dad72025fb053133d65cb8850cef3f6f1b5dc04536a0f1d1ad523a9e8e6 WatchSource:0}: Error finding container d3a38dad72025fb053133d65cb8850cef3f6f1b5dc04536a0f1d1ad523a9e8e6: Status 404 returned error can't find the container with id d3a38dad72025fb053133d65cb8850cef3f6f1b5dc04536a0f1d1ad523a9e8e6 Sep 19 09:52:32.968797 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:32.968754 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-77xzw" event={"ID":"81331dd3-3166-4168-afbb-76e0bb7f012d","Type":"ContainerStarted","Data":"f01b39c7886dfbce68ca4e3da640382d64b51fc278715ee5e081215beba5f241"} Sep 19 09:52:32.969178 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:32.968833 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-77xzw" event={"ID":"81331dd3-3166-4168-afbb-76e0bb7f012d","Type":"ContainerStarted","Data":"d3a38dad72025fb053133d65cb8850cef3f6f1b5dc04536a0f1d1ad523a9e8e6"} Sep 19 09:52:32.971040 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:32.971013 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gs4nm" event={"ID":"0ee7f42d-5d82-4976-a8ea-42571ec0a331","Type":"ContainerStarted","Data":"783844b7abf762cbdc35273ed0cda31743ada9d42076e1f947bb5b39a8b02d72"} Sep 19 09:52:33.976009 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:33.975967 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gs4nm" event={"ID":"0ee7f42d-5d82-4976-a8ea-42571ec0a331","Type":"ContainerStarted","Data":"2dc31868f8c5ec184c60236dc611275d875f3722d68b4ae410741b922164159d"} Sep 19 09:52:33.976348 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:33.976110 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gs4nm" Sep 19 09:52:33.993164 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:33.993124 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gs4nm" podStartSLOduration=17.84937639 podStartE2EDuration="19.993105444s" totalImagesPullingTime="2.143729054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:52:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:52:33.992951443 +0000 UTC m=+53.793734741" watchObservedRunningTime="2026-09-19 09:52:33.993105444 +0000 UTC m=+53.793888741" Sep 19 09:52:34.980332 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:34.980295 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-77xzw" event={"ID":"81331dd3-3166-4168-afbb-76e0bb7f012d","Type":"ContainerStarted","Data":"a8db71d449776f19d586315f34ce6d3e670876403bb1ec3208ae7919d7d50764"} Sep 19 09:52:35.984978 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:35.984946 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-77xzw" event={"ID":"81331dd3-3166-4168-afbb-76e0bb7f012d","Type":"ContainerStarted","Data":"9a1564008514e8fdf11a3ba2661b8fc91c9a7cf11fa483930cde1a1a9adfb3d1"} Sep 19 09:52:36.005216 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:36.005157 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-77xzw" podStartSLOduration=17.481654605 podStartE2EDuration="20.005141644s" totalImagesPullingTime="2.523487039s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 09:52:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:52:36.00385647 +0000 UTC m=+55.804639768" watchObservedRunningTime="2026-09-19 09:52:36.005141644 +0000 UTC m=+55.805924941" Sep 19 09:52:37.475175 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.475145 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6679f55f9f-kp64l"] Sep 19 09:52:37.476937 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.476922 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d6ccd49f-s6xkg"] Sep 19 09:52:37.477064 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.477045 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6679f55f9f-kp64l" Sep 19 09:52:37.478674 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.478654 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d6ccd49f-s6xkg" Sep 19 09:52:37.485709 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.485669 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 19 09:52:37.485709 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.485669 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 19 09:52:37.485867 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.485747 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 19 09:52:37.485867 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.485770 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 19 09:52:37.485867 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.485775 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 19 09:52:37.486019 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.485974 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 19 09:52:37.486019 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.485991 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 19 09:52:37.486254 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.486232 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 19 09:52:37.491684 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.491666 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6679f55f9f-kp64l"] Sep 19 09:52:37.505526 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.505507 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3b0ddaed-1aa8-4bb1-9f21-2095605ec256-klusterlet-config\") pod \"klusterlet-addon-workmgr-6679f55f9f-kp64l\" (UID: \"3b0ddaed-1aa8-4bb1-9f21-2095605ec256\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6679f55f9f-kp64l" Sep 19 09:52:37.505618 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.505533 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d954591f-edf0-42c8-9d84-d2ba808799c7-ca\") pod \"cluster-proxy-proxy-agent-74d6ccd49f-s6xkg\" (UID: \"d954591f-edf0-42c8-9d84-d2ba808799c7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d6ccd49f-s6xkg" Sep 19 09:52:37.505618 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.505550 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d954591f-edf0-42c8-9d84-d2ba808799c7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-74d6ccd49f-s6xkg\" (UID: \"d954591f-edf0-42c8-9d84-d2ba808799c7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d6ccd49f-s6xkg" Sep 19 09:52:37.505618 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.505567 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b0ddaed-1aa8-4bb1-9f21-2095605ec256-tmp\") pod \"klusterlet-addon-workmgr-6679f55f9f-kp64l\" (UID: \"3b0ddaed-1aa8-4bb1-9f21-2095605ec256\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6679f55f9f-kp64l" Sep 19 09:52:37.505618 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.505582 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d954591f-edf0-42c8-9d84-d2ba808799c7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-74d6ccd49f-s6xkg\" (UID: \"d954591f-edf0-42c8-9d84-d2ba808799c7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d6ccd49f-s6xkg" Sep 19 09:52:37.505799 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.505662 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9t2t\" (UniqueName: \"kubernetes.io/projected/3b0ddaed-1aa8-4bb1-9f21-2095605ec256-kube-api-access-n9t2t\") pod \"klusterlet-addon-workmgr-6679f55f9f-kp64l\" (UID: \"3b0ddaed-1aa8-4bb1-9f21-2095605ec256\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6679f55f9f-kp64l" Sep 19 09:52:37.505799 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.505690 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d954591f-edf0-42c8-9d84-d2ba808799c7-hub\") pod \"cluster-proxy-proxy-agent-74d6ccd49f-s6xkg\" (UID: \"d954591f-edf0-42c8-9d84-d2ba808799c7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d6ccd49f-s6xkg" Sep 19 09:52:37.505799 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.505724 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d954591f-edf0-42c8-9d84-d2ba808799c7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-74d6ccd49f-s6xkg\" (UID: \"d954591f-edf0-42c8-9d84-d2ba808799c7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d6ccd49f-s6xkg" Sep 19 09:52:37.505799 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.505739 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8lhl\" (UniqueName: \"kubernetes.io/projected/d954591f-edf0-42c8-9d84-d2ba808799c7-kube-api-access-p8lhl\") pod \"cluster-proxy-proxy-agent-74d6ccd49f-s6xkg\" (UID: \"d954591f-edf0-42c8-9d84-d2ba808799c7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d6ccd49f-s6xkg" Sep 19 09:52:37.521178 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.521159 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d6ccd49f-s6xkg"] Sep 19 09:52:37.606606 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.606574 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3b0ddaed-1aa8-4bb1-9f21-2095605ec256-klusterlet-config\") pod \"klusterlet-addon-workmgr-6679f55f9f-kp64l\" (UID: \"3b0ddaed-1aa8-4bb1-9f21-2095605ec256\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6679f55f9f-kp64l" Sep 19 09:52:37.606606 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.606605 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d954591f-edf0-42c8-9d84-d2ba808799c7-ca\") pod \"cluster-proxy-proxy-agent-74d6ccd49f-s6xkg\" (UID: \"d954591f-edf0-42c8-9d84-d2ba808799c7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d6ccd49f-s6xkg" Sep 19 09:52:37.606861 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.606624 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d954591f-edf0-42c8-9d84-d2ba808799c7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-74d6ccd49f-s6xkg\" (UID: \"d954591f-edf0-42c8-9d84-d2ba808799c7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d6ccd49f-s6xkg" Sep 19 09:52:37.606861 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.606642 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b0ddaed-1aa8-4bb1-9f21-2095605ec256-tmp\") pod \"klusterlet-addon-workmgr-6679f55f9f-kp64l\" (UID: \"3b0ddaed-1aa8-4bb1-9f21-2095605ec256\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6679f55f9f-kp64l" Sep 19 09:52:37.606861 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.606658 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d954591f-edf0-42c8-9d84-d2ba808799c7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-74d6ccd49f-s6xkg\" (UID: \"d954591f-edf0-42c8-9d84-d2ba808799c7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d6ccd49f-s6xkg" Sep 19 09:52:37.606861 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.606719 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9t2t\" (UniqueName: \"kubernetes.io/projected/3b0ddaed-1aa8-4bb1-9f21-2095605ec256-kube-api-access-n9t2t\") pod \"klusterlet-addon-workmgr-6679f55f9f-kp64l\" (UID: \"3b0ddaed-1aa8-4bb1-9f21-2095605ec256\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6679f55f9f-kp64l" Sep 19 09:52:37.606861 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.606753 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d954591f-edf0-42c8-9d84-d2ba808799c7-hub\") pod \"cluster-proxy-proxy-agent-74d6ccd49f-s6xkg\" (UID: \"d954591f-edf0-42c8-9d84-d2ba808799c7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d6ccd49f-s6xkg" Sep 19 09:52:37.606861 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.606776 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d954591f-edf0-42c8-9d84-d2ba808799c7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-74d6ccd49f-s6xkg\" (UID: \"d954591f-edf0-42c8-9d84-d2ba808799c7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d6ccd49f-s6xkg" Sep 19 09:52:37.606861 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.606802 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8lhl\" (UniqueName: \"kubernetes.io/projected/d954591f-edf0-42c8-9d84-d2ba808799c7-kube-api-access-p8lhl\") pod \"cluster-proxy-proxy-agent-74d6ccd49f-s6xkg\" (UID: \"d954591f-edf0-42c8-9d84-d2ba808799c7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d6ccd49f-s6xkg" Sep 19 09:52:37.607222 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.607110 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b0ddaed-1aa8-4bb1-9f21-2095605ec256-tmp\") pod \"klusterlet-addon-workmgr-6679f55f9f-kp64l\" (UID: \"3b0ddaed-1aa8-4bb1-9f21-2095605ec256\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6679f55f9f-kp64l" Sep 19 09:52:37.608047 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.608020 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d954591f-edf0-42c8-9d84-d2ba808799c7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-74d6ccd49f-s6xkg\" (UID: \"d954591f-edf0-42c8-9d84-d2ba808799c7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d6ccd49f-s6xkg" Sep 19 09:52:37.609479 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.609415 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d954591f-edf0-42c8-9d84-d2ba808799c7-ca\") pod \"cluster-proxy-proxy-agent-74d6ccd49f-s6xkg\" (UID: \"d954591f-edf0-42c8-9d84-d2ba808799c7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d6ccd49f-s6xkg" Sep 19 09:52:37.609601 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.609581 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3b0ddaed-1aa8-4bb1-9f21-2095605ec256-klusterlet-config\") pod \"klusterlet-addon-workmgr-6679f55f9f-kp64l\" (UID: \"3b0ddaed-1aa8-4bb1-9f21-2095605ec256\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6679f55f9f-kp64l" Sep 19 09:52:37.609661 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.609589 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d954591f-edf0-42c8-9d84-d2ba808799c7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-74d6ccd49f-s6xkg\" (UID: \"d954591f-edf0-42c8-9d84-d2ba808799c7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d6ccd49f-s6xkg" Sep 19 09:52:37.609853 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.609837 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d954591f-edf0-42c8-9d84-d2ba808799c7-hub\") pod \"cluster-proxy-proxy-agent-74d6ccd49f-s6xkg\" (UID: \"d954591f-edf0-42c8-9d84-d2ba808799c7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d6ccd49f-s6xkg" Sep 19 09:52:37.609895 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.609861 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d954591f-edf0-42c8-9d84-d2ba808799c7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-74d6ccd49f-s6xkg\" (UID: \"d954591f-edf0-42c8-9d84-d2ba808799c7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d6ccd49f-s6xkg" Sep 19 09:52:37.630262 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.630239 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8lhl\" (UniqueName: \"kubernetes.io/projected/d954591f-edf0-42c8-9d84-d2ba808799c7-kube-api-access-p8lhl\") pod \"cluster-proxy-proxy-agent-74d6ccd49f-s6xkg\" (UID: \"d954591f-edf0-42c8-9d84-d2ba808799c7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d6ccd49f-s6xkg" Sep 19 09:52:37.630765 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.630740 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9t2t\" (UniqueName: \"kubernetes.io/projected/3b0ddaed-1aa8-4bb1-9f21-2095605ec256-kube-api-access-n9t2t\") pod \"klusterlet-addon-workmgr-6679f55f9f-kp64l\" (UID: \"3b0ddaed-1aa8-4bb1-9f21-2095605ec256\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6679f55f9f-kp64l" Sep 19 09:52:37.787142 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.787058 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6679f55f9f-kp64l" Sep 19 09:52:37.799347 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:37.799325 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d6ccd49f-s6xkg" Sep 19 09:52:38.059782 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:38.059686 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6679f55f9f-kp64l"] Sep 19 09:52:38.063544 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:52:38.063517 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b0ddaed_1aa8_4bb1_9f21_2095605ec256.slice/crio-63fe2d8f1bcdbd7fe790e62fd5d44e9419b90bfa1edb7132957cdd03eb450857 WatchSource:0}: Error finding container 63fe2d8f1bcdbd7fe790e62fd5d44e9419b90bfa1edb7132957cdd03eb450857: Status 404 returned error can't find the container with id 63fe2d8f1bcdbd7fe790e62fd5d44e9419b90bfa1edb7132957cdd03eb450857 Sep 19 09:52:38.079583 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:38.079557 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d6ccd49f-s6xkg"] Sep 19 09:52:38.084009 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:52:38.083983 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd954591f_edf0_42c8_9d84_d2ba808799c7.slice/crio-ac6aabedc1539ed9cb4414681ea55569749872f40a95cac7b174832c377c2b56 WatchSource:0}: Error finding container ac6aabedc1539ed9cb4414681ea55569749872f40a95cac7b174832c377c2b56: Status 404 returned error can't find the container with id ac6aabedc1539ed9cb4414681ea55569749872f40a95cac7b174832c377c2b56 Sep 19 09:52:38.998395 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:38.998338 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6679f55f9f-kp64l" event={"ID":"3b0ddaed-1aa8-4bb1-9f21-2095605ec256","Type":"ContainerStarted","Data":"63fe2d8f1bcdbd7fe790e62fd5d44e9419b90bfa1edb7132957cdd03eb450857"} Sep 19 09:52:39.002410 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:39.002375 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d6ccd49f-s6xkg" event={"ID":"d954591f-edf0-42c8-9d84-d2ba808799c7","Type":"ContainerStarted","Data":"ac6aabedc1539ed9cb4414681ea55569749872f40a95cac7b174832c377c2b56"} Sep 19 09:52:40.908656 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:40.908625 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sdnzv" Sep 19 09:52:43.982820 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:43.982790 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gs4nm" Sep 19 09:52:44.025418 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:44.025384 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6679f55f9f-kp64l" event={"ID":"3b0ddaed-1aa8-4bb1-9f21-2095605ec256","Type":"ContainerStarted","Data":"0f361258aa45de4713855da8547aeda042f9833188fa9d72d069610198b304f8"} Sep 19 09:52:44.025603 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:44.025570 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6679f55f9f-kp64l" Sep 19 09:52:44.027185 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:44.027163 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6679f55f9f-kp64l" Sep 19 09:52:44.027767 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:44.027739 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d6ccd49f-s6xkg" event={"ID":"d954591f-edf0-42c8-9d84-d2ba808799c7","Type":"ContainerStarted","Data":"93aebfb6680632f302050d59a97a924f32c87f622552e19e40668fc9351f6c6b"} Sep 19 09:52:44.027767 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:44.027766 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d6ccd49f-s6xkg" event={"ID":"d954591f-edf0-42c8-9d84-d2ba808799c7","Type":"ContainerStarted","Data":"72892d254ada2226663ea277b423f84d701d8e085ec794a502f19a748cbd81b0"} Sep 19 09:52:44.027924 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:44.027778 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d6ccd49f-s6xkg" event={"ID":"d954591f-edf0-42c8-9d84-d2ba808799c7","Type":"ContainerStarted","Data":"aca6032eb8054ef7abdc3a22347ba9d3cc4939e9c1b1ac602ca1c0d4a0bbc706"} Sep 19 09:52:44.042017 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:44.041940 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6679f55f9f-kp64l" podStartSLOduration=1.315644494 podStartE2EDuration="7.041926425s" totalImagesPullingTime="5.726281931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:52:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:52:44.041214362 +0000 UTC m=+63.841997658" watchObservedRunningTime="2026-09-19 09:52:44.041926425 +0000 UTC m=+63.842709722" Sep 19 09:52:44.080289 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:44.080246 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-74d6ccd49f-s6xkg" podStartSLOduration=1.374485711 podStartE2EDuration="7.080231626s" totalImagesPullingTime="5.705745915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:52:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:52:44.079334845 +0000 UTC m=+63.880118141" watchObservedRunningTime="2026-09-19 09:52:44.080231626 +0000 UTC m=+63.881014923" Sep 19 09:52:46.380456 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:46.380418 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e7c4050-b0c9-4afe-86a1-e83b1cf46a27-metrics-certs\") pod \"network-metrics-daemon-cxdbk\" (UID: \"5e7c4050-b0c9-4afe-86a1-e83b1cf46a27\") " pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:52:46.383190 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:46.383170 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 19 09:52:46.393624 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:46.393596 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e7c4050-b0c9-4afe-86a1-e83b1cf46a27-metrics-certs\") pod \"network-metrics-daemon-cxdbk\" (UID: \"5e7c4050-b0c9-4afe-86a1-e83b1cf46a27\") " pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:52:46.481447 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:46.481415 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5862d53-93df-4d28-9fb5-48d60ee4a821-original-pull-secret\") pod \"global-pull-secret-syncer-42rhb\" (UID: \"a5862d53-93df-4d28-9fb5-48d60ee4a821\") " pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:52:46.483847 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:46.483832 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 19 09:52:46.493811 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:46.493785 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5862d53-93df-4d28-9fb5-48d60ee4a821-original-pull-secret\") pod \"global-pull-secret-syncer-42rhb\" (UID: \"a5862d53-93df-4d28-9fb5-48d60ee4a821\") " pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:52:46.503883 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:46.503863 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-42rhb" Sep 19 09:52:46.516168 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:46.516154 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bcv4q\"" Sep 19 09:52:46.524800 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:46.524788 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxdbk" Sep 19 09:52:46.582514 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:46.582422 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lbs8\" (UniqueName: \"kubernetes.io/projected/bf45aeae-2af8-46e2-9c5e-e92f0f2d745d-kube-api-access-6lbs8\") pod \"network-check-target-sj4wm\" (UID: \"bf45aeae-2af8-46e2-9c5e-e92f0f2d745d\") " pod="openshift-network-diagnostics/network-check-target-sj4wm" Sep 19 09:52:46.590563 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:46.590496 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 19 09:52:46.595266 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:46.595243 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 19 09:52:46.606225 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:46.606174 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lbs8\" (UniqueName: \"kubernetes.io/projected/bf45aeae-2af8-46e2-9c5e-e92f0f2d745d-kube-api-access-6lbs8\") pod \"network-check-target-sj4wm\" (UID: \"bf45aeae-2af8-46e2-9c5e-e92f0f2d745d\") " pod="openshift-network-diagnostics/network-check-target-sj4wm" Sep 19 09:52:46.791651 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:46.791620 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-42rhb"] Sep 19 09:52:46.794621 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:52:46.794598 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5862d53_93df_4d28_9fb5_48d60ee4a821.slice/crio-cdb7767b0e796ed43cdc97d152eb7b6e116679d63511d599f4cbd47803a88412 WatchSource:0}: Error finding container cdb7767b0e796ed43cdc97d152eb7b6e116679d63511d599f4cbd47803a88412: Status 404 returned error can't find the container with id cdb7767b0e796ed43cdc97d152eb7b6e116679d63511d599f4cbd47803a88412 Sep 19 09:52:46.812442 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:46.812421 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mh4r4\"" Sep 19 09:52:46.820030 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:46.820010 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cxdbk"] Sep 19 09:52:46.821055 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:46.821002 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sj4wm" Sep 19 09:52:46.822927 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:52:46.822906 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e7c4050_b0c9_4afe_86a1_e83b1cf46a27.slice/crio-0231a0a54131091df6e35ec7af46effcf5676dae9cce069d74b3eb8cca643fe2 WatchSource:0}: Error finding container 0231a0a54131091df6e35ec7af46effcf5676dae9cce069d74b3eb8cca643fe2: Status 404 returned error can't find the container with id 0231a0a54131091df6e35ec7af46effcf5676dae9cce069d74b3eb8cca643fe2 Sep 19 09:52:47.039727 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:47.039675 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-42rhb" event={"ID":"a5862d53-93df-4d28-9fb5-48d60ee4a821","Type":"ContainerStarted","Data":"cdb7767b0e796ed43cdc97d152eb7b6e116679d63511d599f4cbd47803a88412"} Sep 19 09:52:47.040908 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:47.040883 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cxdbk" event={"ID":"5e7c4050-b0c9-4afe-86a1-e83b1cf46a27","Type":"ContainerStarted","Data":"0231a0a54131091df6e35ec7af46effcf5676dae9cce069d74b3eb8cca643fe2"} Sep 19 09:52:47.127797 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:47.127727 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sj4wm"] Sep 19 09:52:47.130997 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:52:47.130972 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf45aeae_2af8_46e2_9c5e_e92f0f2d745d.slice/crio-34d7dafea8255e790365f362b8fe5f581a0f8f0f96f155065a23da2056215c24 WatchSource:0}: Error finding container 34d7dafea8255e790365f362b8fe5f581a0f8f0f96f155065a23da2056215c24: Status 404 returned error can't find the container with id 34d7dafea8255e790365f362b8fe5f581a0f8f0f96f155065a23da2056215c24 Sep 19 09:52:48.047382 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:48.047345 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sj4wm" event={"ID":"bf45aeae-2af8-46e2-9c5e-e92f0f2d745d","Type":"ContainerStarted","Data":"34d7dafea8255e790365f362b8fe5f581a0f8f0f96f155065a23da2056215c24"} Sep 19 09:52:49.054608 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:49.054570 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cxdbk" event={"ID":"5e7c4050-b0c9-4afe-86a1-e83b1cf46a27","Type":"ContainerStarted","Data":"fdcb0234e607a8d72ff2d36fcb4bb0d956468019585c457efef85924b2e3bb8b"} Sep 19 09:52:49.055117 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:49.054635 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cxdbk" event={"ID":"5e7c4050-b0c9-4afe-86a1-e83b1cf46a27","Type":"ContainerStarted","Data":"1f12dc81cc8afddc0b2c97357b9137bdd9504a44ebee87d2e093439ac2b90dd5"} Sep 19 09:52:49.076776 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:49.076723 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cxdbk" podStartSLOduration=67.72759613 podStartE2EDuration="1m9.076688245s" totalImagesPullingTime="1.349092115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:52:49.075798591 +0000 UTC m=+68.876581892" watchObservedRunningTime="2026-09-19 09:52:49.076688245 +0000 UTC m=+68.877471541" Sep 19 09:52:52.069894 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:52.069852 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sj4wm" event={"ID":"bf45aeae-2af8-46e2-9c5e-e92f0f2d745d","Type":"ContainerStarted","Data":"bd3b84afd4fc55bfb1ada567617f13ed896f9109de22c34ec93357419ca14ccf"} Sep 19 09:52:52.070313 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:52.069944 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-sj4wm" Sep 19 09:52:52.071319 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:52.071292 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-42rhb" event={"ID":"a5862d53-93df-4d28-9fb5-48d60ee4a821","Type":"ContainerStarted","Data":"f86ab59baa070f743113741fc07ef6a1104ebef0fd07010c0bbbcb9fc7b34121"} Sep 19 09:52:52.086777 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:52.086734 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-sj4wm" podStartSLOduration=67.592531585 podStartE2EDuration="1m12.086720853s" totalImagesPullingTime="4.494189268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:52:52.086120621 +0000 UTC m=+71.886903918" watchObservedRunningTime="2026-09-19 09:52:52.086720853 +0000 UTC m=+71.887504172" Sep 19 09:52:52.100979 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:52:52.100934 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-42rhb" podStartSLOduration=67.269217247 podStartE2EDuration="1m12.100920387s" totalImagesPullingTime="4.83170314s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 09:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:52:52.100418557 +0000 UTC m=+71.901201851" watchObservedRunningTime="2026-09-19 09:52:52.100920387 +0000 UTC m=+71.901703683" Sep 19 09:53:03.182109 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.182000 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pfzd6"] Sep 19 09:53:03.186197 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.186179 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pfzd6" Sep 19 09:53:03.188301 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.188277 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 19 09:53:03.188409 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.188353 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 19 09:53:03.188409 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.188392 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 19 09:53:03.188657 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.188624 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 19 09:53:03.188780 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.188676 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 19 09:53:03.189049 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.189030 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 19 09:53:03.189128 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.189035 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xqtq7\"" Sep 19 09:53:03.310613 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.310574 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/adff6f91-e3b7-48ee-a857-ad2a8fc749de-node-exporter-tls\") pod \"node-exporter-pfzd6\" (UID: \"adff6f91-e3b7-48ee-a857-ad2a8fc749de\") " pod="openshift-monitoring/node-exporter-pfzd6" Sep 19 09:53:03.310613 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.310616 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/adff6f91-e3b7-48ee-a857-ad2a8fc749de-node-exporter-accelerators-collector-config\") pod \"node-exporter-pfzd6\" (UID: \"adff6f91-e3b7-48ee-a857-ad2a8fc749de\") " pod="openshift-monitoring/node-exporter-pfzd6" Sep 19 09:53:03.310902 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.310683 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/adff6f91-e3b7-48ee-a857-ad2a8fc749de-sys\") pod \"node-exporter-pfzd6\" (UID: \"adff6f91-e3b7-48ee-a857-ad2a8fc749de\") " pod="openshift-monitoring/node-exporter-pfzd6" Sep 19 09:53:03.310902 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.310771 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/adff6f91-e3b7-48ee-a857-ad2a8fc749de-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pfzd6\" (UID: \"adff6f91-e3b7-48ee-a857-ad2a8fc749de\") " pod="openshift-monitoring/node-exporter-pfzd6" Sep 19 09:53:03.310902 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.310820 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/adff6f91-e3b7-48ee-a857-ad2a8fc749de-root\") pod \"node-exporter-pfzd6\" (UID: \"adff6f91-e3b7-48ee-a857-ad2a8fc749de\") " pod="openshift-monitoring/node-exporter-pfzd6" Sep 19 09:53:03.310902 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.310845 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adff6f91-e3b7-48ee-a857-ad2a8fc749de-metrics-client-ca\") pod \"node-exporter-pfzd6\" (UID: \"adff6f91-e3b7-48ee-a857-ad2a8fc749de\") " pod="openshift-monitoring/node-exporter-pfzd6" Sep 19 09:53:03.310902 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.310869 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2lxd\" (UniqueName: \"kubernetes.io/projected/adff6f91-e3b7-48ee-a857-ad2a8fc749de-kube-api-access-h2lxd\") pod \"node-exporter-pfzd6\" (UID: \"adff6f91-e3b7-48ee-a857-ad2a8fc749de\") " pod="openshift-monitoring/node-exporter-pfzd6" Sep 19 09:53:03.310902 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.310895 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/adff6f91-e3b7-48ee-a857-ad2a8fc749de-node-exporter-wtmp\") pod \"node-exporter-pfzd6\" (UID: \"adff6f91-e3b7-48ee-a857-ad2a8fc749de\") " pod="openshift-monitoring/node-exporter-pfzd6" Sep 19 09:53:03.311147 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.310923 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/adff6f91-e3b7-48ee-a857-ad2a8fc749de-node-exporter-textfile\") pod \"node-exporter-pfzd6\" (UID: \"adff6f91-e3b7-48ee-a857-ad2a8fc749de\") " pod="openshift-monitoring/node-exporter-pfzd6" Sep 19 09:53:03.411868 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.411832 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/adff6f91-e3b7-48ee-a857-ad2a8fc749de-sys\") pod \"node-exporter-pfzd6\" (UID: \"adff6f91-e3b7-48ee-a857-ad2a8fc749de\") " pod="openshift-monitoring/node-exporter-pfzd6" Sep 19 09:53:03.411868 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.411868 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/adff6f91-e3b7-48ee-a857-ad2a8fc749de-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pfzd6\" (UID: \"adff6f91-e3b7-48ee-a857-ad2a8fc749de\") " pod="openshift-monitoring/node-exporter-pfzd6" Sep 19 09:53:03.412090 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.411888 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/adff6f91-e3b7-48ee-a857-ad2a8fc749de-root\") pod \"node-exporter-pfzd6\" (UID: \"adff6f91-e3b7-48ee-a857-ad2a8fc749de\") " pod="openshift-monitoring/node-exporter-pfzd6" Sep 19 09:53:03.412090 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.411904 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adff6f91-e3b7-48ee-a857-ad2a8fc749de-metrics-client-ca\") pod \"node-exporter-pfzd6\" (UID: \"adff6f91-e3b7-48ee-a857-ad2a8fc749de\") " pod="openshift-monitoring/node-exporter-pfzd6" Sep 19 09:53:03.412090 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.411922 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2lxd\" (UniqueName: \"kubernetes.io/projected/adff6f91-e3b7-48ee-a857-ad2a8fc749de-kube-api-access-h2lxd\") pod \"node-exporter-pfzd6\" (UID: \"adff6f91-e3b7-48ee-a857-ad2a8fc749de\") " pod="openshift-monitoring/node-exporter-pfzd6" Sep 19 09:53:03.412090 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.411967 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/adff6f91-e3b7-48ee-a857-ad2a8fc749de-sys\") pod \"node-exporter-pfzd6\" (UID: \"adff6f91-e3b7-48ee-a857-ad2a8fc749de\") " pod="openshift-monitoring/node-exporter-pfzd6" Sep 19 09:53:03.412090 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.411971 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/adff6f91-e3b7-48ee-a857-ad2a8fc749de-root\") pod \"node-exporter-pfzd6\" (UID: \"adff6f91-e3b7-48ee-a857-ad2a8fc749de\") " pod="openshift-monitoring/node-exporter-pfzd6" Sep 19 09:53:03.412090 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.412040 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/adff6f91-e3b7-48ee-a857-ad2a8fc749de-node-exporter-wtmp\") pod \"node-exporter-pfzd6\" (UID: \"adff6f91-e3b7-48ee-a857-ad2a8fc749de\") " pod="openshift-monitoring/node-exporter-pfzd6" Sep 19 09:53:03.412090 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.412082 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/adff6f91-e3b7-48ee-a857-ad2a8fc749de-node-exporter-textfile\") pod \"node-exporter-pfzd6\" (UID: \"adff6f91-e3b7-48ee-a857-ad2a8fc749de\") " pod="openshift-monitoring/node-exporter-pfzd6" Sep 19 09:53:03.412411 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.412200 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/adff6f91-e3b7-48ee-a857-ad2a8fc749de-node-exporter-tls\") pod \"node-exporter-pfzd6\" (UID: \"adff6f91-e3b7-48ee-a857-ad2a8fc749de\") " pod="openshift-monitoring/node-exporter-pfzd6" Sep 19 09:53:03.412411 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.412212 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/adff6f91-e3b7-48ee-a857-ad2a8fc749de-node-exporter-wtmp\") pod \"node-exporter-pfzd6\" (UID: \"adff6f91-e3b7-48ee-a857-ad2a8fc749de\") " pod="openshift-monitoring/node-exporter-pfzd6" Sep 19 09:53:03.412411 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.412231 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/adff6f91-e3b7-48ee-a857-ad2a8fc749de-node-exporter-accelerators-collector-config\") pod \"node-exporter-pfzd6\" (UID: \"adff6f91-e3b7-48ee-a857-ad2a8fc749de\") " pod="openshift-monitoring/node-exporter-pfzd6" Sep 19 09:53:03.412411 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:53:03.412287 2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 19 09:53:03.412411 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.412340 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/adff6f91-e3b7-48ee-a857-ad2a8fc749de-node-exporter-textfile\") pod \"node-exporter-pfzd6\" (UID: \"adff6f91-e3b7-48ee-a857-ad2a8fc749de\") " pod="openshift-monitoring/node-exporter-pfzd6" Sep 19 09:53:03.412411 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:53:03.412354 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adff6f91-e3b7-48ee-a857-ad2a8fc749de-node-exporter-tls podName:adff6f91-e3b7-48ee-a857-ad2a8fc749de nodeName:}" failed. No retries permitted until 2026-09-19 09:53:03.912338307 +0000 UTC m=+83.713121583 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/adff6f91-e3b7-48ee-a857-ad2a8fc749de-node-exporter-tls") pod "node-exporter-pfzd6" (UID: "adff6f91-e3b7-48ee-a857-ad2a8fc749de") : secret "node-exporter-tls" not found Sep 19 09:53:03.412780 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.412471 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adff6f91-e3b7-48ee-a857-ad2a8fc749de-metrics-client-ca\") pod \"node-exporter-pfzd6\" (UID: \"adff6f91-e3b7-48ee-a857-ad2a8fc749de\") " pod="openshift-monitoring/node-exporter-pfzd6" Sep 19 09:53:03.412841 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.412825 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/adff6f91-e3b7-48ee-a857-ad2a8fc749de-node-exporter-accelerators-collector-config\") pod \"node-exporter-pfzd6\" (UID: \"adff6f91-e3b7-48ee-a857-ad2a8fc749de\") " pod="openshift-monitoring/node-exporter-pfzd6" Sep 19 09:53:03.414382 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.414361 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/adff6f91-e3b7-48ee-a857-ad2a8fc749de-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pfzd6\" (UID: \"adff6f91-e3b7-48ee-a857-ad2a8fc749de\") " pod="openshift-monitoring/node-exporter-pfzd6" Sep 19 09:53:03.420600 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.420577 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2lxd\" (UniqueName: \"kubernetes.io/projected/adff6f91-e3b7-48ee-a857-ad2a8fc749de-kube-api-access-h2lxd\") pod \"node-exporter-pfzd6\" (UID: \"adff6f91-e3b7-48ee-a857-ad2a8fc749de\") " pod="openshift-monitoring/node-exporter-pfzd6" Sep 19 09:53:03.915833 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.915799 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/adff6f91-e3b7-48ee-a857-ad2a8fc749de-node-exporter-tls\") pod \"node-exporter-pfzd6\" (UID: \"adff6f91-e3b7-48ee-a857-ad2a8fc749de\") " pod="openshift-monitoring/node-exporter-pfzd6" Sep 19 09:53:03.918341 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:03.918317 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/adff6f91-e3b7-48ee-a857-ad2a8fc749de-node-exporter-tls\") pod \"node-exporter-pfzd6\" (UID: \"adff6f91-e3b7-48ee-a857-ad2a8fc749de\") " pod="openshift-monitoring/node-exporter-pfzd6" Sep 19 09:53:04.095473 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:04.095439 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pfzd6" Sep 19 09:53:04.107767 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:53:04.107741 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadff6f91_e3b7_48ee_a857_ad2a8fc749de.slice/crio-4cf6e936dcb3deebe6f222a8d77489cf1fe8a9452a3046b4dfdf45bd0ea7dea7 WatchSource:0}: Error finding container 4cf6e936dcb3deebe6f222a8d77489cf1fe8a9452a3046b4dfdf45bd0ea7dea7: Status 404 returned error can't find the container with id 4cf6e936dcb3deebe6f222a8d77489cf1fe8a9452a3046b4dfdf45bd0ea7dea7 Sep 19 09:53:04.114351 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:04.114325 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pfzd6" event={"ID":"adff6f91-e3b7-48ee-a857-ad2a8fc749de","Type":"ContainerStarted","Data":"4cf6e936dcb3deebe6f222a8d77489cf1fe8a9452a3046b4dfdf45bd0ea7dea7"} Sep 19 09:53:06.122452 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:06.122423 2579 generic.go:356] "Generic (PLEG): container finished" podID="adff6f91-e3b7-48ee-a857-ad2a8fc749de" containerID="b1d7db306ac9090bf6834a1f6694bbb6d23cbca13936cf63866972bc23447ac2" exitCode=0 Sep 19 09:53:06.122893 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:06.122515 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pfzd6" event={"ID":"adff6f91-e3b7-48ee-a857-ad2a8fc749de","Type":"ContainerDied","Data":"b1d7db306ac9090bf6834a1f6694bbb6d23cbca13936cf63866972bc23447ac2"} Sep 19 09:53:07.128376 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:07.128336 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pfzd6" event={"ID":"adff6f91-e3b7-48ee-a857-ad2a8fc749de","Type":"ContainerStarted","Data":"a0fa3c0f10f632a79b98c7b52296475cfc637fc0d67c9b6ff0bfba27d69de74c"} Sep 19 09:53:07.128756 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:07.128397 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pfzd6" event={"ID":"adff6f91-e3b7-48ee-a857-ad2a8fc749de","Type":"ContainerStarted","Data":"7cc54a2b0045afdea90480eb1bc5922b3648f0853967ab0e27392f5207a22a66"} Sep 19 09:53:07.149789 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:07.149738 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pfzd6" podStartSLOduration=2.813060048 podStartE2EDuration="4.149721966s" totalImagesPullingTime="1.267555565s" totalInitContainerRuntime="69.106353ms" isStatefulPod=true podCreationTimestamp="2026-09-19 09:53:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:53:07.14833402 +0000 UTC m=+86.949117317" watchObservedRunningTime="2026-09-19 09:53:07.149721966 +0000 UTC m=+86.950505259" Sep 19 09:53:23.078339 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:23.078311 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-sj4wm" Sep 19 09:53:41.854835 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:53:41.854804 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t6sbm_bebbf67e-4435-4df9-be91-7de185c1aa50/serve-healthcheck-canary/0.log" Sep 19 09:55:56.723219 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:55:56.723185 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4s9lx"] Sep 19 09:55:56.726164 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:55:56.726143 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-4s9lx" Sep 19 09:55:56.728421 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:55:56.728405 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 19 09:55:56.728501 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:55:56.728435 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 19 09:55:56.729093 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:55:56.729075 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-wsh9f\"" Sep 19 09:55:56.734161 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:55:56.734138 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4s9lx"] Sep 19 09:55:56.761682 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:55:56.761654 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fdfac34f-b4c5-4529-8f2f-3f3269708e19-bound-sa-token\") pod \"cert-manager-55b4d954d5-4s9lx\" (UID: \"fdfac34f-b4c5-4529-8f2f-3f3269708e19\") " pod="cert-manager/cert-manager-55b4d954d5-4s9lx" Sep 19 09:55:56.761777 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:55:56.761708 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbr7g\" (UniqueName: \"kubernetes.io/projected/fdfac34f-b4c5-4529-8f2f-3f3269708e19-kube-api-access-qbr7g\") pod \"cert-manager-55b4d954d5-4s9lx\" (UID: \"fdfac34f-b4c5-4529-8f2f-3f3269708e19\") " pod="cert-manager/cert-manager-55b4d954d5-4s9lx" Sep 19 09:55:56.862725 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:55:56.862682 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fdfac34f-b4c5-4529-8f2f-3f3269708e19-bound-sa-token\") pod \"cert-manager-55b4d954d5-4s9lx\" (UID: \"fdfac34f-b4c5-4529-8f2f-3f3269708e19\") " pod="cert-manager/cert-manager-55b4d954d5-4s9lx" Sep 19 09:55:56.862829 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:55:56.862737 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbr7g\" (UniqueName: \"kubernetes.io/projected/fdfac34f-b4c5-4529-8f2f-3f3269708e19-kube-api-access-qbr7g\") pod \"cert-manager-55b4d954d5-4s9lx\" (UID: \"fdfac34f-b4c5-4529-8f2f-3f3269708e19\") " pod="cert-manager/cert-manager-55b4d954d5-4s9lx" Sep 19 09:55:56.872131 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:55:56.872101 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fdfac34f-b4c5-4529-8f2f-3f3269708e19-bound-sa-token\") pod \"cert-manager-55b4d954d5-4s9lx\" (UID: \"fdfac34f-b4c5-4529-8f2f-3f3269708e19\") " pod="cert-manager/cert-manager-55b4d954d5-4s9lx" Sep 19 09:55:56.872214 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:55:56.872178 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbr7g\" (UniqueName: \"kubernetes.io/projected/fdfac34f-b4c5-4529-8f2f-3f3269708e19-kube-api-access-qbr7g\") pod \"cert-manager-55b4d954d5-4s9lx\" (UID: \"fdfac34f-b4c5-4529-8f2f-3f3269708e19\") " pod="cert-manager/cert-manager-55b4d954d5-4s9lx" Sep 19 09:55:57.035476 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:55:57.035405 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-4s9lx" Sep 19 09:55:57.305973 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:55:57.305880 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4s9lx"] Sep 19 09:55:57.311666 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:55:57.311639 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfdfac34f_b4c5_4529_8f2f_3f3269708e19.slice/crio-8309819f06867c1ce942f0bd4ec2b1e70774a51ba35a9763c450b22fc3d75bc8 WatchSource:0}: Error finding container 8309819f06867c1ce942f0bd4ec2b1e70774a51ba35a9763c450b22fc3d75bc8: Status 404 returned error can't find the container with id 8309819f06867c1ce942f0bd4ec2b1e70774a51ba35a9763c450b22fc3d75bc8 Sep 19 09:55:57.682645 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:55:57.682609 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-4s9lx" event={"ID":"fdfac34f-b4c5-4529-8f2f-3f3269708e19","Type":"ContainerStarted","Data":"8309819f06867c1ce942f0bd4ec2b1e70774a51ba35a9763c450b22fc3d75bc8"} Sep 19 09:56:00.698303 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:00.698270 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-4s9lx" event={"ID":"fdfac34f-b4c5-4529-8f2f-3f3269708e19","Type":"ContainerStarted","Data":"520ddaf5ea1daf6be055eba02720b9372e8e2d535d610e8e847b46d1e67bc2fb"} Sep 19 09:56:00.712087 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:00.712036 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-4s9lx" podStartSLOduration=1.874799415 podStartE2EDuration="4.71201999s" totalImagesPullingTime="2.837220575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:55:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:56:00.710757001 +0000 UTC m=+260.511540292" watchObservedRunningTime="2026-09-19 09:56:00.71201999 +0000 UTC m=+260.512803288" Sep 19 09:56:04.076490 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:04.076406 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kjr2g"] Sep 19 09:56:04.079310 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:04.079294 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kjr2g" Sep 19 09:56:04.082884 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:04.082859 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 19 09:56:04.082995 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:04.082922 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-m2whw\"" Sep 19 09:56:04.083805 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:04.083789 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 19 09:56:04.093366 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:04.093343 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kjr2g"] Sep 19 09:56:04.114297 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:04.114268 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9k5l\" (UniqueName: \"kubernetes.io/projected/5b2acda5-29e7-4224-ae5c-a7459f4e9b8b-kube-api-access-z9k5l\") pod \"openshift-lws-operator-fd8ccff4c-kjr2g\" (UID: \"5b2acda5-29e7-4224-ae5c-a7459f4e9b8b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kjr2g" Sep 19 09:56:04.114445 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:04.114335 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b2acda5-29e7-4224-ae5c-a7459f4e9b8b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-kjr2g\" (UID: \"5b2acda5-29e7-4224-ae5c-a7459f4e9b8b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kjr2g" Sep 19 09:56:04.215646 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:04.215592 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b2acda5-29e7-4224-ae5c-a7459f4e9b8b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-kjr2g\" (UID: \"5b2acda5-29e7-4224-ae5c-a7459f4e9b8b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kjr2g" Sep 19 09:56:04.215646 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:04.215658 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9k5l\" (UniqueName: \"kubernetes.io/projected/5b2acda5-29e7-4224-ae5c-a7459f4e9b8b-kube-api-access-z9k5l\") pod \"openshift-lws-operator-fd8ccff4c-kjr2g\" (UID: \"5b2acda5-29e7-4224-ae5c-a7459f4e9b8b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kjr2g" Sep 19 09:56:04.216009 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:04.215993 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b2acda5-29e7-4224-ae5c-a7459f4e9b8b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-kjr2g\" (UID: \"5b2acda5-29e7-4224-ae5c-a7459f4e9b8b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kjr2g" Sep 19 09:56:04.225330 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:04.225304 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9k5l\" (UniqueName: \"kubernetes.io/projected/5b2acda5-29e7-4224-ae5c-a7459f4e9b8b-kube-api-access-z9k5l\") pod \"openshift-lws-operator-fd8ccff4c-kjr2g\" (UID: \"5b2acda5-29e7-4224-ae5c-a7459f4e9b8b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kjr2g" Sep 19 09:56:04.387814 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:04.387721 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kjr2g" Sep 19 09:56:04.667431 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:04.667347 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kjr2g"] Sep 19 09:56:04.670888 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:56:04.670838 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b2acda5_29e7_4224_ae5c_a7459f4e9b8b.slice/crio-a16dd0951b9b209e529bfde47e9533a05b92f224de1a493a7b973aae8ce50c5a WatchSource:0}: Error finding container a16dd0951b9b209e529bfde47e9533a05b92f224de1a493a7b973aae8ce50c5a: Status 404 returned error can't find the container with id a16dd0951b9b209e529bfde47e9533a05b92f224de1a493a7b973aae8ce50c5a Sep 19 09:56:04.712131 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:04.712096 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kjr2g" event={"ID":"5b2acda5-29e7-4224-ae5c-a7459f4e9b8b","Type":"ContainerStarted","Data":"a16dd0951b9b209e529bfde47e9533a05b92f224de1a493a7b973aae8ce50c5a"} Sep 19 09:56:07.724460 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:07.724414 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kjr2g" event={"ID":"5b2acda5-29e7-4224-ae5c-a7459f4e9b8b","Type":"ContainerStarted","Data":"ef11284dfb5c173ec0662f5243bcfa32f1b3779d307318d1c55aed622487dde3"} Sep 19 09:56:07.739283 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:07.739234 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-kjr2g" podStartSLOduration=1.274022104 podStartE2EDuration="3.739215428s" totalImagesPullingTime="2.465193324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:56:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:56:07.738894776 +0000 UTC m=+267.539678072" watchObservedRunningTime="2026-09-19 09:56:07.739215428 +0000 UTC m=+267.539998727" Sep 19 09:56:23.964935 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:23.964885 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl"] Sep 19 09:56:23.968097 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:23.968079 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl" Sep 19 09:56:23.970953 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:23.970932 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 19 09:56:23.971163 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:23.971149 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-n2xq2\"" Sep 19 09:56:23.971326 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:23.971314 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 19 09:56:23.971606 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:23.971587 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 19 09:56:23.971723 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:23.971595 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 19 09:56:24.002263 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:24.002234 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl"] Sep 19 09:56:24.053961 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:24.053927 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/21617aef-f4f5-4530-bcbc-278833dc13ee-manifests\") pod \"opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl\" (UID: \"21617aef-f4f5-4530-bcbc-278833dc13ee\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl" Sep 19 09:56:24.053961 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:24.053965 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/21617aef-f4f5-4530-bcbc-278833dc13ee-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl\" (UID: \"21617aef-f4f5-4530-bcbc-278833dc13ee\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl" Sep 19 09:56:24.054152 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:24.053985 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwl8n\" (UniqueName: \"kubernetes.io/projected/21617aef-f4f5-4530-bcbc-278833dc13ee-kube-api-access-gwl8n\") pod \"opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl\" (UID: \"21617aef-f4f5-4530-bcbc-278833dc13ee\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl" Sep 19 09:56:24.054152 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:24.054054 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/21617aef-f4f5-4530-bcbc-278833dc13ee-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl\" (UID: \"21617aef-f4f5-4530-bcbc-278833dc13ee\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl" Sep 19 09:56:24.054152 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:24.054091 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21617aef-f4f5-4530-bcbc-278833dc13ee-tmp\") pod \"opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl\" (UID: \"21617aef-f4f5-4530-bcbc-278833dc13ee\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl" Sep 19 09:56:24.155243 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:24.155208 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/21617aef-f4f5-4530-bcbc-278833dc13ee-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl\" (UID: \"21617aef-f4f5-4530-bcbc-278833dc13ee\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl" Sep 19 09:56:24.155415 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:24.155255 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21617aef-f4f5-4530-bcbc-278833dc13ee-tmp\") pod \"opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl\" (UID: \"21617aef-f4f5-4530-bcbc-278833dc13ee\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl" Sep 19 09:56:24.155415 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:24.155277 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/21617aef-f4f5-4530-bcbc-278833dc13ee-manifests\") pod \"opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl\" (UID: \"21617aef-f4f5-4530-bcbc-278833dc13ee\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl" Sep 19 09:56:24.155415 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:24.155301 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/21617aef-f4f5-4530-bcbc-278833dc13ee-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl\" (UID: \"21617aef-f4f5-4530-bcbc-278833dc13ee\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl" Sep 19 09:56:24.155415 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:24.155315 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwl8n\" (UniqueName: \"kubernetes.io/projected/21617aef-f4f5-4530-bcbc-278833dc13ee-kube-api-access-gwl8n\") pod \"opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl\" (UID: \"21617aef-f4f5-4530-bcbc-278833dc13ee\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl" Sep 19 09:56:24.155779 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:24.155756 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/21617aef-f4f5-4530-bcbc-278833dc13ee-manifests\") pod \"opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl\" (UID: \"21617aef-f4f5-4530-bcbc-278833dc13ee\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl" Sep 19 09:56:24.157837 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:24.157813 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/21617aef-f4f5-4530-bcbc-278833dc13ee-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl\" (UID: \"21617aef-f4f5-4530-bcbc-278833dc13ee\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl" Sep 19 09:56:24.158060 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:24.158042 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21617aef-f4f5-4530-bcbc-278833dc13ee-tmp\") pod \"opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl\" (UID: \"21617aef-f4f5-4530-bcbc-278833dc13ee\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl" Sep 19 09:56:24.158124 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:24.158107 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/21617aef-f4f5-4530-bcbc-278833dc13ee-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl\" (UID: \"21617aef-f4f5-4530-bcbc-278833dc13ee\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl" Sep 19 09:56:24.169852 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:24.169831 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwl8n\" (UniqueName: \"kubernetes.io/projected/21617aef-f4f5-4530-bcbc-278833dc13ee-kube-api-access-gwl8n\") pod \"opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl\" (UID: \"21617aef-f4f5-4530-bcbc-278833dc13ee\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl" Sep 19 09:56:24.277938 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:24.277839 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl" Sep 19 09:56:24.577253 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:24.577225 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl"] Sep 19 09:56:24.579658 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:56:24.579635 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21617aef_f4f5_4530_bcbc_278833dc13ee.slice/crio-87836da1ffbabc911752f1a9fb91c33ff463ab0275597e31e02d0992d89887b1 WatchSource:0}: Error finding container 87836da1ffbabc911752f1a9fb91c33ff463ab0275597e31e02d0992d89887b1: Status 404 returned error can't find the container with id 87836da1ffbabc911752f1a9fb91c33ff463ab0275597e31e02d0992d89887b1 Sep 19 09:56:24.785431 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:24.785391 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl" event={"ID":"21617aef-f4f5-4530-bcbc-278833dc13ee","Type":"ContainerStarted","Data":"87836da1ffbabc911752f1a9fb91c33ff463ab0275597e31e02d0992d89887b1"} Sep 19 09:56:27.797033 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:27.796997 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl" event={"ID":"21617aef-f4f5-4530-bcbc-278833dc13ee","Type":"ContainerStarted","Data":"dca60e6b6aad7e84ff505d82a08da00aafd08748c8e131feb7cfaae25807144e"} Sep 19 09:56:28.804420 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:28.804330 2579 generic.go:356] "Generic (PLEG): container finished" podID="21617aef-f4f5-4530-bcbc-278833dc13ee" containerID="dca60e6b6aad7e84ff505d82a08da00aafd08748c8e131feb7cfaae25807144e" exitCode=0 Sep 19 09:56:28.804420 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:28.804401 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl" event={"ID":"21617aef-f4f5-4530-bcbc-278833dc13ee","Type":"ContainerDied","Data":"dca60e6b6aad7e84ff505d82a08da00aafd08748c8e131feb7cfaae25807144e"} Sep 19 09:56:29.810179 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:29.810134 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl" event={"ID":"21617aef-f4f5-4530-bcbc-278833dc13ee","Type":"ContainerStarted","Data":"e67b7b2ccaed87bd7e1eaff6ffb8a74a47b2d47e467f63355487c80e503a1aa0"} Sep 19 09:56:29.810563 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:29.810241 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl" Sep 19 09:56:29.832151 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:29.832096 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl" podStartSLOduration=2.622992462 podStartE2EDuration="6.832080193s" totalImagesPullingTime="3.180475311s" totalInitContainerRuntime="1.02861242s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:56:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:56:29.830512766 +0000 UTC m=+289.631296062" watchObservedRunningTime="2026-09-19 09:56:29.832080193 +0000 UTC m=+289.632863487" Sep 19 09:56:40.580533 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:40.580495 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sdnzv_3f1d9116-9add-4252-8f32-cccb1f9ee76f/ovn-acl-logging/0.log" Sep 19 09:56:40.584657 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:40.584634 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sdnzv_3f1d9116-9add-4252-8f32-cccb1f9ee76f/ovn-acl-logging/0.log" Sep 19 09:56:40.589216 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:40.589195 2579 kubelet.go:1648] "Image garbage collection succeeded" Sep 19 09:56:40.816818 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:40.816790 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl" Sep 19 09:56:44.522478 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:44.522441 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-65d7d84b5d-94p9q"] Sep 19 09:56:44.525529 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:44.525504 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65d7d84b5d-94p9q" Sep 19 09:56:44.528047 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:44.528028 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 19 09:56:44.528151 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:44.528052 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-7qv9r\"" Sep 19 09:56:44.529678 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:44.529650 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 19 09:56:44.530024 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:44.530005 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 19 09:56:44.530126 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:44.530009 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 19 09:56:44.538311 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:44.538293 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65d7d84b5d-94p9q"] Sep 19 09:56:44.611626 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:44.611588 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8e12b20-5554-47cc-9b5c-195ce8311766-tmp\") pod \"kube-auth-proxy-65d7d84b5d-94p9q\" (UID: \"b8e12b20-5554-47cc-9b5c-195ce8311766\") " pod="openshift-ingress/kube-auth-proxy-65d7d84b5d-94p9q" Sep 19 09:56:44.611812 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:44.611642 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ctcg\" (UniqueName: \"kubernetes.io/projected/b8e12b20-5554-47cc-9b5c-195ce8311766-kube-api-access-4ctcg\") pod \"kube-auth-proxy-65d7d84b5d-94p9q\" (UID: \"b8e12b20-5554-47cc-9b5c-195ce8311766\") " pod="openshift-ingress/kube-auth-proxy-65d7d84b5d-94p9q" Sep 19 09:56:44.611812 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:44.611720 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8e12b20-5554-47cc-9b5c-195ce8311766-tls-certs\") pod \"kube-auth-proxy-65d7d84b5d-94p9q\" (UID: \"b8e12b20-5554-47cc-9b5c-195ce8311766\") " pod="openshift-ingress/kube-auth-proxy-65d7d84b5d-94p9q" Sep 19 09:56:44.712148 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:44.712112 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ctcg\" (UniqueName: \"kubernetes.io/projected/b8e12b20-5554-47cc-9b5c-195ce8311766-kube-api-access-4ctcg\") pod \"kube-auth-proxy-65d7d84b5d-94p9q\" (UID: \"b8e12b20-5554-47cc-9b5c-195ce8311766\") " pod="openshift-ingress/kube-auth-proxy-65d7d84b5d-94p9q" Sep 19 09:56:44.712296 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:44.712159 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8e12b20-5554-47cc-9b5c-195ce8311766-tls-certs\") pod \"kube-auth-proxy-65d7d84b5d-94p9q\" (UID: \"b8e12b20-5554-47cc-9b5c-195ce8311766\") " pod="openshift-ingress/kube-auth-proxy-65d7d84b5d-94p9q" Sep 19 09:56:44.712296 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:44.712219 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8e12b20-5554-47cc-9b5c-195ce8311766-tmp\") pod \"kube-auth-proxy-65d7d84b5d-94p9q\" (UID: \"b8e12b20-5554-47cc-9b5c-195ce8311766\") " pod="openshift-ingress/kube-auth-proxy-65d7d84b5d-94p9q" Sep 19 09:56:44.714634 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:44.714612 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8e12b20-5554-47cc-9b5c-195ce8311766-tmp\") pod \"kube-auth-proxy-65d7d84b5d-94p9q\" (UID: \"b8e12b20-5554-47cc-9b5c-195ce8311766\") " pod="openshift-ingress/kube-auth-proxy-65d7d84b5d-94p9q" Sep 19 09:56:44.714821 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:44.714803 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8e12b20-5554-47cc-9b5c-195ce8311766-tls-certs\") pod \"kube-auth-proxy-65d7d84b5d-94p9q\" (UID: \"b8e12b20-5554-47cc-9b5c-195ce8311766\") " pod="openshift-ingress/kube-auth-proxy-65d7d84b5d-94p9q" Sep 19 09:56:44.731909 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:44.731879 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ctcg\" (UniqueName: \"kubernetes.io/projected/b8e12b20-5554-47cc-9b5c-195ce8311766-kube-api-access-4ctcg\") pod \"kube-auth-proxy-65d7d84b5d-94p9q\" (UID: \"b8e12b20-5554-47cc-9b5c-195ce8311766\") " pod="openshift-ingress/kube-auth-proxy-65d7d84b5d-94p9q" Sep 19 09:56:44.834900 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:44.834806 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65d7d84b5d-94p9q" Sep 19 09:56:45.107357 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:45.107273 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65d7d84b5d-94p9q"] Sep 19 09:56:45.110276 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:56:45.110250 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8e12b20_5554_47cc_9b5c_195ce8311766.slice/crio-cadbbdae33f5a8e5d9042ae870dde951aabccd2ee53adef8063f8580d53b3c9f WatchSource:0}: Error finding container cadbbdae33f5a8e5d9042ae870dde951aabccd2ee53adef8063f8580d53b3c9f: Status 404 returned error can't find the container with id cadbbdae33f5a8e5d9042ae870dde951aabccd2ee53adef8063f8580d53b3c9f Sep 19 09:56:45.112052 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:45.112037 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 19 09:56:45.821515 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:45.821416 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87"] Sep 19 09:56:45.824892 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:45.824860 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" Sep 19 09:56:45.827596 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:45.827571 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 19 09:56:45.827851 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:45.827835 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 19 09:56:45.828019 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:45.828005 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 19 09:56:45.828180 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:45.828166 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 19 09:56:45.828373 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:45.828359 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-bkhsh\"" Sep 19 09:56:45.838765 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:45.838690 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87"] Sep 19 09:56:45.870330 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:45.870264 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65d7d84b5d-94p9q" event={"ID":"b8e12b20-5554-47cc-9b5c-195ce8311766","Type":"ContainerStarted","Data":"cadbbdae33f5a8e5d9042ae870dde951aabccd2ee53adef8063f8580d53b3c9f"} Sep 19 09:56:45.921836 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:45.921762 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a40cd53-188b-4984-bc1c-7456120b520b-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-xlz87\" (UID: \"9a40cd53-188b-4984-bc1c-7456120b520b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" Sep 19 09:56:45.921836 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:45.921809 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9a40cd53-188b-4984-bc1c-7456120b520b-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-xlz87\" (UID: \"9a40cd53-188b-4984-bc1c-7456120b520b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" Sep 19 09:56:45.922086 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:45.921862 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9a40cd53-188b-4984-bc1c-7456120b520b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-xlz87\" (UID: \"9a40cd53-188b-4984-bc1c-7456120b520b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" Sep 19 09:56:45.922086 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:45.921905 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9a40cd53-188b-4984-bc1c-7456120b520b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-xlz87\" (UID: \"9a40cd53-188b-4984-bc1c-7456120b520b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" Sep 19 09:56:45.922086 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:45.921929 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9a40cd53-188b-4984-bc1c-7456120b520b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-xlz87\" (UID: \"9a40cd53-188b-4984-bc1c-7456120b520b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" Sep 19 09:56:45.922086 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:45.921970 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66nbr\" (UniqueName: \"kubernetes.io/projected/9a40cd53-188b-4984-bc1c-7456120b520b-kube-api-access-66nbr\") pod \"istiod-openshift-gateway-7b7995d5cd-xlz87\" (UID: \"9a40cd53-188b-4984-bc1c-7456120b520b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" Sep 19 09:56:45.922086 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:45.922006 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a40cd53-188b-4984-bc1c-7456120b520b-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-xlz87\" (UID: \"9a40cd53-188b-4984-bc1c-7456120b520b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" Sep 19 09:56:46.023062 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:46.023027 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9a40cd53-188b-4984-bc1c-7456120b520b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-xlz87\" (UID: \"9a40cd53-188b-4984-bc1c-7456120b520b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" Sep 19 09:56:46.023250 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:46.023090 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9a40cd53-188b-4984-bc1c-7456120b520b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-xlz87\" (UID: \"9a40cd53-188b-4984-bc1c-7456120b520b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" Sep 19 09:56:46.023250 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:46.023122 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9a40cd53-188b-4984-bc1c-7456120b520b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-xlz87\" (UID: \"9a40cd53-188b-4984-bc1c-7456120b520b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" Sep 19 09:56:46.023250 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:46.023164 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66nbr\" (UniqueName: \"kubernetes.io/projected/9a40cd53-188b-4984-bc1c-7456120b520b-kube-api-access-66nbr\") pod \"istiod-openshift-gateway-7b7995d5cd-xlz87\" (UID: \"9a40cd53-188b-4984-bc1c-7456120b520b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" Sep 19 09:56:46.023250 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:46.023199 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a40cd53-188b-4984-bc1c-7456120b520b-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-xlz87\" (UID: \"9a40cd53-188b-4984-bc1c-7456120b520b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" Sep 19 09:56:46.023250 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:46.023246 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a40cd53-188b-4984-bc1c-7456120b520b-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-xlz87\" (UID: \"9a40cd53-188b-4984-bc1c-7456120b520b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" Sep 19 09:56:46.023499 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:46.023271 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9a40cd53-188b-4984-bc1c-7456120b520b-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-xlz87\" (UID: \"9a40cd53-188b-4984-bc1c-7456120b520b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" Sep 19 09:56:46.023913 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:46.023885 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9a40cd53-188b-4984-bc1c-7456120b520b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-xlz87\" (UID: \"9a40cd53-188b-4984-bc1c-7456120b520b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" Sep 19 09:56:46.026291 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:46.026264 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a40cd53-188b-4984-bc1c-7456120b520b-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-xlz87\" (UID: \"9a40cd53-188b-4984-bc1c-7456120b520b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" Sep 19 09:56:46.026622 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:46.026597 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9a40cd53-188b-4984-bc1c-7456120b520b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-xlz87\" (UID: \"9a40cd53-188b-4984-bc1c-7456120b520b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" Sep 19 09:56:46.027017 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:46.026994 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9a40cd53-188b-4984-bc1c-7456120b520b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-xlz87\" (UID: \"9a40cd53-188b-4984-bc1c-7456120b520b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" Sep 19 09:56:46.027219 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:46.027193 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9a40cd53-188b-4984-bc1c-7456120b520b-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-xlz87\" (UID: \"9a40cd53-188b-4984-bc1c-7456120b520b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" Sep 19 09:56:46.031741 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:46.031682 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66nbr\" (UniqueName: \"kubernetes.io/projected/9a40cd53-188b-4984-bc1c-7456120b520b-kube-api-access-66nbr\") pod \"istiod-openshift-gateway-7b7995d5cd-xlz87\" (UID: \"9a40cd53-188b-4984-bc1c-7456120b520b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" Sep 19 09:56:46.031871 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:46.031795 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a40cd53-188b-4984-bc1c-7456120b520b-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-xlz87\" (UID: \"9a40cd53-188b-4984-bc1c-7456120b520b\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" Sep 19 09:56:46.138180 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:46.138095 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" Sep 19 09:56:46.428456 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:46.428415 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87"] Sep 19 09:56:46.432318 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:56:46.432278 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a40cd53_188b_4984_bc1c_7456120b520b.slice/crio-f3e980b96162b7d74bf881f2aa1556c83ae73854b9eba3e288903e3f26c63c9e WatchSource:0}: Error finding container f3e980b96162b7d74bf881f2aa1556c83ae73854b9eba3e288903e3f26c63c9e: Status 404 returned error can't find the container with id f3e980b96162b7d74bf881f2aa1556c83ae73854b9eba3e288903e3f26c63c9e Sep 19 09:56:46.876192 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:46.876115 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" event={"ID":"9a40cd53-188b-4984-bc1c-7456120b520b","Type":"ContainerStarted","Data":"f3e980b96162b7d74bf881f2aa1556c83ae73854b9eba3e288903e3f26c63c9e"} Sep 19 09:56:48.885730 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:48.885674 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65d7d84b5d-94p9q" event={"ID":"b8e12b20-5554-47cc-9b5c-195ce8311766","Type":"ContainerStarted","Data":"aa2bbc3174e4aa6186a0185b04bb3473ba1908440a0470bdaf78061d25b240bb"} Sep 19 09:56:48.904346 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:48.904298 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-65d7d84b5d-94p9q" podStartSLOduration=2.03344015 podStartE2EDuration="4.904277757s" totalImagesPullingTime="2.870837607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:56:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:56:48.903139303 +0000 UTC m=+308.703922600" watchObservedRunningTime="2026-09-19 09:56:48.904277757 +0000 UTC m=+308.705061056" Sep 19 09:56:49.713138 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:49.713105 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"} Sep 19 09:56:49.713213 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:49.713172 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"} Sep 19 09:56:49.891490 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:49.891459 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" event={"ID":"9a40cd53-188b-4984-bc1c-7456120b520b","Type":"ContainerStarted","Data":"02631b5f810314bf048313dbcace81d091a968654ca42d0ed754a22aa57eb57d"} Sep 19 09:56:49.913171 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:49.913122 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" podStartSLOduration=1.635554112 podStartE2EDuration="4.913105358s" totalImagesPullingTime="3.277551246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:56:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:56:49.91183981 +0000 UTC m=+309.712623107" watchObservedRunningTime="2026-09-19 09:56:49.913105358 +0000 UTC m=+309.713888655" Sep 19 09:56:50.894983 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:50.894952 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" Sep 19 09:56:50.896557 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:50.896529 2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-xlz87 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 19 09:56:50.896677 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:50.896586 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" podUID="9a40cd53-188b-4984-bc1c-7456120b520b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 19 09:56:51.898885 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:51.898858 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" Sep 19 09:56:55.989304 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:55.989270 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gc5ld"] Sep 19 09:56:55.994029 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:55.994011 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gc5ld" Sep 19 09:56:55.996502 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:55.996478 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Sep 19 09:56:55.996749 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:55.996733 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-nqw4r\"" Sep 19 09:56:56.023045 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:56.023019 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gc5ld"] Sep 19 09:56:56.104678 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:56.104633 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcef4a25-cf6a-4b0e-9550-d5e40c190e09-tls-certs\") pod \"model-serving-api-54d89bd5fc-gc5ld\" (UID: \"bcef4a25-cf6a-4b0e-9550-d5e40c190e09\") " pod="opendatahub/model-serving-api-54d89bd5fc-gc5ld" Sep 19 09:56:56.104949 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:56.104825 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nd29\" (UniqueName: \"kubernetes.io/projected/bcef4a25-cf6a-4b0e-9550-d5e40c190e09-kube-api-access-4nd29\") pod \"model-serving-api-54d89bd5fc-gc5ld\" (UID: \"bcef4a25-cf6a-4b0e-9550-d5e40c190e09\") " pod="opendatahub/model-serving-api-54d89bd5fc-gc5ld" Sep 19 09:56:56.205885 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:56.205846 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nd29\" (UniqueName: \"kubernetes.io/projected/bcef4a25-cf6a-4b0e-9550-d5e40c190e09-kube-api-access-4nd29\") pod \"model-serving-api-54d89bd5fc-gc5ld\" (UID: \"bcef4a25-cf6a-4b0e-9550-d5e40c190e09\") " pod="opendatahub/model-serving-api-54d89bd5fc-gc5ld" Sep 19 09:56:56.206075 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:56.205920 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcef4a25-cf6a-4b0e-9550-d5e40c190e09-tls-certs\") pod \"model-serving-api-54d89bd5fc-gc5ld\" (UID: \"bcef4a25-cf6a-4b0e-9550-d5e40c190e09\") " pod="opendatahub/model-serving-api-54d89bd5fc-gc5ld" Sep 19 09:56:56.206075 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:56:56.206054 2579 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Sep 19 09:56:56.206195 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:56:56.206133 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcef4a25-cf6a-4b0e-9550-d5e40c190e09-tls-certs podName:bcef4a25-cf6a-4b0e-9550-d5e40c190e09 nodeName:}" failed. No retries permitted until 2026-09-19 09:56:56.706112268 +0000 UTC m=+316.506895543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/bcef4a25-cf6a-4b0e-9550-d5e40c190e09-tls-certs") pod "model-serving-api-54d89bd5fc-gc5ld" (UID: "bcef4a25-cf6a-4b0e-9550-d5e40c190e09") : secret "model-serving-api-tls" not found Sep 19 09:56:56.216780 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:56.216735 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nd29\" (UniqueName: \"kubernetes.io/projected/bcef4a25-cf6a-4b0e-9550-d5e40c190e09-kube-api-access-4nd29\") pod \"model-serving-api-54d89bd5fc-gc5ld\" (UID: \"bcef4a25-cf6a-4b0e-9550-d5e40c190e09\") " pod="opendatahub/model-serving-api-54d89bd5fc-gc5ld" Sep 19 09:56:56.710183 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:56.710155 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcef4a25-cf6a-4b0e-9550-d5e40c190e09-tls-certs\") pod \"model-serving-api-54d89bd5fc-gc5ld\" (UID: \"bcef4a25-cf6a-4b0e-9550-d5e40c190e09\") " pod="opendatahub/model-serving-api-54d89bd5fc-gc5ld" Sep 19 09:56:56.712783 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:56.712756 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcef4a25-cf6a-4b0e-9550-d5e40c190e09-tls-certs\") pod \"model-serving-api-54d89bd5fc-gc5ld\" (UID: \"bcef4a25-cf6a-4b0e-9550-d5e40c190e09\") " pod="opendatahub/model-serving-api-54d89bd5fc-gc5ld" Sep 19 09:56:56.903937 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:56.903890 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gc5ld" Sep 19 09:56:57.175356 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:57.175331 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gc5ld"] Sep 19 09:56:57.177751 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:56:57.177724 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcef4a25_cf6a_4b0e_9550_d5e40c190e09.slice/crio-07b57897a0760860c3f4096cbe09ad234beddb33adb4cf322ab5ccc377122509 WatchSource:0}: Error finding container 07b57897a0760860c3f4096cbe09ad234beddb33adb4cf322ab5ccc377122509: Status 404 returned error can't find the container with id 07b57897a0760860c3f4096cbe09ad234beddb33adb4cf322ab5ccc377122509 Sep 19 09:56:57.926432 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:57.926366 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gc5ld" event={"ID":"bcef4a25-cf6a-4b0e-9550-d5e40c190e09","Type":"ContainerStarted","Data":"07b57897a0760860c3f4096cbe09ad234beddb33adb4cf322ab5ccc377122509"} Sep 19 09:56:58.935335 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:58.935293 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gc5ld" event={"ID":"bcef4a25-cf6a-4b0e-9550-d5e40c190e09","Type":"ContainerStarted","Data":"0558ec402a48e71583e61d0f933fe8782795413d8c7f6a86bb1364e433fdcc46"} Sep 19 09:56:58.935880 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:58.935457 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-gc5ld" Sep 19 09:56:58.953051 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:56:58.952997 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-gc5ld" podStartSLOduration=2.615797923 podStartE2EDuration="3.952980605s" totalImagesPullingTime="1.337182682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:56:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:56:58.952103702 +0000 UTC m=+318.752887000" watchObservedRunningTime="2026-09-19 09:56:58.952980605 +0000 UTC m=+318.753763902" Sep 19 09:57:04.419356 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:04.419322 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lws9t"] Sep 19 09:57:04.427101 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:04.427081 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lws9t" Sep 19 09:57:04.431848 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:04.431824 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Sep 19 09:57:04.431957 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:04.431893 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-5f8bl\"" Sep 19 09:57:04.432417 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:04.432399 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kfhgh"] Sep 19 09:57:04.435896 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:04.435875 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lws9t"] Sep 19 09:57:04.436020 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:04.435968 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kfhgh" Sep 19 09:57:04.437847 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:04.437820 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-cr9sf\"" Sep 19 09:57:04.437956 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:04.437871 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Sep 19 09:57:04.453246 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:04.453221 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kfhgh"] Sep 19 09:57:04.571417 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:04.571384 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8jzz\" (UniqueName: \"kubernetes.io/projected/e6045c73-29ba-4d00-a710-59d145151ab7-kube-api-access-q8jzz\") pod \"kserve-controller-manager-d6f4b65b8-lws9t\" (UID: \"e6045c73-29ba-4d00-a710-59d145151ab7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lws9t" Sep 19 09:57:04.571587 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:04.571426 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e6045c73-29ba-4d00-a710-59d145151ab7-cert\") pod \"kserve-controller-manager-d6f4b65b8-lws9t\" (UID: \"e6045c73-29ba-4d00-a710-59d145151ab7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lws9t" Sep 19 09:57:04.571587 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:04.571453 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00cb2858-90b4-4444-81d8-c8ef01f1332f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kfhgh\" (UID: \"00cb2858-90b4-4444-81d8-c8ef01f1332f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kfhgh" Sep 19 09:57:04.571587 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:04.571510 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb54f\" (UniqueName: \"kubernetes.io/projected/00cb2858-90b4-4444-81d8-c8ef01f1332f-kube-api-access-qb54f\") pod \"llmisvc-controller-manager-777c6bd7d5-kfhgh\" (UID: \"00cb2858-90b4-4444-81d8-c8ef01f1332f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kfhgh" Sep 19 09:57:04.672395 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:04.672297 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00cb2858-90b4-4444-81d8-c8ef01f1332f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kfhgh\" (UID: \"00cb2858-90b4-4444-81d8-c8ef01f1332f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kfhgh" Sep 19 09:57:04.672395 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:04.672350 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb54f\" (UniqueName: \"kubernetes.io/projected/00cb2858-90b4-4444-81d8-c8ef01f1332f-kube-api-access-qb54f\") pod \"llmisvc-controller-manager-777c6bd7d5-kfhgh\" (UID: \"00cb2858-90b4-4444-81d8-c8ef01f1332f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kfhgh" Sep 19 09:57:04.672636 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:04.672428 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8jzz\" (UniqueName: \"kubernetes.io/projected/e6045c73-29ba-4d00-a710-59d145151ab7-kube-api-access-q8jzz\") pod \"kserve-controller-manager-d6f4b65b8-lws9t\" (UID: \"e6045c73-29ba-4d00-a710-59d145151ab7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lws9t" Sep 19 09:57:04.672636 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:04.672466 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e6045c73-29ba-4d00-a710-59d145151ab7-cert\") pod \"kserve-controller-manager-d6f4b65b8-lws9t\" (UID: \"e6045c73-29ba-4d00-a710-59d145151ab7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lws9t" Sep 19 09:57:04.672636 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:57:04.672557 2579 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Sep 19 09:57:04.672636 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:57:04.672627 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6045c73-29ba-4d00-a710-59d145151ab7-cert podName:e6045c73-29ba-4d00-a710-59d145151ab7 nodeName:}" failed. No retries permitted until 2026-09-19 09:57:05.172605544 +0000 UTC m=+324.973388820 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e6045c73-29ba-4d00-a710-59d145151ab7-cert") pod "kserve-controller-manager-d6f4b65b8-lws9t" (UID: "e6045c73-29ba-4d00-a710-59d145151ab7") : secret "kserve-webhook-server-cert" not found Sep 19 09:57:04.674880 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:04.674850 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00cb2858-90b4-4444-81d8-c8ef01f1332f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kfhgh\" (UID: \"00cb2858-90b4-4444-81d8-c8ef01f1332f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kfhgh" Sep 19 09:57:04.681509 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:04.681482 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8jzz\" (UniqueName: \"kubernetes.io/projected/e6045c73-29ba-4d00-a710-59d145151ab7-kube-api-access-q8jzz\") pod \"kserve-controller-manager-d6f4b65b8-lws9t\" (UID: \"e6045c73-29ba-4d00-a710-59d145151ab7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lws9t" Sep 19 09:57:04.681868 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:04.681849 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb54f\" (UniqueName: \"kubernetes.io/projected/00cb2858-90b4-4444-81d8-c8ef01f1332f-kube-api-access-qb54f\") pod \"llmisvc-controller-manager-777c6bd7d5-kfhgh\" (UID: \"00cb2858-90b4-4444-81d8-c8ef01f1332f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kfhgh" Sep 19 09:57:04.746082 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:04.746049 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kfhgh" Sep 19 09:57:05.015370 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:05.015342 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kfhgh"] Sep 19 09:57:05.018273 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:57:05.018247 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod00cb2858_90b4_4444_81d8_c8ef01f1332f.slice/crio-12b402236754a587ff2f7a382c4029c775d4431a24aa6ab05c34a66a693b11c1 WatchSource:0}: Error finding container 12b402236754a587ff2f7a382c4029c775d4431a24aa6ab05c34a66a693b11c1: Status 404 returned error can't find the container with id 12b402236754a587ff2f7a382c4029c775d4431a24aa6ab05c34a66a693b11c1 Sep 19 09:57:05.175718 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:05.175666 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e6045c73-29ba-4d00-a710-59d145151ab7-cert\") pod \"kserve-controller-manager-d6f4b65b8-lws9t\" (UID: \"e6045c73-29ba-4d00-a710-59d145151ab7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lws9t" Sep 19 09:57:05.178199 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:05.178174 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e6045c73-29ba-4d00-a710-59d145151ab7-cert\") pod \"kserve-controller-manager-d6f4b65b8-lws9t\" (UID: \"e6045c73-29ba-4d00-a710-59d145151ab7\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lws9t" Sep 19 09:57:05.338437 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:05.338339 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lws9t" Sep 19 09:57:05.611543 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:05.611518 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lws9t"] Sep 19 09:57:05.613676 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:57:05.613649 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6045c73_29ba_4d00_a710_59d145151ab7.slice/crio-43b8bdb6884a0d27191a24c8e7b6c67aec78eaeb14aef1f43a11a2c04fd8e93a WatchSource:0}: Error finding container 43b8bdb6884a0d27191a24c8e7b6c67aec78eaeb14aef1f43a11a2c04fd8e93a: Status 404 returned error can't find the container with id 43b8bdb6884a0d27191a24c8e7b6c67aec78eaeb14aef1f43a11a2c04fd8e93a Sep 19 09:57:05.963034 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:05.963003 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lws9t" event={"ID":"e6045c73-29ba-4d00-a710-59d145151ab7","Type":"ContainerStarted","Data":"43b8bdb6884a0d27191a24c8e7b6c67aec78eaeb14aef1f43a11a2c04fd8e93a"} Sep 19 09:57:05.964322 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:05.964288 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kfhgh" event={"ID":"00cb2858-90b4-4444-81d8-c8ef01f1332f","Type":"ContainerStarted","Data":"12b402236754a587ff2f7a382c4029c775d4431a24aa6ab05c34a66a693b11c1"} Sep 19 09:57:06.974053 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:06.974022 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87"] Sep 19 09:57:06.974503 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:06.974250 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" podUID="9a40cd53-188b-4984-bc1c-7456120b520b" containerName="discovery" containerID="cri-o://02631b5f810314bf048313dbcace81d091a968654ca42d0ed754a22aa57eb57d" gracePeriod=30 Sep 19 09:57:07.975261 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:07.975222 2579 generic.go:356] "Generic (PLEG): container finished" podID="9a40cd53-188b-4984-bc1c-7456120b520b" containerID="02631b5f810314bf048313dbcace81d091a968654ca42d0ed754a22aa57eb57d" exitCode=0 Sep 19 09:57:07.975676 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:07.975271 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" event={"ID":"9a40cd53-188b-4984-bc1c-7456120b520b","Type":"ContainerDied","Data":"02631b5f810314bf048313dbcace81d091a968654ca42d0ed754a22aa57eb57d"} Sep 19 09:57:08.062858 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:08.062836 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" Sep 19 09:57:08.095934 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:08.095911 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9a40cd53-188b-4984-bc1c-7456120b520b-istio-kubeconfig\") pod \"9a40cd53-188b-4984-bc1c-7456120b520b\" (UID: \"9a40cd53-188b-4984-bc1c-7456120b520b\") " Sep 19 09:57:08.096059 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:08.095952 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9a40cd53-188b-4984-bc1c-7456120b520b-istio-csr-ca-configmap\") pod \"9a40cd53-188b-4984-bc1c-7456120b520b\" (UID: \"9a40cd53-188b-4984-bc1c-7456120b520b\") " Sep 19 09:57:08.096059 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:08.096010 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a40cd53-188b-4984-bc1c-7456120b520b-local-certs\") pod \"9a40cd53-188b-4984-bc1c-7456120b520b\" (UID: \"9a40cd53-188b-4984-bc1c-7456120b520b\") " Sep 19 09:57:08.096059 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:08.096028 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a40cd53-188b-4984-bc1c-7456120b520b-istio-token\") pod \"9a40cd53-188b-4984-bc1c-7456120b520b\" (UID: \"9a40cd53-188b-4984-bc1c-7456120b520b\") " Sep 19 09:57:08.096059 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:08.096050 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9a40cd53-188b-4984-bc1c-7456120b520b-cacerts\") pod \"9a40cd53-188b-4984-bc1c-7456120b520b\" (UID: \"9a40cd53-188b-4984-bc1c-7456120b520b\") " Sep 19 09:57:08.096274 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:08.096085 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9a40cd53-188b-4984-bc1c-7456120b520b-istio-csr-dns-cert\") pod \"9a40cd53-188b-4984-bc1c-7456120b520b\" (UID: \"9a40cd53-188b-4984-bc1c-7456120b520b\") " Sep 19 09:57:08.097351 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:08.097324 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a40cd53-188b-4984-bc1c-7456120b520b-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "9a40cd53-188b-4984-bc1c-7456120b520b" (UID: "9a40cd53-188b-4984-bc1c-7456120b520b"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 09:57:08.100024 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:08.099998 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a40cd53-188b-4984-bc1c-7456120b520b-cacerts" (OuterVolumeSpecName: "cacerts") pod "9a40cd53-188b-4984-bc1c-7456120b520b" (UID: "9a40cd53-188b-4984-bc1c-7456120b520b"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 09:57:08.100211 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:08.100179 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a40cd53-188b-4984-bc1c-7456120b520b-istio-token" (OuterVolumeSpecName: "istio-token") pod "9a40cd53-188b-4984-bc1c-7456120b520b" (UID: "9a40cd53-188b-4984-bc1c-7456120b520b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 09:57:08.100211 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:08.100201 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a40cd53-188b-4984-bc1c-7456120b520b-local-certs" (OuterVolumeSpecName: "local-certs") pod "9a40cd53-188b-4984-bc1c-7456120b520b" (UID: "9a40cd53-188b-4984-bc1c-7456120b520b"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 09:57:08.100328 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:08.100290 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a40cd53-188b-4984-bc1c-7456120b520b-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "9a40cd53-188b-4984-bc1c-7456120b520b" (UID: "9a40cd53-188b-4984-bc1c-7456120b520b"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 09:57:08.101082 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:08.101056 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a40cd53-188b-4984-bc1c-7456120b520b-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "9a40cd53-188b-4984-bc1c-7456120b520b" (UID: "9a40cd53-188b-4984-bc1c-7456120b520b"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 09:57:08.196537 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:08.196506 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66nbr\" (UniqueName: \"kubernetes.io/projected/9a40cd53-188b-4984-bc1c-7456120b520b-kube-api-access-66nbr\") pod \"9a40cd53-188b-4984-bc1c-7456120b520b\" (UID: \"9a40cd53-188b-4984-bc1c-7456120b520b\") " Sep 19 09:57:08.196747 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:08.196682 2579 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9a40cd53-188b-4984-bc1c-7456120b520b-istio-kubeconfig\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 19 09:57:08.196747 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:08.196726 2579 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9a40cd53-188b-4984-bc1c-7456120b520b-istio-csr-ca-configmap\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 19 09:57:08.196747 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:08.196742 2579 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a40cd53-188b-4984-bc1c-7456120b520b-local-certs\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 19 09:57:08.196918 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:08.196754 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a40cd53-188b-4984-bc1c-7456120b520b-istio-token\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 19 09:57:08.196918 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:08.196765 2579 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9a40cd53-188b-4984-bc1c-7456120b520b-cacerts\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 19 09:57:08.196918 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:08.196777 2579 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9a40cd53-188b-4984-bc1c-7456120b520b-istio-csr-dns-cert\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 19 09:57:08.198726 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:08.198667 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a40cd53-188b-4984-bc1c-7456120b520b-kube-api-access-66nbr" (OuterVolumeSpecName: "kube-api-access-66nbr") pod "9a40cd53-188b-4984-bc1c-7456120b520b" (UID: "9a40cd53-188b-4984-bc1c-7456120b520b"). InnerVolumeSpecName "kube-api-access-66nbr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 09:57:08.297734 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:08.297633 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66nbr\" (UniqueName: \"kubernetes.io/projected/9a40cd53-188b-4984-bc1c-7456120b520b-kube-api-access-66nbr\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 19 09:57:08.980492 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:08.980402 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" Sep 19 09:57:08.980492 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:08.980435 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87" event={"ID":"9a40cd53-188b-4984-bc1c-7456120b520b","Type":"ContainerDied","Data":"f3e980b96162b7d74bf881f2aa1556c83ae73854b9eba3e288903e3f26c63c9e"} Sep 19 09:57:08.981225 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:08.980502 2579 scope.go:117] "RemoveContainer" containerID="02631b5f810314bf048313dbcace81d091a968654ca42d0ed754a22aa57eb57d" Sep 19 09:57:08.982467 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:08.982442 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kfhgh" event={"ID":"00cb2858-90b4-4444-81d8-c8ef01f1332f","Type":"ContainerStarted","Data":"6388d1415ced143df191805721ca6aa2383905ea5f82bd92212033aa99c2e60c"} Sep 19 09:57:08.982583 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:08.982552 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kfhgh" Sep 19 09:57:08.984218 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:08.984193 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lws9t" event={"ID":"e6045c73-29ba-4d00-a710-59d145151ab7","Type":"ContainerStarted","Data":"63d6409057b0e5c342320ab1a9856b591b4054afa21c3c0480b4f7a3c60304e8"} Sep 19 09:57:08.984493 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:08.984303 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lws9t" Sep 19 09:57:09.002153 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:09.002107 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lws9t" podStartSLOduration=2.536281029 podStartE2EDuration="5.002088826s" totalImagesPullingTime="2.465807797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:57:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:57:09.001001263 +0000 UTC m=+328.801784561" watchObservedRunningTime="2026-09-19 09:57:09.002088826 +0000 UTC m=+328.802872124" Sep 19 09:57:09.014749 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:09.014729 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87"] Sep 19 09:57:09.018797 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:09.018774 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xlz87"] Sep 19 09:57:09.032581 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:09.032538 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kfhgh" podStartSLOduration=1.972791854 podStartE2EDuration="5.032524657s" totalImagesPullingTime="3.059732803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:57:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:57:09.032231289 +0000 UTC m=+328.833014590" watchObservedRunningTime="2026-09-19 09:57:09.032524657 +0000 UTC m=+328.833307954" Sep 19 09:57:09.943477 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:09.943445 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-gc5ld" Sep 19 09:57:10.700586 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:10.700555 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a40cd53-188b-4984-bc1c-7456120b520b" path="/var/lib/kubelet/pods/9a40cd53-188b-4984-bc1c-7456120b520b/volumes" Sep 19 09:57:39.992350 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:39.992269 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kfhgh" Sep 19 09:57:39.995434 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:57:39.995414 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lws9t" Sep 19 09:58:24.198711 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:24.198660 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-bzxph"] Sep 19 09:58:24.199224 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:24.199109 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a40cd53-188b-4984-bc1c-7456120b520b" containerName="discovery" Sep 19 09:58:24.199224 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:24.199127 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a40cd53-188b-4984-bc1c-7456120b520b" containerName="discovery" Sep 19 09:58:24.199224 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:24.199196 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a40cd53-188b-4984-bc1c-7456120b520b" containerName="discovery" Sep 19 09:58:24.202175 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:24.202155 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-bzxph" Sep 19 09:58:24.204638 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:24.204607 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 19 09:58:24.204895 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:24.204882 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 19 09:58:24.204990 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:24.204970 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-xchww\"" Sep 19 09:58:24.212816 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:24.212794 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-bzxph"] Sep 19 09:58:24.366209 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:24.366174 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8v4t\" (UniqueName: \"kubernetes.io/projected/b5b1a465-c499-4b7a-9534-f2e145f660c3-kube-api-access-q8v4t\") pod \"authorino-operator-76b478bd78-bzxph\" (UID: \"b5b1a465-c499-4b7a-9534-f2e145f660c3\") " pod="kuadrant-system/authorino-operator-76b478bd78-bzxph" Sep 19 09:58:24.467523 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:24.467439 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8v4t\" (UniqueName: \"kubernetes.io/projected/b5b1a465-c499-4b7a-9534-f2e145f660c3-kube-api-access-q8v4t\") pod \"authorino-operator-76b478bd78-bzxph\" (UID: \"b5b1a465-c499-4b7a-9534-f2e145f660c3\") " pod="kuadrant-system/authorino-operator-76b478bd78-bzxph" Sep 19 09:58:24.478978 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:24.478944 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8v4t\" (UniqueName: \"kubernetes.io/projected/b5b1a465-c499-4b7a-9534-f2e145f660c3-kube-api-access-q8v4t\") pod \"authorino-operator-76b478bd78-bzxph\" (UID: \"b5b1a465-c499-4b7a-9534-f2e145f660c3\") " pod="kuadrant-system/authorino-operator-76b478bd78-bzxph" Sep 19 09:58:24.512000 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:24.511962 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-bzxph" Sep 19 09:58:24.782664 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:24.782591 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-bzxph"] Sep 19 09:58:24.785507 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:58:24.785481 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5b1a465_c499_4b7a_9534_f2e145f660c3.slice/crio-04c54d193f4d8295ccc3605b7a49f9be0db5aa318b692cf0c6636e433335fce4 WatchSource:0}: Error finding container 04c54d193f4d8295ccc3605b7a49f9be0db5aa318b692cf0c6636e433335fce4: Status 404 returned error can't find the container with id 04c54d193f4d8295ccc3605b7a49f9be0db5aa318b692cf0c6636e433335fce4 Sep 19 09:58:25.283646 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:25.283610 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-bzxph" event={"ID":"b5b1a465-c499-4b7a-9534-f2e145f660c3","Type":"ContainerStarted","Data":"04c54d193f4d8295ccc3605b7a49f9be0db5aa318b692cf0c6636e433335fce4"} Sep 19 09:58:26.398754 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:26.398521 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-t4ct2"] Sep 19 09:58:26.406899 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:26.406868 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-t4ct2" Sep 19 09:58:26.409291 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:26.409268 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-445m7\"" Sep 19 09:58:26.412599 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:26.412568 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-t4ct2"] Sep 19 09:58:26.586930 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:26.586896 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkkrg\" (UniqueName: \"kubernetes.io/projected/c626feed-d41e-4cc6-83bf-a8340fc0ad34-kube-api-access-mkkrg\") pod \"limitador-operator-controller-manager-74495c69f8-t4ct2\" (UID: \"c626feed-d41e-4cc6-83bf-a8340fc0ad34\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-t4ct2" Sep 19 09:58:26.687339 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:26.687301 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkkrg\" (UniqueName: \"kubernetes.io/projected/c626feed-d41e-4cc6-83bf-a8340fc0ad34-kube-api-access-mkkrg\") pod \"limitador-operator-controller-manager-74495c69f8-t4ct2\" (UID: \"c626feed-d41e-4cc6-83bf-a8340fc0ad34\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-t4ct2" Sep 19 09:58:26.701619 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:26.701580 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkkrg\" (UniqueName: \"kubernetes.io/projected/c626feed-d41e-4cc6-83bf-a8340fc0ad34-kube-api-access-mkkrg\") pod \"limitador-operator-controller-manager-74495c69f8-t4ct2\" (UID: \"c626feed-d41e-4cc6-83bf-a8340fc0ad34\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-t4ct2" Sep 19 09:58:26.721066 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:26.721033 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-t4ct2" Sep 19 09:58:27.463820 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:27.463744 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-t4ct2"] Sep 19 09:58:27.467224 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:58:27.467194 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc626feed_d41e_4cc6_83bf_a8340fc0ad34.slice/crio-7af01476f39a72af32924b3bb578d48d2afd45685b087a60d8957442df6e0811 WatchSource:0}: Error finding container 7af01476f39a72af32924b3bb578d48d2afd45685b087a60d8957442df6e0811: Status 404 returned error can't find the container with id 7af01476f39a72af32924b3bb578d48d2afd45685b087a60d8957442df6e0811 Sep 19 09:58:28.298053 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:28.298019 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-t4ct2" event={"ID":"c626feed-d41e-4cc6-83bf-a8340fc0ad34","Type":"ContainerStarted","Data":"7af01476f39a72af32924b3bb578d48d2afd45685b087a60d8957442df6e0811"} Sep 19 09:58:28.299757 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:28.299735 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-bzxph" event={"ID":"b5b1a465-c499-4b7a-9534-f2e145f660c3","Type":"ContainerStarted","Data":"70f58adc869b61108a59f12f142eb4c4530170efafca164fa24b17d58799a841"} Sep 19 09:58:28.299940 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:28.299925 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-bzxph" Sep 19 09:58:28.325040 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:28.324998 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-bzxph" podStartSLOduration=1.857122019 podStartE2EDuration="4.324985507s" totalImagesPullingTime="2.467863488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:58:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:58:28.322915834 +0000 UTC m=+408.123699130" watchObservedRunningTime="2026-09-19 09:58:28.324985507 +0000 UTC m=+408.125768804" Sep 19 09:58:29.306788 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:29.306672 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-t4ct2" event={"ID":"c626feed-d41e-4cc6-83bf-a8340fc0ad34","Type":"ContainerStarted","Data":"ca88c99179e5c51203afbe4ff77ef595bcc08e8189d9aef9979b6ec9ae932509"} Sep 19 09:58:29.307197 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:29.306928 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-t4ct2" Sep 19 09:58:29.324139 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:29.324093 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-t4ct2" podStartSLOduration=1.741242916 podStartE2EDuration="3.324077052s" totalImagesPullingTime="1.582834136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:58:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:58:29.322317478 +0000 UTC m=+409.123100774" watchObservedRunningTime="2026-09-19 09:58:29.324077052 +0000 UTC m=+409.124860349" Sep 19 09:58:30.629663 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:30.629629 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-88js9"] Sep 19 09:58:30.633023 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:30.633006 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-88js9" Sep 19 09:58:30.635381 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:30.635354 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ln5h6\"" Sep 19 09:58:30.643134 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:30.643114 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-88js9"] Sep 19 09:58:30.821554 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:30.821520 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e57ed57c-0418-4569-b339-fdb3926d81cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-88js9\" (UID: \"e57ed57c-0418-4569-b339-fdb3926d81cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-88js9" Sep 19 09:58:30.821773 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:30.821646 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8cvr\" (UniqueName: \"kubernetes.io/projected/e57ed57c-0418-4569-b339-fdb3926d81cc-kube-api-access-s8cvr\") pod \"kuadrant-operator-controller-manager-76f8f686bf-88js9\" (UID: \"e57ed57c-0418-4569-b339-fdb3926d81cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-88js9" Sep 19 09:58:30.922413 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:30.922320 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e57ed57c-0418-4569-b339-fdb3926d81cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-88js9\" (UID: \"e57ed57c-0418-4569-b339-fdb3926d81cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-88js9" Sep 19 09:58:30.922413 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:30.922380 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8cvr\" (UniqueName: \"kubernetes.io/projected/e57ed57c-0418-4569-b339-fdb3926d81cc-kube-api-access-s8cvr\") pod \"kuadrant-operator-controller-manager-76f8f686bf-88js9\" (UID: \"e57ed57c-0418-4569-b339-fdb3926d81cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-88js9" Sep 19 09:58:30.922735 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:30.922684 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e57ed57c-0418-4569-b339-fdb3926d81cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-88js9\" (UID: \"e57ed57c-0418-4569-b339-fdb3926d81cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-88js9" Sep 19 09:58:30.933017 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:30.932996 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8cvr\" (UniqueName: \"kubernetes.io/projected/e57ed57c-0418-4569-b339-fdb3926d81cc-kube-api-access-s8cvr\") pod \"kuadrant-operator-controller-manager-76f8f686bf-88js9\" (UID: \"e57ed57c-0418-4569-b339-fdb3926d81cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-88js9" Sep 19 09:58:30.942830 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:30.942809 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-88js9" Sep 19 09:58:31.222482 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:31.222457 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-88js9"] Sep 19 09:58:31.225290 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:58:31.225262 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode57ed57c_0418_4569_b339_fdb3926d81cc.slice/crio-bc8af66c2a78e1e7f3ae5b24b382f10a662d04d4ef5b315dc0a582c635010096 WatchSource:0}: Error finding container bc8af66c2a78e1e7f3ae5b24b382f10a662d04d4ef5b315dc0a582c635010096: Status 404 returned error can't find the container with id bc8af66c2a78e1e7f3ae5b24b382f10a662d04d4ef5b315dc0a582c635010096 Sep 19 09:58:31.316038 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:31.316008 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-88js9" event={"ID":"e57ed57c-0418-4569-b339-fdb3926d81cc","Type":"ContainerStarted","Data":"bc8af66c2a78e1e7f3ae5b24b382f10a662d04d4ef5b315dc0a582c635010096"} Sep 19 09:58:32.632655 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:32.632620 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dhcr5"] Sep 19 09:58:32.636186 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:32.636162 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dhcr5" Sep 19 09:58:32.638470 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:32.638442 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-5568d\"" Sep 19 09:58:32.638604 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:32.638523 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Sep 19 09:58:32.647246 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:32.647223 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dhcr5"] Sep 19 09:58:32.735711 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:32.735670 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7s7p\" (UniqueName: \"kubernetes.io/projected/9f3ec1f4-b8d8-40e2-a846-90398328f525-kube-api-access-z7s7p\") pod \"dns-operator-controller-manager-7b84cd7c9c-dhcr5\" (UID: \"9f3ec1f4-b8d8-40e2-a846-90398328f525\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dhcr5" Sep 19 09:58:32.837006 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:32.836969 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7s7p\" (UniqueName: \"kubernetes.io/projected/9f3ec1f4-b8d8-40e2-a846-90398328f525-kube-api-access-z7s7p\") pod \"dns-operator-controller-manager-7b84cd7c9c-dhcr5\" (UID: \"9f3ec1f4-b8d8-40e2-a846-90398328f525\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dhcr5" Sep 19 09:58:32.853843 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:32.853813 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7s7p\" (UniqueName: \"kubernetes.io/projected/9f3ec1f4-b8d8-40e2-a846-90398328f525-kube-api-access-z7s7p\") pod \"dns-operator-controller-manager-7b84cd7c9c-dhcr5\" (UID: \"9f3ec1f4-b8d8-40e2-a846-90398328f525\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dhcr5" Sep 19 09:58:32.950169 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:32.950126 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dhcr5" Sep 19 09:58:33.228269 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:33.228244 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dhcr5"] Sep 19 09:58:33.231265 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:58:33.231229 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f3ec1f4_b8d8_40e2_a846_90398328f525.slice/crio-8e6966e92819cbbd748fde69229dd1362126692b9e547be91d2be4f3a8f66c1d WatchSource:0}: Error finding container 8e6966e92819cbbd748fde69229dd1362126692b9e547be91d2be4f3a8f66c1d: Status 404 returned error can't find the container with id 8e6966e92819cbbd748fde69229dd1362126692b9e547be91d2be4f3a8f66c1d Sep 19 09:58:33.328525 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:33.328488 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dhcr5" event={"ID":"9f3ec1f4-b8d8-40e2-a846-90398328f525","Type":"ContainerStarted","Data":"8e6966e92819cbbd748fde69229dd1362126692b9e547be91d2be4f3a8f66c1d"} Sep 19 09:58:35.341281 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:35.341240 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-88js9" event={"ID":"e57ed57c-0418-4569-b339-fdb3926d81cc","Type":"ContainerStarted","Data":"95e717b553c8c273f6014bb93b72264583d3e3b24f33f4060a423375ca156b2f"} Sep 19 09:58:35.341794 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:35.341494 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-88js9" Sep 19 09:58:35.359942 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:35.359828 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-88js9" podStartSLOduration=1.491202179 podStartE2EDuration="5.359806432s" totalImagesPullingTime="3.868604253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:58:35.358516174 +0000 UTC m=+415.159299472" watchObservedRunningTime="2026-09-19 09:58:35.359806432 +0000 UTC m=+415.160589730" Sep 19 09:58:36.346960 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:36.346869 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dhcr5" event={"ID":"9f3ec1f4-b8d8-40e2-a846-90398328f525","Type":"ContainerStarted","Data":"ca0ac15207c6bbb9329f7ff4d7278953817511acc0c02c73eb8823ec494b6cb1"} Sep 19 09:58:36.347302 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:36.347070 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dhcr5" Sep 19 09:58:36.363196 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:36.363143 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dhcr5" podStartSLOduration=1.62391251 podStartE2EDuration="4.363129822s" totalImagesPullingTime="2.739217312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:58:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:58:36.361866951 +0000 UTC m=+416.162650249" watchObservedRunningTime="2026-09-19 09:58:36.363129822 +0000 UTC m=+416.163913119" Sep 19 09:58:37.848120 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:37.848083 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-vgbwr"] Sep 19 09:58:37.851328 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:37.851309 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vgbwr" Sep 19 09:58:37.853597 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:37.853578 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tpsml\"" Sep 19 09:58:37.853674 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:37.853578 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Sep 19 09:58:37.853674 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:37.853579 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Sep 19 09:58:37.861530 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:37.861510 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-vgbwr"] Sep 19 09:58:37.876820 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:37.876791 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwjnr\" (UniqueName: \"kubernetes.io/projected/66f26621-0116-4a5a-bd43-4110428ae5b5-kube-api-access-rwjnr\") pod \"kuadrant-console-plugin-fbdd4f445-vgbwr\" (UID: \"66f26621-0116-4a5a-bd43-4110428ae5b5\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vgbwr" Sep 19 09:58:37.876820 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:37.876825 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/66f26621-0116-4a5a-bd43-4110428ae5b5-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-vgbwr\" (UID: \"66f26621-0116-4a5a-bd43-4110428ae5b5\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vgbwr" Sep 19 09:58:37.877081 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:37.876850 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/66f26621-0116-4a5a-bd43-4110428ae5b5-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-vgbwr\" (UID: \"66f26621-0116-4a5a-bd43-4110428ae5b5\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vgbwr" Sep 19 09:58:37.977857 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:37.977818 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwjnr\" (UniqueName: \"kubernetes.io/projected/66f26621-0116-4a5a-bd43-4110428ae5b5-kube-api-access-rwjnr\") pod \"kuadrant-console-plugin-fbdd4f445-vgbwr\" (UID: \"66f26621-0116-4a5a-bd43-4110428ae5b5\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vgbwr" Sep 19 09:58:37.977857 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:37.977860 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/66f26621-0116-4a5a-bd43-4110428ae5b5-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-vgbwr\" (UID: \"66f26621-0116-4a5a-bd43-4110428ae5b5\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vgbwr" Sep 19 09:58:37.978058 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:37.977898 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/66f26621-0116-4a5a-bd43-4110428ae5b5-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-vgbwr\" (UID: \"66f26621-0116-4a5a-bd43-4110428ae5b5\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vgbwr" Sep 19 09:58:37.978724 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:37.978644 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/66f26621-0116-4a5a-bd43-4110428ae5b5-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-vgbwr\" (UID: \"66f26621-0116-4a5a-bd43-4110428ae5b5\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vgbwr" Sep 19 09:58:37.980510 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:37.980489 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/66f26621-0116-4a5a-bd43-4110428ae5b5-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-vgbwr\" (UID: \"66f26621-0116-4a5a-bd43-4110428ae5b5\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vgbwr" Sep 19 09:58:37.986226 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:37.986205 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwjnr\" (UniqueName: \"kubernetes.io/projected/66f26621-0116-4a5a-bd43-4110428ae5b5-kube-api-access-rwjnr\") pod \"kuadrant-console-plugin-fbdd4f445-vgbwr\" (UID: \"66f26621-0116-4a5a-bd43-4110428ae5b5\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vgbwr" Sep 19 09:58:38.160595 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:38.160520 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vgbwr" Sep 19 09:58:38.429069 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:38.429029 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-vgbwr"] Sep 19 09:58:38.431563 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:58:38.431539 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66f26621_0116_4a5a_bd43_4110428ae5b5.slice/crio-59e3b0b7e29f29562ab02adddf3ee6f0429a99db08623820407daf2b8a20bc0c WatchSource:0}: Error finding container 59e3b0b7e29f29562ab02adddf3ee6f0429a99db08623820407daf2b8a20bc0c: Status 404 returned error can't find the container with id 59e3b0b7e29f29562ab02adddf3ee6f0429a99db08623820407daf2b8a20bc0c Sep 19 09:58:39.310379 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:39.309555 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-bzxph" Sep 19 09:58:39.365114 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:39.365053 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vgbwr" event={"ID":"66f26621-0116-4a5a-bd43-4110428ae5b5","Type":"ContainerStarted","Data":"59e3b0b7e29f29562ab02adddf3ee6f0429a99db08623820407daf2b8a20bc0c"} Sep 19 09:58:40.313042 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:40.312995 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-t4ct2" Sep 19 09:58:43.386577 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:43.386484 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vgbwr" event={"ID":"66f26621-0116-4a5a-bd43-4110428ae5b5","Type":"ContainerStarted","Data":"e2576de25e425a29667c0f4e5e4af7bb994c99f49a3b117a5eaf80f6ef210a6d"} Sep 19 09:58:43.402090 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:43.402037 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vgbwr" podStartSLOduration=1.893862168 podStartE2EDuration="6.402019448s" totalImagesPullingTime="4.50815728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:58:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:58:43.40162195 +0000 UTC m=+423.202405248" watchObservedRunningTime="2026-09-19 09:58:43.402019448 +0000 UTC m=+423.202802748" Sep 19 09:58:46.349433 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:46.349399 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-88js9" Sep 19 09:58:47.353044 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:47.353009 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-dhcr5" Sep 19 09:58:48.474634 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.474601 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-88js9"] Sep 19 09:58:48.475139 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.474788 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-88js9" podUID="e57ed57c-0418-4569-b339-fdb3926d81cc" containerName="manager" containerID="cri-o://95e717b553c8c273f6014bb93b72264583d3e3b24f33f4060a423375ca156b2f" gracePeriod=2 Sep 19 09:58:48.488366 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.488341 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-88js9"] Sep 19 09:58:48.505961 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:58:48.505809 2579 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"e57ed57c-0418-4569-b339-fdb3926d81cc\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-88js9\": pods \"kuadrant-operator-controller-manager-76f8f686bf-88js9\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-88js9" Sep 19 09:58:48.508013 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.507882 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zrc9b"] Sep 19 09:58:48.508348 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.508322 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e57ed57c-0418-4569-b339-fdb3926d81cc" containerName="manager" Sep 19 09:58:48.508348 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.508347 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e57ed57c-0418-4569-b339-fdb3926d81cc" containerName="manager" Sep 19 09:58:48.508508 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.508420 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e57ed57c-0418-4569-b339-fdb3926d81cc" containerName="manager" Sep 19 09:58:48.512634 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.511889 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zrc9b" Sep 19 09:58:48.514279 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:58:48.514215 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-88js9\" is forbidden: User \"system:node:ip-10-0-142-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-110.ec2.internal' and this object" podUID="e57ed57c-0418-4569-b339-fdb3926d81cc" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-88js9" Sep 19 09:58:48.517985 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.515389 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-t4ct2"] Sep 19 09:58:48.517985 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.515656 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-t4ct2" podUID="c626feed-d41e-4cc6-83bf-a8340fc0ad34" containerName="manager" containerID="cri-o://ca88c99179e5c51203afbe4ff77ef595bcc08e8189d9aef9979b6ec9ae932509" gracePeriod=2 Sep 19 09:58:48.524128 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.524104 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-t4ct2"] Sep 19 09:58:48.526519 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.526497 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zrc9b"] Sep 19 09:58:48.533536 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.533515 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-trr9l"] Sep 19 09:58:48.533862 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.533847 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c626feed-d41e-4cc6-83bf-a8340fc0ad34" containerName="manager" Sep 19 09:58:48.533948 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.533865 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c626feed-d41e-4cc6-83bf-a8340fc0ad34" containerName="manager" Sep 19 09:58:48.534000 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.533953 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c626feed-d41e-4cc6-83bf-a8340fc0ad34" containerName="manager" Sep 19 09:58:48.537060 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.537038 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-trr9l" Sep 19 09:58:48.550018 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.549995 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-trr9l"] Sep 19 09:58:48.564163 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:58:48.564128 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-88js9\" is forbidden: User \"system:node:ip-10-0-142-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-110.ec2.internal' and this object" podUID="e57ed57c-0418-4569-b339-fdb3926d81cc" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-88js9" Sep 19 09:58:48.565422 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.565388 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjpbf\" (UniqueName: \"kubernetes.io/projected/df59639c-f4f2-4802-8e7f-550e7d8d8829-kube-api-access-jjpbf\") pod \"limitador-operator-controller-manager-74495c69f8-trr9l\" (UID: \"df59639c-f4f2-4802-8e7f-550e7d8d8829\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-trr9l" Sep 19 09:58:48.565531 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.565470 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ccd5a454-e804-44d2-90e5-902b73ad66ae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zrc9b\" (UID: \"ccd5a454-e804-44d2-90e5-902b73ad66ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zrc9b" Sep 19 09:58:48.565531 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.565522 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9pg9\" (UniqueName: \"kubernetes.io/projected/ccd5a454-e804-44d2-90e5-902b73ad66ae-kube-api-access-s9pg9\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zrc9b\" (UID: \"ccd5a454-e804-44d2-90e5-902b73ad66ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zrc9b" Sep 19 09:58:48.565933 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:58:48.565908 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-t4ct2\" is forbidden: User \"system:node:ip-10-0-142-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-110.ec2.internal' and this object" podUID="c626feed-d41e-4cc6-83bf-a8340fc0ad34" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-t4ct2" Sep 19 09:58:48.666804 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.666733 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ccd5a454-e804-44d2-90e5-902b73ad66ae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zrc9b\" (UID: \"ccd5a454-e804-44d2-90e5-902b73ad66ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zrc9b" Sep 19 09:58:48.666989 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.666814 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9pg9\" (UniqueName: \"kubernetes.io/projected/ccd5a454-e804-44d2-90e5-902b73ad66ae-kube-api-access-s9pg9\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zrc9b\" (UID: \"ccd5a454-e804-44d2-90e5-902b73ad66ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zrc9b" Sep 19 09:58:48.666989 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.666862 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjpbf\" (UniqueName: \"kubernetes.io/projected/df59639c-f4f2-4802-8e7f-550e7d8d8829-kube-api-access-jjpbf\") pod \"limitador-operator-controller-manager-74495c69f8-trr9l\" (UID: \"df59639c-f4f2-4802-8e7f-550e7d8d8829\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-trr9l" Sep 19 09:58:48.667207 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.667184 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ccd5a454-e804-44d2-90e5-902b73ad66ae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zrc9b\" (UID: \"ccd5a454-e804-44d2-90e5-902b73ad66ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zrc9b" Sep 19 09:58:48.678720 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.678677 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjpbf\" (UniqueName: \"kubernetes.io/projected/df59639c-f4f2-4802-8e7f-550e7d8d8829-kube-api-access-jjpbf\") pod \"limitador-operator-controller-manager-74495c69f8-trr9l\" (UID: \"df59639c-f4f2-4802-8e7f-550e7d8d8829\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-trr9l" Sep 19 09:58:48.679422 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.679394 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9pg9\" (UniqueName: \"kubernetes.io/projected/ccd5a454-e804-44d2-90e5-902b73ad66ae-kube-api-access-s9pg9\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zrc9b\" (UID: \"ccd5a454-e804-44d2-90e5-902b73ad66ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zrc9b" Sep 19 09:58:48.743429 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.743406 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-88js9" Sep 19 09:58:48.747364 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.747345 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-t4ct2" Sep 19 09:58:48.868167 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.868137 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkkrg\" (UniqueName: \"kubernetes.io/projected/c626feed-d41e-4cc6-83bf-a8340fc0ad34-kube-api-access-mkkrg\") pod \"c626feed-d41e-4cc6-83bf-a8340fc0ad34\" (UID: \"c626feed-d41e-4cc6-83bf-a8340fc0ad34\") " Sep 19 09:58:48.868318 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.868189 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e57ed57c-0418-4569-b339-fdb3926d81cc-extensions-socket-volume\") pod \"e57ed57c-0418-4569-b339-fdb3926d81cc\" (UID: \"e57ed57c-0418-4569-b339-fdb3926d81cc\") " Sep 19 09:58:48.868318 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.868209 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8cvr\" (UniqueName: \"kubernetes.io/projected/e57ed57c-0418-4569-b339-fdb3926d81cc-kube-api-access-s8cvr\") pod \"e57ed57c-0418-4569-b339-fdb3926d81cc\" (UID: \"e57ed57c-0418-4569-b339-fdb3926d81cc\") " Sep 19 09:58:48.868603 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.868577 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e57ed57c-0418-4569-b339-fdb3926d81cc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e57ed57c-0418-4569-b339-fdb3926d81cc" (UID: "e57ed57c-0418-4569-b339-fdb3926d81cc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 09:58:48.870549 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.870529 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e57ed57c-0418-4569-b339-fdb3926d81cc-kube-api-access-s8cvr" (OuterVolumeSpecName: "kube-api-access-s8cvr") pod "e57ed57c-0418-4569-b339-fdb3926d81cc" (UID: "e57ed57c-0418-4569-b339-fdb3926d81cc"). InnerVolumeSpecName "kube-api-access-s8cvr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 09:58:48.870611 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.870572 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c626feed-d41e-4cc6-83bf-a8340fc0ad34-kube-api-access-mkkrg" (OuterVolumeSpecName: "kube-api-access-mkkrg") pod "c626feed-d41e-4cc6-83bf-a8340fc0ad34" (UID: "c626feed-d41e-4cc6-83bf-a8340fc0ad34"). InnerVolumeSpecName "kube-api-access-mkkrg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 09:58:48.909024 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.908997 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zrc9b" Sep 19 09:58:48.914452 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.914427 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-trr9l" Sep 19 09:58:48.969489 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.969284 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkkrg\" (UniqueName: \"kubernetes.io/projected/c626feed-d41e-4cc6-83bf-a8340fc0ad34-kube-api-access-mkkrg\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 19 09:58:48.969489 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.969315 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e57ed57c-0418-4569-b339-fdb3926d81cc-extensions-socket-volume\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 19 09:58:48.969489 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:48.969329 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8cvr\" (UniqueName: \"kubernetes.io/projected/e57ed57c-0418-4569-b339-fdb3926d81cc-kube-api-access-s8cvr\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 19 09:58:49.187486 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:49.187464 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zrc9b"] Sep 19 09:58:49.190547 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:49.190526 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-trr9l"] Sep 19 09:58:49.190630 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:58:49.190582 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccd5a454_e804_44d2_90e5_902b73ad66ae.slice/crio-11cd53cdbd3d1355f678ce38dcce64dd5b9c7a92396338a269303f0e33c52156 WatchSource:0}: Error finding container 11cd53cdbd3d1355f678ce38dcce64dd5b9c7a92396338a269303f0e33c52156: Status 404 returned error can't find the container with id 11cd53cdbd3d1355f678ce38dcce64dd5b9c7a92396338a269303f0e33c52156 Sep 19 09:58:49.192820 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:58:49.192789 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf59639c_f4f2_4802_8e7f_550e7d8d8829.slice/crio-022a11829e45d529d1b22ed6cc3b45f487d6b25efb9aa9decb88cbe07f3352d7 WatchSource:0}: Error finding container 022a11829e45d529d1b22ed6cc3b45f487d6b25efb9aa9decb88cbe07f3352d7: Status 404 returned error can't find the container with id 022a11829e45d529d1b22ed6cc3b45f487d6b25efb9aa9decb88cbe07f3352d7 Sep 19 09:58:49.413507 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:49.413455 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-trr9l" event={"ID":"df59639c-f4f2-4802-8e7f-550e7d8d8829","Type":"ContainerStarted","Data":"f0ee95b95b0449c96dddadd454cfb84234bafc159a3e30e90780644c4726e0e5"} Sep 19 09:58:49.413809 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:49.413531 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-trr9l" event={"ID":"df59639c-f4f2-4802-8e7f-550e7d8d8829","Type":"ContainerStarted","Data":"022a11829e45d529d1b22ed6cc3b45f487d6b25efb9aa9decb88cbe07f3352d7"} Sep 19 09:58:49.413809 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:49.413570 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-trr9l" Sep 19 09:58:49.415595 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:49.415569 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zrc9b" event={"ID":"ccd5a454-e804-44d2-90e5-902b73ad66ae","Type":"ContainerStarted","Data":"9ca87e89c18973dfb7ffcb7f2a342ea4c93a7985dde1122c73241bee41a33e24"} Sep 19 09:58:49.415729 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:49.415621 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zrc9b" Sep 19 09:58:49.415729 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:49.415644 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zrc9b" event={"ID":"ccd5a454-e804-44d2-90e5-902b73ad66ae","Type":"ContainerStarted","Data":"11cd53cdbd3d1355f678ce38dcce64dd5b9c7a92396338a269303f0e33c52156"} Sep 19 09:58:49.417361 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:49.417336 2579 generic.go:356] "Generic (PLEG): container finished" podID="c626feed-d41e-4cc6-83bf-a8340fc0ad34" containerID="ca88c99179e5c51203afbe4ff77ef595bcc08e8189d9aef9979b6ec9ae932509" exitCode=0 Sep 19 09:58:49.417445 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:49.417370 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-t4ct2" Sep 19 09:58:49.417445 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:49.417420 2579 scope.go:117] "RemoveContainer" containerID="ca88c99179e5c51203afbe4ff77ef595bcc08e8189d9aef9979b6ec9ae932509" Sep 19 09:58:49.419003 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:49.418975 2579 generic.go:356] "Generic (PLEG): container finished" podID="e57ed57c-0418-4569-b339-fdb3926d81cc" containerID="95e717b553c8c273f6014bb93b72264583d3e3b24f33f4060a423375ca156b2f" exitCode=0 Sep 19 09:58:49.419116 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:49.419019 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-88js9" Sep 19 09:58:49.426888 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:49.426856 2579 scope.go:117] "RemoveContainer" containerID="ca88c99179e5c51203afbe4ff77ef595bcc08e8189d9aef9979b6ec9ae932509" Sep 19 09:58:49.427235 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:58:49.427204 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca88c99179e5c51203afbe4ff77ef595bcc08e8189d9aef9979b6ec9ae932509\": container with ID starting with ca88c99179e5c51203afbe4ff77ef595bcc08e8189d9aef9979b6ec9ae932509 not found: ID does not exist" containerID="ca88c99179e5c51203afbe4ff77ef595bcc08e8189d9aef9979b6ec9ae932509" Sep 19 09:58:49.427328 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:49.427247 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca88c99179e5c51203afbe4ff77ef595bcc08e8189d9aef9979b6ec9ae932509"} err="failed to get container status \"ca88c99179e5c51203afbe4ff77ef595bcc08e8189d9aef9979b6ec9ae932509\": rpc error: code = NotFound desc = could not find container \"ca88c99179e5c51203afbe4ff77ef595bcc08e8189d9aef9979b6ec9ae932509\": container with ID starting with ca88c99179e5c51203afbe4ff77ef595bcc08e8189d9aef9979b6ec9ae932509 not found: ID does not exist" Sep 19 09:58:49.427328 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:49.427288 2579 scope.go:117] "RemoveContainer" containerID="95e717b553c8c273f6014bb93b72264583d3e3b24f33f4060a423375ca156b2f" Sep 19 09:58:49.430677 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:49.430629 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-trr9l" podStartSLOduration=1.430611486 podStartE2EDuration="1.430611486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:58:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:58:49.429435776 +0000 UTC m=+429.230219074" watchObservedRunningTime="2026-09-19 09:58:49.430611486 +0000 UTC m=+429.231394784" Sep 19 09:58:49.435996 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:49.435979 2579 scope.go:117] "RemoveContainer" containerID="95e717b553c8c273f6014bb93b72264583d3e3b24f33f4060a423375ca156b2f" Sep 19 09:58:49.436263 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:58:49.436245 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95e717b553c8c273f6014bb93b72264583d3e3b24f33f4060a423375ca156b2f\": container with ID starting with 95e717b553c8c273f6014bb93b72264583d3e3b24f33f4060a423375ca156b2f not found: ID does not exist" containerID="95e717b553c8c273f6014bb93b72264583d3e3b24f33f4060a423375ca156b2f" Sep 19 09:58:49.436310 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:49.436269 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95e717b553c8c273f6014bb93b72264583d3e3b24f33f4060a423375ca156b2f"} err="failed to get container status \"95e717b553c8c273f6014bb93b72264583d3e3b24f33f4060a423375ca156b2f\": rpc error: code = NotFound desc = could not find container \"95e717b553c8c273f6014bb93b72264583d3e3b24f33f4060a423375ca156b2f\": container with ID starting with 95e717b553c8c273f6014bb93b72264583d3e3b24f33f4060a423375ca156b2f not found: ID does not exist" Sep 19 09:58:49.452336 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:49.452266 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zrc9b" podStartSLOduration=1.452243706 podStartE2EDuration="1.452243706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:58:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:58:49.451117437 +0000 UTC m=+429.251900816" watchObservedRunningTime="2026-09-19 09:58:49.452243706 +0000 UTC m=+429.253027003" Sep 19 09:58:50.699540 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:50.699500 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c626feed-d41e-4cc6-83bf-a8340fc0ad34" path="/var/lib/kubelet/pods/c626feed-d41e-4cc6-83bf-a8340fc0ad34/volumes" Sep 19 09:58:50.700034 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:58:50.699997 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e57ed57c-0418-4569-b339-fdb3926d81cc" path="/var/lib/kubelet/pods/e57ed57c-0418-4569-b339-fdb3926d81cc/volumes" Sep 19 09:59:00.428132 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:00.428097 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zrc9b" Sep 19 09:59:00.428568 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:00.428194 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-trr9l" Sep 19 09:59:05.162805 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:05.162722 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zrc9b"] Sep 19 09:59:05.163230 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:05.162982 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zrc9b" podUID="ccd5a454-e804-44d2-90e5-902b73ad66ae" containerName="manager" containerID="cri-o://9ca87e89c18973dfb7ffcb7f2a342ea4c93a7985dde1122c73241bee41a33e24" gracePeriod=10 Sep 19 09:59:05.403854 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:05.403832 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zrc9b" Sep 19 09:59:05.449643 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:05.449620 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9tk4c"] Sep 19 09:59:05.449935 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:05.449922 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccd5a454-e804-44d2-90e5-902b73ad66ae" containerName="manager" Sep 19 09:59:05.449985 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:05.449937 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccd5a454-e804-44d2-90e5-902b73ad66ae" containerName="manager" Sep 19 09:59:05.450023 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:05.449996 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccd5a454-e804-44d2-90e5-902b73ad66ae" containerName="manager" Sep 19 09:59:05.452609 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:05.452587 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9tk4c" Sep 19 09:59:05.467285 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:05.467263 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9tk4c"] Sep 19 09:59:05.492022 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:05.491991 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9pg9\" (UniqueName: \"kubernetes.io/projected/ccd5a454-e804-44d2-90e5-902b73ad66ae-kube-api-access-s9pg9\") pod \"ccd5a454-e804-44d2-90e5-902b73ad66ae\" (UID: \"ccd5a454-e804-44d2-90e5-902b73ad66ae\") " Sep 19 09:59:05.492123 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:05.492042 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ccd5a454-e804-44d2-90e5-902b73ad66ae-extensions-socket-volume\") pod \"ccd5a454-e804-44d2-90e5-902b73ad66ae\" (UID: \"ccd5a454-e804-44d2-90e5-902b73ad66ae\") " Sep 19 09:59:05.492212 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:05.492194 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79386a95-e8c1-4df0-a842-57f36d38d5b2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-9tk4c\" (UID: \"79386a95-e8c1-4df0-a842-57f36d38d5b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9tk4c" Sep 19 09:59:05.492268 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:05.492259 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k2pj\" (UniqueName: \"kubernetes.io/projected/79386a95-e8c1-4df0-a842-57f36d38d5b2-kube-api-access-9k2pj\") pod \"kuadrant-operator-controller-manager-5769f99d9f-9tk4c\" (UID: \"79386a95-e8c1-4df0-a842-57f36d38d5b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9tk4c" Sep 19 09:59:05.492435 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:05.492411 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccd5a454-e804-44d2-90e5-902b73ad66ae-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ccd5a454-e804-44d2-90e5-902b73ad66ae" (UID: "ccd5a454-e804-44d2-90e5-902b73ad66ae"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 19 09:59:05.494380 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:05.494361 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccd5a454-e804-44d2-90e5-902b73ad66ae-kube-api-access-s9pg9" (OuterVolumeSpecName: "kube-api-access-s9pg9") pod "ccd5a454-e804-44d2-90e5-902b73ad66ae" (UID: "ccd5a454-e804-44d2-90e5-902b73ad66ae"). InnerVolumeSpecName "kube-api-access-s9pg9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 09:59:05.497772 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:05.497751 2579 generic.go:356] "Generic (PLEG): container finished" podID="ccd5a454-e804-44d2-90e5-902b73ad66ae" containerID="9ca87e89c18973dfb7ffcb7f2a342ea4c93a7985dde1122c73241bee41a33e24" exitCode=0 Sep 19 09:59:05.497865 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:05.497790 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zrc9b" event={"ID":"ccd5a454-e804-44d2-90e5-902b73ad66ae","Type":"ContainerDied","Data":"9ca87e89c18973dfb7ffcb7f2a342ea4c93a7985dde1122c73241bee41a33e24"} Sep 19 09:59:05.497865 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:05.497806 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zrc9b" Sep 19 09:59:05.497865 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:05.497828 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zrc9b" event={"ID":"ccd5a454-e804-44d2-90e5-902b73ad66ae","Type":"ContainerDied","Data":"11cd53cdbd3d1355f678ce38dcce64dd5b9c7a92396338a269303f0e33c52156"} Sep 19 09:59:05.497865 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:05.497848 2579 scope.go:117] "RemoveContainer" containerID="9ca87e89c18973dfb7ffcb7f2a342ea4c93a7985dde1122c73241bee41a33e24" Sep 19 09:59:05.506408 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:05.506306 2579 scope.go:117] "RemoveContainer" containerID="9ca87e89c18973dfb7ffcb7f2a342ea4c93a7985dde1122c73241bee41a33e24" Sep 19 09:59:05.506664 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:59:05.506643 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ca87e89c18973dfb7ffcb7f2a342ea4c93a7985dde1122c73241bee41a33e24\": container with ID starting with 9ca87e89c18973dfb7ffcb7f2a342ea4c93a7985dde1122c73241bee41a33e24 not found: ID does not exist" containerID="9ca87e89c18973dfb7ffcb7f2a342ea4c93a7985dde1122c73241bee41a33e24" Sep 19 09:59:05.506768 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:05.506670 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ca87e89c18973dfb7ffcb7f2a342ea4c93a7985dde1122c73241bee41a33e24"} err="failed to get container status \"9ca87e89c18973dfb7ffcb7f2a342ea4c93a7985dde1122c73241bee41a33e24\": rpc error: code = NotFound desc = could not find container \"9ca87e89c18973dfb7ffcb7f2a342ea4c93a7985dde1122c73241bee41a33e24\": container with ID starting with 9ca87e89c18973dfb7ffcb7f2a342ea4c93a7985dde1122c73241bee41a33e24 not found: ID does not exist" Sep 19 09:59:05.542185 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:05.542164 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zrc9b"] Sep 19 09:59:05.554786 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:05.554763 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zrc9b"] Sep 19 09:59:05.592582 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:05.592562 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k2pj\" (UniqueName: \"kubernetes.io/projected/79386a95-e8c1-4df0-a842-57f36d38d5b2-kube-api-access-9k2pj\") pod \"kuadrant-operator-controller-manager-5769f99d9f-9tk4c\" (UID: \"79386a95-e8c1-4df0-a842-57f36d38d5b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9tk4c" Sep 19 09:59:05.592723 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:05.592616 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79386a95-e8c1-4df0-a842-57f36d38d5b2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-9tk4c\" (UID: \"79386a95-e8c1-4df0-a842-57f36d38d5b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9tk4c" Sep 19 09:59:05.592723 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:05.592653 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9pg9\" (UniqueName: \"kubernetes.io/projected/ccd5a454-e804-44d2-90e5-902b73ad66ae-kube-api-access-s9pg9\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 19 09:59:05.592723 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:05.592665 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ccd5a454-e804-44d2-90e5-902b73ad66ae-extensions-socket-volume\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 19 09:59:05.592984 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:05.592967 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79386a95-e8c1-4df0-a842-57f36d38d5b2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-9tk4c\" (UID: \"79386a95-e8c1-4df0-a842-57f36d38d5b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9tk4c" Sep 19 09:59:05.605175 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:05.605158 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k2pj\" (UniqueName: \"kubernetes.io/projected/79386a95-e8c1-4df0-a842-57f36d38d5b2-kube-api-access-9k2pj\") pod \"kuadrant-operator-controller-manager-5769f99d9f-9tk4c\" (UID: \"79386a95-e8c1-4df0-a842-57f36d38d5b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9tk4c" Sep 19 09:59:05.762322 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:05.762248 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9tk4c" Sep 19 09:59:06.036858 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:06.036829 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9tk4c"] Sep 19 09:59:06.038953 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:59:06.038929 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79386a95_e8c1_4df0_a842_57f36d38d5b2.slice/crio-16fa27369a884825fc32186cac23372a717a7f58fd94611802c67ca0c34f781f WatchSource:0}: Error finding container 16fa27369a884825fc32186cac23372a717a7f58fd94611802c67ca0c34f781f: Status 404 returned error can't find the container with id 16fa27369a884825fc32186cac23372a717a7f58fd94611802c67ca0c34f781f Sep 19 09:59:06.505005 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:06.504967 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9tk4c" event={"ID":"79386a95-e8c1-4df0-a842-57f36d38d5b2","Type":"ContainerStarted","Data":"d50a3cdd85f422d78ad03a9b117621e6e2333d038beaba60c6e478f25f2d4f49"} Sep 19 09:59:06.505448 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:06.505068 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9tk4c" Sep 19 09:59:06.505448 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:06.505096 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9tk4c" event={"ID":"79386a95-e8c1-4df0-a842-57f36d38d5b2","Type":"ContainerStarted","Data":"16fa27369a884825fc32186cac23372a717a7f58fd94611802c67ca0c34f781f"} Sep 19 09:59:06.524527 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:06.524476 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9tk4c" podStartSLOduration=1.5244634750000001 podStartE2EDuration="1.524463475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:59:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:59:06.523591654 +0000 UTC m=+446.324374951" watchObservedRunningTime="2026-09-19 09:59:06.524463475 +0000 UTC m=+446.325246771" Sep 19 09:59:06.701819 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:06.701692 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccd5a454-e804-44d2-90e5-902b73ad66ae" path="/var/lib/kubelet/pods/ccd5a454-e804-44d2-90e5-902b73ad66ae/volumes" Sep 19 09:59:17.513577 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:17.513547 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-9tk4c" Sep 19 09:59:36.988492 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:36.988453 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-t7snv"] Sep 19 09:59:36.991742 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:36.991726 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-t7snv" Sep 19 09:59:36.994066 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:36.994043 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 19 09:59:37.000633 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:37.000613 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-t7snv"] Sep 19 09:59:37.085538 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:37.085508 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-t7snv"] Sep 19 09:59:37.136300 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:37.136270 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dwxx\" (UniqueName: \"kubernetes.io/projected/f37a7f63-4f51-42bc-81ef-a7f7a2db4418-kube-api-access-6dwxx\") pod \"limitador-limitador-8588749977-t7snv\" (UID: \"f37a7f63-4f51-42bc-81ef-a7f7a2db4418\") " pod="kuadrant-system/limitador-limitador-8588749977-t7snv" Sep 19 09:59:37.136441 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:37.136335 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f37a7f63-4f51-42bc-81ef-a7f7a2db4418-config-file\") pod \"limitador-limitador-8588749977-t7snv\" (UID: \"f37a7f63-4f51-42bc-81ef-a7f7a2db4418\") " pod="kuadrant-system/limitador-limitador-8588749977-t7snv" Sep 19 09:59:37.237684 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:37.237645 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f37a7f63-4f51-42bc-81ef-a7f7a2db4418-config-file\") pod \"limitador-limitador-8588749977-t7snv\" (UID: \"f37a7f63-4f51-42bc-81ef-a7f7a2db4418\") " pod="kuadrant-system/limitador-limitador-8588749977-t7snv" Sep 19 09:59:37.237874 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:37.237718 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dwxx\" (UniqueName: \"kubernetes.io/projected/f37a7f63-4f51-42bc-81ef-a7f7a2db4418-kube-api-access-6dwxx\") pod \"limitador-limitador-8588749977-t7snv\" (UID: \"f37a7f63-4f51-42bc-81ef-a7f7a2db4418\") " pod="kuadrant-system/limitador-limitador-8588749977-t7snv" Sep 19 09:59:37.238303 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:37.238281 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f37a7f63-4f51-42bc-81ef-a7f7a2db4418-config-file\") pod \"limitador-limitador-8588749977-t7snv\" (UID: \"f37a7f63-4f51-42bc-81ef-a7f7a2db4418\") " pod="kuadrant-system/limitador-limitador-8588749977-t7snv" Sep 19 09:59:37.246102 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:37.246037 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dwxx\" (UniqueName: \"kubernetes.io/projected/f37a7f63-4f51-42bc-81ef-a7f7a2db4418-kube-api-access-6dwxx\") pod \"limitador-limitador-8588749977-t7snv\" (UID: \"f37a7f63-4f51-42bc-81ef-a7f7a2db4418\") " pod="kuadrant-system/limitador-limitador-8588749977-t7snv" Sep 19 09:59:37.303034 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:37.302996 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-t7snv" Sep 19 09:59:37.574066 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:37.574039 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-t7snv"] Sep 19 09:59:37.576681 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:59:37.576650 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf37a7f63_4f51_42bc_81ef_a7f7a2db4418.slice/crio-8b48b7ad52802c876ccc953cae825fe0bfd5224f606c2ac6cc1e28568f3cb3dd WatchSource:0}: Error finding container 8b48b7ad52802c876ccc953cae825fe0bfd5224f606c2ac6cc1e28568f3cb3dd: Status 404 returned error can't find the container with id 8b48b7ad52802c876ccc953cae825fe0bfd5224f606c2ac6cc1e28568f3cb3dd Sep 19 09:59:37.647285 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:37.647251 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-t7snv" event={"ID":"f37a7f63-4f51-42bc-81ef-a7f7a2db4418","Type":"ContainerStarted","Data":"8b48b7ad52802c876ccc953cae825fe0bfd5224f606c2ac6cc1e28568f3cb3dd"} Sep 19 09:59:37.918617 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:37.918548 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-nw7nl"] Sep 19 09:59:37.922814 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:37.922794 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-nw7nl" Sep 19 09:59:37.924916 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:37.924895 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wmmgk\"" Sep 19 09:59:37.929456 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:37.929436 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-nw7nl"] Sep 19 09:59:38.043830 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:38.043796 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnmnr\" (UniqueName: \"kubernetes.io/projected/91d4e36e-c5b4-4a0b-9ad9-0425131b0e18-kube-api-access-xnmnr\") pod \"authorino-59c974bd48-nw7nl\" (UID: \"91d4e36e-c5b4-4a0b-9ad9-0425131b0e18\") " pod="kuadrant-system/authorino-59c974bd48-nw7nl" Sep 19 09:59:38.144244 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:38.144207 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnmnr\" (UniqueName: \"kubernetes.io/projected/91d4e36e-c5b4-4a0b-9ad9-0425131b0e18-kube-api-access-xnmnr\") pod \"authorino-59c974bd48-nw7nl\" (UID: \"91d4e36e-c5b4-4a0b-9ad9-0425131b0e18\") " pod="kuadrant-system/authorino-59c974bd48-nw7nl" Sep 19 09:59:38.152370 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:38.152344 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnmnr\" (UniqueName: \"kubernetes.io/projected/91d4e36e-c5b4-4a0b-9ad9-0425131b0e18-kube-api-access-xnmnr\") pod \"authorino-59c974bd48-nw7nl\" (UID: \"91d4e36e-c5b4-4a0b-9ad9-0425131b0e18\") " pod="kuadrant-system/authorino-59c974bd48-nw7nl" Sep 19 09:59:38.233013 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:38.232985 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-nw7nl" Sep 19 09:59:38.505715 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:38.501885 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-nw7nl"] Sep 19 09:59:38.508809 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:59:38.508766 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91d4e36e_c5b4_4a0b_9ad9_0425131b0e18.slice/crio-6b276329b6af73ea36464212e9b3ea4cca7f044e8361120a32957c6e3fee25a7 WatchSource:0}: Error finding container 6b276329b6af73ea36464212e9b3ea4cca7f044e8361120a32957c6e3fee25a7: Status 404 returned error can't find the container with id 6b276329b6af73ea36464212e9b3ea4cca7f044e8361120a32957c6e3fee25a7 Sep 19 09:59:38.653189 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:38.653151 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-nw7nl" event={"ID":"91d4e36e-c5b4-4a0b-9ad9-0425131b0e18","Type":"ContainerStarted","Data":"6b276329b6af73ea36464212e9b3ea4cca7f044e8361120a32957c6e3fee25a7"} Sep 19 09:59:40.663882 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:40.663851 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-t7snv" event={"ID":"f37a7f63-4f51-42bc-81ef-a7f7a2db4418","Type":"ContainerStarted","Data":"b2a96650951e65afadca43ae2fc5c2afd35262648d1aa420c6acf068d5cf5646"} Sep 19 09:59:40.664270 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:40.664019 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-t7snv" Sep 19 09:59:40.665385 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:40.665362 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-nw7nl" event={"ID":"91d4e36e-c5b4-4a0b-9ad9-0425131b0e18","Type":"ContainerStarted","Data":"9c363ab83ad1accd1288a1f5542889e6d7ef9be761b3fcc4b20e5800781c1375"} Sep 19 09:59:40.683041 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:40.682999 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-t7snv" podStartSLOduration=2.536921021 podStartE2EDuration="4.682983603s" totalImagesPullingTime="2.146062582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:59:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:59:40.681336287 +0000 UTC m=+480.482119578" watchObservedRunningTime="2026-09-19 09:59:40.682983603 +0000 UTC m=+480.483766896" Sep 19 09:59:40.694628 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:40.694582 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-nw7nl" podStartSLOduration=1.741263921 podStartE2EDuration="3.69456604s" totalImagesPullingTime="1.953302119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:59:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 09:59:40.694252749 +0000 UTC m=+480.495036046" watchObservedRunningTime="2026-09-19 09:59:40.69456604 +0000 UTC m=+480.495349338" Sep 19 09:59:51.394854 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:51.394823 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-t7snv"] Sep 19 09:59:51.395301 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:51.395005 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-t7snv" podUID="f37a7f63-4f51-42bc-81ef-a7f7a2db4418" containerName="limitador" containerID="cri-o://b2a96650951e65afadca43ae2fc5c2afd35262648d1aa420c6acf068d5cf5646" gracePeriod=30 Sep 19 09:59:51.396543 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:51.396519 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-t7snv" Sep 19 09:59:52.330238 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:52.330216 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-t7snv" Sep 19 09:59:52.451200 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:52.451161 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f37a7f63-4f51-42bc-81ef-a7f7a2db4418-config-file\") pod \"f37a7f63-4f51-42bc-81ef-a7f7a2db4418\" (UID: \"f37a7f63-4f51-42bc-81ef-a7f7a2db4418\") " Sep 19 09:59:52.451200 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:52.451203 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dwxx\" (UniqueName: \"kubernetes.io/projected/f37a7f63-4f51-42bc-81ef-a7f7a2db4418-kube-api-access-6dwxx\") pod \"f37a7f63-4f51-42bc-81ef-a7f7a2db4418\" (UID: \"f37a7f63-4f51-42bc-81ef-a7f7a2db4418\") " Sep 19 09:59:52.451738 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:52.451604 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f37a7f63-4f51-42bc-81ef-a7f7a2db4418-config-file" (OuterVolumeSpecName: "config-file") pod "f37a7f63-4f51-42bc-81ef-a7f7a2db4418" (UID: "f37a7f63-4f51-42bc-81ef-a7f7a2db4418"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 09:59:52.453484 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:52.453463 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f37a7f63-4f51-42bc-81ef-a7f7a2db4418-kube-api-access-6dwxx" (OuterVolumeSpecName: "kube-api-access-6dwxx") pod "f37a7f63-4f51-42bc-81ef-a7f7a2db4418" (UID: "f37a7f63-4f51-42bc-81ef-a7f7a2db4418"). InnerVolumeSpecName "kube-api-access-6dwxx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 09:59:52.552108 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:52.552026 2579 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f37a7f63-4f51-42bc-81ef-a7f7a2db4418-config-file\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 19 09:59:52.552108 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:52.552058 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dwxx\" (UniqueName: \"kubernetes.io/projected/f37a7f63-4f51-42bc-81ef-a7f7a2db4418-kube-api-access-6dwxx\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 19 09:59:52.724215 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:52.724176 2579 generic.go:356] "Generic (PLEG): container finished" podID="f37a7f63-4f51-42bc-81ef-a7f7a2db4418" containerID="b2a96650951e65afadca43ae2fc5c2afd35262648d1aa420c6acf068d5cf5646" exitCode=0 Sep 19 09:59:52.724379 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:52.724231 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-t7snv" Sep 19 09:59:52.724379 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:52.724258 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-t7snv" event={"ID":"f37a7f63-4f51-42bc-81ef-a7f7a2db4418","Type":"ContainerDied","Data":"b2a96650951e65afadca43ae2fc5c2afd35262648d1aa420c6acf068d5cf5646"} Sep 19 09:59:52.724379 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:52.724323 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-t7snv" event={"ID":"f37a7f63-4f51-42bc-81ef-a7f7a2db4418","Type":"ContainerDied","Data":"8b48b7ad52802c876ccc953cae825fe0bfd5224f606c2ac6cc1e28568f3cb3dd"} Sep 19 09:59:52.724379 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:52.724353 2579 scope.go:117] "RemoveContainer" containerID="b2a96650951e65afadca43ae2fc5c2afd35262648d1aa420c6acf068d5cf5646" Sep 19 09:59:52.732485 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:52.732456 2579 scope.go:117] "RemoveContainer" containerID="b2a96650951e65afadca43ae2fc5c2afd35262648d1aa420c6acf068d5cf5646" Sep 19 09:59:52.732752 ip-10-0-142-110 kubenswrapper[2579]: E0919 09:59:52.732734 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2a96650951e65afadca43ae2fc5c2afd35262648d1aa420c6acf068d5cf5646\": container with ID starting with b2a96650951e65afadca43ae2fc5c2afd35262648d1aa420c6acf068d5cf5646 not found: ID does not exist" containerID="b2a96650951e65afadca43ae2fc5c2afd35262648d1aa420c6acf068d5cf5646" Sep 19 09:59:52.732815 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:52.732761 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2a96650951e65afadca43ae2fc5c2afd35262648d1aa420c6acf068d5cf5646"} err="failed to get container status \"b2a96650951e65afadca43ae2fc5c2afd35262648d1aa420c6acf068d5cf5646\": rpc error: code = NotFound desc = could not find container \"b2a96650951e65afadca43ae2fc5c2afd35262648d1aa420c6acf068d5cf5646\": container with ID starting with b2a96650951e65afadca43ae2fc5c2afd35262648d1aa420c6acf068d5cf5646 not found: ID does not exist" Sep 19 09:59:52.739543 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:52.739523 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-t7snv"] Sep 19 09:59:52.743317 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:52.743298 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-t7snv"] Sep 19 09:59:54.029081 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:54.029056 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-vh2wm"] Sep 19 09:59:54.029540 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:54.029487 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f37a7f63-4f51-42bc-81ef-a7f7a2db4418" containerName="limitador" Sep 19 09:59:54.029540 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:54.029505 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f37a7f63-4f51-42bc-81ef-a7f7a2db4418" containerName="limitador" Sep 19 09:59:54.029642 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:54.029605 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f37a7f63-4f51-42bc-81ef-a7f7a2db4418" containerName="limitador" Sep 19 09:59:54.033806 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:54.033783 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vh2wm" Sep 19 09:59:54.035948 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:54.035924 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 19 09:59:54.036132 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:54.035943 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Sep 19 09:59:54.036664 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:54.036648 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-99g6w\"" Sep 19 09:59:54.036787 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:54.036713 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 19 09:59:54.039190 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:54.039159 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-vh2wm"] Sep 19 09:59:54.066662 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:54.066630 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/de2ebace-af53-4786-9206-4d55652249f2-data\") pod \"postgres-69fb4594cf-vh2wm\" (UID: \"de2ebace-af53-4786-9206-4d55652249f2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vh2wm" Sep 19 09:59:54.066829 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:54.066681 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk95f\" (UniqueName: \"kubernetes.io/projected/de2ebace-af53-4786-9206-4d55652249f2-kube-api-access-qk95f\") pod \"postgres-69fb4594cf-vh2wm\" (UID: \"de2ebace-af53-4786-9206-4d55652249f2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vh2wm" Sep 19 09:59:54.167061 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:54.167015 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/de2ebace-af53-4786-9206-4d55652249f2-data\") pod \"postgres-69fb4594cf-vh2wm\" (UID: \"de2ebace-af53-4786-9206-4d55652249f2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vh2wm" Sep 19 09:59:54.167207 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:54.167111 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk95f\" (UniqueName: \"kubernetes.io/projected/de2ebace-af53-4786-9206-4d55652249f2-kube-api-access-qk95f\") pod \"postgres-69fb4594cf-vh2wm\" (UID: \"de2ebace-af53-4786-9206-4d55652249f2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vh2wm" Sep 19 09:59:54.167490 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:54.167470 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/de2ebace-af53-4786-9206-4d55652249f2-data\") pod \"postgres-69fb4594cf-vh2wm\" (UID: \"de2ebace-af53-4786-9206-4d55652249f2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vh2wm" Sep 19 09:59:54.175219 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:54.175199 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk95f\" (UniqueName: \"kubernetes.io/projected/de2ebace-af53-4786-9206-4d55652249f2-kube-api-access-qk95f\") pod \"postgres-69fb4594cf-vh2wm\" (UID: \"de2ebace-af53-4786-9206-4d55652249f2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vh2wm" Sep 19 09:59:54.345361 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:54.345265 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vh2wm" Sep 19 09:59:54.617677 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:54.617592 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-vh2wm"] Sep 19 09:59:54.620414 ip-10-0-142-110 kubenswrapper[2579]: W0919 09:59:54.620380 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde2ebace_af53_4786_9206_4d55652249f2.slice/crio-7a3d952c5cad733a3a67e5ad5f8f52e42cbfa83ed144c6e3f381adb37114427e WatchSource:0}: Error finding container 7a3d952c5cad733a3a67e5ad5f8f52e42cbfa83ed144c6e3f381adb37114427e: Status 404 returned error can't find the container with id 7a3d952c5cad733a3a67e5ad5f8f52e42cbfa83ed144c6e3f381adb37114427e Sep 19 09:59:54.699569 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:54.699544 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f37a7f63-4f51-42bc-81ef-a7f7a2db4418" path="/var/lib/kubelet/pods/f37a7f63-4f51-42bc-81ef-a7f7a2db4418/volumes" Sep 19 09:59:54.737031 ip-10-0-142-110 kubenswrapper[2579]: I0919 09:59:54.737005 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vh2wm" event={"ID":"de2ebace-af53-4786-9206-4d55652249f2","Type":"ContainerStarted","Data":"7a3d952c5cad733a3a67e5ad5f8f52e42cbfa83ed144c6e3f381adb37114427e"} Sep 19 10:00:00.768308 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:00.768275 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vh2wm" event={"ID":"de2ebace-af53-4786-9206-4d55652249f2","Type":"ContainerStarted","Data":"897ae51778c3b792ff9c5cfc5542fde7e1f66576924819ac7235332548d6b389"} Sep 19 10:00:00.768746 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:00.768391 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vh2wm" Sep 19 10:00:00.786144 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:00.786096 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vh2wm" podStartSLOduration=1.365139087 podStartE2EDuration="6.786080348s" totalImagesPullingTime="5.420941261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 09:59:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:00:00.784337976 +0000 UTC m=+500.585121273" watchObservedRunningTime="2026-09-19 10:00:00.786080348 +0000 UTC m=+500.586863645" Sep 19 10:00:06.801537 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:06.801505 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vh2wm" Sep 19 10:00:07.505160 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:07.505127 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-6zk9z"] Sep 19 10:00:07.511259 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:07.511232 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-6zk9z" Sep 19 10:00:07.513401 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:07.513382 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Sep 19 10:00:07.516465 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:07.516443 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-6zk9z"] Sep 19 10:00:07.569665 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:07.569629 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-6zk9z"] Sep 19 10:00:07.569875 ip-10-0-142-110 kubenswrapper[2579]: E0919 10:00:07.569855 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-58wgg tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-6zk9z" podUID="88a35fbb-fc40-4655-966c-c5f2f094f21a" Sep 19 10:00:07.575272 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:07.575243 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/88a35fbb-fc40-4655-966c-c5f2f094f21a-tls-cert\") pod \"authorino-6d4dfc649f-6zk9z\" (UID: \"88a35fbb-fc40-4655-966c-c5f2f094f21a\") " pod="kuadrant-system/authorino-6d4dfc649f-6zk9z" Sep 19 10:00:07.575406 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:07.575291 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58wgg\" (UniqueName: \"kubernetes.io/projected/88a35fbb-fc40-4655-966c-c5f2f094f21a-kube-api-access-58wgg\") pod \"authorino-6d4dfc649f-6zk9z\" (UID: \"88a35fbb-fc40-4655-966c-c5f2f094f21a\") " pod="kuadrant-system/authorino-6d4dfc649f-6zk9z" Sep 19 10:00:07.596163 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:07.596132 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d8b7696df-xqvnp"] Sep 19 10:00:07.600414 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:07.600394 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d8b7696df-xqvnp" Sep 19 10:00:07.608831 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:07.608804 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d8b7696df-xqvnp"] Sep 19 10:00:07.676156 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:07.676123 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h846d\" (UniqueName: \"kubernetes.io/projected/5af589b2-5ce4-44c2-8848-b042a02e226d-kube-api-access-h846d\") pod \"authorino-d8b7696df-xqvnp\" (UID: \"5af589b2-5ce4-44c2-8848-b042a02e226d\") " pod="kuadrant-system/authorino-d8b7696df-xqvnp" Sep 19 10:00:07.676331 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:07.676177 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/88a35fbb-fc40-4655-966c-c5f2f094f21a-tls-cert\") pod \"authorino-6d4dfc649f-6zk9z\" (UID: \"88a35fbb-fc40-4655-966c-c5f2f094f21a\") " pod="kuadrant-system/authorino-6d4dfc649f-6zk9z" Sep 19 10:00:07.676331 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:07.676201 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5af589b2-5ce4-44c2-8848-b042a02e226d-tls-cert\") pod \"authorino-d8b7696df-xqvnp\" (UID: \"5af589b2-5ce4-44c2-8848-b042a02e226d\") " pod="kuadrant-system/authorino-d8b7696df-xqvnp" Sep 19 10:00:07.676331 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:07.676225 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58wgg\" (UniqueName: \"kubernetes.io/projected/88a35fbb-fc40-4655-966c-c5f2f094f21a-kube-api-access-58wgg\") pod \"authorino-6d4dfc649f-6zk9z\" (UID: \"88a35fbb-fc40-4655-966c-c5f2f094f21a\") " pod="kuadrant-system/authorino-6d4dfc649f-6zk9z" Sep 19 10:00:07.678778 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:07.678750 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/88a35fbb-fc40-4655-966c-c5f2f094f21a-tls-cert\") pod \"authorino-6d4dfc649f-6zk9z\" (UID: \"88a35fbb-fc40-4655-966c-c5f2f094f21a\") " pod="kuadrant-system/authorino-6d4dfc649f-6zk9z" Sep 19 10:00:07.684086 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:07.684058 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58wgg\" (UniqueName: \"kubernetes.io/projected/88a35fbb-fc40-4655-966c-c5f2f094f21a-kube-api-access-58wgg\") pod \"authorino-6d4dfc649f-6zk9z\" (UID: \"88a35fbb-fc40-4655-966c-c5f2f094f21a\") " pod="kuadrant-system/authorino-6d4dfc649f-6zk9z" Sep 19 10:00:07.777023 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:07.776931 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h846d\" (UniqueName: \"kubernetes.io/projected/5af589b2-5ce4-44c2-8848-b042a02e226d-kube-api-access-h846d\") pod \"authorino-d8b7696df-xqvnp\" (UID: \"5af589b2-5ce4-44c2-8848-b042a02e226d\") " pod="kuadrant-system/authorino-d8b7696df-xqvnp" Sep 19 10:00:07.777023 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:07.777016 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5af589b2-5ce4-44c2-8848-b042a02e226d-tls-cert\") pod \"authorino-d8b7696df-xqvnp\" (UID: \"5af589b2-5ce4-44c2-8848-b042a02e226d\") " pod="kuadrant-system/authorino-d8b7696df-xqvnp" Sep 19 10:00:07.779782 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:07.779757 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5af589b2-5ce4-44c2-8848-b042a02e226d-tls-cert\") pod \"authorino-d8b7696df-xqvnp\" (UID: \"5af589b2-5ce4-44c2-8848-b042a02e226d\") " pod="kuadrant-system/authorino-d8b7696df-xqvnp" Sep 19 10:00:07.785419 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:07.785395 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h846d\" (UniqueName: \"kubernetes.io/projected/5af589b2-5ce4-44c2-8848-b042a02e226d-kube-api-access-h846d\") pod \"authorino-d8b7696df-xqvnp\" (UID: \"5af589b2-5ce4-44c2-8848-b042a02e226d\") " pod="kuadrant-system/authorino-d8b7696df-xqvnp" Sep 19 10:00:07.798898 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:07.798875 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-6zk9z" Sep 19 10:00:07.805867 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:07.805847 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-6zk9z" Sep 19 10:00:07.878222 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:07.878188 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58wgg\" (UniqueName: \"kubernetes.io/projected/88a35fbb-fc40-4655-966c-c5f2f094f21a-kube-api-access-58wgg\") pod \"88a35fbb-fc40-4655-966c-c5f2f094f21a\" (UID: \"88a35fbb-fc40-4655-966c-c5f2f094f21a\") " Sep 19 10:00:07.878376 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:07.878233 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/88a35fbb-fc40-4655-966c-c5f2f094f21a-tls-cert\") pod \"88a35fbb-fc40-4655-966c-c5f2f094f21a\" (UID: \"88a35fbb-fc40-4655-966c-c5f2f094f21a\") " Sep 19 10:00:07.880474 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:07.880444 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88a35fbb-fc40-4655-966c-c5f2f094f21a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "88a35fbb-fc40-4655-966c-c5f2f094f21a" (UID: "88a35fbb-fc40-4655-966c-c5f2f094f21a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 10:00:07.880595 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:07.880521 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88a35fbb-fc40-4655-966c-c5f2f094f21a-kube-api-access-58wgg" (OuterVolumeSpecName: "kube-api-access-58wgg") pod "88a35fbb-fc40-4655-966c-c5f2f094f21a" (UID: "88a35fbb-fc40-4655-966c-c5f2f094f21a"). InnerVolumeSpecName "kube-api-access-58wgg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 10:00:07.910335 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:07.910307 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d8b7696df-xqvnp" Sep 19 10:00:07.979083 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:07.979057 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58wgg\" (UniqueName: \"kubernetes.io/projected/88a35fbb-fc40-4655-966c-c5f2f094f21a-kube-api-access-58wgg\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 19 10:00:07.979083 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:07.979082 2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/88a35fbb-fc40-4655-966c-c5f2f094f21a-tls-cert\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 19 10:00:08.178996 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:08.178966 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d8b7696df-xqvnp"] Sep 19 10:00:08.181743 ip-10-0-142-110 kubenswrapper[2579]: W0919 10:00:08.181724 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5af589b2_5ce4_44c2_8848_b042a02e226d.slice/crio-630afb01e66b0c876f4e1e061ab89355e6fb3bb7958ddf5a08a098e4c20d9b81 WatchSource:0}: Error finding container 630afb01e66b0c876f4e1e061ab89355e6fb3bb7958ddf5a08a098e4c20d9b81: Status 404 returned error can't find the container with id 630afb01e66b0c876f4e1e061ab89355e6fb3bb7958ddf5a08a098e4c20d9b81 Sep 19 10:00:08.804567 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:08.804539 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-6zk9z" Sep 19 10:00:08.804763 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:08.804538 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d8b7696df-xqvnp" event={"ID":"5af589b2-5ce4-44c2-8848-b042a02e226d","Type":"ContainerStarted","Data":"630afb01e66b0c876f4e1e061ab89355e6fb3bb7958ddf5a08a098e4c20d9b81"} Sep 19 10:00:08.830054 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:08.830022 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-6zk9z"] Sep 19 10:00:08.833855 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:08.833834 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-6zk9z"] Sep 19 10:00:10.701369 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:10.701335 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88a35fbb-fc40-4655-966c-c5f2f094f21a" path="/var/lib/kubelet/pods/88a35fbb-fc40-4655-966c-c5f2f094f21a/volumes" Sep 19 10:00:10.814765 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:10.814729 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d8b7696df-xqvnp" event={"ID":"5af589b2-5ce4-44c2-8848-b042a02e226d","Type":"ContainerStarted","Data":"18c938245b91938d93681709334c066bb957f15280403eb6c581ebe61a506fed"} Sep 19 10:00:10.830251 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:10.830199 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-d8b7696df-xqvnp" podStartSLOduration=1.6824019890000002 podStartE2EDuration="3.830184033s" totalImagesPullingTime="2.147782044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:00:10.828685885 +0000 UTC m=+510.629469182" watchObservedRunningTime="2026-09-19 10:00:10.830184033 +0000 UTC m=+510.630967346" Sep 19 10:00:10.853790 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:10.853758 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-nw7nl"] Sep 19 10:00:10.853978 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:10.853953 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-nw7nl" podUID="91d4e36e-c5b4-4a0b-9ad9-0425131b0e18" containerName="authorino" containerID="cri-o://9c363ab83ad1accd1288a1f5542889e6d7ef9be761b3fcc4b20e5800781c1375" gracePeriod=30 Sep 19 10:00:11.094513 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:11.094486 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-nw7nl" Sep 19 10:00:11.205288 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:11.205255 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnmnr\" (UniqueName: \"kubernetes.io/projected/91d4e36e-c5b4-4a0b-9ad9-0425131b0e18-kube-api-access-xnmnr\") pod \"91d4e36e-c5b4-4a0b-9ad9-0425131b0e18\" (UID: \"91d4e36e-c5b4-4a0b-9ad9-0425131b0e18\") " Sep 19 10:00:11.207455 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:11.207428 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91d4e36e-c5b4-4a0b-9ad9-0425131b0e18-kube-api-access-xnmnr" (OuterVolumeSpecName: "kube-api-access-xnmnr") pod "91d4e36e-c5b4-4a0b-9ad9-0425131b0e18" (UID: "91d4e36e-c5b4-4a0b-9ad9-0425131b0e18"). InnerVolumeSpecName "kube-api-access-xnmnr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 10:00:11.306159 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:11.306069 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnmnr\" (UniqueName: \"kubernetes.io/projected/91d4e36e-c5b4-4a0b-9ad9-0425131b0e18-kube-api-access-xnmnr\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 19 10:00:11.821796 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:11.821763 2579 generic.go:356] "Generic (PLEG): container finished" podID="91d4e36e-c5b4-4a0b-9ad9-0425131b0e18" containerID="9c363ab83ad1accd1288a1f5542889e6d7ef9be761b3fcc4b20e5800781c1375" exitCode=0 Sep 19 10:00:11.822218 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:11.821806 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-nw7nl" Sep 19 10:00:11.822218 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:11.821841 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-nw7nl" event={"ID":"91d4e36e-c5b4-4a0b-9ad9-0425131b0e18","Type":"ContainerDied","Data":"9c363ab83ad1accd1288a1f5542889e6d7ef9be761b3fcc4b20e5800781c1375"} Sep 19 10:00:11.822218 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:11.821894 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-nw7nl" event={"ID":"91d4e36e-c5b4-4a0b-9ad9-0425131b0e18","Type":"ContainerDied","Data":"6b276329b6af73ea36464212e9b3ea4cca7f044e8361120a32957c6e3fee25a7"} Sep 19 10:00:11.822218 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:11.821913 2579 scope.go:117] "RemoveContainer" containerID="9c363ab83ad1accd1288a1f5542889e6d7ef9be761b3fcc4b20e5800781c1375" Sep 19 10:00:11.832025 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:11.832007 2579 scope.go:117] "RemoveContainer" containerID="9c363ab83ad1accd1288a1f5542889e6d7ef9be761b3fcc4b20e5800781c1375" Sep 19 10:00:11.832345 ip-10-0-142-110 kubenswrapper[2579]: E0919 10:00:11.832325 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c363ab83ad1accd1288a1f5542889e6d7ef9be761b3fcc4b20e5800781c1375\": container with ID starting with 9c363ab83ad1accd1288a1f5542889e6d7ef9be761b3fcc4b20e5800781c1375 not found: ID does not exist" containerID="9c363ab83ad1accd1288a1f5542889e6d7ef9be761b3fcc4b20e5800781c1375" Sep 19 10:00:11.832422 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:11.832355 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c363ab83ad1accd1288a1f5542889e6d7ef9be761b3fcc4b20e5800781c1375"} err="failed to get container status \"9c363ab83ad1accd1288a1f5542889e6d7ef9be761b3fcc4b20e5800781c1375\": rpc error: code = NotFound desc = could not find container \"9c363ab83ad1accd1288a1f5542889e6d7ef9be761b3fcc4b20e5800781c1375\": container with ID starting with 9c363ab83ad1accd1288a1f5542889e6d7ef9be761b3fcc4b20e5800781c1375 not found: ID does not exist" Sep 19 10:00:11.842238 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:11.842215 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-nw7nl"] Sep 19 10:00:11.845754 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:11.845732 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-nw7nl"] Sep 19 10:00:12.700206 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:12.700175 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91d4e36e-c5b4-4a0b-9ad9-0425131b0e18" path="/var/lib/kubelet/pods/91d4e36e-c5b4-4a0b-9ad9-0425131b0e18/volumes" Sep 19 10:00:52.922146 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:52.922107 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-9rg7n"] Sep 19 10:00:52.922622 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:52.922603 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91d4e36e-c5b4-4a0b-9ad9-0425131b0e18" containerName="authorino" Sep 19 10:00:52.922664 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:52.922627 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="91d4e36e-c5b4-4a0b-9ad9-0425131b0e18" containerName="authorino" Sep 19 10:00:52.922745 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:52.922733 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="91d4e36e-c5b4-4a0b-9ad9-0425131b0e18" containerName="authorino" Sep 19 10:00:52.927420 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:52.927399 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-9rg7n" Sep 19 10:00:52.929930 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:52.929902 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 19 10:00:52.930061 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:52.930035 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-56nmr\"" Sep 19 10:00:52.936878 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:52.936857 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-9rg7n"] Sep 19 10:00:52.939676 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:52.939647 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2rm4\" (UniqueName: \"kubernetes.io/projected/4f5da240-214c-4f17-8bff-f97bb636c595-kube-api-access-c2rm4\") pod \"payload-processing-5b54b7fbb7-9rg7n\" (UID: \"4f5da240-214c-4f17-8bff-f97bb636c595\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9rg7n" Sep 19 10:00:52.939904 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:52.939877 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f5da240-214c-4f17-8bff-f97bb636c595-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-9rg7n\" (UID: \"4f5da240-214c-4f17-8bff-f97bb636c595\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9rg7n" Sep 19 10:00:53.041138 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:53.041077 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f5da240-214c-4f17-8bff-f97bb636c595-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-9rg7n\" (UID: \"4f5da240-214c-4f17-8bff-f97bb636c595\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9rg7n" Sep 19 10:00:53.041138 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:53.041148 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2rm4\" (UniqueName: \"kubernetes.io/projected/4f5da240-214c-4f17-8bff-f97bb636c595-kube-api-access-c2rm4\") pod \"payload-processing-5b54b7fbb7-9rg7n\" (UID: \"4f5da240-214c-4f17-8bff-f97bb636c595\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9rg7n" Sep 19 10:00:53.041795 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:53.041764 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f5da240-214c-4f17-8bff-f97bb636c595-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-9rg7n\" (UID: \"4f5da240-214c-4f17-8bff-f97bb636c595\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9rg7n" Sep 19 10:00:53.056791 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:53.056755 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2rm4\" (UniqueName: \"kubernetes.io/projected/4f5da240-214c-4f17-8bff-f97bb636c595-kube-api-access-c2rm4\") pod \"payload-processing-5b54b7fbb7-9rg7n\" (UID: \"4f5da240-214c-4f17-8bff-f97bb636c595\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9rg7n" Sep 19 10:00:53.242092 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:53.242046 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-9rg7n" Sep 19 10:00:53.514638 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:53.514597 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-9rg7n"] Sep 19 10:00:53.517167 ip-10-0-142-110 kubenswrapper[2579]: W0919 10:00:53.517139 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f5da240_214c_4f17_8bff_f97bb636c595.slice/crio-daf39a60ceab403aa689837cc43afa95f16dbae69b9092c423aaf28b6cdc9e27 WatchSource:0}: Error finding container daf39a60ceab403aa689837cc43afa95f16dbae69b9092c423aaf28b6cdc9e27: Status 404 returned error can't find the container with id daf39a60ceab403aa689837cc43afa95f16dbae69b9092c423aaf28b6cdc9e27 Sep 19 10:00:54.008780 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:54.008742 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-9rg7n" event={"ID":"4f5da240-214c-4f17-8bff-f97bb636c595","Type":"ContainerStarted","Data":"daf39a60ceab403aa689837cc43afa95f16dbae69b9092c423aaf28b6cdc9e27"} Sep 19 10:00:55.019112 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:55.019074 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-9rg7n" event={"ID":"4f5da240-214c-4f17-8bff-f97bb636c595","Type":"ContainerStarted","Data":"35988b6f946770e3410bad8e13b3b6fd491d6e09814f1691f53e2a9ff543ba82"} Sep 19 10:00:55.019522 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:55.019219 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-9rg7n" Sep 19 10:00:55.038024 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:00:55.037970 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-9rg7n" podStartSLOduration=1.672095042 podStartE2EDuration="3.037949598s" totalImagesPullingTime="1.365854556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:00:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:00:55.035278631 +0000 UTC m=+554.836061927" watchObservedRunningTime="2026-09-19 10:00:55.037949598 +0000 UTC m=+554.838732898" Sep 19 10:01:06.025888 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:06.025854 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-9rg7n" Sep 19 10:01:09.472084 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:09.469153 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc"] Sep 19 10:01:09.475306 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:09.474447 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc" Sep 19 10:01:09.477631 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:09.477606 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Sep 19 10:01:09.477631 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:09.477625 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 19 10:01:09.477848 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:09.477667 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 19 10:01:09.477848 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:09.477606 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sjfgs\"" Sep 19 10:01:09.481439 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:09.481419 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc"] Sep 19 10:01:09.575216 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:09.575182 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d6f9ee5-47a7-4c6a-9e15-4678835c04d0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc\" (UID: \"5d6f9ee5-47a7-4c6a-9e15-4678835c04d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc" Sep 19 10:01:09.575216 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:09.575219 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs9r8\" (UniqueName: \"kubernetes.io/projected/5d6f9ee5-47a7-4c6a-9e15-4678835c04d0-kube-api-access-xs9r8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc\" (UID: \"5d6f9ee5-47a7-4c6a-9e15-4678835c04d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc" Sep 19 10:01:09.575460 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:09.575239 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d6f9ee5-47a7-4c6a-9e15-4678835c04d0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc\" (UID: \"5d6f9ee5-47a7-4c6a-9e15-4678835c04d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc" Sep 19 10:01:09.575460 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:09.575334 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d6f9ee5-47a7-4c6a-9e15-4678835c04d0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc\" (UID: \"5d6f9ee5-47a7-4c6a-9e15-4678835c04d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc" Sep 19 10:01:09.575460 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:09.575403 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d6f9ee5-47a7-4c6a-9e15-4678835c04d0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc\" (UID: \"5d6f9ee5-47a7-4c6a-9e15-4678835c04d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc" Sep 19 10:01:09.575460 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:09.575429 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d6f9ee5-47a7-4c6a-9e15-4678835c04d0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc\" (UID: \"5d6f9ee5-47a7-4c6a-9e15-4678835c04d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc" Sep 19 10:01:09.676213 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:09.676177 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d6f9ee5-47a7-4c6a-9e15-4678835c04d0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc\" (UID: \"5d6f9ee5-47a7-4c6a-9e15-4678835c04d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc" Sep 19 10:01:09.676213 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:09.676210 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d6f9ee5-47a7-4c6a-9e15-4678835c04d0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc\" (UID: \"5d6f9ee5-47a7-4c6a-9e15-4678835c04d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc" Sep 19 10:01:09.676460 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:09.676242 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d6f9ee5-47a7-4c6a-9e15-4678835c04d0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc\" (UID: \"5d6f9ee5-47a7-4c6a-9e15-4678835c04d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc" Sep 19 10:01:09.676460 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:09.676264 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs9r8\" (UniqueName: \"kubernetes.io/projected/5d6f9ee5-47a7-4c6a-9e15-4678835c04d0-kube-api-access-xs9r8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc\" (UID: \"5d6f9ee5-47a7-4c6a-9e15-4678835c04d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc" Sep 19 10:01:09.676460 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:09.676395 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d6f9ee5-47a7-4c6a-9e15-4678835c04d0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc\" (UID: \"5d6f9ee5-47a7-4c6a-9e15-4678835c04d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc" Sep 19 10:01:09.676630 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:09.676468 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d6f9ee5-47a7-4c6a-9e15-4678835c04d0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc\" (UID: \"5d6f9ee5-47a7-4c6a-9e15-4678835c04d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc" Sep 19 10:01:09.676630 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:09.676614 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d6f9ee5-47a7-4c6a-9e15-4678835c04d0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc\" (UID: \"5d6f9ee5-47a7-4c6a-9e15-4678835c04d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc" Sep 19 10:01:09.676795 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:09.676771 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d6f9ee5-47a7-4c6a-9e15-4678835c04d0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc\" (UID: \"5d6f9ee5-47a7-4c6a-9e15-4678835c04d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc" Sep 19 10:01:09.676877 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:09.676826 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d6f9ee5-47a7-4c6a-9e15-4678835c04d0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc\" (UID: \"5d6f9ee5-47a7-4c6a-9e15-4678835c04d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc" Sep 19 10:01:09.678810 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:09.678779 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d6f9ee5-47a7-4c6a-9e15-4678835c04d0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc\" (UID: \"5d6f9ee5-47a7-4c6a-9e15-4678835c04d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc" Sep 19 10:01:09.678915 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:09.678890 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d6f9ee5-47a7-4c6a-9e15-4678835c04d0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc\" (UID: \"5d6f9ee5-47a7-4c6a-9e15-4678835c04d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc" Sep 19 10:01:09.683858 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:09.683837 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs9r8\" (UniqueName: \"kubernetes.io/projected/5d6f9ee5-47a7-4c6a-9e15-4678835c04d0-kube-api-access-xs9r8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc\" (UID: \"5d6f9ee5-47a7-4c6a-9e15-4678835c04d0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc" Sep 19 10:01:09.786953 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:09.786864 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc" Sep 19 10:01:10.065560 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:10.065472 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc"] Sep 19 10:01:10.068654 ip-10-0-142-110 kubenswrapper[2579]: W0919 10:01:10.068619 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d6f9ee5_47a7_4c6a_9e15_4678835c04d0.slice/crio-8115a7ed3e5f647bfb1d3c600c650edf29cb74f2a3bb52a95af05efcf388c11c WatchSource:0}: Error finding container 8115a7ed3e5f647bfb1d3c600c650edf29cb74f2a3bb52a95af05efcf388c11c: Status 404 returned error can't find the container with id 8115a7ed3e5f647bfb1d3c600c650edf29cb74f2a3bb52a95af05efcf388c11c Sep 19 10:01:10.086923 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:10.086893 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc" event={"ID":"5d6f9ee5-47a7-4c6a-9e15-4678835c04d0","Type":"ContainerStarted","Data":"8115a7ed3e5f647bfb1d3c600c650edf29cb74f2a3bb52a95af05efcf388c11c"} Sep 19 10:01:12.098545 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:12.098507 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc" event={"ID":"5d6f9ee5-47a7-4c6a-9e15-4678835c04d0","Type":"ContainerStarted","Data":"7e11a54b0069e8f61bfef685c30432ca8836d8eeaced064fecb79dbb242dda97"} Sep 19 10:01:12.117728 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:12.117664 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc" podStartSLOduration=2.007437403 podStartE2EDuration="3.117647148s" totalImagesPullingTime="1.110209745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:01:12.116455329 +0000 UTC m=+571.917238627" watchObservedRunningTime="2026-09-19 10:01:12.117647148 +0000 UTC m=+571.918430444" Sep 19 10:01:19.787476 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:19.787436 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc" Sep 19 10:01:19.787878 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:19.787565 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc" Sep 19 10:01:19.802584 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:19.802553 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc" Sep 19 10:01:20.146609 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:20.146531 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc" Sep 19 10:01:40.610031 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:40.610004 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sdnzv_3f1d9116-9add-4252-8f32-cccb1f9ee76f/ovn-acl-logging/0.log" Sep 19 10:01:40.612117 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:01:40.612095 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sdnzv_3f1d9116-9add-4252-8f32-cccb1f9ee76f/ovn-acl-logging/0.log" Sep 19 10:02:49.427893 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:49.427862 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-65b5875748-r9kfv"] Sep 19 10:02:49.431082 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:49.431064 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65b5875748-r9kfv" Sep 19 10:02:49.441818 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:49.441776 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65b5875748-r9kfv"] Sep 19 10:02:49.510832 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:49.510799 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgz8j\" (UniqueName: \"kubernetes.io/projected/5440a7d4-a8b9-4d20-9c44-e3139fdf2e2c-kube-api-access-mgz8j\") pod \"authorino-65b5875748-r9kfv\" (UID: \"5440a7d4-a8b9-4d20-9c44-e3139fdf2e2c\") " pod="kuadrant-system/authorino-65b5875748-r9kfv" Sep 19 10:02:49.510990 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:49.510870 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5440a7d4-a8b9-4d20-9c44-e3139fdf2e2c-tls-cert\") pod \"authorino-65b5875748-r9kfv\" (UID: \"5440a7d4-a8b9-4d20-9c44-e3139fdf2e2c\") " pod="kuadrant-system/authorino-65b5875748-r9kfv" Sep 19 10:02:49.611579 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:49.611551 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5440a7d4-a8b9-4d20-9c44-e3139fdf2e2c-tls-cert\") pod \"authorino-65b5875748-r9kfv\" (UID: \"5440a7d4-a8b9-4d20-9c44-e3139fdf2e2c\") " pod="kuadrant-system/authorino-65b5875748-r9kfv" Sep 19 10:02:49.611777 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:49.611599 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgz8j\" (UniqueName: \"kubernetes.io/projected/5440a7d4-a8b9-4d20-9c44-e3139fdf2e2c-kube-api-access-mgz8j\") pod \"authorino-65b5875748-r9kfv\" (UID: \"5440a7d4-a8b9-4d20-9c44-e3139fdf2e2c\") " pod="kuadrant-system/authorino-65b5875748-r9kfv" Sep 19 10:02:49.614180 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:49.614153 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5440a7d4-a8b9-4d20-9c44-e3139fdf2e2c-tls-cert\") pod \"authorino-65b5875748-r9kfv\" (UID: \"5440a7d4-a8b9-4d20-9c44-e3139fdf2e2c\") " pod="kuadrant-system/authorino-65b5875748-r9kfv" Sep 19 10:02:49.625381 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:49.625350 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgz8j\" (UniqueName: \"kubernetes.io/projected/5440a7d4-a8b9-4d20-9c44-e3139fdf2e2c-kube-api-access-mgz8j\") pod \"authorino-65b5875748-r9kfv\" (UID: \"5440a7d4-a8b9-4d20-9c44-e3139fdf2e2c\") " pod="kuadrant-system/authorino-65b5875748-r9kfv" Sep 19 10:02:49.740375 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:49.740292 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65b5875748-r9kfv" Sep 19 10:02:50.015809 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:50.015782 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65b5875748-r9kfv"] Sep 19 10:02:50.018609 ip-10-0-142-110 kubenswrapper[2579]: W0919 10:02:50.018582 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5440a7d4_a8b9_4d20_9c44_e3139fdf2e2c.slice/crio-ece22b954008c6d349e055d86dedc38c760662f04dff95a1de4c5cdd3d5a4283 WatchSource:0}: Error finding container ece22b954008c6d349e055d86dedc38c760662f04dff95a1de4c5cdd3d5a4283: Status 404 returned error can't find the container with id ece22b954008c6d349e055d86dedc38c760662f04dff95a1de4c5cdd3d5a4283 Sep 19 10:02:50.020324 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:50.020305 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 19 10:02:50.532397 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:50.532360 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65b5875748-r9kfv" event={"ID":"5440a7d4-a8b9-4d20-9c44-e3139fdf2e2c","Type":"ContainerStarted","Data":"ece22b954008c6d349e055d86dedc38c760662f04dff95a1de4c5cdd3d5a4283"} Sep 19 10:02:51.539516 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:51.539478 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65b5875748-r9kfv" event={"ID":"5440a7d4-a8b9-4d20-9c44-e3139fdf2e2c","Type":"ContainerStarted","Data":"54bbd6b9dba3f7830bfaf27be111a3677a10e7466ebef74a8d86f8958e49643f"} Sep 19 10:02:51.591357 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:51.591299 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-65b5875748-r9kfv" podStartSLOduration=1.745267955 podStartE2EDuration="2.591278645s" totalImagesPullingTime="846.01069ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:02:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:02:51.560397539 +0000 UTC m=+671.361180837" watchObservedRunningTime="2026-09-19 10:02:51.591278645 +0000 UTC m=+671.392061945" Sep 19 10:02:51.591719 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:51.591686 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d8b7696df-xqvnp"] Sep 19 10:02:51.591894 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:51.591874 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-d8b7696df-xqvnp" podUID="5af589b2-5ce4-44c2-8848-b042a02e226d" containerName="authorino" containerID="cri-o://18c938245b91938d93681709334c066bb957f15280403eb6c581ebe61a506fed" gracePeriod=30 Sep 19 10:02:51.845508 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:51.845483 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d8b7696df-xqvnp" Sep 19 10:02:51.930422 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:51.930383 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5af589b2-5ce4-44c2-8848-b042a02e226d-tls-cert\") pod \"5af589b2-5ce4-44c2-8848-b042a02e226d\" (UID: \"5af589b2-5ce4-44c2-8848-b042a02e226d\") " Sep 19 10:02:51.930422 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:51.930422 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h846d\" (UniqueName: \"kubernetes.io/projected/5af589b2-5ce4-44c2-8848-b042a02e226d-kube-api-access-h846d\") pod \"5af589b2-5ce4-44c2-8848-b042a02e226d\" (UID: \"5af589b2-5ce4-44c2-8848-b042a02e226d\") " Sep 19 10:02:51.930834 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:51.930806 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-65dd9b4479-twn9b"] Sep 19 10:02:51.931188 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:51.931168 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5af589b2-5ce4-44c2-8848-b042a02e226d" containerName="authorino" Sep 19 10:02:51.931188 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:51.931188 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5af589b2-5ce4-44c2-8848-b042a02e226d" containerName="authorino" Sep 19 10:02:51.931468 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:51.931261 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5af589b2-5ce4-44c2-8848-b042a02e226d" containerName="authorino" Sep 19 10:02:51.932988 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:51.932963 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5af589b2-5ce4-44c2-8848-b042a02e226d-kube-api-access-h846d" (OuterVolumeSpecName: "kube-api-access-h846d") pod "5af589b2-5ce4-44c2-8848-b042a02e226d" (UID: "5af589b2-5ce4-44c2-8848-b042a02e226d"). InnerVolumeSpecName "kube-api-access-h846d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 10:02:51.934355 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:51.934339 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-65dd9b4479-twn9b" Sep 19 10:02:51.937101 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:51.937080 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\"" Sep 19 10:02:51.938273 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:51.938251 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-7tkj8\"" Sep 19 10:02:51.941868 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:51.941843 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5af589b2-5ce4-44c2-8848-b042a02e226d-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "5af589b2-5ce4-44c2-8848-b042a02e226d" (UID: "5af589b2-5ce4-44c2-8848-b042a02e226d"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 19 10:02:51.950109 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:51.950081 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-65dd9b4479-twn9b"] Sep 19 10:02:52.031462 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:52.031418 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kzgc\" (UniqueName: \"kubernetes.io/projected/cd8d5a07-635e-46eb-b132-d5c2540dd59b-kube-api-access-4kzgc\") pod \"ai-gateway-controller-65dd9b4479-twn9b\" (UID: \"cd8d5a07-635e-46eb-b132-d5c2540dd59b\") " pod="opendatahub/ai-gateway-controller-65dd9b4479-twn9b" Sep 19 10:02:52.031643 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:52.031557 2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5af589b2-5ce4-44c2-8848-b042a02e226d-tls-cert\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 19 10:02:52.031643 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:52.031592 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h846d\" (UniqueName: \"kubernetes.io/projected/5af589b2-5ce4-44c2-8848-b042a02e226d-kube-api-access-h846d\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 19 10:02:52.132743 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:52.132626 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kzgc\" (UniqueName: \"kubernetes.io/projected/cd8d5a07-635e-46eb-b132-d5c2540dd59b-kube-api-access-4kzgc\") pod \"ai-gateway-controller-65dd9b4479-twn9b\" (UID: \"cd8d5a07-635e-46eb-b132-d5c2540dd59b\") " pod="opendatahub/ai-gateway-controller-65dd9b4479-twn9b" Sep 19 10:02:52.141955 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:52.141921 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kzgc\" (UniqueName: \"kubernetes.io/projected/cd8d5a07-635e-46eb-b132-d5c2540dd59b-kube-api-access-4kzgc\") pod \"ai-gateway-controller-65dd9b4479-twn9b\" (UID: \"cd8d5a07-635e-46eb-b132-d5c2540dd59b\") " pod="opendatahub/ai-gateway-controller-65dd9b4479-twn9b" Sep 19 10:02:52.262120 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:52.262084 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-65dd9b4479-twn9b" Sep 19 10:02:52.545463 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:52.545419 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-65dd9b4479-twn9b"] Sep 19 10:02:52.552663 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:52.552631 2579 generic.go:356] "Generic (PLEG): container finished" podID="5af589b2-5ce4-44c2-8848-b042a02e226d" containerID="18c938245b91938d93681709334c066bb957f15280403eb6c581ebe61a506fed" exitCode=0 Sep 19 10:02:52.552808 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:52.552684 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d8b7696df-xqvnp" Sep 19 10:02:52.552808 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:52.552730 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d8b7696df-xqvnp" event={"ID":"5af589b2-5ce4-44c2-8848-b042a02e226d","Type":"ContainerDied","Data":"18c938245b91938d93681709334c066bb957f15280403eb6c581ebe61a506fed"} Sep 19 10:02:52.552808 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:52.552779 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d8b7696df-xqvnp" event={"ID":"5af589b2-5ce4-44c2-8848-b042a02e226d","Type":"ContainerDied","Data":"630afb01e66b0c876f4e1e061ab89355e6fb3bb7958ddf5a08a098e4c20d9b81"} Sep 19 10:02:52.552808 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:52.552805 2579 scope.go:117] "RemoveContainer" containerID="18c938245b91938d93681709334c066bb957f15280403eb6c581ebe61a506fed" Sep 19 10:02:52.562491 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:52.562473 2579 scope.go:117] "RemoveContainer" containerID="18c938245b91938d93681709334c066bb957f15280403eb6c581ebe61a506fed" Sep 19 10:02:52.562921 ip-10-0-142-110 kubenswrapper[2579]: E0919 10:02:52.562900 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18c938245b91938d93681709334c066bb957f15280403eb6c581ebe61a506fed\": container with ID starting with 18c938245b91938d93681709334c066bb957f15280403eb6c581ebe61a506fed not found: ID does not exist" containerID="18c938245b91938d93681709334c066bb957f15280403eb6c581ebe61a506fed" Sep 19 10:02:52.563000 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:52.562931 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18c938245b91938d93681709334c066bb957f15280403eb6c581ebe61a506fed"} err="failed to get container status \"18c938245b91938d93681709334c066bb957f15280403eb6c581ebe61a506fed\": rpc error: code = NotFound desc = could not find container \"18c938245b91938d93681709334c066bb957f15280403eb6c581ebe61a506fed\": container with ID starting with 18c938245b91938d93681709334c066bb957f15280403eb6c581ebe61a506fed not found: ID does not exist" Sep 19 10:02:52.580509 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:52.580474 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d8b7696df-xqvnp"] Sep 19 10:02:52.593692 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:52.593665 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-d8b7696df-xqvnp"] Sep 19 10:02:52.701014 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:52.700983 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5af589b2-5ce4-44c2-8848-b042a02e226d" path="/var/lib/kubelet/pods/5af589b2-5ce4-44c2-8848-b042a02e226d/volumes" Sep 19 10:02:53.562215 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:53.562173 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-65dd9b4479-twn9b" event={"ID":"cd8d5a07-635e-46eb-b132-d5c2540dd59b","Type":"ContainerStarted","Data":"c59f01e89e8f49664fc6a261cb84285813da47878b908315b0598b67fba9a986"} Sep 19 10:02:55.575548 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:55.575505 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-65dd9b4479-twn9b" event={"ID":"cd8d5a07-635e-46eb-b132-d5c2540dd59b","Type":"ContainerStarted","Data":"445659a746b26d2ca88fd3afebb20e88a45a5f665560d864a27bdfa3bc7fff20"} Sep 19 10:02:55.575962 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:55.575617 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-65dd9b4479-twn9b" Sep 19 10:02:55.612080 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:02:55.612034 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-65dd9b4479-twn9b" podStartSLOduration=2.058435049 podStartE2EDuration="4.61201848s" totalImagesPullingTime="2.553583431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:02:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:02:55.601828843 +0000 UTC m=+675.402612152" watchObservedRunningTime="2026-09-19 10:02:55.61201848 +0000 UTC m=+675.412801801" Sep 19 10:03:06.582044 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:06.582010 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-65dd9b4479-twn9b" Sep 19 10:03:06.768599 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:06.768562 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-5fbc954fb5-s87tn"] Sep 19 10:03:06.774970 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:06.774942 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5fbc954fb5-s87tn" Sep 19 10:03:06.783523 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:06.783496 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-5fbc954fb5-s87tn"] Sep 19 10:03:06.853568 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:06.853486 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf9wr\" (UniqueName: \"kubernetes.io/projected/0a32e689-6209-4b8e-868e-9b7ff487b3db-kube-api-access-vf9wr\") pod \"ai-gateway-controller-5fbc954fb5-s87tn\" (UID: \"0a32e689-6209-4b8e-868e-9b7ff487b3db\") " pod="opendatahub/ai-gateway-controller-5fbc954fb5-s87tn" Sep 19 10:03:06.954223 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:06.954185 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf9wr\" (UniqueName: \"kubernetes.io/projected/0a32e689-6209-4b8e-868e-9b7ff487b3db-kube-api-access-vf9wr\") pod \"ai-gateway-controller-5fbc954fb5-s87tn\" (UID: \"0a32e689-6209-4b8e-868e-9b7ff487b3db\") " pod="opendatahub/ai-gateway-controller-5fbc954fb5-s87tn" Sep 19 10:03:06.964229 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:06.964201 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf9wr\" (UniqueName: \"kubernetes.io/projected/0a32e689-6209-4b8e-868e-9b7ff487b3db-kube-api-access-vf9wr\") pod \"ai-gateway-controller-5fbc954fb5-s87tn\" (UID: \"0a32e689-6209-4b8e-868e-9b7ff487b3db\") " pod="opendatahub/ai-gateway-controller-5fbc954fb5-s87tn" Sep 19 10:03:07.086663 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:07.086628 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5fbc954fb5-s87tn" Sep 19 10:03:07.359228 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:07.359206 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-5fbc954fb5-s87tn"] Sep 19 10:03:07.361710 ip-10-0-142-110 kubenswrapper[2579]: W0919 10:03:07.361670 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a32e689_6209_4b8e_868e_9b7ff487b3db.slice/crio-41ea76dcb9f84bdef52495f8794acdf065d2d0e86794a099fa9776e9389c29ab WatchSource:0}: Error finding container 41ea76dcb9f84bdef52495f8794acdf065d2d0e86794a099fa9776e9389c29ab: Status 404 returned error can't find the container with id 41ea76dcb9f84bdef52495f8794acdf065d2d0e86794a099fa9776e9389c29ab Sep 19 10:03:07.632769 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:07.632731 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5fbc954fb5-s87tn" event={"ID":"0a32e689-6209-4b8e-868e-9b7ff487b3db","Type":"ContainerStarted","Data":"41ea76dcb9f84bdef52495f8794acdf065d2d0e86794a099fa9776e9389c29ab"} Sep 19 10:03:08.638841 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:08.638803 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5fbc954fb5-s87tn" event={"ID":"0a32e689-6209-4b8e-868e-9b7ff487b3db","Type":"ContainerStarted","Data":"5655610bc40e89990901e960e560cd3e67915b559ea78f95f9972a2d22a6881b"} Sep 19 10:03:08.639271 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:08.638870 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-5fbc954fb5-s87tn" Sep 19 10:03:08.660634 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:08.660581 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-5fbc954fb5-s87tn" podStartSLOduration=2.284185332 podStartE2EDuration="2.660564713s" totalImagesPullingTime="376.379381ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:03:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:03:08.658003954 +0000 UTC m=+688.458787249" watchObservedRunningTime="2026-09-19 10:03:08.660564713 +0000 UTC m=+688.461348009" Sep 19 10:03:19.646010 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:19.645977 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-5fbc954fb5-s87tn" Sep 19 10:03:19.709372 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:19.709339 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-65dd9b4479-twn9b"] Sep 19 10:03:19.709539 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:19.709507 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/ai-gateway-controller-65dd9b4479-twn9b" podUID="cd8d5a07-635e-46eb-b132-d5c2540dd59b" containerName="manager" containerID="cri-o://445659a746b26d2ca88fd3afebb20e88a45a5f665560d864a27bdfa3bc7fff20" gracePeriod=30 Sep 19 10:03:19.956573 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:19.956554 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-65dd9b4479-twn9b" Sep 19 10:03:20.058850 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:20.058822 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kzgc\" (UniqueName: \"kubernetes.io/projected/cd8d5a07-635e-46eb-b132-d5c2540dd59b-kube-api-access-4kzgc\") pod \"cd8d5a07-635e-46eb-b132-d5c2540dd59b\" (UID: \"cd8d5a07-635e-46eb-b132-d5c2540dd59b\") " Sep 19 10:03:20.061028 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:20.061007 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd8d5a07-635e-46eb-b132-d5c2540dd59b-kube-api-access-4kzgc" (OuterVolumeSpecName: "kube-api-access-4kzgc") pod "cd8d5a07-635e-46eb-b132-d5c2540dd59b" (UID: "cd8d5a07-635e-46eb-b132-d5c2540dd59b"). InnerVolumeSpecName "kube-api-access-4kzgc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 10:03:20.160219 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:20.160196 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kzgc\" (UniqueName: \"kubernetes.io/projected/cd8d5a07-635e-46eb-b132-d5c2540dd59b-kube-api-access-4kzgc\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 19 10:03:20.372012 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:20.371934 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-9rg7n"] Sep 19 10:03:20.372163 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:20.372139 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-5b54b7fbb7-9rg7n" podUID="4f5da240-214c-4f17-8bff-f97bb636c595" containerName="payload-processing" containerID="cri-o://35988b6f946770e3410bad8e13b3b6fd491d6e09814f1691f53e2a9ff543ba82" gracePeriod=30 Sep 19 10:03:20.603043 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:20.603016 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-9rg7n" Sep 19 10:03:20.663546 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:20.663479 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2rm4\" (UniqueName: \"kubernetes.io/projected/4f5da240-214c-4f17-8bff-f97bb636c595-kube-api-access-c2rm4\") pod \"4f5da240-214c-4f17-8bff-f97bb636c595\" (UID: \"4f5da240-214c-4f17-8bff-f97bb636c595\") " Sep 19 10:03:20.663962 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:20.663554 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f5da240-214c-4f17-8bff-f97bb636c595-plugins-config-volume\") pod \"4f5da240-214c-4f17-8bff-f97bb636c595\" (UID: \"4f5da240-214c-4f17-8bff-f97bb636c595\") " Sep 19 10:03:20.663962 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:20.663911 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f5da240-214c-4f17-8bff-f97bb636c595-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4f5da240-214c-4f17-8bff-f97bb636c595" (UID: "4f5da240-214c-4f17-8bff-f97bb636c595"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 19 10:03:20.665730 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:20.665686 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f5da240-214c-4f17-8bff-f97bb636c595-kube-api-access-c2rm4" (OuterVolumeSpecName: "kube-api-access-c2rm4") pod "4f5da240-214c-4f17-8bff-f97bb636c595" (UID: "4f5da240-214c-4f17-8bff-f97bb636c595"). InnerVolumeSpecName "kube-api-access-c2rm4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 19 10:03:20.694198 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:20.694172 2579 generic.go:356] "Generic (PLEG): container finished" podID="cd8d5a07-635e-46eb-b132-d5c2540dd59b" containerID="445659a746b26d2ca88fd3afebb20e88a45a5f665560d864a27bdfa3bc7fff20" exitCode=0 Sep 19 10:03:20.695679 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:20.695653 2579 generic.go:356] "Generic (PLEG): container finished" podID="4f5da240-214c-4f17-8bff-f97bb636c595" containerID="35988b6f946770e3410bad8e13b3b6fd491d6e09814f1691f53e2a9ff543ba82" exitCode=0 Sep 19 10:03:20.696155 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:20.696136 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-65dd9b4479-twn9b" Sep 19 10:03:20.696260 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:20.696155 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-9rg7n" Sep 19 10:03:20.701195 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:20.701159 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-65dd9b4479-twn9b" event={"ID":"cd8d5a07-635e-46eb-b132-d5c2540dd59b","Type":"ContainerDied","Data":"445659a746b26d2ca88fd3afebb20e88a45a5f665560d864a27bdfa3bc7fff20"} Sep 19 10:03:20.701304 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:20.701215 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-65dd9b4479-twn9b" event={"ID":"cd8d5a07-635e-46eb-b132-d5c2540dd59b","Type":"ContainerDied","Data":"c59f01e89e8f49664fc6a261cb84285813da47878b908315b0598b67fba9a986"} Sep 19 10:03:20.701304 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:20.701239 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-9rg7n" event={"ID":"4f5da240-214c-4f17-8bff-f97bb636c595","Type":"ContainerDied","Data":"35988b6f946770e3410bad8e13b3b6fd491d6e09814f1691f53e2a9ff543ba82"} Sep 19 10:03:20.701304 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:20.701263 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-9rg7n" event={"ID":"4f5da240-214c-4f17-8bff-f97bb636c595","Type":"ContainerDied","Data":"daf39a60ceab403aa689837cc43afa95f16dbae69b9092c423aaf28b6cdc9e27"} Sep 19 10:03:20.701304 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:20.701293 2579 scope.go:117] "RemoveContainer" containerID="445659a746b26d2ca88fd3afebb20e88a45a5f665560d864a27bdfa3bc7fff20" Sep 19 10:03:20.712943 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:20.712770 2579 scope.go:117] "RemoveContainer" containerID="445659a746b26d2ca88fd3afebb20e88a45a5f665560d864a27bdfa3bc7fff20" Sep 19 10:03:20.713067 ip-10-0-142-110 kubenswrapper[2579]: E0919 10:03:20.713047 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"445659a746b26d2ca88fd3afebb20e88a45a5f665560d864a27bdfa3bc7fff20\": container with ID starting with 445659a746b26d2ca88fd3afebb20e88a45a5f665560d864a27bdfa3bc7fff20 not found: ID does not exist" containerID="445659a746b26d2ca88fd3afebb20e88a45a5f665560d864a27bdfa3bc7fff20" Sep 19 10:03:20.713134 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:20.713074 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"445659a746b26d2ca88fd3afebb20e88a45a5f665560d864a27bdfa3bc7fff20"} err="failed to get container status \"445659a746b26d2ca88fd3afebb20e88a45a5f665560d864a27bdfa3bc7fff20\": rpc error: code = NotFound desc = could not find container \"445659a746b26d2ca88fd3afebb20e88a45a5f665560d864a27bdfa3bc7fff20\": container with ID starting with 445659a746b26d2ca88fd3afebb20e88a45a5f665560d864a27bdfa3bc7fff20 not found: ID does not exist" Sep 19 10:03:20.713134 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:20.713092 2579 scope.go:117] "RemoveContainer" containerID="35988b6f946770e3410bad8e13b3b6fd491d6e09814f1691f53e2a9ff543ba82" Sep 19 10:03:20.721578 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:20.721562 2579 scope.go:117] "RemoveContainer" containerID="35988b6f946770e3410bad8e13b3b6fd491d6e09814f1691f53e2a9ff543ba82" Sep 19 10:03:20.721915 ip-10-0-142-110 kubenswrapper[2579]: E0919 10:03:20.721896 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35988b6f946770e3410bad8e13b3b6fd491d6e09814f1691f53e2a9ff543ba82\": container with ID starting with 35988b6f946770e3410bad8e13b3b6fd491d6e09814f1691f53e2a9ff543ba82 not found: ID does not exist" containerID="35988b6f946770e3410bad8e13b3b6fd491d6e09814f1691f53e2a9ff543ba82" Sep 19 10:03:20.721977 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:20.721924 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35988b6f946770e3410bad8e13b3b6fd491d6e09814f1691f53e2a9ff543ba82"} err="failed to get container status \"35988b6f946770e3410bad8e13b3b6fd491d6e09814f1691f53e2a9ff543ba82\": rpc error: code = NotFound desc = could not find container \"35988b6f946770e3410bad8e13b3b6fd491d6e09814f1691f53e2a9ff543ba82\": container with ID starting with 35988b6f946770e3410bad8e13b3b6fd491d6e09814f1691f53e2a9ff543ba82 not found: ID does not exist" Sep 19 10:03:20.733320 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:20.733298 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-9rg7n"] Sep 19 10:03:20.738778 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:20.738758 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-9rg7n"] Sep 19 10:03:20.760875 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:20.760849 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-65dd9b4479-twn9b"] Sep 19 10:03:20.764737 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:20.764720 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2rm4\" (UniqueName: \"kubernetes.io/projected/4f5da240-214c-4f17-8bff-f97bb636c595-kube-api-access-c2rm4\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 19 10:03:20.764794 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:20.764742 2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f5da240-214c-4f17-8bff-f97bb636c595-plugins-config-volume\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\"" Sep 19 10:03:20.767726 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:20.767692 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/ai-gateway-controller-65dd9b4479-twn9b"] Sep 19 10:03:20.811841 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:20.811819 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-65b5875748-r9kfv_5440a7d4-a8b9-4d20-9c44-e3139fdf2e2c/authorino/0.log" Sep 19 10:03:21.558870 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:21.558837 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-dpwcq"] Sep 19 10:03:21.559164 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:21.559152 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd8d5a07-635e-46eb-b132-d5c2540dd59b" containerName="manager" Sep 19 10:03:21.559213 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:21.559165 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd8d5a07-635e-46eb-b132-d5c2540dd59b" containerName="manager" Sep 19 10:03:21.559213 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:21.559176 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f5da240-214c-4f17-8bff-f97bb636c595" containerName="payload-processing" Sep 19 10:03:21.559213 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:21.559182 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f5da240-214c-4f17-8bff-f97bb636c595" containerName="payload-processing" Sep 19 10:03:21.559304 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:21.559239 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f5da240-214c-4f17-8bff-f97bb636c595" containerName="payload-processing" Sep 19 10:03:21.559304 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:21.559247 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd8d5a07-635e-46eb-b132-d5c2540dd59b" containerName="manager" Sep 19 10:03:21.563680 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:21.563663 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dpwcq" Sep 19 10:03:21.566977 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:21.566949 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-rvcp4\"" Sep 19 10:03:21.567521 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:21.567503 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 19 10:03:21.578771 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:21.578752 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-dpwcq"] Sep 19 10:03:21.640654 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:21.640622 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-trd2r"] Sep 19 10:03:21.643999 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:21.643984 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-trd2r" Sep 19 10:03:21.661506 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:21.661481 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-trd2r"] Sep 19 10:03:21.671809 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:21.671786 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ce1a5fe-1b40-493c-87a5-a13b217839c6-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-dpwcq\" (UID: \"3ce1a5fe-1b40-493c-87a5-a13b217839c6\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dpwcq" Sep 19 10:03:21.672073 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:21.671820 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjdpl\" (UniqueName: \"kubernetes.io/projected/3ce1a5fe-1b40-493c-87a5-a13b217839c6-kube-api-access-wjdpl\") pod \"payload-pre-processing-59fbc47bf8-dpwcq\" (UID: \"3ce1a5fe-1b40-493c-87a5-a13b217839c6\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dpwcq" Sep 19 10:03:21.772759 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:21.772728 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4db82c73-b6f7-43d9-843e-ffb892fdad40-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-trd2r\" (UID: \"4db82c73-b6f7-43d9-843e-ffb892fdad40\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-trd2r" Sep 19 10:03:21.772932 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:21.772786 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ce1a5fe-1b40-493c-87a5-a13b217839c6-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-dpwcq\" (UID: \"3ce1a5fe-1b40-493c-87a5-a13b217839c6\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dpwcq" Sep 19 10:03:21.772932 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:21.772812 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjdpl\" (UniqueName: \"kubernetes.io/projected/3ce1a5fe-1b40-493c-87a5-a13b217839c6-kube-api-access-wjdpl\") pod \"payload-pre-processing-59fbc47bf8-dpwcq\" (UID: \"3ce1a5fe-1b40-493c-87a5-a13b217839c6\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dpwcq" Sep 19 10:03:21.772932 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:21.772848 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r42gj\" (UniqueName: \"kubernetes.io/projected/4db82c73-b6f7-43d9-843e-ffb892fdad40-kube-api-access-r42gj\") pod \"payload-processing-5b54b7fbb7-trd2r\" (UID: \"4db82c73-b6f7-43d9-843e-ffb892fdad40\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-trd2r" Sep 19 10:03:21.773563 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:21.773544 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3ce1a5fe-1b40-493c-87a5-a13b217839c6-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-dpwcq\" (UID: \"3ce1a5fe-1b40-493c-87a5-a13b217839c6\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dpwcq" Sep 19 10:03:21.783192 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:21.783167 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjdpl\" (UniqueName: \"kubernetes.io/projected/3ce1a5fe-1b40-493c-87a5-a13b217839c6-kube-api-access-wjdpl\") pod \"payload-pre-processing-59fbc47bf8-dpwcq\" (UID: \"3ce1a5fe-1b40-493c-87a5-a13b217839c6\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dpwcq" Sep 19 10:03:21.873269 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:21.873199 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dpwcq" Sep 19 10:03:21.873368 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:21.873324 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4db82c73-b6f7-43d9-843e-ffb892fdad40-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-trd2r\" (UID: \"4db82c73-b6f7-43d9-843e-ffb892fdad40\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-trd2r" Sep 19 10:03:21.873415 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:21.873369 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r42gj\" (UniqueName: \"kubernetes.io/projected/4db82c73-b6f7-43d9-843e-ffb892fdad40-kube-api-access-r42gj\") pod \"payload-processing-5b54b7fbb7-trd2r\" (UID: \"4db82c73-b6f7-43d9-843e-ffb892fdad40\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-trd2r" Sep 19 10:03:21.873942 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:21.873924 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4db82c73-b6f7-43d9-843e-ffb892fdad40-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-trd2r\" (UID: \"4db82c73-b6f7-43d9-843e-ffb892fdad40\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-trd2r" Sep 19 10:03:21.885074 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:21.885053 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r42gj\" (UniqueName: \"kubernetes.io/projected/4db82c73-b6f7-43d9-843e-ffb892fdad40-kube-api-access-r42gj\") pod \"payload-processing-5b54b7fbb7-trd2r\" (UID: \"4db82c73-b6f7-43d9-843e-ffb892fdad40\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-trd2r" Sep 19 10:03:21.954033 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:21.954006 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-trd2r" Sep 19 10:03:22.148345 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:22.148188 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-dpwcq"] Sep 19 10:03:22.150577 ip-10-0-142-110 kubenswrapper[2579]: W0919 10:03:22.150552 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ce1a5fe_1b40_493c_87a5_a13b217839c6.slice/crio-729e9baf2dbbc6a947bceec77310b52897abf5e2b0e27debb4e937e1c2269826 WatchSource:0}: Error finding container 729e9baf2dbbc6a947bceec77310b52897abf5e2b0e27debb4e937e1c2269826: Status 404 returned error can't find the container with id 729e9baf2dbbc6a947bceec77310b52897abf5e2b0e27debb4e937e1c2269826 Sep 19 10:03:22.225102 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:22.225064 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-trd2r"] Sep 19 10:03:22.226598 ip-10-0-142-110 kubenswrapper[2579]: W0919 10:03:22.226575 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4db82c73_b6f7_43d9_843e_ffb892fdad40.slice/crio-c2b8dab72d76f9723c20982e2374b7441f846d084ee76c8dfbe0d6defaccfdbe WatchSource:0}: Error finding container c2b8dab72d76f9723c20982e2374b7441f846d084ee76c8dfbe0d6defaccfdbe: Status 404 returned error can't find the container with id c2b8dab72d76f9723c20982e2374b7441f846d084ee76c8dfbe0d6defaccfdbe Sep 19 10:03:22.700386 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:22.700354 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f5da240-214c-4f17-8bff-f97bb636c595" path="/var/lib/kubelet/pods/4f5da240-214c-4f17-8bff-f97bb636c595/volumes" Sep 19 10:03:22.700871 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:22.700677 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd8d5a07-635e-46eb-b132-d5c2540dd59b" path="/var/lib/kubelet/pods/cd8d5a07-635e-46eb-b132-d5c2540dd59b/volumes" Sep 19 10:03:22.708297 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:22.708276 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dpwcq" event={"ID":"3ce1a5fe-1b40-493c-87a5-a13b217839c6","Type":"ContainerStarted","Data":"0ef2ab3849be7fd8e79d733a5d1c8c10d939e528d06803ca757ed4d4fe677588"} Sep 19 10:03:22.708416 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:22.708313 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dpwcq" event={"ID":"3ce1a5fe-1b40-493c-87a5-a13b217839c6","Type":"ContainerStarted","Data":"729e9baf2dbbc6a947bceec77310b52897abf5e2b0e27debb4e937e1c2269826"} Sep 19 10:03:22.708480 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:22.708380 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dpwcq" Sep 19 10:03:22.710049 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:22.710028 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-trd2r" event={"ID":"4db82c73-b6f7-43d9-843e-ffb892fdad40","Type":"ContainerStarted","Data":"7274b92f35c19448341012901d5121999b294326c3faf5d442f2d0d4025ffbf3"} Sep 19 10:03:22.710155 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:22.710064 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-trd2r" event={"ID":"4db82c73-b6f7-43d9-843e-ffb892fdad40","Type":"ContainerStarted","Data":"c2b8dab72d76f9723c20982e2374b7441f846d084ee76c8dfbe0d6defaccfdbe"} Sep 19 10:03:22.710155 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:22.710088 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-trd2r" Sep 19 10:03:22.740347 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:22.740311 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dpwcq" podStartSLOduration=1.740298138 podStartE2EDuration="1.740298138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:03:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:03:22.73857375 +0000 UTC m=+702.539357048" watchObservedRunningTime="2026-09-19 10:03:22.740298138 +0000 UTC m=+702.541081433" Sep 19 10:03:22.759360 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:22.759322 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-trd2r" podStartSLOduration=1.7593097210000002 podStartE2EDuration="1.759309721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:03:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:03:22.757731792 +0000 UTC m=+702.558515091" watchObservedRunningTime="2026-09-19 10:03:22.759309721 +0000 UTC m=+702.560093017" Sep 19 10:03:26.873548 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:26.873516 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-5fbc954fb5-s87tn_0a32e689-6209-4b8e-868e-9b7ff487b3db/manager/0.log" Sep 19 10:03:26.983266 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:26.983228 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-lws9t_e6045c73-29ba-4d00-a710-59d145151ab7/manager/0.log" Sep 19 10:03:27.102071 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:27.102036 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kfhgh_00cb2858-90b4-4444-81d8-c8ef01f1332f/manager/0.log" Sep 19 10:03:27.385263 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:27.385231 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gc5ld_bcef4a25-cf6a-4b0e-9550-d5e40c190e09/server/0.log" Sep 19 10:03:27.860525 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:27.860498 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl_21617aef-f4f5-4530-bcbc-278833dc13ee/copy-manifests/0.log" Sep 19 10:03:27.884574 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:27.884541 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl_21617aef-f4f5-4530-bcbc-278833dc13ee/manager/0.log" Sep 19 10:03:28.346145 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:28.346117 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-vh2wm_de2ebace-af53-4786-9206-4d55652249f2/postgres/0.log" Sep 19 10:03:29.161440 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:29.161413 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-65b5875748-r9kfv_5440a7d4-a8b9-4d20-9c44-e3139fdf2e2c/authorino/0.log" Sep 19 10:03:29.292108 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:29.292072 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-bzxph_b5b1a465-c499-4b7a-9534-f2e145f660c3/manager/0.log" Sep 19 10:03:29.427266 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:29.427235 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-dhcr5_9f3ec1f4-b8d8-40e2-a846-90398328f525/manager/0.log" Sep 19 10:03:29.533467 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:29.533443 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-vgbwr_66f26621-0116-4a5a-bd43-4110428ae5b5/kuadrant-console-plugin/0.log" Sep 19 10:03:29.663655 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:29.663624 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-9tk4c_79386a95-e8c1-4df0-a842-57f36d38d5b2/manager/0.log" Sep 19 10:03:29.894689 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:29.894605 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-trr9l_df59639c-f4f2-4802-8e7f-550e7d8d8829/manager/0.log" Sep 19 10:03:30.594251 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:30.594226 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65d7d84b5d-94p9q_b8e12b20-5554-47cc-9b5c-195ce8311766/kube-auth-proxy/0.log" Sep 19 10:03:30.838976 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:30.838943 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-dpwcq_3ce1a5fe-1b40-493c-87a5-a13b217839c6/payload-pre-processing/0.log" Sep 19 10:03:30.948312 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:30.948286 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-trd2r_4db82c73-b6f7-43d9-843e-ffb892fdad40/payload-processing/0.log" Sep 19 10:03:31.394627 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:31.394548 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc_5d6f9ee5-47a7-4c6a-9e15-4678835c04d0/main/0.log" Sep 19 10:03:32.749162 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:32.749128 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-65b5875748-r9kfv_5440a7d4-a8b9-4d20-9c44-e3139fdf2e2c/authorino/0.log" Sep 19 10:03:33.717118 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:33.717088 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-trd2r" Sep 19 10:03:33.717311 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:33.717156 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dpwcq" Sep 19 10:03:38.458851 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:38.458814 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-5fbc954fb5-s87tn_0a32e689-6209-4b8e-868e-9b7ff487b3db/manager/0.log" Sep 19 10:03:38.568298 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:38.568262 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-lws9t_e6045c73-29ba-4d00-a710-59d145151ab7/manager/0.log" Sep 19 10:03:38.699429 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:38.699401 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kfhgh_00cb2858-90b4-4444-81d8-c8ef01f1332f/manager/0.log" Sep 19 10:03:38.943568 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:38.943538 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gc5ld_bcef4a25-cf6a-4b0e-9550-d5e40c190e09/server/0.log" Sep 19 10:03:39.393964 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:39.393885 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl_21617aef-f4f5-4530-bcbc-278833dc13ee/copy-manifests/0.log" Sep 19 10:03:39.413047 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:39.413023 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl_21617aef-f4f5-4530-bcbc-278833dc13ee/manager/0.log" Sep 19 10:03:39.894964 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:39.894932 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-vh2wm_de2ebace-af53-4786-9206-4d55652249f2/postgres/0.log" Sep 19 10:03:40.655440 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:40.655408 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-65b5875748-r9kfv_5440a7d4-a8b9-4d20-9c44-e3139fdf2e2c/authorino/0.log" Sep 19 10:03:40.773637 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:40.773602 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-bzxph_b5b1a465-c499-4b7a-9534-f2e145f660c3/manager/0.log" Sep 19 10:03:40.885301 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:40.885273 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-dhcr5_9f3ec1f4-b8d8-40e2-a846-90398328f525/manager/0.log" Sep 19 10:03:40.992251 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:40.992226 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-vgbwr_66f26621-0116-4a5a-bd43-4110428ae5b5/kuadrant-console-plugin/0.log" Sep 19 10:03:41.118500 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:41.118462 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-9tk4c_79386a95-e8c1-4df0-a842-57f36d38d5b2/manager/0.log" Sep 19 10:03:41.339967 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:41.339892 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-trr9l_df59639c-f4f2-4802-8e7f-550e7d8d8829/manager/0.log" Sep 19 10:03:42.031430 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:42.031401 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65d7d84b5d-94p9q_b8e12b20-5554-47cc-9b5c-195ce8311766/kube-auth-proxy/0.log" Sep 19 10:03:42.253305 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:42.253268 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-dpwcq_3ce1a5fe-1b40-493c-87a5-a13b217839c6/payload-pre-processing/0.log" Sep 19 10:03:42.412654 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:42.412568 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-trd2r_4db82c73-b6f7-43d9-843e-ffb892fdad40/payload-processing/0.log" Sep 19 10:03:42.858348 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:42.858309 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-4b9bc_5d6f9ee5-47a7-4c6a-9e15-4678835c04d0/main/0.log" Sep 19 10:03:59.602016 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:59.601982 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-trd2r_4db82c73-b6f7-43d9-843e-ffb892fdad40/payload-processing/0.log" Sep 19 10:03:59.716076 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:59.716045 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-trd2r_4db82c73-b6f7-43d9-843e-ffb892fdad40/payload-processing/0.log" Sep 19 10:03:59.890326 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:59.890252 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2l7hw/must-gather-zxw2b"] Sep 19 10:03:59.895266 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:59.895243 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2l7hw/must-gather-zxw2b" Sep 19 10:03:59.897750 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:59.897727 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2l7hw\"/\"default-dockercfg-5zqvl\"" Sep 19 10:03:59.897917 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:59.897850 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2l7hw\"/\"kube-root-ca.crt\"" Sep 19 10:03:59.898212 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:59.898182 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2l7hw\"/\"openshift-service-ca.crt\"" Sep 19 10:03:59.903640 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:59.903617 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2l7hw/must-gather-zxw2b"] Sep 19 10:03:59.995162 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:59.995128 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5hj4\" (UniqueName: \"kubernetes.io/projected/77918370-2f95-4302-bf13-95f4618d6c24-kube-api-access-g5hj4\") pod \"must-gather-zxw2b\" (UID: \"77918370-2f95-4302-bf13-95f4618d6c24\") " pod="openshift-must-gather-2l7hw/must-gather-zxw2b" Sep 19 10:03:59.995341 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:03:59.995186 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/77918370-2f95-4302-bf13-95f4618d6c24-must-gather-output\") pod \"must-gather-zxw2b\" (UID: \"77918370-2f95-4302-bf13-95f4618d6c24\") " pod="openshift-must-gather-2l7hw/must-gather-zxw2b" Sep 19 10:04:00.096227 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:00.096190 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/77918370-2f95-4302-bf13-95f4618d6c24-must-gather-output\") pod \"must-gather-zxw2b\" (UID: \"77918370-2f95-4302-bf13-95f4618d6c24\") " pod="openshift-must-gather-2l7hw/must-gather-zxw2b" Sep 19 10:04:00.096421 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:00.096260 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5hj4\" (UniqueName: \"kubernetes.io/projected/77918370-2f95-4302-bf13-95f4618d6c24-kube-api-access-g5hj4\") pod \"must-gather-zxw2b\" (UID: \"77918370-2f95-4302-bf13-95f4618d6c24\") " pod="openshift-must-gather-2l7hw/must-gather-zxw2b" Sep 19 10:04:00.096604 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:00.096582 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/77918370-2f95-4302-bf13-95f4618d6c24-must-gather-output\") pod \"must-gather-zxw2b\" (UID: \"77918370-2f95-4302-bf13-95f4618d6c24\") " pod="openshift-must-gather-2l7hw/must-gather-zxw2b" Sep 19 10:04:00.106189 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:00.106158 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5hj4\" (UniqueName: \"kubernetes.io/projected/77918370-2f95-4302-bf13-95f4618d6c24-kube-api-access-g5hj4\") pod \"must-gather-zxw2b\" (UID: \"77918370-2f95-4302-bf13-95f4618d6c24\") " pod="openshift-must-gather-2l7hw/must-gather-zxw2b" Sep 19 10:04:00.204477 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:00.204443 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2l7hw/must-gather-zxw2b" Sep 19 10:04:00.477104 ip-10-0-142-110 kubenswrapper[2579]: W0919 10:04:00.477069 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77918370_2f95_4302_bf13_95f4618d6c24.slice/crio-8211694a67db9281d4ec74c82ba7a25b861dc424bfb67290249dd3e16f8d0518 WatchSource:0}: Error finding container 8211694a67db9281d4ec74c82ba7a25b861dc424bfb67290249dd3e16f8d0518: Status 404 returned error can't find the container with id 8211694a67db9281d4ec74c82ba7a25b861dc424bfb67290249dd3e16f8d0518 Sep 19 10:04:00.481164 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:00.481135 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2l7hw/must-gather-zxw2b"] Sep 19 10:04:00.897649 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:00.897569 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2l7hw/must-gather-zxw2b" event={"ID":"77918370-2f95-4302-bf13-95f4618d6c24","Type":"ContainerStarted","Data":"8211694a67db9281d4ec74c82ba7a25b861dc424bfb67290249dd3e16f8d0518"} Sep 19 10:04:01.907416 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:01.907373 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2l7hw/must-gather-zxw2b" event={"ID":"77918370-2f95-4302-bf13-95f4618d6c24","Type":"ContainerStarted","Data":"0cf6b75da4c8044d44a2d3ae62cfbccfc673102fefa1acea6d0991f848c3a792"} Sep 19 10:04:01.907936 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:01.907428 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2l7hw/must-gather-zxw2b" event={"ID":"77918370-2f95-4302-bf13-95f4618d6c24","Type":"ContainerStarted","Data":"5da5ab892c79790c151dca980b870d50142d752167558d091d96ad8ab73ca310"} Sep 19 10:04:02.900665 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:02.900637 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-42rhb_a5862d53-93df-4d28-9fb5-48d60ee4a821/global-pull-secret-syncer/0.log" Sep 19 10:04:03.148516 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:03.148477 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rxntx_2ecdf95f-237b-41ea-a042-a6a821fab942/konnectivity-agent/0.log" Sep 19 10:04:03.198603 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:03.198568 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-110.ec2.internal_2e40f5fbb603a9d1bc50add58c51c34d/haproxy/0.log" Sep 19 10:04:07.501189 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:07.501153 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-65b5875748-r9kfv_5440a7d4-a8b9-4d20-9c44-e3139fdf2e2c/authorino/0.log" Sep 19 10:04:07.535030 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:07.534994 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-bzxph_b5b1a465-c499-4b7a-9534-f2e145f660c3/manager/0.log" Sep 19 10:04:07.565283 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:07.565195 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-dhcr5_9f3ec1f4-b8d8-40e2-a846-90398328f525/manager/0.log" Sep 19 10:04:07.596391 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:07.596172 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-vgbwr_66f26621-0116-4a5a-bd43-4110428ae5b5/kuadrant-console-plugin/0.log" Sep 19 10:04:07.647080 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:07.647044 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-9tk4c_79386a95-e8c1-4df0-a842-57f36d38d5b2/manager/0.log" Sep 19 10:04:07.724096 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:07.724053 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-trr9l_df59639c-f4f2-4802-8e7f-550e7d8d8829/manager/0.log" Sep 19 10:04:09.917172 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:09.917142 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pfzd6_adff6f91-e3b7-48ee-a857-ad2a8fc749de/node-exporter/0.log" Sep 19 10:04:09.952508 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:09.952472 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pfzd6_adff6f91-e3b7-48ee-a857-ad2a8fc749de/kube-rbac-proxy/0.log" Sep 19 10:04:09.979264 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:09.979234 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pfzd6_adff6f91-e3b7-48ee-a857-ad2a8fc749de/init-textfile/0.log" Sep 19 10:04:12.591573 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:12.591506 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2l7hw/must-gather-zxw2b" podStartSLOduration=12.870548315 podStartE2EDuration="13.591482289s" totalImagesPullingTime="720.933974ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 10:03:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:04:01.932458896 +0000 UTC m=+741.733242194" watchObservedRunningTime="2026-09-19 10:04:12.591482289 +0000 UTC m=+752.392265586" Sep 19 10:04:12.592830 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:12.592797 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2l7hw/perf-node-gather-daemonset-hjk55"] Sep 19 10:04:12.599029 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:12.599003 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2l7hw/perf-node-gather-daemonset-hjk55" Sep 19 10:04:12.607583 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:12.607550 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2l7hw/perf-node-gather-daemonset-hjk55"] Sep 19 10:04:12.723955 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:12.723914 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3fe1533c-0ba9-491f-bf55-34c192e81c54-lib-modules\") pod \"perf-node-gather-daemonset-hjk55\" (UID: \"3fe1533c-0ba9-491f-bf55-34c192e81c54\") " pod="openshift-must-gather-2l7hw/perf-node-gather-daemonset-hjk55" Sep 19 10:04:12.724141 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:12.723965 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3fe1533c-0ba9-491f-bf55-34c192e81c54-proc\") pod \"perf-node-gather-daemonset-hjk55\" (UID: \"3fe1533c-0ba9-491f-bf55-34c192e81c54\") " pod="openshift-must-gather-2l7hw/perf-node-gather-daemonset-hjk55" Sep 19 10:04:12.724141 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:12.724051 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3fe1533c-0ba9-491f-bf55-34c192e81c54-podres\") pod \"perf-node-gather-daemonset-hjk55\" (UID: \"3fe1533c-0ba9-491f-bf55-34c192e81c54\") " pod="openshift-must-gather-2l7hw/perf-node-gather-daemonset-hjk55" Sep 19 10:04:12.724141 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:12.724106 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3fe1533c-0ba9-491f-bf55-34c192e81c54-sys\") pod \"perf-node-gather-daemonset-hjk55\" (UID: \"3fe1533c-0ba9-491f-bf55-34c192e81c54\") " pod="openshift-must-gather-2l7hw/perf-node-gather-daemonset-hjk55" Sep 19 10:04:12.724316 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:12.724188 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvcn8\" (UniqueName: \"kubernetes.io/projected/3fe1533c-0ba9-491f-bf55-34c192e81c54-kube-api-access-rvcn8\") pod \"perf-node-gather-daemonset-hjk55\" (UID: \"3fe1533c-0ba9-491f-bf55-34c192e81c54\") " pod="openshift-must-gather-2l7hw/perf-node-gather-daemonset-hjk55" Sep 19 10:04:12.824788 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:12.824740 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3fe1533c-0ba9-491f-bf55-34c192e81c54-lib-modules\") pod \"perf-node-gather-daemonset-hjk55\" (UID: \"3fe1533c-0ba9-491f-bf55-34c192e81c54\") " pod="openshift-must-gather-2l7hw/perf-node-gather-daemonset-hjk55" Sep 19 10:04:12.824974 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:12.824805 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3fe1533c-0ba9-491f-bf55-34c192e81c54-proc\") pod \"perf-node-gather-daemonset-hjk55\" (UID: \"3fe1533c-0ba9-491f-bf55-34c192e81c54\") " pod="openshift-must-gather-2l7hw/perf-node-gather-daemonset-hjk55" Sep 19 10:04:12.824974 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:12.824843 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3fe1533c-0ba9-491f-bf55-34c192e81c54-podres\") pod \"perf-node-gather-daemonset-hjk55\" (UID: \"3fe1533c-0ba9-491f-bf55-34c192e81c54\") " pod="openshift-must-gather-2l7hw/perf-node-gather-daemonset-hjk55" Sep 19 10:04:12.824974 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:12.824889 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3fe1533c-0ba9-491f-bf55-34c192e81c54-sys\") pod \"perf-node-gather-daemonset-hjk55\" (UID: \"3fe1533c-0ba9-491f-bf55-34c192e81c54\") " pod="openshift-must-gather-2l7hw/perf-node-gather-daemonset-hjk55" Sep 19 10:04:12.824974 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:12.824950 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvcn8\" (UniqueName: \"kubernetes.io/projected/3fe1533c-0ba9-491f-bf55-34c192e81c54-kube-api-access-rvcn8\") pod \"perf-node-gather-daemonset-hjk55\" (UID: \"3fe1533c-0ba9-491f-bf55-34c192e81c54\") " pod="openshift-must-gather-2l7hw/perf-node-gather-daemonset-hjk55" Sep 19 10:04:12.825526 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:12.825493 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3fe1533c-0ba9-491f-bf55-34c192e81c54-lib-modules\") pod \"perf-node-gather-daemonset-hjk55\" (UID: \"3fe1533c-0ba9-491f-bf55-34c192e81c54\") " pod="openshift-must-gather-2l7hw/perf-node-gather-daemonset-hjk55" Sep 19 10:04:12.825634 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:12.825578 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3fe1533c-0ba9-491f-bf55-34c192e81c54-proc\") pod \"perf-node-gather-daemonset-hjk55\" (UID: \"3fe1533c-0ba9-491f-bf55-34c192e81c54\") " pod="openshift-must-gather-2l7hw/perf-node-gather-daemonset-hjk55" Sep 19 10:04:12.825717 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:12.825662 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3fe1533c-0ba9-491f-bf55-34c192e81c54-podres\") pod \"perf-node-gather-daemonset-hjk55\" (UID: \"3fe1533c-0ba9-491f-bf55-34c192e81c54\") " pod="openshift-must-gather-2l7hw/perf-node-gather-daemonset-hjk55" Sep 19 10:04:12.825781 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:12.825736 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3fe1533c-0ba9-491f-bf55-34c192e81c54-sys\") pod \"perf-node-gather-daemonset-hjk55\" (UID: \"3fe1533c-0ba9-491f-bf55-34c192e81c54\") " pod="openshift-must-gather-2l7hw/perf-node-gather-daemonset-hjk55" Sep 19 10:04:12.834341 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:12.834304 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvcn8\" (UniqueName: \"kubernetes.io/projected/3fe1533c-0ba9-491f-bf55-34c192e81c54-kube-api-access-rvcn8\") pod \"perf-node-gather-daemonset-hjk55\" (UID: \"3fe1533c-0ba9-491f-bf55-34c192e81c54\") " pod="openshift-must-gather-2l7hw/perf-node-gather-daemonset-hjk55" Sep 19 10:04:12.914392 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:12.914304 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2l7hw/perf-node-gather-daemonset-hjk55" Sep 19 10:04:13.212750 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:13.211004 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2l7hw/perf-node-gather-daemonset-hjk55"] Sep 19 10:04:13.991605 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:13.991571 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2l7hw/perf-node-gather-daemonset-hjk55" event={"ID":"3fe1533c-0ba9-491f-bf55-34c192e81c54","Type":"ContainerStarted","Data":"15ed925924adddb8fa2d33ffbbc302488be1ae40c2874302a292ab3a216cdf96"} Sep 19 10:04:13.992007 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:13.991625 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2l7hw/perf-node-gather-daemonset-hjk55" event={"ID":"3fe1533c-0ba9-491f-bf55-34c192e81c54","Type":"ContainerStarted","Data":"9a88308f341cb8ab6c799556c2045b6b50e2360ea1c2e37c803057e9df927aef"} Sep 19 10:04:13.992007 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:13.991725 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2l7hw/perf-node-gather-daemonset-hjk55" Sep 19 10:04:14.017420 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:14.017358 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2l7hw/perf-node-gather-daemonset-hjk55" podStartSLOduration=2.017337565 podStartE2EDuration="2.017337565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 10:04:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 10:04:14.016396465 +0000 UTC m=+753.817179763" watchObservedRunningTime="2026-09-19 10:04:14.017337565 +0000 UTC m=+753.818120863" Sep 19 10:04:15.296181 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:15.296149 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gs4nm_0ee7f42d-5d82-4976-a8ea-42571ec0a331/dns/0.log" Sep 19 10:04:15.318861 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:15.318830 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gs4nm_0ee7f42d-5d82-4976-a8ea-42571ec0a331/kube-rbac-proxy/0.log" Sep 19 10:04:15.395002 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:15.394967 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sv4k8_0fab0c31-fc90-48c2-ba03-ba1bf2abe9b1/dns-node-resolver/0.log" Sep 19 10:04:15.996651 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:15.996614 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mvk4m_621ae7f4-6b60-4424-95fe-a400cf2f6e01/node-ca/0.log" Sep 19 10:04:17.088294 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:17.088262 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65d7d84b5d-94p9q_b8e12b20-5554-47cc-9b5c-195ce8311766/kube-auth-proxy/0.log" Sep 19 10:04:17.140649 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:17.140618 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-dpwcq_3ce1a5fe-1b40-493c-87a5-a13b217839c6/payload-pre-processing/0.log" Sep 19 10:04:17.167550 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:17.167522 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-trd2r_4db82c73-b6f7-43d9-843e-ffb892fdad40/payload-processing/0.log" Sep 19 10:04:17.880546 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:17.880518 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t6sbm_bebbf67e-4435-4df9-be91-7de185c1aa50/serve-healthcheck-canary/0.log" Sep 19 10:04:18.377684 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:18.377655 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-77xzw_81331dd3-3166-4168-afbb-76e0bb7f012d/kube-rbac-proxy/0.log" Sep 19 10:04:18.406765 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:18.406740 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-77xzw_81331dd3-3166-4168-afbb-76e0bb7f012d/exporter/0.log" Sep 19 10:04:18.429566 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:18.429533 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-77xzw_81331dd3-3166-4168-afbb-76e0bb7f012d/extractor/0.log" Sep 19 10:04:20.013827 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:20.013800 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2l7hw/perf-node-gather-daemonset-hjk55" Sep 19 10:04:20.678723 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:20.678666 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-5fbc954fb5-s87tn_0a32e689-6209-4b8e-868e-9b7ff487b3db/manager/0.log" Sep 19 10:04:20.713953 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:20.713921 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-lws9t_e6045c73-29ba-4d00-a710-59d145151ab7/manager/0.log" Sep 19 10:04:20.763548 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:20.763520 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kfhgh_00cb2858-90b4-4444-81d8-c8ef01f1332f/manager/0.log" Sep 19 10:04:20.824869 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:20.824841 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gc5ld_bcef4a25-cf6a-4b0e-9550-d5e40c190e09/server/0.log" Sep 19 10:04:21.067497 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:21.067406 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl_21617aef-f4f5-4530-bcbc-278833dc13ee/manager/0.log" Sep 19 10:04:21.087663 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:21.087637 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c8c4cc7bf-z5jjl_21617aef-f4f5-4530-bcbc-278833dc13ee/copy-manifests/0.log" Sep 19 10:04:22.602318 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:22.602282 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-kjr2g_5b2acda5-29e7-4224-ae5c-a7459f4e9b8b/openshift-lws-operator/0.log" Sep 19 10:04:23.447028 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:23.446997 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65d7d84b5d-94p9q_b8e12b20-5554-47cc-9b5c-195ce8311766/kube-auth-proxy/0.log" Sep 19 10:04:23.480820 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:23.480789 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-dpwcq_3ce1a5fe-1b40-493c-87a5-a13b217839c6/payload-pre-processing/0.log" Sep 19 10:04:23.503599 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:23.503567 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-trd2r_4db82c73-b6f7-43d9-843e-ffb892fdad40/payload-processing/0.log" Sep 19 10:04:24.710634 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:24.710591 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65d7d84b5d-94p9q_b8e12b20-5554-47cc-9b5c-195ce8311766/kube-auth-proxy/0.log" Sep 19 10:04:24.745537 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:24.745503 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-dpwcq_3ce1a5fe-1b40-493c-87a5-a13b217839c6/payload-pre-processing/0.log" Sep 19 10:04:24.766099 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:24.766071 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-trd2r_4db82c73-b6f7-43d9-843e-ffb892fdad40/payload-processing/0.log" Sep 19 10:04:27.711021 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:27.710988 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-ntl98_ff023f49-9478-46c5-9aff-b3c083494a7b/migrator/0.log" Sep 19 10:04:27.758556 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:27.758523 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-ntl98_ff023f49-9478-46c5-9aff-b3c083494a7b/graceful-termination/0.log" Sep 19 10:04:29.187560 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:29.187528 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8pk6q_376e12c4-2b51-4e58-baa4-56f54d631255/kube-multus/0.log" Sep 19 10:04:29.212768 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:29.212745 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7cp7g_9f6cca46-77e3-4de4-abac-85520c106e82/kube-multus-additional-cni-plugins/0.log" Sep 19 10:04:29.235850 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:29.235819 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7cp7g_9f6cca46-77e3-4de4-abac-85520c106e82/egress-router-binary-copy/0.log" Sep 19 10:04:29.264462 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:29.264435 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7cp7g_9f6cca46-77e3-4de4-abac-85520c106e82/cni-plugins/0.log" Sep 19 10:04:29.290325 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:29.290293 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7cp7g_9f6cca46-77e3-4de4-abac-85520c106e82/bond-cni-plugin/0.log" Sep 19 10:04:29.316562 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:29.316534 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7cp7g_9f6cca46-77e3-4de4-abac-85520c106e82/routeoverride-cni/0.log" Sep 19 10:04:29.339815 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:29.339786 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7cp7g_9f6cca46-77e3-4de4-abac-85520c106e82/whereabouts-cni-bincopy/0.log" Sep 19 10:04:29.369955 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:29.369927 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7cp7g_9f6cca46-77e3-4de4-abac-85520c106e82/whereabouts-cni/0.log" Sep 19 10:04:29.816777 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:29.816743 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cxdbk_5e7c4050-b0c9-4afe-86a1-e83b1cf46a27/network-metrics-daemon/0.log" Sep 19 10:04:29.847942 ip-10-0-142-110 kubenswrapper[2579]: I0919 10:04:29.847903 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cxdbk_5e7c4050-b0c9-4afe-86a1-e83b1cf46a27/kube-rbac-proxy/0.log"