Oct 30 08:52:24.155499 ip-10-0-140-65 systemd[1]: Starting Kubernetes Kubelet... Oct 30 08:52:24.553733 ip-10-0-140-65 kubenswrapper[2585]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 08:52:24.553733 ip-10-0-140-65 kubenswrapper[2585]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 30 08:52:24.553733 ip-10-0-140-65 kubenswrapper[2585]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 08:52:24.553733 ip-10-0-140-65 kubenswrapper[2585]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 08:52:24.557800 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557733 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 08:52:24.557800 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557800 2585 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 08:52:24.557865 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557806 2585 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 08:52:24.557865 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557810 2585 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 08:52:24.557865 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557813 2585 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 08:52:24.557865 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557816 2585 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 08:52:24.557865 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557819 2585 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 08:52:24.557865 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557821 2585 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 08:52:24.557865 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557824 2585 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 08:52:24.557865 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557827 2585 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 08:52:24.557865 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557829 2585 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 08:52:24.557865 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557832 2585 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 08:52:24.557865 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557835 2585 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 08:52:24.557865 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557837 2585 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 08:52:24.557865 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557840 2585 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 08:52:24.557865 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557843 2585 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 08:52:24.557865 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557846 2585 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 08:52:24.557865 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557848 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 08:52:24.557865 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557851 2585 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 08:52:24.557865 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557853 2585 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 08:52:24.557865 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557856 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 08:52:24.557865 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557859 2585 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 08:52:24.558337 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557861 2585 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 08:52:24.558337 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557864 2585 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 08:52:24.558337 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557870 2585 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 08:52:24.558337 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557873 2585 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 08:52:24.558337 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557876 2585 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 08:52:24.558337 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557879 2585 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 08:52:24.558337 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557882 2585 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 08:52:24.558337 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557885 2585 feature_gate.go:386] unrecognized feature gate: Example Oct 30 08:52:24.558337 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557887 2585 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 08:52:24.558337 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557890 2585 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 08:52:24.558337 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557893 2585 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 08:52:24.558337 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557895 2585 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 08:52:24.558337 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557898 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 08:52:24.558337 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557901 2585 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 08:52:24.558337 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557903 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 08:52:24.558337 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557906 2585 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 08:52:24.558337 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557908 2585 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 08:52:24.558337 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557911 2585 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 08:52:24.558337 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557913 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 08:52:24.558337 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557916 2585 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 08:52:24.558799 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557918 2585 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 08:52:24.558799 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557921 2585 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 08:52:24.558799 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557923 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 08:52:24.558799 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557926 2585 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 08:52:24.558799 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557928 2585 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 08:52:24.558799 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557931 2585 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 08:52:24.558799 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557933 2585 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 08:52:24.558799 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557936 2585 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 08:52:24.558799 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557938 2585 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 08:52:24.558799 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557941 2585 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 08:52:24.558799 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557943 2585 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 08:52:24.558799 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557946 2585 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 08:52:24.558799 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557949 2585 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 08:52:24.558799 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557952 2585 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 08:52:24.558799 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557955 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 08:52:24.558799 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557958 2585 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 08:52:24.558799 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557961 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 08:52:24.558799 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557964 2585 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 08:52:24.558799 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557966 2585 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 08:52:24.558799 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557969 2585 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 08:52:24.559288 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557971 2585 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 08:52:24.559288 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557974 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 08:52:24.559288 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557976 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 08:52:24.559288 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557979 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 08:52:24.559288 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557981 2585 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 08:52:24.559288 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557984 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 08:52:24.559288 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557987 2585 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 08:52:24.559288 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557989 2585 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 08:52:24.559288 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557992 2585 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 08:52:24.559288 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557994 2585 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 08:52:24.559288 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.557997 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 08:52:24.559288 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558000 2585 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 08:52:24.559288 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558002 2585 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 08:52:24.559288 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558005 2585 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 08:52:24.559288 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558007 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 08:52:24.559288 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558010 2585 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 08:52:24.559288 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558012 2585 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 08:52:24.559288 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558015 2585 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 08:52:24.559288 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558017 2585 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 08:52:24.559288 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558020 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 08:52:24.559751 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558022 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 08:52:24.559751 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558025 2585 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 08:52:24.559751 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558027 2585 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 08:52:24.559751 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558031 2585 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 08:52:24.559751 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558035 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 08:52:24.559751 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558039 2585 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 08:52:24.559751 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558042 2585 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 08:52:24.559751 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558045 2585 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 08:52:24.559751 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558048 2585 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 08:52:24.559751 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558050 2585 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 08:52:24.559751 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558053 2585 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 08:52:24.559751 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558056 2585 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 08:52:24.559751 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558059 2585 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 08:52:24.559751 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558061 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 08:52:24.559751 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558064 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 08:52:24.559751 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558066 2585 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 08:52:24.559751 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558068 2585 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 08:52:24.559751 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558073 2585 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 08:52:24.559751 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558076 2585 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 08:52:24.560243 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558078 2585 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 08:52:24.560243 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558081 2585 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 08:52:24.560243 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558083 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 08:52:24.560243 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558086 2585 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 08:52:24.560243 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558090 2585 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 08:52:24.560243 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558859 2585 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 08:52:24.560243 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558866 2585 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 08:52:24.560243 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558869 2585 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 08:52:24.560243 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558872 2585 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 08:52:24.560243 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558874 2585 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 08:52:24.560243 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558877 2585 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 08:52:24.560243 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558880 2585 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 08:52:24.560243 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558882 2585 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 08:52:24.560243 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558885 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 08:52:24.560243 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558888 2585 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 08:52:24.560243 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558891 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 08:52:24.560243 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558894 2585 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 08:52:24.560243 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558897 2585 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 08:52:24.560243 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558900 2585 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 08:52:24.560243 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558903 2585 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 08:52:24.560723 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558906 2585 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 08:52:24.560723 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558908 2585 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 08:52:24.560723 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558911 2585 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 08:52:24.560723 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558914 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 08:52:24.560723 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558916 2585 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 08:52:24.560723 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558919 2585 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 08:52:24.560723 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558921 2585 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 08:52:24.560723 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558924 2585 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 08:52:24.560723 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558927 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 08:52:24.560723 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558929 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 08:52:24.560723 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558932 2585 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 08:52:24.560723 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558934 2585 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 08:52:24.560723 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558937 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 08:52:24.560723 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558939 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 08:52:24.560723 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558942 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 08:52:24.560723 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558944 2585 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 08:52:24.560723 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558947 2585 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 08:52:24.560723 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558951 2585 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 08:52:24.560723 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558953 2585 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 08:52:24.560723 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558956 2585 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 08:52:24.561197 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558959 2585 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 08:52:24.561197 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558964 2585 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 08:52:24.561197 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558968 2585 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 08:52:24.561197 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558971 2585 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 08:52:24.561197 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558974 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 08:52:24.561197 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558977 2585 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 08:52:24.561197 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558980 2585 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 08:52:24.561197 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558983 2585 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 08:52:24.561197 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558985 2585 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 08:52:24.561197 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558989 2585 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 08:52:24.561197 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558992 2585 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 08:52:24.561197 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558995 2585 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 08:52:24.561197 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.558997 2585 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 08:52:24.561197 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559000 2585 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 08:52:24.561197 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559002 2585 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 08:52:24.561197 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559005 2585 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 08:52:24.561197 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559008 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 08:52:24.561197 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559010 2585 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 08:52:24.561197 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559013 2585 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 08:52:24.561663 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559015 2585 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 08:52:24.561663 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559018 2585 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 08:52:24.561663 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559020 2585 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 08:52:24.561663 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559023 2585 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 08:52:24.561663 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559027 2585 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 08:52:24.561663 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559030 2585 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 08:52:24.561663 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559033 2585 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 08:52:24.561663 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559037 2585 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 08:52:24.561663 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559040 2585 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 08:52:24.561663 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559042 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 08:52:24.561663 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559045 2585 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 08:52:24.561663 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559049 2585 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 08:52:24.561663 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559051 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 08:52:24.561663 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559054 2585 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 08:52:24.561663 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559056 2585 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 08:52:24.561663 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559059 2585 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 08:52:24.561663 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559061 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 08:52:24.561663 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559064 2585 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 08:52:24.561663 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559067 2585 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 08:52:24.562102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559069 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 08:52:24.562102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559072 2585 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 08:52:24.562102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559075 2585 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 08:52:24.562102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559079 2585 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 08:52:24.562102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559082 2585 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 08:52:24.562102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559085 2585 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 08:52:24.562102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559087 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 08:52:24.562102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559090 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 08:52:24.562102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559092 2585 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 08:52:24.562102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559095 2585 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 08:52:24.562102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559098 2585 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 08:52:24.562102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559100 2585 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 08:52:24.562102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559102 2585 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 08:52:24.562102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559105 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 08:52:24.562102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559108 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 08:52:24.562102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559110 2585 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 08:52:24.562102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559113 2585 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 08:52:24.562102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559115 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 08:52:24.562102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559118 2585 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 08:52:24.562557 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559120 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 08:52:24.562557 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559123 2585 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 08:52:24.562557 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559125 2585 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 08:52:24.562557 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559128 2585 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 08:52:24.562557 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559130 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 08:52:24.562557 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559133 2585 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 08:52:24.562557 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559136 2585 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 08:52:24.562557 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559139 2585 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 08:52:24.562557 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559141 2585 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 08:52:24.562557 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559144 2585 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 08:52:24.562557 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559147 2585 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 08:52:24.562557 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559149 2585 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 08:52:24.562557 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559152 2585 feature_gate.go:386] unrecognized feature gate: Example Oct 30 08:52:24.562557 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559154 2585 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 08:52:24.562557 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559631 2585 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 08:52:24.562557 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559636 2585 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 08:52:24.562557 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559640 2585 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 08:52:24.562557 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559643 2585 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 08:52:24.562557 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559645 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 08:52:24.563002 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559648 2585 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 08:52:24.563002 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559651 2585 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 08:52:24.563002 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559654 2585 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 08:52:24.563002 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559656 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 08:52:24.563002 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559659 2585 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 08:52:24.563002 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559662 2585 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 08:52:24.563002 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559665 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 08:52:24.563002 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559667 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 08:52:24.563002 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559670 2585 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 08:52:24.563002 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559673 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 08:52:24.563002 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559676 2585 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 08:52:24.563002 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559678 2585 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 08:52:24.563002 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559681 2585 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 08:52:24.563002 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559684 2585 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 08:52:24.563002 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559686 2585 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 08:52:24.563002 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559689 2585 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 08:52:24.563002 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559691 2585 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 08:52:24.563002 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559694 2585 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 08:52:24.563002 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559696 2585 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 08:52:24.563002 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559700 2585 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 08:52:24.563490 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559703 2585 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 08:52:24.563490 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559706 2585 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 08:52:24.563490 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559708 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 08:52:24.563490 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559711 2585 feature_gate.go:386] unrecognized feature gate: Example Oct 30 08:52:24.563490 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559714 2585 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 08:52:24.563490 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559716 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 08:52:24.563490 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559719 2585 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 08:52:24.563490 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559721 2585 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 08:52:24.563490 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559724 2585 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 08:52:24.563490 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559729 2585 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 08:52:24.563490 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559732 2585 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 08:52:24.563490 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559735 2585 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 08:52:24.563490 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559737 2585 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 08:52:24.563490 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559740 2585 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 08:52:24.563490 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559742 2585 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 08:52:24.563490 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559745 2585 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 08:52:24.563490 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559747 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 08:52:24.563490 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559750 2585 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 08:52:24.563490 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559752 2585 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 08:52:24.563490 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559755 2585 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 08:52:24.563955 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559758 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 08:52:24.563955 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559761 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 08:52:24.563955 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559764 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 08:52:24.563955 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559767 2585 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 08:52:24.563955 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559769 2585 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 08:52:24.563955 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559772 2585 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 08:52:24.563955 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559774 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 08:52:24.563955 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559777 2585 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 08:52:24.563955 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559779 2585 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 08:52:24.563955 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559782 2585 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 08:52:24.563955 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559785 2585 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 08:52:24.563955 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559789 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 08:52:24.563955 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559792 2585 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 08:52:24.563955 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559795 2585 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 08:52:24.563955 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559797 2585 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 08:52:24.563955 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559800 2585 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 08:52:24.563955 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559802 2585 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 08:52:24.563955 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559805 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 08:52:24.564388 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559807 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 08:52:24.564388 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559810 2585 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 08:52:24.564388 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559812 2585 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 08:52:24.564388 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559815 2585 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 08:52:24.564388 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559818 2585 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 08:52:24.564388 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559820 2585 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 08:52:24.564388 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559823 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 08:52:24.564388 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559826 2585 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 08:52:24.564388 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559828 2585 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 08:52:24.564388 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559831 2585 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 08:52:24.564388 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559833 2585 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 08:52:24.564388 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559836 2585 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 08:52:24.564388 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559838 2585 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 08:52:24.564388 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559841 2585 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 08:52:24.564388 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559843 2585 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 08:52:24.564388 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559846 2585 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 08:52:24.564388 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559848 2585 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 08:52:24.564388 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559851 2585 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 08:52:24.564388 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559853 2585 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 08:52:24.564388 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559856 2585 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 08:52:24.564971 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559858 2585 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 08:52:24.564971 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559860 2585 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 08:52:24.564971 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559863 2585 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 08:52:24.564971 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559865 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 08:52:24.564971 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559869 2585 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 08:52:24.564971 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559874 2585 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 08:52:24.564971 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559876 2585 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 08:52:24.564971 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559881 2585 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 08:52:24.564971 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559884 2585 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 08:52:24.564971 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559887 2585 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 08:52:24.564971 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559889 2585 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 08:52:24.564971 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559891 2585 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 08:52:24.564971 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559894 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 08:52:24.564971 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559897 2585 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 08:52:24.564971 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559899 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 08:52:24.564971 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559902 2585 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 08:52:24.564971 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559904 2585 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 08:52:24.564971 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559907 2585 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 08:52:24.564971 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559909 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 08:52:24.565460 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559912 2585 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 08:52:24.565460 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559915 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 08:52:24.565460 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559918 2585 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 08:52:24.565460 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.559920 2585 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 08:52:24.565460 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560787 2585 flags.go:64] FLAG: --address="0.0.0.0" Oct 30 08:52:24.565460 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560796 2585 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 30 08:52:24.565460 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560804 2585 flags.go:64] FLAG: --anonymous-auth="true" Oct 30 08:52:24.565460 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560808 2585 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 30 08:52:24.565460 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560812 2585 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 30 08:52:24.565460 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560815 2585 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 30 08:52:24.565460 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560820 2585 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 30 08:52:24.565460 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560824 2585 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 30 08:52:24.565460 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560827 2585 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 30 08:52:24.565460 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560830 2585 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 30 08:52:24.565460 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560834 2585 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 30 08:52:24.565460 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560837 2585 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 30 08:52:24.565460 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560841 2585 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 30 08:52:24.565460 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560844 2585 flags.go:64] FLAG: --cgroup-root="" Oct 30 08:52:24.565460 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560847 2585 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 30 08:52:24.565460 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560850 2585 flags.go:64] FLAG: --client-ca-file="" Oct 30 08:52:24.565460 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560855 2585 flags.go:64] FLAG: --cloud-provider="external" Oct 30 08:52:24.565460 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560859 2585 flags.go:64] FLAG: --cluster-dns="[]" Oct 30 08:52:24.565460 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560863 2585 flags.go:64] FLAG: --cluster-domain="" Oct 30 08:52:24.565995 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560866 2585 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 30 08:52:24.565995 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560869 2585 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 30 08:52:24.565995 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560873 2585 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 30 08:52:24.565995 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560876 2585 flags.go:64] FLAG: --container-log-max-files="5" Oct 30 08:52:24.565995 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560880 2585 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 30 08:52:24.565995 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560883 2585 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 30 08:52:24.565995 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560886 2585 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 30 08:52:24.565995 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560890 2585 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 30 08:52:24.565995 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560893 2585 flags.go:64] FLAG: --contention-profiling="false" Oct 30 08:52:24.565995 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560896 2585 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 30 08:52:24.565995 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560899 2585 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 30 08:52:24.565995 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560902 2585 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 30 08:52:24.565995 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560905 2585 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 30 08:52:24.565995 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560910 2585 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 30 08:52:24.565995 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560913 2585 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 30 08:52:24.565995 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560916 2585 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 30 08:52:24.565995 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560919 2585 flags.go:64] FLAG: --enable-load-reader="false" Oct 30 08:52:24.565995 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560922 2585 flags.go:64] FLAG: --enable-server="true" Oct 30 08:52:24.565995 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560925 2585 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 30 08:52:24.565995 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560929 2585 flags.go:64] FLAG: --event-burst="100" Oct 30 08:52:24.565995 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560933 2585 flags.go:64] FLAG: --event-qps="50" Oct 30 08:52:24.565995 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560936 2585 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 30 08:52:24.565995 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560939 2585 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 30 08:52:24.565995 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560942 2585 flags.go:64] FLAG: --eviction-hard="" Oct 30 08:52:24.566584 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560946 2585 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 30 08:52:24.566584 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560949 2585 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 30 08:52:24.566584 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560953 2585 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 30 08:52:24.566584 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560956 2585 flags.go:64] FLAG: --eviction-soft="" Oct 30 08:52:24.566584 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560959 2585 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 30 08:52:24.566584 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560963 2585 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 30 08:52:24.566584 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560966 2585 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 30 08:52:24.566584 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560970 2585 flags.go:64] FLAG: --experimental-mounter-path="" Oct 30 08:52:24.566584 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560973 2585 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 30 08:52:24.566584 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560976 2585 flags.go:64] FLAG: --fail-swap-on="true" Oct 30 08:52:24.566584 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560979 2585 flags.go:64] FLAG: --feature-gates="" Oct 30 08:52:24.566584 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560983 2585 flags.go:64] FLAG: --file-check-frequency="20s" Oct 30 08:52:24.566584 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560986 2585 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 30 08:52:24.566584 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560990 2585 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 30 08:52:24.566584 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560993 2585 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 30 08:52:24.566584 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560996 2585 flags.go:64] FLAG: --healthz-port="10248" Oct 30 08:52:24.566584 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.560999 2585 flags.go:64] FLAG: --help="false" Oct 30 08:52:24.566584 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561002 2585 flags.go:64] FLAG: --hostname-override="ip-10-0-140-65.ec2.internal" Oct 30 08:52:24.566584 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561005 2585 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 30 08:52:24.566584 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561008 2585 flags.go:64] FLAG: --http-check-frequency="20s" Oct 30 08:52:24.566584 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561011 2585 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 30 08:52:24.566584 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561014 2585 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 30 08:52:24.566584 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561017 2585 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 30 08:52:24.567134 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561020 2585 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 30 08:52:24.567134 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561023 2585 flags.go:64] FLAG: --image-service-endpoint="" Oct 30 08:52:24.567134 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561026 2585 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 30 08:52:24.567134 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561029 2585 flags.go:64] FLAG: --kube-api-burst="100" Oct 30 08:52:24.567134 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561032 2585 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 30 08:52:24.567134 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561035 2585 flags.go:64] FLAG: --kube-api-qps="50" Oct 30 08:52:24.567134 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561037 2585 flags.go:64] FLAG: --kube-reserved="" Oct 30 08:52:24.567134 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561040 2585 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 30 08:52:24.567134 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561043 2585 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 30 08:52:24.567134 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561046 2585 flags.go:64] FLAG: --kubelet-cgroups="" Oct 30 08:52:24.567134 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561049 2585 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 30 08:52:24.567134 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561052 2585 flags.go:64] FLAG: --lock-file="" Oct 30 08:52:24.567134 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561055 2585 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 30 08:52:24.567134 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561058 2585 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 30 08:52:24.567134 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561063 2585 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 30 08:52:24.567134 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561068 2585 flags.go:64] FLAG: --log-json-split-stream="false" Oct 30 08:52:24.567134 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561071 2585 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 30 08:52:24.567134 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561074 2585 flags.go:64] FLAG: --log-text-split-stream="false" Oct 30 08:52:24.567134 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561078 2585 flags.go:64] FLAG: --logging-format="text" Oct 30 08:52:24.567134 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561081 2585 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 30 08:52:24.567134 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561084 2585 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 30 08:52:24.567134 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561088 2585 flags.go:64] FLAG: --manifest-url="" Oct 30 08:52:24.567134 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561091 2585 flags.go:64] FLAG: --manifest-url-header="" Oct 30 08:52:24.567134 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561096 2585 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 30 08:52:24.567134 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561099 2585 flags.go:64] FLAG: --max-open-files="1000000" Oct 30 08:52:24.567771 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561103 2585 flags.go:64] FLAG: --max-pods="110" Oct 30 08:52:24.567771 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561106 2585 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 30 08:52:24.567771 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561109 2585 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 30 08:52:24.567771 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561112 2585 flags.go:64] FLAG: --memory-manager-policy="None" Oct 30 08:52:24.567771 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561115 2585 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 30 08:52:24.567771 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561118 2585 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 30 08:52:24.567771 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561121 2585 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 30 08:52:24.567771 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561124 2585 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 30 08:52:24.567771 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561131 2585 flags.go:64] FLAG: --node-status-max-images="50" Oct 30 08:52:24.567771 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561134 2585 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 30 08:52:24.567771 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561137 2585 flags.go:64] FLAG: --oom-score-adj="-999" Oct 30 08:52:24.567771 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561141 2585 flags.go:64] FLAG: --pod-cidr="" Oct 30 08:52:24.567771 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561143 2585 flags.go:64] FLAG: --pod-manifest-path="" Oct 30 08:52:24.567771 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561146 2585 flags.go:64] FLAG: --pod-max-pids="-1" Oct 30 08:52:24.567771 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561150 2585 flags.go:64] FLAG: --pods-per-core="0" Oct 30 08:52:24.567771 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561153 2585 flags.go:64] FLAG: --port="10250" Oct 30 08:52:24.567771 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561156 2585 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 30 08:52:24.567771 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561158 2585 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-020214f56190d89ab" Oct 30 08:52:24.567771 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561162 2585 flags.go:64] FLAG: --qos-reserved="" Oct 30 08:52:24.567771 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561165 2585 flags.go:64] FLAG: --read-only-port="10255" Oct 30 08:52:24.567771 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561168 2585 flags.go:64] FLAG: --register-node="true" Oct 30 08:52:24.567771 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561173 2585 flags.go:64] FLAG: --register-with-taints="" Oct 30 08:52:24.567771 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561177 2585 flags.go:64] FLAG: --registry-burst="10" Oct 30 08:52:24.567771 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561180 2585 flags.go:64] FLAG: --registry-qps="5" Oct 30 08:52:24.567771 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561183 2585 flags.go:64] FLAG: --reserved-cpus="" Oct 30 08:52:24.567771 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561186 2585 flags.go:64] FLAG: --reserved-memory="" Oct 30 08:52:24.568437 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561190 2585 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 30 08:52:24.568437 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561193 2585 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 30 08:52:24.568437 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561198 2585 flags.go:64] FLAG: --rotate-certificates="false" Oct 30 08:52:24.568437 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561211 2585 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 30 08:52:24.568437 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561215 2585 flags.go:64] FLAG: --runonce="false" Oct 30 08:52:24.568437 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561218 2585 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 30 08:52:24.568437 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561221 2585 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 30 08:52:24.568437 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561224 2585 flags.go:64] FLAG: --seccomp-default="false" Oct 30 08:52:24.568437 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561227 2585 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 30 08:52:24.568437 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561230 2585 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 30 08:52:24.568437 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561234 2585 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 30 08:52:24.568437 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561237 2585 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 30 08:52:24.568437 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561240 2585 flags.go:64] FLAG: --storage-driver-password="root" Oct 30 08:52:24.568437 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561243 2585 flags.go:64] FLAG: --storage-driver-secure="false" Oct 30 08:52:24.568437 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561246 2585 flags.go:64] FLAG: --storage-driver-table="stats" Oct 30 08:52:24.568437 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561249 2585 flags.go:64] FLAG: --storage-driver-user="root" Oct 30 08:52:24.568437 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561252 2585 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 30 08:52:24.568437 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561255 2585 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 30 08:52:24.568437 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561258 2585 flags.go:64] FLAG: --system-cgroups="" Oct 30 08:52:24.568437 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561261 2585 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 30 08:52:24.568437 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561266 2585 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 30 08:52:24.568437 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561268 2585 flags.go:64] FLAG: --tls-cert-file="" Oct 30 08:52:24.568437 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561271 2585 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 30 08:52:24.568437 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561275 2585 flags.go:64] FLAG: --tls-min-version="" Oct 30 08:52:24.568437 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561278 2585 flags.go:64] FLAG: --tls-private-key-file="" Oct 30 08:52:24.569019 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561281 2585 flags.go:64] FLAG: --topology-manager-policy="none" Oct 30 08:52:24.569019 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561284 2585 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 30 08:52:24.569019 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561289 2585 flags.go:64] FLAG: --topology-manager-scope="container" Oct 30 08:52:24.569019 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561292 2585 flags.go:64] FLAG: --v="2" Oct 30 08:52:24.569019 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561296 2585 flags.go:64] FLAG: --version="false" Oct 30 08:52:24.569019 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561300 2585 flags.go:64] FLAG: --vmodule="" Oct 30 08:52:24.569019 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561304 2585 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 30 08:52:24.569019 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561308 2585 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 30 08:52:24.569019 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561453 2585 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 08:52:24.569019 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561458 2585 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 08:52:24.569019 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561462 2585 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 08:52:24.569019 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561465 2585 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 08:52:24.569019 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561468 2585 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 08:52:24.569019 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561470 2585 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 08:52:24.569019 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561473 2585 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 08:52:24.569019 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561476 2585 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 08:52:24.569019 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561478 2585 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 08:52:24.569019 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561481 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 08:52:24.569019 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561484 2585 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 08:52:24.569019 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561486 2585 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 08:52:24.569019 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561489 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 08:52:24.569535 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561492 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 08:52:24.569535 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561495 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 08:52:24.569535 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561498 2585 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 08:52:24.569535 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561500 2585 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 08:52:24.569535 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561503 2585 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 08:52:24.569535 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561505 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 08:52:24.569535 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561508 2585 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 08:52:24.569535 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561511 2585 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 08:52:24.569535 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561513 2585 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 08:52:24.569535 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561516 2585 feature_gate.go:386] unrecognized feature gate: Example Oct 30 08:52:24.569535 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561519 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 08:52:24.569535 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561521 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 08:52:24.569535 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561524 2585 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 08:52:24.569535 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561528 2585 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 08:52:24.569535 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561531 2585 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 08:52:24.569535 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561533 2585 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 08:52:24.569535 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561536 2585 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 08:52:24.569535 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561539 2585 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 08:52:24.569535 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561541 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 08:52:24.569535 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561544 2585 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 08:52:24.570001 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561548 2585 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 08:52:24.570001 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561550 2585 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 08:52:24.570001 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561553 2585 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 08:52:24.570001 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561556 2585 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 08:52:24.570001 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561558 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 08:52:24.570001 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561561 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 08:52:24.570001 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561564 2585 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 08:52:24.570001 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561566 2585 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 08:52:24.570001 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561569 2585 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 08:52:24.570001 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561571 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 08:52:24.570001 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561574 2585 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 08:52:24.570001 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561577 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 08:52:24.570001 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561579 2585 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 08:52:24.570001 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561582 2585 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 08:52:24.570001 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561585 2585 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 08:52:24.570001 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561587 2585 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 08:52:24.570001 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561590 2585 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 08:52:24.570001 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561593 2585 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 08:52:24.570001 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561595 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 08:52:24.570466 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561598 2585 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 08:52:24.570466 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561600 2585 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 08:52:24.570466 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561604 2585 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 08:52:24.570466 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561607 2585 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 08:52:24.570466 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561610 2585 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 08:52:24.570466 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561612 2585 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 08:52:24.570466 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561616 2585 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 08:52:24.570466 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561618 2585 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 08:52:24.570466 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561621 2585 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 08:52:24.570466 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561624 2585 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 08:52:24.570466 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561626 2585 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 08:52:24.570466 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561629 2585 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 08:52:24.570466 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561631 2585 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 08:52:24.570466 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561636 2585 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 08:52:24.570466 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561638 2585 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 08:52:24.570466 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561641 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 08:52:24.570466 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561643 2585 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 08:52:24.570466 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561646 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 08:52:24.570466 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561649 2585 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 08:52:24.570909 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561651 2585 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 08:52:24.570909 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561654 2585 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 08:52:24.570909 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561656 2585 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 08:52:24.570909 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561659 2585 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 08:52:24.570909 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561662 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 08:52:24.570909 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561665 2585 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 08:52:24.570909 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561668 2585 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 08:52:24.570909 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561673 2585 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 08:52:24.570909 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561676 2585 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 08:52:24.570909 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561679 2585 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 08:52:24.570909 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561683 2585 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 08:52:24.570909 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561687 2585 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 08:52:24.570909 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561690 2585 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 08:52:24.570909 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561693 2585 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 08:52:24.570909 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561695 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 08:52:24.570909 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561698 2585 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 08:52:24.570909 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561701 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 08:52:24.570909 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561703 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 08:52:24.570909 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561706 2585 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 08:52:24.571407 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561710 2585 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 08:52:24.571407 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561712 2585 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 08:52:24.571407 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561715 2585 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 08:52:24.571407 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561718 2585 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 08:52:24.571407 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561720 2585 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 08:52:24.571407 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561723 2585 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 08:52:24.571407 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561725 2585 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 08:52:24.571407 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561729 2585 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 08:52:24.571407 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561733 2585 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 08:52:24.571407 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561735 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 08:52:24.571407 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561738 2585 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 08:52:24.571407 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561741 2585 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 08:52:24.571407 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561743 2585 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 08:52:24.571407 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561746 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 08:52:24.571407 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561749 2585 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 08:52:24.571407 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561751 2585 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 08:52:24.571779 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.561779 2585 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 08:52:24.571779 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561828 2585 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 08:52:24.571779 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561833 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 08:52:24.571779 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561836 2585 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 08:52:24.571779 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561839 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 08:52:24.571779 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561842 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 08:52:24.571779 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561845 2585 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 08:52:24.571779 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561847 2585 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 08:52:24.571779 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561850 2585 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 08:52:24.571779 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561853 2585 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 08:52:24.571779 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561855 2585 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 08:52:24.571779 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561858 2585 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 08:52:24.571779 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561860 2585 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 08:52:24.571779 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561863 2585 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 08:52:24.571779 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561866 2585 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 08:52:24.571779 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561868 2585 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 08:52:24.572160 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561872 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 08:52:24.572160 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561875 2585 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 08:52:24.572160 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561877 2585 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 08:52:24.572160 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561880 2585 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 08:52:24.572160 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561883 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 08:52:24.572160 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561885 2585 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 08:52:24.572160 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561888 2585 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 08:52:24.572160 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561891 2585 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 08:52:24.572160 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561894 2585 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 08:52:24.572160 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561898 2585 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 08:52:24.572160 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561901 2585 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 08:52:24.572160 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561904 2585 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 08:52:24.572160 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561906 2585 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 08:52:24.572160 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561908 2585 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 08:52:24.572160 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561911 2585 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 08:52:24.572160 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561914 2585 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 08:52:24.572160 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561916 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 08:52:24.572160 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561919 2585 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 08:52:24.572160 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561922 2585 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 08:52:24.572629 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561924 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 08:52:24.572629 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561927 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 08:52:24.572629 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561930 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 08:52:24.572629 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561933 2585 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 08:52:24.572629 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561936 2585 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 08:52:24.572629 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561938 2585 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 08:52:24.572629 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561941 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 08:52:24.572629 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561943 2585 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 08:52:24.572629 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561946 2585 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 08:52:24.572629 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561948 2585 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 08:52:24.572629 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561951 2585 feature_gate.go:386] unrecognized feature gate: Example Oct 30 08:52:24.572629 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561954 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 08:52:24.572629 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561956 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 08:52:24.572629 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561960 2585 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 08:52:24.572629 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561963 2585 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 08:52:24.572629 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561965 2585 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 08:52:24.572629 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561968 2585 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 08:52:24.572629 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561971 2585 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 08:52:24.572629 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561973 2585 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 08:52:24.572629 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561976 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 08:52:24.573102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561978 2585 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 08:52:24.573102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561982 2585 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 08:52:24.573102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561985 2585 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 08:52:24.573102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561988 2585 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 08:52:24.573102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561991 2585 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 08:52:24.573102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561993 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 08:52:24.573102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561996 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 08:52:24.573102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.561998 2585 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 08:52:24.573102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562001 2585 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 08:52:24.573102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562003 2585 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 08:52:24.573102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562006 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 08:52:24.573102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562009 2585 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 08:52:24.573102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562011 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 08:52:24.573102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562014 2585 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 08:52:24.573102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562017 2585 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 08:52:24.573102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562021 2585 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 08:52:24.573102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562023 2585 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 08:52:24.573102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562026 2585 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 08:52:24.573102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562028 2585 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 08:52:24.573680 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562031 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 08:52:24.573680 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562034 2585 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 08:52:24.573680 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562036 2585 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 08:52:24.573680 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562039 2585 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 08:52:24.573680 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562041 2585 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 08:52:24.573680 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562044 2585 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 08:52:24.573680 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562048 2585 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 08:52:24.573680 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562050 2585 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 08:52:24.573680 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562053 2585 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 08:52:24.573680 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562056 2585 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 08:52:24.573680 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562058 2585 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 08:52:24.573680 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562061 2585 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 08:52:24.573680 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562064 2585 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 08:52:24.573680 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562066 2585 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 08:52:24.573680 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562070 2585 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 08:52:24.573680 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562073 2585 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 08:52:24.573680 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562075 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 08:52:24.573680 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562078 2585 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 08:52:24.573680 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562081 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 08:52:24.574138 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562084 2585 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 08:52:24.574138 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562086 2585 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 08:52:24.574138 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562089 2585 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 08:52:24.574138 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562092 2585 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 08:52:24.574138 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562094 2585 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 08:52:24.574138 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562096 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 08:52:24.574138 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562099 2585 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 08:52:24.574138 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562103 2585 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 08:52:24.574138 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562107 2585 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 08:52:24.574138 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562110 2585 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 08:52:24.574138 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562114 2585 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 08:52:24.574138 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562119 2585 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 08:52:24.574138 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562122 2585 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 08:52:24.574138 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.562125 2585 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 08:52:24.574138 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.568824 2585 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 30 08:52:24.574138 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.568839 2585 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 30 08:52:24.574138 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.568849 2585 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 30 08:52:24.574138 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.568854 2585 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 30 08:52:24.574138 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568909 2585 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 08:52:24.574631 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568913 2585 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 08:52:24.574631 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568917 2585 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 08:52:24.574631 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568920 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 08:52:24.574631 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568923 2585 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 08:52:24.574631 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568925 2585 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 08:52:24.574631 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568928 2585 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 08:52:24.574631 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568931 2585 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 08:52:24.574631 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568934 2585 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 08:52:24.574631 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568936 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 08:52:24.574631 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568939 2585 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 08:52:24.574631 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568942 2585 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 08:52:24.574631 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568945 2585 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 08:52:24.574631 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568948 2585 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 08:52:24.574631 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568950 2585 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 08:52:24.574631 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568953 2585 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 08:52:24.574631 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568956 2585 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 08:52:24.574631 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568958 2585 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 08:52:24.574631 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568961 2585 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 08:52:24.574631 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568964 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 08:52:24.574631 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568966 2585 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 08:52:24.575102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568969 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 08:52:24.575102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568971 2585 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 08:52:24.575102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568974 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 08:52:24.575102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568977 2585 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 08:52:24.575102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568979 2585 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 08:52:24.575102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568982 2585 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 08:52:24.575102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568984 2585 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 08:52:24.575102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568987 2585 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 08:52:24.575102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568991 2585 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 08:52:24.575102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568994 2585 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 08:52:24.575102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.568996 2585 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 08:52:24.575102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569000 2585 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 08:52:24.575102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569002 2585 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 08:52:24.575102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569005 2585 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 08:52:24.575102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569007 2585 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 08:52:24.575102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569010 2585 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 08:52:24.575102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569013 2585 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 08:52:24.575102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569015 2585 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 08:52:24.575102 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569018 2585 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 08:52:24.575572 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569020 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 08:52:24.575572 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569023 2585 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 08:52:24.575572 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569026 2585 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 08:52:24.575572 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569030 2585 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 08:52:24.575572 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569035 2585 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 08:52:24.575572 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569038 2585 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 08:52:24.575572 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569041 2585 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 08:52:24.575572 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569044 2585 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 08:52:24.575572 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569047 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 08:52:24.575572 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569049 2585 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 08:52:24.575572 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569052 2585 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 08:52:24.575572 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569055 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 08:52:24.575572 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569057 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 08:52:24.575572 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569060 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 08:52:24.575572 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569063 2585 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 08:52:24.575572 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569065 2585 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 08:52:24.575572 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569068 2585 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 08:52:24.575572 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569070 2585 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 08:52:24.575572 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569073 2585 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 08:52:24.576020 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569075 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 08:52:24.576020 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569078 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 08:52:24.576020 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569081 2585 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 08:52:24.576020 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569085 2585 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 08:52:24.576020 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569088 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 08:52:24.576020 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569090 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 08:52:24.576020 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569093 2585 feature_gate.go:386] unrecognized feature gate: Example Oct 30 08:52:24.576020 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569095 2585 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 08:52:24.576020 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569098 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 08:52:24.576020 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569100 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 08:52:24.576020 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569103 2585 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 08:52:24.576020 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569106 2585 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 08:52:24.576020 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569109 2585 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 08:52:24.576020 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569113 2585 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 08:52:24.576020 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569116 2585 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 08:52:24.576020 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569119 2585 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 08:52:24.576020 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569122 2585 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 08:52:24.576020 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569125 2585 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 08:52:24.576020 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569128 2585 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 08:52:24.576020 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569130 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 08:52:24.576496 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569133 2585 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 08:52:24.576496 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569136 2585 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 08:52:24.576496 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569139 2585 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 08:52:24.576496 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569141 2585 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 08:52:24.576496 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569144 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 08:52:24.576496 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569146 2585 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 08:52:24.576496 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569149 2585 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 08:52:24.576496 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569151 2585 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 08:52:24.576496 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569154 2585 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 08:52:24.576496 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569157 2585 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 08:52:24.576496 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569159 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 08:52:24.576496 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569162 2585 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 08:52:24.576496 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569164 2585 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 08:52:24.576496 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569167 2585 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 08:52:24.576496 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569170 2585 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 08:52:24.576496 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569173 2585 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 08:52:24.576496 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569176 2585 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 08:52:24.576496 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569179 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 08:52:24.576496 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569181 2585 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 08:52:24.576496 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569184 2585 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 08:52:24.576956 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569187 2585 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 08:52:24.576956 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569189 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 08:52:24.576956 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569192 2585 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 08:52:24.576956 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569194 2585 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 08:52:24.576956 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569197 2585 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 08:52:24.576956 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569199 2585 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 08:52:24.576956 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569213 2585 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 08:52:24.576956 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.569241 2585 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 08:52:24.576956 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569380 2585 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 08:52:24.576956 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569384 2585 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 08:52:24.576956 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569387 2585 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 08:52:24.576956 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569390 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 08:52:24.576956 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569392 2585 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 08:52:24.576956 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569395 2585 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 08:52:24.576956 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569398 2585 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 08:52:24.576956 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569400 2585 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 08:52:24.577358 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569403 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 08:52:24.577358 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569405 2585 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 08:52:24.577358 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569408 2585 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 08:52:24.577358 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569410 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 08:52:24.577358 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569413 2585 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 08:52:24.577358 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569416 2585 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 08:52:24.577358 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569418 2585 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 08:52:24.577358 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569421 2585 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 08:52:24.577358 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569423 2585 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 08:52:24.577358 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569426 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 08:52:24.577358 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569428 2585 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 08:52:24.577358 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569431 2585 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 08:52:24.577358 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569434 2585 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 08:52:24.577358 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569438 2585 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 08:52:24.577358 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569442 2585 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 08:52:24.577358 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569446 2585 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 08:52:24.577358 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569449 2585 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 08:52:24.577358 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569452 2585 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 08:52:24.577358 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569454 2585 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 08:52:24.577832 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569457 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 08:52:24.577832 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569460 2585 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 08:52:24.577832 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569462 2585 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 08:52:24.577832 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569465 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 08:52:24.577832 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569467 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 08:52:24.577832 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569470 2585 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 08:52:24.577832 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569472 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 08:52:24.577832 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569475 2585 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 08:52:24.577832 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569477 2585 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 08:52:24.577832 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569480 2585 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 08:52:24.577832 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569483 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 08:52:24.577832 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569486 2585 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 08:52:24.577832 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569488 2585 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 08:52:24.577832 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569491 2585 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 08:52:24.577832 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569493 2585 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 08:52:24.577832 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569496 2585 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 08:52:24.577832 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569498 2585 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 08:52:24.577832 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569501 2585 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 08:52:24.577832 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569504 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 08:52:24.577832 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569506 2585 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 08:52:24.578303 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569509 2585 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 08:52:24.578303 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569511 2585 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 08:52:24.578303 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569514 2585 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 08:52:24.578303 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569516 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 08:52:24.578303 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569519 2585 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 08:52:24.578303 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569522 2585 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 08:52:24.578303 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569524 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 08:52:24.578303 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569527 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 08:52:24.578303 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569530 2585 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 08:52:24.578303 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569532 2585 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 08:52:24.578303 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569535 2585 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 08:52:24.578303 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569538 2585 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 08:52:24.578303 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569540 2585 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 08:52:24.578303 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569543 2585 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 08:52:24.578303 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569546 2585 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 08:52:24.578303 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569548 2585 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 08:52:24.578303 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569551 2585 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 08:52:24.578303 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569553 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 08:52:24.578303 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569556 2585 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 08:52:24.578303 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569558 2585 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 08:52:24.578765 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569561 2585 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 08:52:24.578765 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569564 2585 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 08:52:24.578765 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569566 2585 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 08:52:24.578765 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569568 2585 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 08:52:24.578765 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569571 2585 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 08:52:24.578765 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569573 2585 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 08:52:24.578765 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569577 2585 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 08:52:24.578765 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569581 2585 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 08:52:24.578765 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569584 2585 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 08:52:24.578765 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569587 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 08:52:24.578765 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569590 2585 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 08:52:24.578765 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569593 2585 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 08:52:24.578765 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569596 2585 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 08:52:24.578765 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569598 2585 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 08:52:24.578765 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569601 2585 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 08:52:24.578765 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569604 2585 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 08:52:24.578765 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569606 2585 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 08:52:24.578765 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569609 2585 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 08:52:24.578765 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569611 2585 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 08:52:24.578765 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569614 2585 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 08:52:24.579234 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569617 2585 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 08:52:24.579234 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569620 2585 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 08:52:24.579234 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569622 2585 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 08:52:24.579234 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569625 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 08:52:24.579234 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569627 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 08:52:24.579234 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569630 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 08:52:24.579234 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569632 2585 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 08:52:24.579234 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569635 2585 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 08:52:24.579234 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569638 2585 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 08:52:24.579234 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569640 2585 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 08:52:24.579234 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569643 2585 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 08:52:24.579234 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569645 2585 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 08:52:24.579234 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569648 2585 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 08:52:24.579234 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569650 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 08:52:24.579234 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569653 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 08:52:24.579234 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569655 2585 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 08:52:24.579234 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569658 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 08:52:24.579234 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569661 2585 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 08:52:24.579234 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569663 2585 feature_gate.go:386] unrecognized feature gate: Example Oct 30 08:52:24.579674 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.569686 2585 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 08:52:24.579674 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569716 2585 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 08:52:24.579674 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569720 2585 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 08:52:24.579674 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569722 2585 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 08:52:24.579674 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569725 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 08:52:24.579674 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569727 2585 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 08:52:24.579674 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569730 2585 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 08:52:24.579674 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569733 2585 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 08:52:24.579674 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569736 2585 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 08:52:24.579674 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569738 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 08:52:24.579674 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569741 2585 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 08:52:24.579674 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569744 2585 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 08:52:24.579674 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569746 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 08:52:24.579674 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569749 2585 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 08:52:24.579674 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569752 2585 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 08:52:24.579674 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569755 2585 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 08:52:24.580076 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569757 2585 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 08:52:24.580076 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569760 2585 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 08:52:24.580076 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569762 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 08:52:24.580076 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569765 2585 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 08:52:24.580076 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569767 2585 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 08:52:24.580076 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569770 2585 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 08:52:24.580076 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569773 2585 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 08:52:24.580076 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569777 2585 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 08:52:24.580076 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569780 2585 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 08:52:24.580076 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569782 2585 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 08:52:24.580076 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569785 2585 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 08:52:24.580076 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569787 2585 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 08:52:24.580076 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569790 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 08:52:24.580076 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569793 2585 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 08:52:24.580076 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569795 2585 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 08:52:24.580076 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569801 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 08:52:24.580076 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569803 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 08:52:24.580076 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569806 2585 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 08:52:24.580076 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569809 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 08:52:24.580634 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569811 2585 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 08:52:24.580634 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569814 2585 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 08:52:24.580634 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569816 2585 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 08:52:24.580634 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569819 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 08:52:24.580634 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569821 2585 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 08:52:24.580634 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569824 2585 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 08:52:24.580634 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569826 2585 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 08:52:24.580634 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569829 2585 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 08:52:24.580634 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569831 2585 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 08:52:24.580634 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569834 2585 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 08:52:24.580634 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569836 2585 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 08:52:24.580634 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569839 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 08:52:24.580634 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569842 2585 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 08:52:24.580634 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569845 2585 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 08:52:24.580634 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569847 2585 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 08:52:24.580634 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569850 2585 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 08:52:24.580634 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569852 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 08:52:24.580634 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569855 2585 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 08:52:24.580634 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569857 2585 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 08:52:24.580634 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569860 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 08:52:24.581098 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569863 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 08:52:24.581098 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569866 2585 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 08:52:24.581098 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569868 2585 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 08:52:24.581098 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569871 2585 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 08:52:24.581098 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569873 2585 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 08:52:24.581098 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569876 2585 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 08:52:24.581098 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569878 2585 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 08:52:24.581098 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569881 2585 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 08:52:24.581098 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569885 2585 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 08:52:24.581098 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569887 2585 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 08:52:24.581098 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569890 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 08:52:24.581098 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569892 2585 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 08:52:24.581098 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569895 2585 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 08:52:24.581098 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569897 2585 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 08:52:24.581098 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569900 2585 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 08:52:24.581098 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569902 2585 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 08:52:24.581098 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569905 2585 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 08:52:24.581098 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569907 2585 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 08:52:24.581098 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569913 2585 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 08:52:24.581098 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569917 2585 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 08:52:24.581756 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569921 2585 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 08:52:24.581756 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569924 2585 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 08:52:24.581756 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569927 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 08:52:24.581756 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569929 2585 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 08:52:24.581756 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569932 2585 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 08:52:24.581756 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569935 2585 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 08:52:24.581756 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569939 2585 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 08:52:24.581756 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569941 2585 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 08:52:24.581756 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569944 2585 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 08:52:24.581756 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569946 2585 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 08:52:24.581756 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569949 2585 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 08:52:24.581756 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569952 2585 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 08:52:24.581756 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569954 2585 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 08:52:24.581756 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569957 2585 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 08:52:24.581756 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569959 2585 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 08:52:24.581756 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569962 2585 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 08:52:24.581756 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569965 2585 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 08:52:24.581756 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569967 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 08:52:24.581756 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569970 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 08:52:24.582385 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569972 2585 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 08:52:24.582385 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569979 2585 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 08:52:24.582385 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569982 2585 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 08:52:24.582385 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569985 2585 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 08:52:24.582385 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569987 2585 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 08:52:24.582385 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569990 2585 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 08:52:24.582385 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569993 2585 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 08:52:24.582385 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569995 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 08:52:24.582385 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.569998 2585 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 08:52:24.582385 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.570000 2585 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 08:52:24.582385 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.570003 2585 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 08:52:24.582385 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.570007 2585 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 08:52:24.582385 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:24.570011 2585 feature_gate.go:386] unrecognized feature gate: Example Oct 30 08:52:24.582385 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.570068 2585 server.go:957] "Client rotation is on, will bootstrap in background" Oct 30 08:52:24.582385 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.574075 2585 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Oct 30 08:52:24.582385 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.575200 2585 server.go:1014] "Starting client certificate rotation" Oct 30 08:52:24.582385 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.575309 2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 08:52:24.582385 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.575994 2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 08:52:24.582857 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.578033 2585 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 08:52:24.583661 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.583644 2585 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 08:52:24.594298 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.594282 2585 log.go:25] "Validated CRI v1 runtime API" Oct 30 08:52:24.598101 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.598087 2585 log.go:25] "Validated CRI v1 image API" Oct 30 08:52:24.598948 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.598927 2585 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 30 08:52:24.604409 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.604383 2585 fs.go:135] Filesystem UUIDs: map[24637759-fa63-4973-b3f8-564ac474b0a9:/dev/nvme0n1p4 561aa8b2-00a8-4a79-9474-41dd58af7988:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Oct 30 08:52:24.604488 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.604408 2585 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Oct 30 08:52:24.609318 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.609189 2585 manager.go:217] Machine: {Timestamp:2026-10-30 08:52:24.608743782 +0000 UTC m=+0.361805842 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3138729 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27eeb944fb90d19bdcb2f164757b65 SystemUUID:ec27eeb9-44fb-90d1-9bdc-b2f164757b65 BootID:7d7dda57-ffc8-4a7f-8f0f-e08d7eaa0aa4 Filesystems:[{Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:ca:24:c9:f3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:ca:24:c9:f3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:71:7e:df:42:a5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 30 08:52:24.609318 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.609306 2585 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 30 08:52:24.609544 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.609437 2585 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 30 08:52:24.613144 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.613119 2585 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 30 08:52:24.613278 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.613146 2585 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-65.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 30 08:52:24.613331 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.613280 2585 topology_manager.go:143] "Creating topology manager with none policy" Oct 30 08:52:24.613331 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.613288 2585 container_manager_linux.go:311] "Creating device plugin manager" Oct 30 08:52:24.613331 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.613304 2585 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 08:52:24.613331 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.613317 2585 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 08:52:24.614575 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.614564 2585 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 30 08:52:24.619232 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.619220 2585 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 30 08:52:24.619366 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.619357 2585 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 30 08:52:24.620858 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.620845 2585 kubelet.go:493] "Attempting to sync node with API server" Oct 30 08:52:24.620919 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.620862 2585 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 30 08:52:24.620919 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.620877 2585 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 30 08:52:24.620919 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.620885 2585 kubelet.go:405] "Adding apiserver pod source" Oct 30 08:52:24.620919 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.620893 2585 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 30 08:52:24.621235 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.621224 2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 08:52:24.623786 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.623764 2585 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 30 08:52:24.630245 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.630233 2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 08:52:24.631132 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.631121 2585 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 30 08:52:24.631166 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.631150 2585 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 30 08:52:24.631319 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.631310 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 30 08:52:24.631349 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.631325 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 30 08:52:24.631349 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.631331 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 30 08:52:24.631349 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.631337 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 30 08:52:24.631349 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.631343 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 30 08:52:24.631349 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.631349 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 30 08:52:24.631972 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.631962 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 30 08:52:24.631999 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.631972 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 30 08:52:24.631999 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.631980 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 30 08:52:24.631999 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.631986 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 30 08:52:24.632075 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.632002 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 30 08:52:24.632075 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.632011 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 30 08:52:24.632914 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.632905 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 30 08:52:24.632951 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.632915 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 30 08:52:24.636484 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.636473 2585 server.go:1263] "Started kubelet" Oct 30 08:52:24.637624 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.637344 2585 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 30 08:52:24.637823 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.636647 2585 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 30 08:52:24.637872 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.637842 2585 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 30 08:52:24.637947 ip-10-0-140-65 systemd[1]: Started Kubernetes Kubelet. Oct 30 08:52:24.639245 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.639226 2585 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 30 08:52:24.643442 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.643425 2585 server.go:317] "Adding debug handlers to kubelet server" Oct 30 08:52:24.645630 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:24.645603 2585 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Oct 30 08:52:24.649757 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.649741 2585 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 30 08:52:24.649846 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.649758 2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 30 08:52:24.649846 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:24.649825 2585 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-65.ec2.internal\" not found" Oct 30 08:52:24.650539 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.650518 2585 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 30 08:52:24.650539 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.650538 2585 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 30 08:52:24.650667 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.650517 2585 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 30 08:52:24.650718 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.650680 2585 reconstruct.go:97] "Volume reconstruction finished" Oct 30 08:52:24.650718 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.650694 2585 reconciler.go:29] "Reconciler: start to sync state" Oct 30 08:52:24.650799 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.650761 2585 factory.go:55] Registering systemd factory Oct 30 08:52:24.650799 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.650776 2585 factory.go:223] Registration of the systemd container factory successfully Oct 30 08:52:24.650972 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.650960 2585 factory.go:153] Registering CRI-O factory Oct 30 08:52:24.651012 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.650974 2585 factory.go:223] Registration of the crio container factory successfully Oct 30 08:52:24.651042 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.651013 2585 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 30 08:52:24.651042 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.651025 2585 factory.go:103] Registering Raw factory Oct 30 08:52:24.651042 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.651035 2585 manager.go:1199] Started watching for new ooms in manager Oct 30 08:52:24.652185 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.652171 2585 manager.go:319] Starting recovery of all containers Oct 30 08:52:24.664432 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.664368 2585 manager.go:324] Recovery completed Oct 30 08:52:24.669056 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.669042 2585 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 08:52:24.670629 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.670603 2585 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-65.ec2.internal" event="NodeHasSufficientMemory" Oct 30 08:52:24.670704 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.670641 2585 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-65.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 08:52:24.670704 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.670653 2585 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-65.ec2.internal" event="NodeHasSufficientPID" Oct 30 08:52:24.673050 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.673032 2585 cpu_manager.go:226] "Starting" policy="none" Oct 30 08:52:24.673050 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.673047 2585 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 30 08:52:24.673155 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.673057 2585 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 08:52:24.673155 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.673067 2585 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 30 08:52:24.673767 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.673750 2585 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-65.ec2.internal" event="NodeHasSufficientMemory" Oct 30 08:52:24.673830 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.673779 2585 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-65.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 08:52:24.673830 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.673791 2585 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-65.ec2.internal" event="NodeHasSufficientPID" Oct 30 08:52:24.674671 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.674652 2585 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 30 08:52:24.675140 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:24.675114 2585 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-65.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Oct 30 08:52:24.675188 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.675149 2585 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-65.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Oct 30 08:52:24.675377 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.675360 2585 policy_none.go:50] "Start" Oct 30 08:52:24.675377 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.675377 2585 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 30 08:52:24.675520 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.675387 2585 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 30 08:52:24.676248 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:24.675105 2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-65.ec2.internal.18e342a309e123c3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-65.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-65.ec2.internal,},FirstTimestamp:2026-10-30 08:52:24.636441539 +0000 UTC m=+0.389503580,LastTimestamp:2026-10-30 08:52:24.636441539 +0000 UTC m=+0.389503580,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-65.ec2.internal,}" Oct 30 08:52:24.677415 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.677402 2585 policy_none.go:44] "Start" Oct 30 08:52:24.696763 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:24.696693 2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-65.ec2.internal.18e342a30beac5b3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-65.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-65.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-65.ec2.internal,},FirstTimestamp:2026-10-30 08:52:24.670627251 +0000 UTC m=+0.423689291,LastTimestamp:2026-10-30 08:52:24.670627251 +0000 UTC m=+0.423689291,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-65.ec2.internal,}" Oct 30 08:52:24.696763 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:24.696749 2585 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-65.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" Oct 30 08:52:24.696903 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:24.696809 2585 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Oct 30 08:52:24.697019 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:24.697003 2585 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" Oct 30 08:52:24.702139 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.702120 2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k684w" Oct 30 08:52:24.714957 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.714939 2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k684w" Oct 30 08:52:24.737600 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:24.720743 2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-65.ec2.internal.18e342a30beb1307 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-65.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-65.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-65.ec2.internal,},FirstTimestamp:2026-10-30 08:52:24.670647047 +0000 UTC m=+0.423709088,LastTimestamp:2026-10-30 08:52:24.670647047 +0000 UTC m=+0.423709088,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-65.ec2.internal,}" Oct 30 08:52:24.737600 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.723838 2585 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 30 08:52:24.737600 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.726832 2585 manager.go:341] "Starting Device Plugin manager" Oct 30 08:52:24.737600 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:24.726860 2585 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 30 08:52:24.737600 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.726871 2585 server.go:87] "Starting device plugin registration server" Oct 30 08:52:24.737600 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.727089 2585 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 30 08:52:24.737600 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.727100 2585 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 30 08:52:24.737600 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.727171 2585 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 30 08:52:24.737600 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.727255 2585 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 30 08:52:24.737600 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.727264 2585 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 30 08:52:24.737600 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:24.727632 2585 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 30 08:52:24.737600 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:24.727670 2585 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-65.ec2.internal\" not found" Oct 30 08:52:24.750084 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.750069 2585 container_manager_linux.go:682] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2622 into the system container \"/system.slice\": " Oct 30 08:52:24.827297 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.827237 2585 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 08:52:24.827922 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.827908 2585 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-65.ec2.internal" event="NodeHasSufficientMemory" Oct 30 08:52:24.827976 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.827936 2585 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-65.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 08:52:24.827976 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.827951 2585 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-65.ec2.internal" event="NodeHasSufficientPID" Oct 30 08:52:24.827976 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.827973 2585 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-140-65.ec2.internal" Oct 30 08:52:24.846622 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.846600 2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 30 08:52:24.847652 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.847636 2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 30 08:52:24.847652 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.847652 2585 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 30 08:52:24.847758 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.847672 2585 kubelet.go:2521] "Starting kubelet main sync loop" Oct 30 08:52:24.847758 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:24.847699 2585 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Oct 30 08:52:24.850920 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.850904 2585 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-140-65.ec2.internal" Oct 30 08:52:24.851007 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:24.850927 2585 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-65.ec2.internal\": node \"ip-10-0-140-65.ec2.internal\" not found" Oct 30 08:52:24.864960 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.864945 2585 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 08:52:24.896412 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:24.896393 2585 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-65.ec2.internal\" not found" Oct 30 08:52:24.948215 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.948177 2585 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-65.ec2.internal"] Oct 30 08:52:24.948290 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.948264 2585 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 08:52:24.950307 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.950291 2585 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-65.ec2.internal" event="NodeHasSufficientMemory" Oct 30 08:52:24.950374 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.950319 2585 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-65.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 08:52:24.950374 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.950333 2585 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-65.ec2.internal" event="NodeHasSufficientPID" Oct 30 08:52:24.952543 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.952530 2585 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 08:52:24.952684 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.952670 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal" Oct 30 08:52:24.952733 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.952699 2585 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 08:52:24.953369 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.953351 2585 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-65.ec2.internal" event="NodeHasSufficientMemory" Oct 30 08:52:24.953467 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.953379 2585 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-65.ec2.internal" event="NodeHasSufficientMemory" Oct 30 08:52:24.953467 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.953393 2585 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-65.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 08:52:24.953467 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.953399 2585 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-65.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 08:52:24.953467 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.953408 2585 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-65.ec2.internal" event="NodeHasSufficientPID" Oct 30 08:52:24.953467 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.953414 2585 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-65.ec2.internal" event="NodeHasSufficientPID" Oct 30 08:52:24.955608 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.955593 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-65.ec2.internal" Oct 30 08:52:24.955687 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.955621 2585 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 08:52:24.956451 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.956428 2585 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-65.ec2.internal" event="NodeHasSufficientMemory" Oct 30 08:52:24.956531 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.956458 2585 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-65.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 08:52:24.956531 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:24.956468 2585 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-65.ec2.internal" event="NodeHasSufficientPID" Oct 30 08:52:24.983598 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:24.983579 2585 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-65.ec2.internal\" not found" node="ip-10-0-140-65.ec2.internal" Oct 30 08:52:24.986231 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:24.986195 2585 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-65.ec2.internal\" not found" node="ip-10-0-140-65.ec2.internal" Oct 30 08:52:24.997057 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:24.997038 2585 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-65.ec2.internal\" not found" Oct 30 08:52:25.051950 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:25.051924 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ef96270cb9f6591ce2fc63b09dc321b6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal\" (UID: \"ef96270cb9f6591ce2fc63b09dc321b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal" Oct 30 08:52:25.052010 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:25.051954 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef96270cb9f6591ce2fc63b09dc321b6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal\" (UID: \"ef96270cb9f6591ce2fc63b09dc321b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal" Oct 30 08:52:25.052010 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:25.051969 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/95a72c37fac53f4d285523d303757dc7-config\") pod \"kube-apiserver-proxy-ip-10-0-140-65.ec2.internal\" (UID: \"95a72c37fac53f4d285523d303757dc7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-65.ec2.internal" Oct 30 08:52:25.097961 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:25.097914 2585 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-65.ec2.internal\" not found" Oct 30 08:52:25.152851 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:25.152827 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ef96270cb9f6591ce2fc63b09dc321b6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal\" (UID: \"ef96270cb9f6591ce2fc63b09dc321b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal" Oct 30 08:52:25.152913 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:25.152856 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef96270cb9f6591ce2fc63b09dc321b6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal\" (UID: \"ef96270cb9f6591ce2fc63b09dc321b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal" Oct 30 08:52:25.152913 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:25.152871 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/95a72c37fac53f4d285523d303757dc7-config\") pod \"kube-apiserver-proxy-ip-10-0-140-65.ec2.internal\" (UID: \"95a72c37fac53f4d285523d303757dc7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-65.ec2.internal" Oct 30 08:52:25.152985 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:25.152926 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/95a72c37fac53f4d285523d303757dc7-config\") pod \"kube-apiserver-proxy-ip-10-0-140-65.ec2.internal\" (UID: \"95a72c37fac53f4d285523d303757dc7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-65.ec2.internal" Oct 30 08:52:25.152985 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:25.152930 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ef96270cb9f6591ce2fc63b09dc321b6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal\" (UID: \"ef96270cb9f6591ce2fc63b09dc321b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal" Oct 30 08:52:25.152985 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:25.152940 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef96270cb9f6591ce2fc63b09dc321b6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal\" (UID: \"ef96270cb9f6591ce2fc63b09dc321b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal" Oct 30 08:52:25.198519 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:25.198498 2585 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-65.ec2.internal\" not found" Oct 30 08:52:25.287189 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:25.287168 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal" Oct 30 08:52:25.289329 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:25.289308 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-65.ec2.internal" Oct 30 08:52:25.299102 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:25.298993 2585 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-65.ec2.internal\" not found" Oct 30 08:52:25.399553 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:25.399488 2585 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-65.ec2.internal\" not found" Oct 30 08:52:25.499953 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:25.499923 2585 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-65.ec2.internal\" not found" Oct 30 08:52:25.574465 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:25.574441 2585 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Oct 30 08:52:25.574934 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:25.574598 2585 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Oct 30 08:52:25.600139 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:25.600116 2585 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-65.ec2.internal\" not found" Oct 30 08:52:25.700878 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:25.700851 2585 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-65.ec2.internal\" not found" Oct 30 08:52:25.719845 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:25.719787 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 08:47:25 +0000 UTC" deadline="2028-06-05 04:08:27.035961713 +0000 UTC" Oct 30 08:52:25.719845 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:25.719843 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14011h16m1.316121285s" Oct 30 08:52:25.730915 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:25.730895 2585 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 08:52:25.732323 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:25.732305 2585 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-65.ec2.internal" event="NodeHasSufficientMemory" Oct 30 08:52:25.732417 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:25.732337 2585 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-65.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 08:52:25.732417 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:25.732363 2585 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-65.ec2.internal" event="NodeHasSufficientPID" Oct 30 08:52:25.801282 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:25.801263 2585 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-65.ec2.internal\" not found" Oct 30 08:52:25.808007 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:25.807983 2585 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef96270cb9f6591ce2fc63b09dc321b6.slice/crio-c62189c32b3cc816fe6a0e7861b154718b899119ced51829b3ffa2e44217f4fe WatchSource:0}: Error finding container c62189c32b3cc816fe6a0e7861b154718b899119ced51829b3ffa2e44217f4fe: Status 404 returned error can't find the container with id c62189c32b3cc816fe6a0e7861b154718b899119ced51829b3ffa2e44217f4fe Oct 30 08:52:25.814373 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:25.814356 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 08:52:25.821726 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:25.821699 2585 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95a72c37fac53f4d285523d303757dc7.slice/crio-637c8cb7d8f5c83b8ae118fd9e09ba89952b3df9ecd1e395a6025274cde8d31d WatchSource:0}: Error finding container 637c8cb7d8f5c83b8ae118fd9e09ba89952b3df9ecd1e395a6025274cde8d31d: Status 404 returned error can't find the container with id 637c8cb7d8f5c83b8ae118fd9e09ba89952b3df9ecd1e395a6025274cde8d31d Oct 30 08:52:25.851241 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:25.851190 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal" event={"ID":"ef96270cb9f6591ce2fc63b09dc321b6","Type":"ContainerStarted","Data":"c62189c32b3cc816fe6a0e7861b154718b899119ced51829b3ffa2e44217f4fe"} Oct 30 08:52:25.852219 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:25.852173 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-65.ec2.internal" event={"ID":"95a72c37fac53f4d285523d303757dc7","Type":"ContainerStarted","Data":"637c8cb7d8f5c83b8ae118fd9e09ba89952b3df9ecd1e395a6025274cde8d31d"} Oct 30 08:52:25.902329 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:25.902300 2585 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-65.ec2.internal\" not found" Oct 30 08:52:26.002567 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:26.002511 2585 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-65.ec2.internal\" not found" Oct 30 08:52:26.023055 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.023037 2585 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 08:52:26.051235 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.051192 2585 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal" Oct 30 08:52:26.078584 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.078564 2585 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 08:52:26.080063 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.080051 2585 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-65.ec2.internal" Oct 30 08:52:26.099366 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.099349 2585 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 08:52:26.138817 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.138796 2585 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 08:52:26.326968 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.326884 2585 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 08:52:26.622761 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.622690 2585 apiserver.go:52] "Watching apiserver" Oct 30 08:52:26.650455 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.650427 2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Oct 30 08:52:26.652754 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.652720 2585 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 30 08:52:26.653093 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.653071 2585 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-xgdfr","kube-system/konnectivity-agent-wzfpw","openshift-cluster-node-tuning-operator/tuned-kw85k","openshift-image-registry/node-ca-9fzvv","openshift-multus/multus-s9pz8","openshift-network-diagnostics/network-check-target-gn6v4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc","openshift-network-operator/iptables-alerter-nnwhb","openshift-ovn-kubernetes/ovnkube-node-gdgzh","kube-system/kube-apiserver-proxy-ip-10-0-140-65.ec2.internal","openshift-dns/node-resolver-bqlk7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal","openshift-multus/multus-additional-cni-plugins-xwrk9","openshift-multus/network-metrics-daemon-rtjs6"] Oct 30 08:52:26.655892 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.655859 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:52:26.658216 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.658188 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:52:26.660615 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.660592 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.662886 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.662865 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9fzvv" Oct 30 08:52:26.665391 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.665371 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.667770 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.667751 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gn6v4" Oct 30 08:52:26.667868 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:26.667847 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gn6v4" podUID="26e2f6af-5dbf-44c2-9acf-58c70be503bf" Oct 30 08:52:26.670569 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.670547 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.671867 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.671848 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 30 08:52:26.671957 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.671942 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 30 08:52:26.672025 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.671972 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 30 08:52:26.674354 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.672575 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-82c76\"" Oct 30 08:52:26.674354 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.673763 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gmnvz\"" Oct 30 08:52:26.674354 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.673858 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 30 08:52:26.674354 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.673976 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 30 08:52:26.674626 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.674523 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 30 08:52:26.674626 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.674622 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:26.675790 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:26.674711 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgdfr" podUID="f039cecc-3f4f-4e9b-94e5-5d46918f9487" Oct 30 08:52:26.677470 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.677450 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wzfpw" Oct 30 08:52:26.679768 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.679744 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:52:26.679876 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.679859 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 30 08:52:26.679947 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.679927 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 30 08:52:26.680011 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:26.679938 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtjs6" podUID="fece1d69-0824-4ecc-ad78-cea4e19bde61" Oct 30 08:52:26.680071 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.680008 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 30 08:52:26.682247 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.682230 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bqlk7" Oct 30 08:52:26.684397 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.684376 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nnwhb" Oct 30 08:52:26.684912 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.684887 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 30 08:52:26.685007 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.684994 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 30 08:52:26.685067 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.685043 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-mkl4r\"" Oct 30 08:52:26.685119 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.685090 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zg48k\"" Oct 30 08:52:26.685176 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.685153 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 30 08:52:26.685176 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.685053 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8d9hk\"" Oct 30 08:52:26.685176 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.685173 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 30 08:52:26.685345 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.685307 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 30 08:52:26.713617 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.713171 2585 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 30 08:52:26.713617 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.713260 2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-k7f7w" Oct 30 08:52:26.752042 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.752025 2585 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 30 08:52:26.761414 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.761389 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d03bffbe-b198-427f-86cb-e854d42260a5-ovnkube-script-lib\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.761513 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.761418 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e1be1b32-6246-4b96-a707-6df15d3d950f-konnectivity-ca\") pod \"konnectivity-agent-wzfpw\" (UID: \"e1be1b32-6246-4b96-a707-6df15d3d950f\") " pod="kube-system/konnectivity-agent-wzfpw" Oct 30 08:52:26.761513 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.761435 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-node-log\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.761513 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.761457 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-etc-openvswitch\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.761647 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.761581 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d03bffbe-b198-427f-86cb-e854d42260a5-env-overrides\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.761647 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.761619 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvpsp\" (UniqueName: \"kubernetes.io/projected/af7f9e2a-c57b-4396-bd6e-40c05cf1ef42-kube-api-access-zvpsp\") pod \"node-ca-9fzvv\" (UID: \"af7f9e2a-c57b-4396-bd6e-40c05cf1ef42\") " pod="openshift-image-registry/node-ca-9fzvv" Oct 30 08:52:26.761731 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.761651 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0eac401-f877-428f-b85c-271fa0aca679-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:52:26.761731 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.761712 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-systemd\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.761808 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.761750 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-multus-cni-dir\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.761808 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.761777 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-run-ovn-kubernetes\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.761808 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.761797 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0eac401-f877-428f-b85c-271fa0aca679-cnibin\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:52:26.761953 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.761844 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-sysconfig\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.761953 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.761886 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-sysctl-conf\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.761953 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.761921 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0df87d60-113c-4039-93a4-06205c202a73-cni-binary-copy\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.762103 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.761963 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-run-netns\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.762103 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.761993 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3447411a-b1de-406a-9df8-4d5e565add87-iptables-alerter-script\") pod \"iptables-alerter-nnwhb\" (UID: \"3447411a-b1de-406a-9df8-4d5e565add87\") " pod="openshift-network-operator/iptables-alerter-nnwhb" Oct 30 08:52:26.762103 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.762047 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-device-dir\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:52:26.762103 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.762086 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-sys-fs\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:52:26.762327 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.762125 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxbkp\" (UniqueName: \"kubernetes.io/projected/d03bffbe-b198-427f-86cb-e854d42260a5-kube-api-access-gxbkp\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.762327 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.762157 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e0eac401-f877-428f-b85c-271fa0aca679-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:52:26.762327 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.762208 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0df87d60-113c-4039-93a4-06205c202a73-multus-daemon-config\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.762327 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.762239 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-run-multus-certs\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.762327 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.762306 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-etc-kubernetes\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.762558 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.762344 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-registration-dir\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:52:26.762558 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.762386 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-run-netns\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.762558 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.762425 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-run-systemd\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.762558 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.762466 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttr59\" (UniqueName: \"kubernetes.io/projected/26e2f6af-5dbf-44c2-9acf-58c70be503bf-kube-api-access-ttr59\") pod \"network-check-target-gn6v4\" (UID: \"26e2f6af-5dbf-44c2-9acf-58c70be503bf\") " pod="openshift-network-diagnostics/network-check-target-gn6v4" Oct 30 08:52:26.762558 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.762511 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fece1d69-0824-4ecc-ad78-cea4e19bde61-metrics-certs\") pod \"network-metrics-daemon-rtjs6\" (UID: \"fece1d69-0824-4ecc-ad78-cea4e19bde61\") " pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:52:26.762783 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.762571 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f529x\" (UniqueName: \"kubernetes.io/projected/097227b5-19cd-449b-88a1-ce703f741481-kube-api-access-f529x\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:52:26.762783 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.762603 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-kubernetes\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.762783 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.762647 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-cnibin\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.762783 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.762699 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-var-lib-cni-multus\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.762783 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.762727 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3447411a-b1de-406a-9df8-4d5e565add87-host-slash\") pod \"iptables-alerter-nnwhb\" (UID: \"3447411a-b1de-406a-9df8-4d5e565add87\") " pod="openshift-network-operator/iptables-alerter-nnwhb" Oct 30 08:52:26.762783 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.762762 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-sys\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.763087 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.762818 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c444edaf-cb41-4707-a33f-f181873a6b01-etc-tuned\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.763087 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.762857 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f039cecc-3f4f-4e9b-94e5-5d46918f9487-kubelet-config\") pod \"global-pull-secret-syncer-xgdfr\" (UID: \"f039cecc-3f4f-4e9b-94e5-5d46918f9487\") " pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:26.763087 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.762891 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e1be1b32-6246-4b96-a707-6df15d3d950f-agent-certs\") pod \"konnectivity-agent-wzfpw\" (UID: \"e1be1b32-6246-4b96-a707-6df15d3d950f\") " pod="kube-system/konnectivity-agent-wzfpw" Oct 30 08:52:26.763087 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.762945 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/094983e9-88e8-4881-be25-8ba5d8bc0979-hosts-file\") pod \"node-resolver-bqlk7\" (UID: \"094983e9-88e8-4881-be25-8ba5d8bc0979\") " pod="openshift-dns/node-resolver-bqlk7" Oct 30 08:52:26.763087 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.762996 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/094983e9-88e8-4881-be25-8ba5d8bc0979-tmp-dir\") pod \"node-resolver-bqlk7\" (UID: \"094983e9-88e8-4881-be25-8ba5d8bc0979\") " pod="openshift-dns/node-resolver-bqlk7" Oct 30 08:52:26.763087 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.763015 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-var-lib-kubelet\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.763087 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.763056 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-cni-bin\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.763469 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.763110 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-etc-selinux\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:52:26.763469 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.763141 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/af7f9e2a-c57b-4396-bd6e-40c05cf1ef42-serviceca\") pod \"node-ca-9fzvv\" (UID: \"af7f9e2a-c57b-4396-bd6e-40c05cf1ef42\") " pod="openshift-image-registry/node-ca-9fzvv" Oct 30 08:52:26.763469 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.763189 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-systemd-units\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.763469 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.763253 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-kubelet\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.763469 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.763292 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-run-openvswitch\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.763469 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.763325 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-run-ovn\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.763469 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.763379 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0eac401-f877-428f-b85c-271fa0aca679-system-cni-dir\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:52:26.763469 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.763417 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-sysctl-d\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.763469 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.763449 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d03bffbe-b198-427f-86cb-e854d42260a5-ovnkube-config\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.763947 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.763489 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-system-cni-dir\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.763947 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.763518 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f039cecc-3f4f-4e9b-94e5-5d46918f9487-original-pull-secret\") pod \"global-pull-secret-syncer-xgdfr\" (UID: \"f039cecc-3f4f-4e9b-94e5-5d46918f9487\") " pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:26.763947 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.763551 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-socket-dir\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:52:26.763947 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.763577 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-run\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.763947 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.763611 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-lib-modules\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.763947 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.763646 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c444edaf-cb41-4707-a33f-f181873a6b01-tmp\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.763947 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.763686 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-var-lib-cni-bin\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.763947 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.763717 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-var-lib-kubelet\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.763947 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.763749 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f039cecc-3f4f-4e9b-94e5-5d46918f9487-dbus\") pod \"global-pull-secret-syncer-xgdfr\" (UID: \"f039cecc-3f4f-4e9b-94e5-5d46918f9487\") " pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:26.763947 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.763776 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:52:26.763947 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.763806 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-var-lib-openvswitch\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.763947 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.763835 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.763947 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.763911 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwsgv\" (UniqueName: \"kubernetes.io/projected/094983e9-88e8-4881-be25-8ba5d8bc0979-kube-api-access-vwsgv\") pod \"node-resolver-bqlk7\" (UID: \"094983e9-88e8-4881-be25-8ba5d8bc0979\") " pod="openshift-dns/node-resolver-bqlk7" Oct 30 08:52:26.763947 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.763938 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-multus-socket-dir-parent\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.764672 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.763965 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-run-k8s-cni-cncf-io\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.764672 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.763991 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-cni-netd\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.764672 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.764015 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af7f9e2a-c57b-4396-bd6e-40c05cf1ef42-host\") pod \"node-ca-9fzvv\" (UID: \"af7f9e2a-c57b-4396-bd6e-40c05cf1ef42\") " pod="openshift-image-registry/node-ca-9fzvv" Oct 30 08:52:26.764672 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.764041 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-hostroot\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.764672 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.764074 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvxv8\" (UniqueName: \"kubernetes.io/projected/0df87d60-113c-4039-93a4-06205c202a73-kube-api-access-dvxv8\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.764672 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.764101 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlspr\" (UniqueName: \"kubernetes.io/projected/fece1d69-0824-4ecc-ad78-cea4e19bde61-kube-api-access-wlspr\") pod \"network-metrics-daemon-rtjs6\" (UID: \"fece1d69-0824-4ecc-ad78-cea4e19bde61\") " pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:52:26.764672 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.764170 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d03bffbe-b198-427f-86cb-e854d42260a5-ovn-node-metrics-cert\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.764672 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.764212 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0eac401-f877-428f-b85c-271fa0aca679-cni-binary-copy\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:52:26.764672 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.764236 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-host\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.764672 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.764291 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-log-socket\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.764672 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.764318 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e0eac401-f877-428f-b85c-271fa0aca679-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:52:26.764672 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.764361 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-modprobe-d\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.764672 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.764389 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-multus-conf-dir\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.764672 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.764423 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxv9t\" (UniqueName: \"kubernetes.io/projected/3447411a-b1de-406a-9df8-4d5e565add87-kube-api-access-sxv9t\") pod \"iptables-alerter-nnwhb\" (UID: \"3447411a-b1de-406a-9df8-4d5e565add87\") " pod="openshift-network-operator/iptables-alerter-nnwhb" Oct 30 08:52:26.764672 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.764450 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-slash\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.764672 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.764476 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z9bt\" (UniqueName: \"kubernetes.io/projected/e0eac401-f877-428f-b85c-271fa0aca679-kube-api-access-6z9bt\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:52:26.765527 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.764502 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q2kt\" (UniqueName: \"kubernetes.io/projected/c444edaf-cb41-4707-a33f-f181873a6b01-kube-api-access-4q2kt\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.780380 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.780341 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 30 08:52:26.780760 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.780731 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 30 08:52:26.780852 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.780828 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 30 08:52:26.780897 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.780873 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 30 08:52:26.780962 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.780947 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 30 08:52:26.781008 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.780968 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 30 08:52:26.781008 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.781002 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 30 08:52:26.781073 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.781020 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 30 08:52:26.781541 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.781470 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 30 08:52:26.781541 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.781481 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 30 08:52:26.781541 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.781505 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8gzrt\"" Oct 30 08:52:26.781541 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.781506 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sjrcm\"" Oct 30 08:52:26.781541 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.781528 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-8kjgd\"" Oct 30 08:52:26.781763 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.781548 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 30 08:52:26.794540 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.794498 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 30 08:52:26.794540 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.794505 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hkwvt\"" Oct 30 08:52:26.794667 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.794547 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 30 08:52:26.865412 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.865378 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-sysconfig\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.865552 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.865425 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-sysctl-conf\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.865552 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.865455 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0df87d60-113c-4039-93a4-06205c202a73-cni-binary-copy\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.865552 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.865478 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-sysconfig\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.865674 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.865610 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-sysctl-conf\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.865674 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.865482 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-run-netns\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.865674 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.865643 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3447411a-b1de-406a-9df8-4d5e565add87-iptables-alerter-script\") pod \"iptables-alerter-nnwhb\" (UID: \"3447411a-b1de-406a-9df8-4d5e565add87\") " pod="openshift-network-operator/iptables-alerter-nnwhb" Oct 30 08:52:26.865771 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.865678 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-run-netns\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.865771 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.865697 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-device-dir\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:52:26.865771 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.865713 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-sys-fs\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:52:26.865771 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.865746 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-device-dir\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:52:26.865895 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.865771 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxbkp\" (UniqueName: \"kubernetes.io/projected/d03bffbe-b198-427f-86cb-e854d42260a5-kube-api-access-gxbkp\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.865895 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.865798 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e0eac401-f877-428f-b85c-271fa0aca679-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:52:26.865895 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.865817 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0df87d60-113c-4039-93a4-06205c202a73-multus-daemon-config\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.865990 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.865950 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0df87d60-113c-4039-93a4-06205c202a73-cni-binary-copy\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.866036 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866012 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-sys-fs\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:52:26.866076 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866036 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-run-multus-certs\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.866076 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866055 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-etc-kubernetes\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.866140 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866078 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-registration-dir\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:52:26.866140 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866094 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-run-netns\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.866140 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866136 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-run-systemd\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.866231 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866159 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttr59\" (UniqueName: \"kubernetes.io/projected/26e2f6af-5dbf-44c2-9acf-58c70be503bf-kube-api-access-ttr59\") pod \"network-check-target-gn6v4\" (UID: \"26e2f6af-5dbf-44c2-9acf-58c70be503bf\") " pod="openshift-network-diagnostics/network-check-target-gn6v4" Oct 30 08:52:26.866231 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866177 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fece1d69-0824-4ecc-ad78-cea4e19bde61-metrics-certs\") pod \"network-metrics-daemon-rtjs6\" (UID: \"fece1d69-0824-4ecc-ad78-cea4e19bde61\") " pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:52:26.866231 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866192 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f529x\" (UniqueName: \"kubernetes.io/projected/097227b5-19cd-449b-88a1-ce703f741481-kube-api-access-f529x\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:52:26.866231 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866207 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-kubernetes\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.866231 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866223 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-cnibin\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.866472 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866244 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-var-lib-cni-multus\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.866472 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866264 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3447411a-b1de-406a-9df8-4d5e565add87-host-slash\") pod \"iptables-alerter-nnwhb\" (UID: \"3447411a-b1de-406a-9df8-4d5e565add87\") " pod="openshift-network-operator/iptables-alerter-nnwhb" Oct 30 08:52:26.866472 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866304 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e0eac401-f877-428f-b85c-271fa0aca679-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:52:26.866472 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866326 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3447411a-b1de-406a-9df8-4d5e565add87-host-slash\") pod \"iptables-alerter-nnwhb\" (UID: \"3447411a-b1de-406a-9df8-4d5e565add87\") " pod="openshift-network-operator/iptables-alerter-nnwhb" Oct 30 08:52:26.866472 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866385 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-cnibin\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.866472 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866425 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-var-lib-cni-multus\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.866472 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866474 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-run-multus-certs\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.866827 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866487 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-kubernetes\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.866827 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:26.866489 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 08:52:26.866827 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866510 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-registration-dir\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:52:26.866827 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866518 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-sys\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.866827 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866543 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-etc-kubernetes\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.866827 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:26.866566 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fece1d69-0824-4ecc-ad78-cea4e19bde61-metrics-certs podName:fece1d69-0824-4ecc-ad78-cea4e19bde61 nodeName:}" failed. No retries permitted until 2026-10-30 08:52:27.366534469 +0000 UTC m=+3.119596521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fece1d69-0824-4ecc-ad78-cea4e19bde61-metrics-certs") pod "network-metrics-daemon-rtjs6" (UID: "fece1d69-0824-4ecc-ad78-cea4e19bde61") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 08:52:26.866827 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866582 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c444edaf-cb41-4707-a33f-f181873a6b01-etc-tuned\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.866827 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866590 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-sys\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.866827 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866605 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f039cecc-3f4f-4e9b-94e5-5d46918f9487-kubelet-config\") pod \"global-pull-secret-syncer-xgdfr\" (UID: \"f039cecc-3f4f-4e9b-94e5-5d46918f9487\") " pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:26.866827 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866618 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-run-systemd\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.866827 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866637 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-run-netns\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.866827 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866625 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e1be1b32-6246-4b96-a707-6df15d3d950f-agent-certs\") pod \"konnectivity-agent-wzfpw\" (UID: \"e1be1b32-6246-4b96-a707-6df15d3d950f\") " pod="kube-system/konnectivity-agent-wzfpw" Oct 30 08:52:26.866827 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866687 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/094983e9-88e8-4881-be25-8ba5d8bc0979-hosts-file\") pod \"node-resolver-bqlk7\" (UID: \"094983e9-88e8-4881-be25-8ba5d8bc0979\") " pod="openshift-dns/node-resolver-bqlk7" Oct 30 08:52:26.866827 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866713 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/094983e9-88e8-4881-be25-8ba5d8bc0979-tmp-dir\") pod \"node-resolver-bqlk7\" (UID: \"094983e9-88e8-4881-be25-8ba5d8bc0979\") " pod="openshift-dns/node-resolver-bqlk7" Oct 30 08:52:26.866827 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866740 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/094983e9-88e8-4881-be25-8ba5d8bc0979-hosts-file\") pod \"node-resolver-bqlk7\" (UID: \"094983e9-88e8-4881-be25-8ba5d8bc0979\") " pod="openshift-dns/node-resolver-bqlk7" Oct 30 08:52:26.866827 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866746 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-var-lib-kubelet\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.866827 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866773 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-cni-bin\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.867713 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866798 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-etc-selinux\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:52:26.867713 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866825 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/af7f9e2a-c57b-4396-bd6e-40c05cf1ef42-serviceca\") pod \"node-ca-9fzvv\" (UID: \"af7f9e2a-c57b-4396-bd6e-40c05cf1ef42\") " pod="openshift-image-registry/node-ca-9fzvv" Oct 30 08:52:26.867713 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866848 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-systemd-units\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.867713 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866868 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3447411a-b1de-406a-9df8-4d5e565add87-iptables-alerter-script\") pod \"iptables-alerter-nnwhb\" (UID: \"3447411a-b1de-406a-9df8-4d5e565add87\") " pod="openshift-network-operator/iptables-alerter-nnwhb" Oct 30 08:52:26.867713 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866878 2585 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 30 08:52:26.867713 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866894 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-kubelet\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.867713 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866921 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-run-openvswitch\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.867713 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866946 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-run-ovn\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.867713 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866971 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0eac401-f877-428f-b85c-271fa0aca679-system-cni-dir\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:52:26.867713 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.866996 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-sysctl-d\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.867713 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867022 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d03bffbe-b198-427f-86cb-e854d42260a5-ovnkube-config\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.867713 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867056 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-system-cni-dir\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.867713 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867083 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f039cecc-3f4f-4e9b-94e5-5d46918f9487-original-pull-secret\") pod \"global-pull-secret-syncer-xgdfr\" (UID: \"f039cecc-3f4f-4e9b-94e5-5d46918f9487\") " pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:26.867713 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867112 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0df87d60-113c-4039-93a4-06205c202a73-multus-daemon-config\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.867713 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867128 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-socket-dir\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:52:26.867713 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867148 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-var-lib-kubelet\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.867713 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867155 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-run\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.867713 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867178 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0eac401-f877-428f-b85c-271fa0aca679-system-cni-dir\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:52:26.868647 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867189 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-lib-modules\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.868647 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867224 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c444edaf-cb41-4707-a33f-f181873a6b01-tmp\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.868647 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867243 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-kubelet\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.868647 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867251 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-var-lib-cni-bin\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.868647 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867277 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-var-lib-kubelet\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.868647 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867306 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-run-openvswitch\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.868647 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867317 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f039cecc-3f4f-4e9b-94e5-5d46918f9487-dbus\") pod \"global-pull-secret-syncer-xgdfr\" (UID: \"f039cecc-3f4f-4e9b-94e5-5d46918f9487\") " pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:26.868647 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867347 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:52:26.868647 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867355 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-run-ovn\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.868647 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867373 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-var-lib-openvswitch\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.868647 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867401 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f039cecc-3f4f-4e9b-94e5-5d46918f9487-kubelet-config\") pod \"global-pull-secret-syncer-xgdfr\" (UID: \"f039cecc-3f4f-4e9b-94e5-5d46918f9487\") " pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:26.868647 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867405 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/af7f9e2a-c57b-4396-bd6e-40c05cf1ef42-serviceca\") pod \"node-ca-9fzvv\" (UID: \"af7f9e2a-c57b-4396-bd6e-40c05cf1ef42\") " pod="openshift-image-registry/node-ca-9fzvv" Oct 30 08:52:26.868647 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867401 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.868647 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867462 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/094983e9-88e8-4881-be25-8ba5d8bc0979-tmp-dir\") pod \"node-resolver-bqlk7\" (UID: \"094983e9-88e8-4881-be25-8ba5d8bc0979\") " pod="openshift-dns/node-resolver-bqlk7" Oct 30 08:52:26.868647 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867480 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-var-lib-cni-bin\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.868647 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867483 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwsgv\" (UniqueName: \"kubernetes.io/projected/094983e9-88e8-4881-be25-8ba5d8bc0979-kube-api-access-vwsgv\") pod \"node-resolver-bqlk7\" (UID: \"094983e9-88e8-4881-be25-8ba5d8bc0979\") " pod="openshift-dns/node-resolver-bqlk7" Oct 30 08:52:26.868647 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867512 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-multus-socket-dir-parent\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.868647 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867528 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-var-lib-kubelet\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.869528 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867537 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-run-k8s-cni-cncf-io\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.869528 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867602 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-var-lib-openvswitch\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.869528 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867662 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-run\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.869528 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867664 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f039cecc-3f4f-4e9b-94e5-5d46918f9487-dbus\") pod \"global-pull-secret-syncer-xgdfr\" (UID: \"f039cecc-3f4f-4e9b-94e5-5d46918f9487\") " pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:26.869528 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867690 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-cni-netd\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.869528 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:26.867746 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 08:52:26.869528 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867779 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af7f9e2a-c57b-4396-bd6e-40c05cf1ef42-host\") pod \"node-ca-9fzvv\" (UID: \"af7f9e2a-c57b-4396-bd6e-40c05cf1ef42\") " pod="openshift-image-registry/node-ca-9fzvv" Oct 30 08:52:26.869528 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:26.867821 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f039cecc-3f4f-4e9b-94e5-5d46918f9487-original-pull-secret podName:f039cecc-3f4f-4e9b-94e5-5d46918f9487 nodeName:}" failed. No retries permitted until 2026-10-30 08:52:27.367786225 +0000 UTC m=+3.120848271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f039cecc-3f4f-4e9b-94e5-5d46918f9487-original-pull-secret") pod "global-pull-secret-syncer-xgdfr" (UID: "f039cecc-3f4f-4e9b-94e5-5d46918f9487") : object "kube-system"/"original-pull-secret" not registered Oct 30 08:52:26.869528 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867829 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:52:26.869528 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867868 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-run-k8s-cni-cncf-io\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.869528 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867746 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af7f9e2a-c57b-4396-bd6e-40c05cf1ef42-host\") pod \"node-ca-9fzvv\" (UID: \"af7f9e2a-c57b-4396-bd6e-40c05cf1ef42\") " pod="openshift-image-registry/node-ca-9fzvv" Oct 30 08:52:26.869528 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867919 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-systemd-units\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.869528 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867946 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-socket-dir\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:52:26.869528 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867956 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-hostroot\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.869528 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.867984 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvxv8\" (UniqueName: \"kubernetes.io/projected/0df87d60-113c-4039-93a4-06205c202a73-kube-api-access-dvxv8\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.869528 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.868007 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d03bffbe-b198-427f-86cb-e854d42260a5-ovnkube-config\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.869528 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.868009 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-etc-selinux\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:52:26.870306 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.868013 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlspr\" (UniqueName: \"kubernetes.io/projected/fece1d69-0824-4ecc-ad78-cea4e19bde61-kube-api-access-wlspr\") pod \"network-metrics-daemon-rtjs6\" (UID: \"fece1d69-0824-4ecc-ad78-cea4e19bde61\") " pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:52:26.870306 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.868039 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-system-cni-dir\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.870306 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.868058 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-hostroot\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.870306 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.868093 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-lib-modules\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.870306 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.868152 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-multus-socket-dir-parent\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.870306 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.868165 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d03bffbe-b198-427f-86cb-e854d42260a5-ovn-node-metrics-cert\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.870306 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.868199 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0eac401-f877-428f-b85c-271fa0aca679-cni-binary-copy\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:52:26.870306 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.868229 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-host\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.870306 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.868240 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-cni-bin\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.870306 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.868201 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-cni-netd\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.870306 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.868277 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-sysctl-d\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.870306 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.868303 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-log-socket\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.870306 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.868331 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-host\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.870306 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.868352 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e0eac401-f877-428f-b85c-271fa0aca679-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:52:26.870306 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.868481 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-modprobe-d\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.870306 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.868510 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-multus-conf-dir\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.870306 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.868539 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxv9t\" (UniqueName: \"kubernetes.io/projected/3447411a-b1de-406a-9df8-4d5e565add87-kube-api-access-sxv9t\") pod \"iptables-alerter-nnwhb\" (UID: \"3447411a-b1de-406a-9df8-4d5e565add87\") " pod="openshift-network-operator/iptables-alerter-nnwhb" Oct 30 08:52:26.870927 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.868572 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.870927 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.868591 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-log-socket\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.870927 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.868672 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-modprobe-d\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.870927 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.868703 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-slash\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.870927 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.868738 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-multus-conf-dir\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.870927 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.868765 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z9bt\" (UniqueName: \"kubernetes.io/projected/e0eac401-f877-428f-b85c-271fa0aca679-kube-api-access-6z9bt\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:52:26.870927 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.868805 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q2kt\" (UniqueName: \"kubernetes.io/projected/c444edaf-cb41-4707-a33f-f181873a6b01-kube-api-access-4q2kt\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.870927 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.868854 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d03bffbe-b198-427f-86cb-e854d42260a5-ovnkube-script-lib\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.870927 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.868881 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e1be1b32-6246-4b96-a707-6df15d3d950f-konnectivity-ca\") pod \"konnectivity-agent-wzfpw\" (UID: \"e1be1b32-6246-4b96-a707-6df15d3d950f\") " pod="kube-system/konnectivity-agent-wzfpw" Oct 30 08:52:26.870927 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.868920 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-node-log\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.870927 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.868924 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-slash\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.870927 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.868971 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-etc-openvswitch\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.870927 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.869020 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-etc-openvswitch\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.870927 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.869059 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-node-log\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.870927 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.869305 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d03bffbe-b198-427f-86cb-e854d42260a5-env-overrides\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.870927 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.869385 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvpsp\" (UniqueName: \"kubernetes.io/projected/af7f9e2a-c57b-4396-bd6e-40c05cf1ef42-kube-api-access-zvpsp\") pod \"node-ca-9fzvv\" (UID: \"af7f9e2a-c57b-4396-bd6e-40c05cf1ef42\") " pod="openshift-image-registry/node-ca-9fzvv" Oct 30 08:52:26.870927 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.869414 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0eac401-f877-428f-b85c-271fa0aca679-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:52:26.871758 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.869464 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-systemd\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.871758 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.869491 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-multus-cni-dir\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.871758 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.869520 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-run-ovn-kubernetes\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.871758 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.869577 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0eac401-f877-428f-b85c-271fa0aca679-cnibin\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:52:26.871758 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.869656 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0eac401-f877-428f-b85c-271fa0aca679-cnibin\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:52:26.871758 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.869692 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-run-ovn-kubernetes\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.871758 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.869965 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0eac401-f877-428f-b85c-271fa0aca679-cni-binary-copy\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:52:26.871758 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.870409 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-systemd\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.871758 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.870466 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-multus-cni-dir\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.871758 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.870790 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e1be1b32-6246-4b96-a707-6df15d3d950f-konnectivity-ca\") pod \"konnectivity-agent-wzfpw\" (UID: \"e1be1b32-6246-4b96-a707-6df15d3d950f\") " pod="kube-system/konnectivity-agent-wzfpw" Oct 30 08:52:26.871758 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.870971 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e0eac401-f877-428f-b85c-271fa0aca679-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:52:26.871758 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.871117 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d03bffbe-b198-427f-86cb-e854d42260a5-env-overrides\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.871758 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.871234 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0eac401-f877-428f-b85c-271fa0aca679-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:52:26.871758 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.871338 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c444edaf-cb41-4707-a33f-f181873a6b01-tmp\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.871758 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.871664 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d03bffbe-b198-427f-86cb-e854d42260a5-ovnkube-script-lib\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.871758 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.871724 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e1be1b32-6246-4b96-a707-6df15d3d950f-agent-certs\") pod \"konnectivity-agent-wzfpw\" (UID: \"e1be1b32-6246-4b96-a707-6df15d3d950f\") " pod="kube-system/konnectivity-agent-wzfpw" Oct 30 08:52:26.872656 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.872631 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c444edaf-cb41-4707-a33f-f181873a6b01-etc-tuned\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.874503 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.874454 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d03bffbe-b198-427f-86cb-e854d42260a5-ovn-node-metrics-cert\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.889313 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:26.889293 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 08:52:26.889412 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:26.889317 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 08:52:26.889412 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:26.889331 2585 projected.go:196] Error preparing data for projected volume kube-api-access-ttr59 for pod openshift-network-diagnostics/network-check-target-gn6v4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 08:52:26.889412 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:26.889394 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26e2f6af-5dbf-44c2-9acf-58c70be503bf-kube-api-access-ttr59 podName:26e2f6af-5dbf-44c2-9acf-58c70be503bf nodeName:}" failed. No retries permitted until 2026-10-30 08:52:27.389376666 +0000 UTC m=+3.142438713 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ttr59" (UniqueName: "kubernetes.io/projected/26e2f6af-5dbf-44c2-9acf-58c70be503bf-kube-api-access-ttr59") pod "network-check-target-gn6v4" (UID: "26e2f6af-5dbf-44c2-9acf-58c70be503bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 08:52:26.900242 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.892507 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f529x\" (UniqueName: \"kubernetes.io/projected/097227b5-19cd-449b-88a1-ce703f741481-kube-api-access-f529x\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:52:26.900242 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.892879 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxbkp\" (UniqueName: \"kubernetes.io/projected/d03bffbe-b198-427f-86cb-e854d42260a5-kube-api-access-gxbkp\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:26.900242 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.893161 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlspr\" (UniqueName: \"kubernetes.io/projected/fece1d69-0824-4ecc-ad78-cea4e19bde61-kube-api-access-wlspr\") pod \"network-metrics-daemon-rtjs6\" (UID: \"fece1d69-0824-4ecc-ad78-cea4e19bde61\") " pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:52:26.900242 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.893891 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxv9t\" (UniqueName: \"kubernetes.io/projected/3447411a-b1de-406a-9df8-4d5e565add87-kube-api-access-sxv9t\") pod \"iptables-alerter-nnwhb\" (UID: \"3447411a-b1de-406a-9df8-4d5e565add87\") " pod="openshift-network-operator/iptables-alerter-nnwhb" Oct 30 08:52:26.900242 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.894725 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvxv8\" (UniqueName: \"kubernetes.io/projected/0df87d60-113c-4039-93a4-06205c202a73-kube-api-access-dvxv8\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:52:26.900242 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.895490 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q2kt\" (UniqueName: \"kubernetes.io/projected/c444edaf-cb41-4707-a33f-f181873a6b01-kube-api-access-4q2kt\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:26.900242 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.895763 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwsgv\" (UniqueName: \"kubernetes.io/projected/094983e9-88e8-4881-be25-8ba5d8bc0979-kube-api-access-vwsgv\") pod \"node-resolver-bqlk7\" (UID: \"094983e9-88e8-4881-be25-8ba5d8bc0979\") " pod="openshift-dns/node-resolver-bqlk7" Oct 30 08:52:26.900242 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.899888 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z9bt\" (UniqueName: \"kubernetes.io/projected/e0eac401-f877-428f-b85c-271fa0aca679-kube-api-access-6z9bt\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:52:26.903945 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.903922 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvpsp\" (UniqueName: \"kubernetes.io/projected/af7f9e2a-c57b-4396-bd6e-40c05cf1ef42-kube-api-access-zvpsp\") pod \"node-ca-9fzvv\" (UID: \"af7f9e2a-c57b-4396-bd6e-40c05cf1ef42\") " pod="openshift-image-registry/node-ca-9fzvv" Oct 30 08:52:26.981636 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.981603 2585 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 08:52:26.983835 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:26.983812 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:52:26.995189 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:26.995162 2585 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod097227b5_19cd_449b_88a1_ce703f741481.slice/crio-5945c4e50cabb13a2578a7442d267550039459ddf667bf50c10bdbb79de1a588 WatchSource:0}: Error finding container 5945c4e50cabb13a2578a7442d267550039459ddf667bf50c10bdbb79de1a588: Status 404 returned error can't find the container with id 5945c4e50cabb13a2578a7442d267550039459ddf667bf50c10bdbb79de1a588 Oct 30 08:52:27.003457 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:27.003434 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:52:27.006670 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:27.006559 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9fzvv" Oct 30 08:52:27.008009 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:27.007987 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:52:27.012187 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:27.011875 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s9pz8" Oct 30 08:52:27.014120 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:27.014081 2585 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc444edaf_cb41_4707_a33f_f181873a6b01.slice/crio-581e34daf2b29d3d3cfe2e26842a25e9f1013e2daa6dfe9cb9c23c19a12d8272 WatchSource:0}: Error finding container 581e34daf2b29d3d3cfe2e26842a25e9f1013e2daa6dfe9cb9c23c19a12d8272: Status 404 returned error can't find the container with id 581e34daf2b29d3d3cfe2e26842a25e9f1013e2daa6dfe9cb9c23c19a12d8272 Oct 30 08:52:27.024093 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:27.024071 2585 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf7f9e2a_c57b_4396_bd6e_40c05cf1ef42.slice/crio-d3a65f5bada964910f26e970d3c955245fca061b87d40b8d86fa7e504140c716 WatchSource:0}: Error finding container d3a65f5bada964910f26e970d3c955245fca061b87d40b8d86fa7e504140c716: Status 404 returned error can't find the container with id d3a65f5bada964910f26e970d3c955245fca061b87d40b8d86fa7e504140c716 Oct 30 08:52:27.028142 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:27.028106 2585 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0df87d60_113c_4039_93a4_06205c202a73.slice/crio-268bad2dccb160593df725bc54f203be808816c33bbc079bd36baff74535eebe WatchSource:0}: Error finding container 268bad2dccb160593df725bc54f203be808816c33bbc079bd36baff74535eebe: Status 404 returned error can't find the container with id 268bad2dccb160593df725bc54f203be808816c33bbc079bd36baff74535eebe Oct 30 08:52:27.029287 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:27.029261 2585 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0eac401_f877_428f_b85c_271fa0aca679.slice/crio-3246ff75e3a8ecdd66a5d5b3519c4d7e8c04396a5db54a8021811a7c0388235d WatchSource:0}: Error finding container 3246ff75e3a8ecdd66a5d5b3519c4d7e8c04396a5db54a8021811a7c0388235d: Status 404 returned error can't find the container with id 3246ff75e3a8ecdd66a5d5b3519c4d7e8c04396a5db54a8021811a7c0388235d Oct 30 08:52:27.036952 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:27.036932 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wzfpw" Oct 30 08:52:27.039421 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:27.039404 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:27.042154 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:27.042112 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bqlk7" Oct 30 08:52:27.047376 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:27.047353 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nnwhb" Oct 30 08:52:27.048557 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:27.048532 2585 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1be1b32_6246_4b96_a707_6df15d3d950f.slice/crio-412765416b673a60659d5b15104da378252c47976ca249b70bd4ffb93e201404 WatchSource:0}: Error finding container 412765416b673a60659d5b15104da378252c47976ca249b70bd4ffb93e201404: Status 404 returned error can't find the container with id 412765416b673a60659d5b15104da378252c47976ca249b70bd4ffb93e201404 Oct 30 08:52:27.056321 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:27.055294 2585 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod094983e9_88e8_4881_be25_8ba5d8bc0979.slice/crio-26cf68cf2779d64cedc600a9d7c405c7fa201e6dc5701586d2c476d63ff5761c WatchSource:0}: Error finding container 26cf68cf2779d64cedc600a9d7c405c7fa201e6dc5701586d2c476d63ff5761c: Status 404 returned error can't find the container with id 26cf68cf2779d64cedc600a9d7c405c7fa201e6dc5701586d2c476d63ff5761c Oct 30 08:52:27.056321 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:27.056086 2585 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd03bffbe_b198_427f_86cb_e854d42260a5.slice/crio-121f7fab5bb1e5a04f36ea661e038f35cd811b86c3fe91ce5023a9f0988cd0e7 WatchSource:0}: Error finding container 121f7fab5bb1e5a04f36ea661e038f35cd811b86c3fe91ce5023a9f0988cd0e7: Status 404 returned error can't find the container with id 121f7fab5bb1e5a04f36ea661e038f35cd811b86c3fe91ce5023a9f0988cd0e7 Oct 30 08:52:27.060672 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:27.060648 2585 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3447411a_b1de_406a_9df8_4d5e565add87.slice/crio-7f9636f0e5c062922c70425d1f25451433182f735903ca2da75023ab1aacae3b WatchSource:0}: Error finding container 7f9636f0e5c062922c70425d1f25451433182f735903ca2da75023ab1aacae3b: Status 404 returned error can't find the container with id 7f9636f0e5c062922c70425d1f25451433182f735903ca2da75023ab1aacae3b Oct 30 08:52:27.373847 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:27.373822 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f039cecc-3f4f-4e9b-94e5-5d46918f9487-original-pull-secret\") pod \"global-pull-secret-syncer-xgdfr\" (UID: \"f039cecc-3f4f-4e9b-94e5-5d46918f9487\") " pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:27.373995 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:27.373882 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fece1d69-0824-4ecc-ad78-cea4e19bde61-metrics-certs\") pod \"network-metrics-daemon-rtjs6\" (UID: \"fece1d69-0824-4ecc-ad78-cea4e19bde61\") " pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:52:27.373995 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:27.373983 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 08:52:27.374180 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:27.374031 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fece1d69-0824-4ecc-ad78-cea4e19bde61-metrics-certs podName:fece1d69-0824-4ecc-ad78-cea4e19bde61 nodeName:}" failed. No retries permitted until 2026-10-30 08:52:28.374018336 +0000 UTC m=+4.127080364 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fece1d69-0824-4ecc-ad78-cea4e19bde61-metrics-certs") pod "network-metrics-daemon-rtjs6" (UID: "fece1d69-0824-4ecc-ad78-cea4e19bde61") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 08:52:27.374180 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:27.373983 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 08:52:27.374180 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:27.374121 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f039cecc-3f4f-4e9b-94e5-5d46918f9487-original-pull-secret podName:f039cecc-3f4f-4e9b-94e5-5d46918f9487 nodeName:}" failed. No retries permitted until 2026-10-30 08:52:28.374106353 +0000 UTC m=+4.127168400 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f039cecc-3f4f-4e9b-94e5-5d46918f9487-original-pull-secret") pod "global-pull-secret-syncer-xgdfr" (UID: "f039cecc-3f4f-4e9b-94e5-5d46918f9487") : object "kube-system"/"original-pull-secret" not registered Oct 30 08:52:27.475818 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:27.475186 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttr59\" (UniqueName: \"kubernetes.io/projected/26e2f6af-5dbf-44c2-9acf-58c70be503bf-kube-api-access-ttr59\") pod \"network-check-target-gn6v4\" (UID: \"26e2f6af-5dbf-44c2-9acf-58c70be503bf\") " pod="openshift-network-diagnostics/network-check-target-gn6v4" Oct 30 08:52:27.475818 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:27.475399 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 08:52:27.475818 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:27.475421 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 08:52:27.475818 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:27.475435 2585 projected.go:196] Error preparing data for projected volume kube-api-access-ttr59 for pod openshift-network-diagnostics/network-check-target-gn6v4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 08:52:27.475818 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:27.475493 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26e2f6af-5dbf-44c2-9acf-58c70be503bf-kube-api-access-ttr59 podName:26e2f6af-5dbf-44c2-9acf-58c70be503bf nodeName:}" failed. No retries permitted until 2026-10-30 08:52:28.475471866 +0000 UTC m=+4.228533913 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ttr59" (UniqueName: "kubernetes.io/projected/26e2f6af-5dbf-44c2-9acf-58c70be503bf-kube-api-access-ttr59") pod "network-check-target-gn6v4" (UID: "26e2f6af-5dbf-44c2-9acf-58c70be503bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 08:52:27.717198 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:27.717147 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 08:47:27 +0000 UTC" deadline="2028-08-14 02:53:36.667143568 +0000 UTC" Oct 30 08:52:27.717198 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:27.717197 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15690h1m8.949949387s" Oct 30 08:52:27.849238 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:27.848525 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:52:27.849238 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:27.848883 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtjs6" podUID="fece1d69-0824-4ecc-ad78-cea4e19bde61" Oct 30 08:52:27.860178 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:27.860146 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s9pz8" event={"ID":"0df87d60-113c-4039-93a4-06205c202a73","Type":"ContainerStarted","Data":"268bad2dccb160593df725bc54f203be808816c33bbc079bd36baff74535eebe"} Oct 30 08:52:27.879027 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:27.878993 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9fzvv" event={"ID":"af7f9e2a-c57b-4396-bd6e-40c05cf1ef42","Type":"ContainerStarted","Data":"d3a65f5bada964910f26e970d3c955245fca061b87d40b8d86fa7e504140c716"} Oct 30 08:52:27.886483 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:27.886405 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" event={"ID":"097227b5-19cd-449b-88a1-ce703f741481","Type":"ContainerStarted","Data":"5945c4e50cabb13a2578a7442d267550039459ddf667bf50c10bdbb79de1a588"} Oct 30 08:52:27.891868 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:27.891837 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-65.ec2.internal" event={"ID":"95a72c37fac53f4d285523d303757dc7","Type":"ContainerStarted","Data":"0b9a0d9e62b91413e9deaca959ee50fb6dda0c0447e0223a3c91bfc9cf36c873"} Oct 30 08:52:27.903717 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:27.903627 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal" event={"ID":"ef96270cb9f6591ce2fc63b09dc321b6","Type":"ContainerStarted","Data":"17a96e7c10fedf31bda42d75021f67daf03ea50c43c79873d179680657713dba"} Oct 30 08:52:27.913971 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:27.913903 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwrk9" event={"ID":"e0eac401-f877-428f-b85c-271fa0aca679","Type":"ContainerStarted","Data":"3246ff75e3a8ecdd66a5d5b3519c4d7e8c04396a5db54a8021811a7c0388235d"} Oct 30 08:52:27.919332 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:27.919304 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kw85k" event={"ID":"c444edaf-cb41-4707-a33f-f181873a6b01","Type":"ContainerStarted","Data":"581e34daf2b29d3d3cfe2e26842a25e9f1013e2daa6dfe9cb9c23c19a12d8272"} Oct 30 08:52:27.931189 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:27.931163 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nnwhb" event={"ID":"3447411a-b1de-406a-9df8-4d5e565add87","Type":"ContainerStarted","Data":"7f9636f0e5c062922c70425d1f25451433182f735903ca2da75023ab1aacae3b"} Oct 30 08:52:27.943194 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:27.943161 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bqlk7" event={"ID":"094983e9-88e8-4881-be25-8ba5d8bc0979","Type":"ContainerStarted","Data":"26cf68cf2779d64cedc600a9d7c405c7fa201e6dc5701586d2c476d63ff5761c"} Oct 30 08:52:27.945517 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:27.945491 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" event={"ID":"d03bffbe-b198-427f-86cb-e854d42260a5","Type":"ContainerStarted","Data":"121f7fab5bb1e5a04f36ea661e038f35cd811b86c3fe91ce5023a9f0988cd0e7"} Oct 30 08:52:27.948221 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:27.948189 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wzfpw" event={"ID":"e1be1b32-6246-4b96-a707-6df15d3d950f","Type":"ContainerStarted","Data":"412765416b673a60659d5b15104da378252c47976ca249b70bd4ffb93e201404"} Oct 30 08:52:27.982257 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:27.981114 2585 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-65.ec2.internal" podStartSLOduration=1.9811020240000001 podStartE2EDuration="1.981102024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 08:52:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:52:27.936917839 +0000 UTC m=+3.689979893" watchObservedRunningTime="2026-10-30 08:52:27.981102024 +0000 UTC m=+3.734164070" Oct 30 08:52:28.383338 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:28.383301 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fece1d69-0824-4ecc-ad78-cea4e19bde61-metrics-certs\") pod \"network-metrics-daemon-rtjs6\" (UID: \"fece1d69-0824-4ecc-ad78-cea4e19bde61\") " pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:52:28.383533 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:28.383451 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f039cecc-3f4f-4e9b-94e5-5d46918f9487-original-pull-secret\") pod \"global-pull-secret-syncer-xgdfr\" (UID: \"f039cecc-3f4f-4e9b-94e5-5d46918f9487\") " pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:28.383626 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:28.383608 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 08:52:28.383705 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:28.383676 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f039cecc-3f4f-4e9b-94e5-5d46918f9487-original-pull-secret podName:f039cecc-3f4f-4e9b-94e5-5d46918f9487 nodeName:}" failed. No retries permitted until 2026-10-30 08:52:30.383657282 +0000 UTC m=+6.136719327 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f039cecc-3f4f-4e9b-94e5-5d46918f9487-original-pull-secret") pod "global-pull-secret-syncer-xgdfr" (UID: "f039cecc-3f4f-4e9b-94e5-5d46918f9487") : object "kube-system"/"original-pull-secret" not registered Oct 30 08:52:28.383774 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:28.383754 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 08:52:28.383831 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:28.383792 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fece1d69-0824-4ecc-ad78-cea4e19bde61-metrics-certs podName:fece1d69-0824-4ecc-ad78-cea4e19bde61 nodeName:}" failed. No retries permitted until 2026-10-30 08:52:30.383780606 +0000 UTC m=+6.136842637 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fece1d69-0824-4ecc-ad78-cea4e19bde61-metrics-certs") pod "network-metrics-daemon-rtjs6" (UID: "fece1d69-0824-4ecc-ad78-cea4e19bde61") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 08:52:28.484397 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:28.484278 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttr59\" (UniqueName: \"kubernetes.io/projected/26e2f6af-5dbf-44c2-9acf-58c70be503bf-kube-api-access-ttr59\") pod \"network-check-target-gn6v4\" (UID: \"26e2f6af-5dbf-44c2-9acf-58c70be503bf\") " pod="openshift-network-diagnostics/network-check-target-gn6v4" Oct 30 08:52:28.484555 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:28.484501 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 08:52:28.484555 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:28.484521 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 08:52:28.484555 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:28.484533 2585 projected.go:196] Error preparing data for projected volume kube-api-access-ttr59 for pod openshift-network-diagnostics/network-check-target-gn6v4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 08:52:28.484728 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:28.484588 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26e2f6af-5dbf-44c2-9acf-58c70be503bf-kube-api-access-ttr59 podName:26e2f6af-5dbf-44c2-9acf-58c70be503bf nodeName:}" failed. No retries permitted until 2026-10-30 08:52:30.484570641 +0000 UTC m=+6.237632677 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ttr59" (UniqueName: "kubernetes.io/projected/26e2f6af-5dbf-44c2-9acf-58c70be503bf-kube-api-access-ttr59") pod "network-check-target-gn6v4" (UID: "26e2f6af-5dbf-44c2-9acf-58c70be503bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 08:52:28.718189 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:28.718143 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 08:47:27 +0000 UTC" deadline="2028-04-09 08:01:24.947846856 +0000 UTC" Oct 30 08:52:28.718189 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:28.718186 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12647h8m56.229665503s" Oct 30 08:52:28.861342 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:28.857541 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gn6v4" Oct 30 08:52:28.861342 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:28.857856 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gn6v4" podUID="26e2f6af-5dbf-44c2-9acf-58c70be503bf" Oct 30 08:52:28.861342 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:28.858468 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:28.861342 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:28.858618 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgdfr" podUID="f039cecc-3f4f-4e9b-94e5-5d46918f9487" Oct 30 08:52:28.972556 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:28.970877 2585 generic.go:356] "Generic (PLEG): container finished" podID="ef96270cb9f6591ce2fc63b09dc321b6" containerID="17a96e7c10fedf31bda42d75021f67daf03ea50c43c79873d179680657713dba" exitCode=0 Oct 30 08:52:28.972556 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:28.971977 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal" event={"ID":"ef96270cb9f6591ce2fc63b09dc321b6","Type":"ContainerDied","Data":"17a96e7c10fedf31bda42d75021f67daf03ea50c43c79873d179680657713dba"} Oct 30 08:52:28.972556 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:28.972046 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal" event={"ID":"ef96270cb9f6591ce2fc63b09dc321b6","Type":"ContainerStarted","Data":"cf7835f472df21842a393bd19e7f822c76415d670c2f16250b8b74d3fa018450"} Oct 30 08:52:29.014244 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:29.014184 2585 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal" podStartSLOduration=3.014166717 podStartE2EDuration="3.014166717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 08:52:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:52:29.013373401 +0000 UTC m=+4.766435453" watchObservedRunningTime="2026-10-30 08:52:29.014166717 +0000 UTC m=+4.767228771" Oct 30 08:52:29.848612 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:29.848125 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:52:29.848612 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:29.848285 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtjs6" podUID="fece1d69-0824-4ecc-ad78-cea4e19bde61" Oct 30 08:52:29.994952 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:29.994686 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwrk9" event={"ID":"e0eac401-f877-428f-b85c-271fa0aca679","Type":"ContainerStarted","Data":"cef3ac9f20c7d33502c2574d421dc4f42db22161029606ccb767a6edbe7d3721"} Oct 30 08:52:30.402200 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:30.401368 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fece1d69-0824-4ecc-ad78-cea4e19bde61-metrics-certs\") pod \"network-metrics-daemon-rtjs6\" (UID: \"fece1d69-0824-4ecc-ad78-cea4e19bde61\") " pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:52:30.402200 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:30.401428 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f039cecc-3f4f-4e9b-94e5-5d46918f9487-original-pull-secret\") pod \"global-pull-secret-syncer-xgdfr\" (UID: \"f039cecc-3f4f-4e9b-94e5-5d46918f9487\") " pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:30.402200 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:30.401570 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 08:52:30.402200 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:30.401629 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f039cecc-3f4f-4e9b-94e5-5d46918f9487-original-pull-secret podName:f039cecc-3f4f-4e9b-94e5-5d46918f9487 nodeName:}" failed. No retries permitted until 2026-10-30 08:52:34.40161096 +0000 UTC m=+10.154673004 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f039cecc-3f4f-4e9b-94e5-5d46918f9487-original-pull-secret") pod "global-pull-secret-syncer-xgdfr" (UID: "f039cecc-3f4f-4e9b-94e5-5d46918f9487") : object "kube-system"/"original-pull-secret" not registered Oct 30 08:52:30.402200 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:30.402048 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 08:52:30.402200 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:30.402126 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fece1d69-0824-4ecc-ad78-cea4e19bde61-metrics-certs podName:fece1d69-0824-4ecc-ad78-cea4e19bde61 nodeName:}" failed. No retries permitted until 2026-10-30 08:52:34.402085443 +0000 UTC m=+10.155147486 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fece1d69-0824-4ecc-ad78-cea4e19bde61-metrics-certs") pod "network-metrics-daemon-rtjs6" (UID: "fece1d69-0824-4ecc-ad78-cea4e19bde61") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 08:52:30.503003 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:30.502405 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttr59\" (UniqueName: \"kubernetes.io/projected/26e2f6af-5dbf-44c2-9acf-58c70be503bf-kube-api-access-ttr59\") pod \"network-check-target-gn6v4\" (UID: \"26e2f6af-5dbf-44c2-9acf-58c70be503bf\") " pod="openshift-network-diagnostics/network-check-target-gn6v4" Oct 30 08:52:30.503003 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:30.502561 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 08:52:30.503003 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:30.502585 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 08:52:30.503003 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:30.502598 2585 projected.go:196] Error preparing data for projected volume kube-api-access-ttr59 for pod openshift-network-diagnostics/network-check-target-gn6v4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 08:52:30.503003 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:30.502656 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26e2f6af-5dbf-44c2-9acf-58c70be503bf-kube-api-access-ttr59 podName:26e2f6af-5dbf-44c2-9acf-58c70be503bf nodeName:}" failed. No retries permitted until 2026-10-30 08:52:34.502637056 +0000 UTC m=+10.255699104 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ttr59" (UniqueName: "kubernetes.io/projected/26e2f6af-5dbf-44c2-9acf-58c70be503bf-kube-api-access-ttr59") pod "network-check-target-gn6v4" (UID: "26e2f6af-5dbf-44c2-9acf-58c70be503bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 08:52:30.850821 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:30.850745 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gn6v4" Oct 30 08:52:30.851276 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:30.850877 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gn6v4" podUID="26e2f6af-5dbf-44c2-9acf-58c70be503bf" Oct 30 08:52:30.851346 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:30.851267 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:30.851440 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:30.851388 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgdfr" podUID="f039cecc-3f4f-4e9b-94e5-5d46918f9487" Oct 30 08:52:31.001238 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:31.001200 2585 generic.go:356] "Generic (PLEG): container finished" podID="e0eac401-f877-428f-b85c-271fa0aca679" containerID="cef3ac9f20c7d33502c2574d421dc4f42db22161029606ccb767a6edbe7d3721" exitCode=0 Oct 30 08:52:31.001868 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:31.001822 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwrk9" event={"ID":"e0eac401-f877-428f-b85c-271fa0aca679","Type":"ContainerDied","Data":"cef3ac9f20c7d33502c2574d421dc4f42db22161029606ccb767a6edbe7d3721"} Oct 30 08:52:31.848901 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:31.848361 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:52:31.848901 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:31.848517 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtjs6" podUID="fece1d69-0824-4ecc-ad78-cea4e19bde61" Oct 30 08:52:32.007761 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:32.006948 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wzfpw" event={"ID":"e1be1b32-6246-4b96-a707-6df15d3d950f","Type":"ContainerStarted","Data":"2ad8b12ab8206920bf79f4a39559f4792d68d0dc074a23e65cde674a1efbc39f"} Oct 30 08:52:32.342476 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:32.342391 2585 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wzfpw" Oct 30 08:52:32.342950 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:32.342928 2585 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wzfpw" Oct 30 08:52:32.382442 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:32.382387 2585 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wzfpw" podStartSLOduration=3.432975984 podStartE2EDuration="7.382370629s" totalImagesPullingTime="3.949394645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:52:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:52:32.051143195 +0000 UTC m=+7.804205248" watchObservedRunningTime="2026-10-30 08:52:32.382370629 +0000 UTC m=+8.135432679" Oct 30 08:52:32.850955 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:32.850266 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gn6v4" Oct 30 08:52:32.850955 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:32.850393 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gn6v4" podUID="26e2f6af-5dbf-44c2-9acf-58c70be503bf" Oct 30 08:52:32.850955 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:32.850799 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:32.850955 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:32.850894 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgdfr" podUID="f039cecc-3f4f-4e9b-94e5-5d46918f9487" Oct 30 08:52:33.013215 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:33.013122 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9fzvv" event={"ID":"af7f9e2a-c57b-4396-bd6e-40c05cf1ef42","Type":"ContainerStarted","Data":"95f53dea204ca96067b95f0a81772060700decdd9d3182833a36c99f88ec4870"} Oct 30 08:52:33.051263 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:33.051192 2585 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9fzvv" podStartSLOduration=2.540130968 podStartE2EDuration="8.051175934s" totalImagesPullingTime="5.511044966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 08:52:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:52:33.050577503 +0000 UTC m=+8.803639553" watchObservedRunningTime="2026-10-30 08:52:33.051175934 +0000 UTC m=+8.804237984" Oct 30 08:52:33.848852 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:33.848823 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:52:33.849025 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:33.848957 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtjs6" podUID="fece1d69-0824-4ecc-ad78-cea4e19bde61" Oct 30 08:52:34.016626 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:34.016593 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" event={"ID":"097227b5-19cd-449b-88a1-ce703f741481","Type":"ContainerStarted","Data":"4010b122fd105521f2045a7dc72c550e9a7847c02b3ff9e1f700cf7512175f69"} Oct 30 08:52:34.017034 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:34.016686 2585 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 08:52:34.434007 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:34.433970 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f039cecc-3f4f-4e9b-94e5-5d46918f9487-original-pull-secret\") pod \"global-pull-secret-syncer-xgdfr\" (UID: \"f039cecc-3f4f-4e9b-94e5-5d46918f9487\") " pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:34.434168 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:34.434058 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fece1d69-0824-4ecc-ad78-cea4e19bde61-metrics-certs\") pod \"network-metrics-daemon-rtjs6\" (UID: \"fece1d69-0824-4ecc-ad78-cea4e19bde61\") " pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:52:34.434244 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:34.434181 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 08:52:34.434307 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:34.434261 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fece1d69-0824-4ecc-ad78-cea4e19bde61-metrics-certs podName:fece1d69-0824-4ecc-ad78-cea4e19bde61 nodeName:}" failed. No retries permitted until 2026-10-30 08:52:42.43424133 +0000 UTC m=+18.187303374 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fece1d69-0824-4ecc-ad78-cea4e19bde61-metrics-certs") pod "network-metrics-daemon-rtjs6" (UID: "fece1d69-0824-4ecc-ad78-cea4e19bde61") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 08:52:34.434638 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:34.434618 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 08:52:34.434736 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:34.434668 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f039cecc-3f4f-4e9b-94e5-5d46918f9487-original-pull-secret podName:f039cecc-3f4f-4e9b-94e5-5d46918f9487 nodeName:}" failed. No retries permitted until 2026-10-30 08:52:42.434655379 +0000 UTC m=+18.187717421 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f039cecc-3f4f-4e9b-94e5-5d46918f9487-original-pull-secret") pod "global-pull-secret-syncer-xgdfr" (UID: "f039cecc-3f4f-4e9b-94e5-5d46918f9487") : object "kube-system"/"original-pull-secret" not registered Oct 30 08:52:34.534894 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:34.534857 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttr59\" (UniqueName: \"kubernetes.io/projected/26e2f6af-5dbf-44c2-9acf-58c70be503bf-kube-api-access-ttr59\") pod \"network-check-target-gn6v4\" (UID: \"26e2f6af-5dbf-44c2-9acf-58c70be503bf\") " pod="openshift-network-diagnostics/network-check-target-gn6v4" Oct 30 08:52:34.535073 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:34.535043 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 08:52:34.535073 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:34.535068 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 08:52:34.535221 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:34.535081 2585 projected.go:196] Error preparing data for projected volume kube-api-access-ttr59 for pod openshift-network-diagnostics/network-check-target-gn6v4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 08:52:34.535221 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:34.535139 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26e2f6af-5dbf-44c2-9acf-58c70be503bf-kube-api-access-ttr59 podName:26e2f6af-5dbf-44c2-9acf-58c70be503bf nodeName:}" failed. No retries permitted until 2026-10-30 08:52:42.535122084 +0000 UTC m=+18.288184127 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ttr59" (UniqueName: "kubernetes.io/projected/26e2f6af-5dbf-44c2-9acf-58c70be503bf-kube-api-access-ttr59") pod "network-check-target-gn6v4" (UID: "26e2f6af-5dbf-44c2-9acf-58c70be503bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 08:52:34.768456 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:34.768431 2585 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 30 08:52:34.851020 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:34.850505 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:34.851020 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:34.850644 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgdfr" podUID="f039cecc-3f4f-4e9b-94e5-5d46918f9487" Oct 30 08:52:34.851429 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:34.851271 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gn6v4" Oct 30 08:52:34.851429 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:34.851383 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gn6v4" podUID="26e2f6af-5dbf-44c2-9acf-58c70be503bf" Oct 30 08:52:35.021360 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:35.021275 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s9pz8" event={"ID":"0df87d60-113c-4039-93a4-06205c202a73","Type":"ContainerStarted","Data":"87f8ebcd271acbd6b200bc10857c4df95509f0008199bfe5071115326530746e"} Oct 30 08:52:35.024524 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:35.024490 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" event={"ID":"097227b5-19cd-449b-88a1-ce703f741481","Type":"ContainerStarted","Data":"02dc996e5fcb644bced3279aa356c21dd7b67e9d32e2d52f029a4c96a01f77f4"} Oct 30 08:52:35.027961 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:35.027923 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwrk9" event={"ID":"e0eac401-f877-428f-b85c-271fa0aca679","Type":"ContainerStarted","Data":"fe832321602258851dda453ad03ed3b97623b0990de3ea2d0d38d67b385efe82"} Oct 30 08:52:35.064979 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:35.064936 2585 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-s9pz8" podStartSLOduration=2.271316546 podStartE2EDuration="10.064923598s" totalImagesPullingTime="7.793607052s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 08:52:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:52:35.064398926 +0000 UTC m=+10.817460977" watchObservedRunningTime="2026-10-30 08:52:35.064923598 +0000 UTC m=+10.817985647" Oct 30 08:52:35.733215 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:35.732903 2585 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T08:52:34.768451956Z","UUID":"134823ce-48ac-4d78-a579-d26f3dbd4e8d","Handler":null,"Name":"","Endpoint":""} Oct 30 08:52:35.734810 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:35.734789 2585 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 30 08:52:35.734905 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:35.734817 2585 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 30 08:52:35.848052 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:35.848021 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:52:35.848172 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:35.848156 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtjs6" podUID="fece1d69-0824-4ecc-ad78-cea4e19bde61" Oct 30 08:52:36.032782 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:36.032707 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" event={"ID":"097227b5-19cd-449b-88a1-ce703f741481","Type":"ContainerStarted","Data":"1c1183aed3d9f7224a35f5a1c0fd1035771460eb8f37ebec8fa980d3c9a16ff0"} Oct 30 08:52:36.035572 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:36.035541 2585 generic.go:356] "Generic (PLEG): container finished" podID="e0eac401-f877-428f-b85c-271fa0aca679" containerID="fe832321602258851dda453ad03ed3b97623b0990de3ea2d0d38d67b385efe82" exitCode=0 Oct 30 08:52:36.036232 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:36.036185 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwrk9" event={"ID":"e0eac401-f877-428f-b85c-271fa0aca679","Type":"ContainerDied","Data":"fe832321602258851dda453ad03ed3b97623b0990de3ea2d0d38d67b385efe82"} Oct 30 08:52:36.039578 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:36.039553 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bqlk7" event={"ID":"094983e9-88e8-4881-be25-8ba5d8bc0979","Type":"ContainerStarted","Data":"9a31b56f0c10593ec11a6d4869c7fc41dddd451e46491efc4c5e64dcc8d8341b"} Oct 30 08:52:36.075556 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:36.075505 2585 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" podStartSLOduration=2.810260404 podStartE2EDuration="11.075487443s" totalImagesPullingTime="8.265227039s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 08:52:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:52:36.07431176 +0000 UTC m=+11.827373810" watchObservedRunningTime="2026-10-30 08:52:36.075487443 +0000 UTC m=+11.828549495" Oct 30 08:52:36.112723 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:36.112667 2585 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-bqlk7" podStartSLOduration=2.867782922 podStartE2EDuration="11.112658684s" totalImagesPullingTime="8.244875762s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 08:52:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:52:36.112486509 +0000 UTC m=+11.865548558" watchObservedRunningTime="2026-10-30 08:52:36.112658684 +0000 UTC m=+11.865720734" Oct 30 08:52:36.384803 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:36.384774 2585 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wzfpw" Oct 30 08:52:36.384952 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:36.384902 2585 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 08:52:36.385502 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:36.385481 2585 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wzfpw" Oct 30 08:52:36.848434 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:36.848406 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gn6v4" Oct 30 08:52:36.848581 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:36.848541 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gn6v4" podUID="26e2f6af-5dbf-44c2-9acf-58c70be503bf" Oct 30 08:52:36.848701 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:36.848670 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:36.848757 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:36.848739 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgdfr" podUID="f039cecc-3f4f-4e9b-94e5-5d46918f9487" Oct 30 08:52:37.043092 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:37.043023 2585 generic.go:356] "Generic (PLEG): container finished" podID="e0eac401-f877-428f-b85c-271fa0aca679" containerID="29527a4a722056368c942fc9516cae1603c6cb11bf43ee60de3ab27ea8cafc3d" exitCode=0 Oct 30 08:52:37.043467 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:37.043107 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwrk9" event={"ID":"e0eac401-f877-428f-b85c-271fa0aca679","Type":"ContainerDied","Data":"29527a4a722056368c942fc9516cae1603c6cb11bf43ee60de3ab27ea8cafc3d"} Oct 30 08:52:37.044895 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:37.044849 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nnwhb" event={"ID":"3447411a-b1de-406a-9df8-4d5e565add87","Type":"ContainerStarted","Data":"6845d6addc944f1ea27d9802b8e39b01e1936e6bcfd140f35f3afefaf375a0f9"} Oct 30 08:52:37.128914 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:37.128387 2585 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nnwhb" podStartSLOduration=3.994479251 podStartE2EDuration="12.128371831s" totalImagesPullingTime="8.13389258s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 08:52:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:52:37.12760138 +0000 UTC m=+12.880663431" watchObservedRunningTime="2026-10-30 08:52:37.128371831 +0000 UTC m=+12.881433873" Oct 30 08:52:37.848628 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:37.848570 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:52:37.848731 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:37.848671 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtjs6" podUID="fece1d69-0824-4ecc-ad78-cea4e19bde61" Oct 30 08:52:38.049991 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:38.049952 2585 generic.go:356] "Generic (PLEG): container finished" podID="e0eac401-f877-428f-b85c-271fa0aca679" containerID="0aaeb7572c43f7ab3f568497e513b8beb563d10e97cff37aacba4497407d21b3" exitCode=0 Oct 30 08:52:38.050793 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:38.050051 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwrk9" event={"ID":"e0eac401-f877-428f-b85c-271fa0aca679","Type":"ContainerDied","Data":"0aaeb7572c43f7ab3f568497e513b8beb563d10e97cff37aacba4497407d21b3"} Oct 30 08:52:38.052154 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:38.052133 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kw85k" event={"ID":"c444edaf-cb41-4707-a33f-f181873a6b01","Type":"ContainerStarted","Data":"6cf72955ba88807772e44fdc4d47f8d219dceeb549e794685ac1cd0ff25ede8c"} Oct 30 08:52:38.135133 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:38.135060 2585 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kw85k" podStartSLOduration=2.919875751 podStartE2EDuration="13.13504704s" totalImagesPullingTime="10.215171289s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 08:52:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:52:38.134767633 +0000 UTC m=+13.887829707" watchObservedRunningTime="2026-10-30 08:52:38.13504704 +0000 UTC m=+13.888109113" Oct 30 08:52:38.849297 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:38.848817 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gn6v4" Oct 30 08:52:38.849297 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:38.848946 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gn6v4" podUID="26e2f6af-5dbf-44c2-9acf-58c70be503bf" Oct 30 08:52:38.849297 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:38.848999 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:38.849297 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:38.849108 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgdfr" podUID="f039cecc-3f4f-4e9b-94e5-5d46918f9487" Oct 30 08:52:39.848153 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:39.848122 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:52:39.848724 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:39.848277 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtjs6" podUID="fece1d69-0824-4ecc-ad78-cea4e19bde61" Oct 30 08:52:40.059848 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:40.059600 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwrk9" event={"ID":"e0eac401-f877-428f-b85c-271fa0aca679","Type":"ContainerStarted","Data":"98bc5a76eb267dcfd38aa1a7a145c99d2c1010109f40982fff277ec336fb21e8"} Oct 30 08:52:40.848249 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:40.848190 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gn6v4" Oct 30 08:52:40.848249 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:40.848253 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:40.848736 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:40.848327 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gn6v4" podUID="26e2f6af-5dbf-44c2-9acf-58c70be503bf" Oct 30 08:52:40.848736 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:40.848440 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgdfr" podUID="f039cecc-3f4f-4e9b-94e5-5d46918f9487" Oct 30 08:52:41.064341 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:41.064307 2585 generic.go:356] "Generic (PLEG): container finished" podID="e0eac401-f877-428f-b85c-271fa0aca679" containerID="98bc5a76eb267dcfd38aa1a7a145c99d2c1010109f40982fff277ec336fb21e8" exitCode=0 Oct 30 08:52:41.064504 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:41.064372 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwrk9" event={"ID":"e0eac401-f877-428f-b85c-271fa0aca679","Type":"ContainerDied","Data":"98bc5a76eb267dcfd38aa1a7a145c99d2c1010109f40982fff277ec336fb21e8"} Oct 30 08:52:41.847855 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:41.847837 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:52:41.847958 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:41.847942 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtjs6" podUID="fece1d69-0824-4ecc-ad78-cea4e19bde61" Oct 30 08:52:42.069136 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:42.068998 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" event={"ID":"d03bffbe-b198-427f-86cb-e854d42260a5","Type":"ContainerStarted","Data":"493659b20e6cf433daaf86719e058e7c16912bafbe32778bee432ef4bb6ce50b"} Oct 30 08:52:42.069504 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:42.069179 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" event={"ID":"d03bffbe-b198-427f-86cb-e854d42260a5","Type":"ContainerStarted","Data":"1a38275f3603e22095f734132a06388ad4b1c5d3e8671c5c76bfd5daa3bb7c90"} Oct 30 08:52:42.069504 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:42.069237 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" event={"ID":"d03bffbe-b198-427f-86cb-e854d42260a5","Type":"ContainerStarted","Data":"f03a089fbcaa1baa72bbec63759be3d9cc078e6c91b66a18c495986b90bbc636"} Oct 30 08:52:42.069504 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:42.069284 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" event={"ID":"d03bffbe-b198-427f-86cb-e854d42260a5","Type":"ContainerStarted","Data":"ae60c87c632605d8aac92bca22e2f9f7c796671a5611ac2d8f3ef8cdd5a7eddb"} Oct 30 08:52:42.072105 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:42.072082 2585 generic.go:356] "Generic (PLEG): container finished" podID="e0eac401-f877-428f-b85c-271fa0aca679" containerID="4e84b63d9d8a89b5122df5f235de439b7c8a5111a279b62a5403e3040d473066" exitCode=0 Oct 30 08:52:42.072193 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:42.072118 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwrk9" event={"ID":"e0eac401-f877-428f-b85c-271fa0aca679","Type":"ContainerDied","Data":"4e84b63d9d8a89b5122df5f235de439b7c8a5111a279b62a5403e3040d473066"} Oct 30 08:52:42.498860 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:42.498787 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fece1d69-0824-4ecc-ad78-cea4e19bde61-metrics-certs\") pod \"network-metrics-daemon-rtjs6\" (UID: \"fece1d69-0824-4ecc-ad78-cea4e19bde61\") " pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:52:42.498860 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:42.498830 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f039cecc-3f4f-4e9b-94e5-5d46918f9487-original-pull-secret\") pod \"global-pull-secret-syncer-xgdfr\" (UID: \"f039cecc-3f4f-4e9b-94e5-5d46918f9487\") " pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:42.499024 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:42.498923 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 08:52:42.499024 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:42.498975 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 08:52:42.499024 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:42.498979 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fece1d69-0824-4ecc-ad78-cea4e19bde61-metrics-certs podName:fece1d69-0824-4ecc-ad78-cea4e19bde61 nodeName:}" failed. No retries permitted until 2026-10-30 08:52:58.498964722 +0000 UTC m=+34.252026761 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fece1d69-0824-4ecc-ad78-cea4e19bde61-metrics-certs") pod "network-metrics-daemon-rtjs6" (UID: "fece1d69-0824-4ecc-ad78-cea4e19bde61") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 08:52:42.499024 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:42.499021 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f039cecc-3f4f-4e9b-94e5-5d46918f9487-original-pull-secret podName:f039cecc-3f4f-4e9b-94e5-5d46918f9487 nodeName:}" failed. No retries permitted until 2026-10-30 08:52:58.499009381 +0000 UTC m=+34.252071408 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f039cecc-3f4f-4e9b-94e5-5d46918f9487-original-pull-secret") pod "global-pull-secret-syncer-xgdfr" (UID: "f039cecc-3f4f-4e9b-94e5-5d46918f9487") : object "kube-system"/"original-pull-secret" not registered Oct 30 08:52:42.599322 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:42.599291 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttr59\" (UniqueName: \"kubernetes.io/projected/26e2f6af-5dbf-44c2-9acf-58c70be503bf-kube-api-access-ttr59\") pod \"network-check-target-gn6v4\" (UID: \"26e2f6af-5dbf-44c2-9acf-58c70be503bf\") " pod="openshift-network-diagnostics/network-check-target-gn6v4" Oct 30 08:52:42.599437 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:42.599405 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 08:52:42.599437 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:42.599421 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 08:52:42.599437 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:42.599431 2585 projected.go:196] Error preparing data for projected volume kube-api-access-ttr59 for pod openshift-network-diagnostics/network-check-target-gn6v4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 08:52:42.599559 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:42.599469 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26e2f6af-5dbf-44c2-9acf-58c70be503bf-kube-api-access-ttr59 podName:26e2f6af-5dbf-44c2-9acf-58c70be503bf nodeName:}" failed. No retries permitted until 2026-10-30 08:52:58.59946046 +0000 UTC m=+34.352522488 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ttr59" (UniqueName: "kubernetes.io/projected/26e2f6af-5dbf-44c2-9acf-58c70be503bf-kube-api-access-ttr59") pod "network-check-target-gn6v4" (UID: "26e2f6af-5dbf-44c2-9acf-58c70be503bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 08:52:42.847889 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:42.847824 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gn6v4" Oct 30 08:52:42.847992 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:42.847914 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gn6v4" podUID="26e2f6af-5dbf-44c2-9acf-58c70be503bf" Oct 30 08:52:42.848061 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:42.847986 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:42.848134 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:42.848113 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgdfr" podUID="f039cecc-3f4f-4e9b-94e5-5d46918f9487" Oct 30 08:52:43.077953 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:43.077926 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xwrk9" event={"ID":"e0eac401-f877-428f-b85c-271fa0aca679","Type":"ContainerStarted","Data":"b3563e75d3f87e729e84535e132525a413e41ae81f29d94c27b7908b0e3fde32"} Oct 30 08:52:43.081117 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:43.081095 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" event={"ID":"d03bffbe-b198-427f-86cb-e854d42260a5","Type":"ContainerStarted","Data":"1e71d85c200d0ae0b05a86163602dd9ab44e8ab588fbc85a017ffcf7bf7d6941"} Oct 30 08:52:43.081198 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:43.081150 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" event={"ID":"d03bffbe-b198-427f-86cb-e854d42260a5","Type":"ContainerStarted","Data":"85864a4bd67658f1fb8a88e74870cc739fba96f3cbdfc74acb51a4ab2ee96f45"} Oct 30 08:52:43.123585 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:43.123519 2585 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xwrk9" podStartSLOduration=7.746854869 podStartE2EDuration="18.12350652s" totalImagesPullingTime="10.376651651s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 08:52:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:52:43.122995132 +0000 UTC m=+18.876057184" watchObservedRunningTime="2026-10-30 08:52:43.12350652 +0000 UTC m=+18.876568569" Oct 30 08:52:43.848828 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:43.848793 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:52:43.848976 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:43.848901 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtjs6" podUID="fece1d69-0824-4ecc-ad78-cea4e19bde61" Oct 30 08:52:44.849285 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:44.849254 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gn6v4" Oct 30 08:52:44.849682 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:44.849442 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:44.849682 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:44.849437 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gn6v4" podUID="26e2f6af-5dbf-44c2-9acf-58c70be503bf" Oct 30 08:52:44.849682 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:44.849542 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgdfr" podUID="f039cecc-3f4f-4e9b-94e5-5d46918f9487" Oct 30 08:52:45.087650 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:45.087615 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" event={"ID":"d03bffbe-b198-427f-86cb-e854d42260a5","Type":"ContainerStarted","Data":"277bf9858a0a3a632a220ff3e8de3409e194714907e30fe376318ff403a95645"} Oct 30 08:52:45.848136 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:45.848113 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:52:45.848317 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:45.848230 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtjs6" podUID="fece1d69-0824-4ecc-ad78-cea4e19bde61" Oct 30 08:52:46.848033 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:46.848007 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:46.848716 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:46.848007 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gn6v4" Oct 30 08:52:46.848716 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:46.848104 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgdfr" podUID="f039cecc-3f4f-4e9b-94e5-5d46918f9487" Oct 30 08:52:46.848716 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:46.848179 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gn6v4" podUID="26e2f6af-5dbf-44c2-9acf-58c70be503bf" Oct 30 08:52:47.094597 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:47.094572 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" event={"ID":"d03bffbe-b198-427f-86cb-e854d42260a5","Type":"ContainerStarted","Data":"ce8e098d3a74a4f2a514553c2f378606172629d7fb845a2519c2f1821f66b464"} Oct 30 08:52:47.094897 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:47.094878 2585 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:47.109574 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:47.109520 2585 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:47.182302 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:47.182261 2585 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" podStartSLOduration=7.396284249 podStartE2EDuration="22.182250736s" totalImagesPullingTime="14.785966487s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 08:52:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:52:47.169828847 +0000 UTC m=+22.922890896" watchObservedRunningTime="2026-10-30 08:52:47.182250736 +0000 UTC m=+22.935312785" Oct 30 08:52:47.848756 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:47.848729 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:52:47.849097 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:47.848823 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtjs6" podUID="fece1d69-0824-4ecc-ad78-cea4e19bde61" Oct 30 08:52:48.096675 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:48.096650 2585 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 08:52:48.097054 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:48.097036 2585 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:48.111120 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:48.111068 2585 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:48.255378 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:48.255351 2585 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:52:48.336060 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:48.336018 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xgdfr"] Oct 30 08:52:48.336180 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:48.336135 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:48.336260 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:48.336240 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgdfr" podUID="f039cecc-3f4f-4e9b-94e5-5d46918f9487" Oct 30 08:52:48.339509 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:48.339483 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gn6v4"] Oct 30 08:52:48.339615 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:48.339593 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gn6v4" Oct 30 08:52:48.339701 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:48.339680 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gn6v4" podUID="26e2f6af-5dbf-44c2-9acf-58c70be503bf" Oct 30 08:52:48.342258 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:48.342234 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rtjs6"] Oct 30 08:52:48.342351 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:48.342337 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:52:48.342470 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:48.342441 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtjs6" podUID="fece1d69-0824-4ecc-ad78-cea4e19bde61" Oct 30 08:52:49.848744 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:49.848713 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gn6v4" Oct 30 08:52:49.849199 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:49.848715 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:52:49.849199 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:49.848815 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gn6v4" podUID="26e2f6af-5dbf-44c2-9acf-58c70be503bf" Oct 30 08:52:49.849199 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:49.848904 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtjs6" podUID="fece1d69-0824-4ecc-ad78-cea4e19bde61" Oct 30 08:52:49.849199 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:49.848715 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:49.849199 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:49.848978 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgdfr" podUID="f039cecc-3f4f-4e9b-94e5-5d46918f9487" Oct 30 08:52:51.849066 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:51.848886 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:52:51.849531 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:51.848886 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gn6v4" Oct 30 08:52:51.849531 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:51.849150 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtjs6" podUID="fece1d69-0824-4ecc-ad78-cea4e19bde61" Oct 30 08:52:51.849531 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:51.849218 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gn6v4" podUID="26e2f6af-5dbf-44c2-9acf-58c70be503bf" Oct 30 08:52:51.849531 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:51.848926 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:51.849531 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:51.849281 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgdfr" podUID="f039cecc-3f4f-4e9b-94e5-5d46918f9487" Oct 30 08:52:53.848221 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:53.848178 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:53.848221 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:53.848189 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gn6v4" Oct 30 08:52:53.848662 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:53.848189 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:52:53.848662 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:53.848288 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xgdfr" podUID="f039cecc-3f4f-4e9b-94e5-5d46918f9487" Oct 30 08:52:53.848662 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:53.848369 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gn6v4" podUID="26e2f6af-5dbf-44c2-9acf-58c70be503bf" Oct 30 08:52:53.848662 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:53.848441 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtjs6" podUID="fece1d69-0824-4ecc-ad78-cea4e19bde61" Oct 30 08:52:54.521786 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.521723 2585 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-65.ec2.internal" event="NodeReady" Oct 30 08:52:54.521886 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.521822 2585 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Oct 30 08:52:54.569590 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.569563 2585 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-q4sp5"] Oct 30 08:52:54.572614 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.572583 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-q4sp5" Oct 30 08:52:54.574397 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.574370 2585 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-8q4xg"] Oct 30 08:52:54.578021 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.578002 2585 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-mzwbj"] Oct 30 08:52:54.578154 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.578131 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-8q4xg" Oct 30 08:52:54.581172 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.581149 2585 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-prnqf"] Oct 30 08:52:54.581309 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.581275 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-mzwbj" Oct 30 08:52:54.584101 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.584079 2585 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-r95n6"] Oct 30 08:52:54.584233 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.584183 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-prnqf" Oct 30 08:52:54.590297 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.590269 2585 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-99562"] Oct 30 08:52:54.591983 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.591223 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-r95n6" Oct 30 08:52:54.591983 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.591523 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\"" Oct 30 08:52:54.591983 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.591574 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\"" Oct 30 08:52:54.594833 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.594809 2585 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-jxz7s"] Oct 30 08:52:54.596848 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.595150 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-99562" Oct 30 08:52:54.597683 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.597663 2585 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c5bffb4d-x885p"] Oct 30 08:52:54.597807 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.597788 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-jxz7s" Oct 30 08:52:54.598753 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.598729 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Oct 30 08:52:54.604013 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.603156 2585 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9"] Oct 30 08:52:54.604013 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.603459 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:52:54.609133 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.609110 2585 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-46mmb"] Oct 30 08:52:54.610314 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.610291 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9" Oct 30 08:52:54.611634 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.611615 2585 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b77f4b5fc-fdtlw"] Oct 30 08:52:54.612646 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.612624 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:52:54.614604 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.614587 2585 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-777d6b9d77-br8dn"] Oct 30 08:52:54.614725 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.614709 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:52:54.617255 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.617232 2585 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-cdnwr"] Oct 30 08:52:54.617392 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.617371 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:52:54.625871 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.625849 2585 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-qvd5x"] Oct 30 08:52:54.626220 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.626187 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-cdnwr" Oct 30 08:52:54.629477 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.629458 2585 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-6jb9v"] Oct 30 08:52:54.629616 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.629600 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-qvd5x" Oct 30 08:52:54.640742 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.640718 2585 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vbv2z"] Oct 30 08:52:54.640878 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.640858 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" Oct 30 08:52:54.678665 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.678632 2585 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-j4lkv"] Oct 30 08:52:54.678833 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.678813 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vbv2z" Oct 30 08:52:54.683271 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.683190 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-q4sp5"] Oct 30 08:52:54.685302 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.685283 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-8q4xg"] Oct 30 08:52:54.685373 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.683285 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j4lkv" Oct 30 08:52:54.685373 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.685324 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-mzwbj"] Oct 30 08:52:54.685373 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.685350 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-prnqf"] Oct 30 08:52:54.685490 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.685375 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-99562"] Oct 30 08:52:54.685490 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.685409 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c5bffb4d-x885p"] Oct 30 08:52:54.685490 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.685431 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-cdnwr"] Oct 30 08:52:54.685490 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.685453 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-46mmb"] Oct 30 08:52:54.685490 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.685473 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b77f4b5fc-fdtlw"] Oct 30 08:52:54.685627 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.685494 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j4lkv"] Oct 30 08:52:54.685627 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.685516 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vbv2z"] Oct 30 08:52:54.685627 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.685548 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-r95n6"] Oct 30 08:52:54.685627 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.685571 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-777d6b9d77-br8dn"] Oct 30 08:52:54.685627 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.685593 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-jxz7s"] Oct 30 08:52:54.685627 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.685613 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9"] Oct 30 08:52:54.685794 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.685634 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-qvd5x"] Oct 30 08:52:54.685794 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.685656 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-6jb9v"] Oct 30 08:52:54.691703 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.691683 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-bound-sa-token\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:52:54.691788 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.691715 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/55ed1a9f-f5a7-44fd-8b91-01d4e25f651a-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9\" (UID: \"55ed1a9f-f5a7-44fd-8b91-01d4e25f651a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9" Oct 30 08:52:54.691788 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.691741 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55ed1a9f-f5a7-44fd-8b91-01d4e25f651a-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9\" (UID: \"55ed1a9f-f5a7-44fd-8b91-01d4e25f651a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9" Oct 30 08:52:54.691873 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.691804 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/80da5ad0-0b1d-40da-82b8-97202a58ee9f-snapshots\") pod \"insights-operator-7c4986d449-46mmb\" (UID: \"80da5ad0-0b1d-40da-82b8-97202a58ee9f\") " pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:52:54.691921 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.691896 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-trusted-ca\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:52:54.692002 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.691982 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e02c520e-2276-440e-8f36-1047f78af40a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-r95n6\" (UID: \"e02c520e-2276-440e-8f36-1047f78af40a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-r95n6" Oct 30 08:52:54.692069 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.692054 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wlpn\" (UniqueName: \"kubernetes.io/projected/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb-kube-api-access-7wlpn\") pod \"cluster-samples-operator-6ddb6c8b94-99562\" (UID: \"a88ad1f8-2002-4e56-abcb-47c68c0a1fbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-99562" Oct 30 08:52:54.692123 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.692098 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tlk8\" (UniqueName: \"kubernetes.io/projected/e5371073-8444-4462-93f1-2cb7cfd54d9f-kube-api-access-4tlk8\") pod \"kas-connection-checker-685895c7c9-q4sp5\" (UID: \"e5371073-8444-4462-93f1-2cb7cfd54d9f\") " pod="kube-system/kas-connection-checker-685895c7c9-q4sp5" Oct 30 08:52:54.692192 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.692178 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-99562\" (UID: \"a88ad1f8-2002-4e56-abcb-47c68c0a1fbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-99562" Oct 30 08:52:54.692256 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.692238 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-image-registry-private-configuration\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:52:54.692328 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.692273 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97b9l\" (UniqueName: \"kubernetes.io/projected/0a14ed2f-0a6c-4ed6-b05a-54f733f19453-kube-api-access-97b9l\") pod \"volume-data-source-validator-58c9f5f46d-jxz7s\" (UID: \"0a14ed2f-0a6c-4ed6-b05a-54f733f19453\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-jxz7s" Oct 30 08:52:54.692394 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.692346 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-tls\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:52:54.692394 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.692363 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzbp9\" (UniqueName: \"kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-kube-api-access-hzbp9\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:52:54.692394 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.692378 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80da5ad0-0b1d-40da-82b8-97202a58ee9f-service-ca-bundle\") pod \"insights-operator-7c4986d449-46mmb\" (UID: \"80da5ad0-0b1d-40da-82b8-97202a58ee9f\") " pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:52:54.692521 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.692439 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80da5ad0-0b1d-40da-82b8-97202a58ee9f-tmp\") pod \"insights-operator-7c4986d449-46mmb\" (UID: \"80da5ad0-0b1d-40da-82b8-97202a58ee9f\") " pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:52:54.692583 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.692487 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-installation-pull-secrets\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:52:54.692644 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.692612 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm8s9\" (UniqueName: \"kubernetes.io/projected/0e9e7178-b316-431d-851b-565dfc341afa-kube-api-access-tm8s9\") pod \"kas-connection-checker-685895c7c9-mzwbj\" (UID: \"0e9e7178-b316-431d-851b-565dfc341afa\") " pod="kube-system/kas-connection-checker-685895c7c9-mzwbj" Oct 30 08:52:54.692644 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.692632 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpszg\" (UniqueName: \"kubernetes.io/projected/e02c520e-2276-440e-8f36-1047f78af40a-kube-api-access-dpszg\") pod \"cluster-monitoring-operator-884576c57-r95n6\" (UID: \"e02c520e-2276-440e-8f36-1047f78af40a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-r95n6" Oct 30 08:52:54.692753 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.692650 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwwbq\" (UniqueName: \"kubernetes.io/projected/d4b82adb-d2fe-406a-a9e9-ea28cb3679ff-kube-api-access-lwwbq\") pod \"kas-connection-checker-685895c7c9-prnqf\" (UID: \"d4b82adb-d2fe-406a-a9e9-ea28cb3679ff\") " pod="kube-system/kas-connection-checker-685895c7c9-prnqf" Oct 30 08:52:54.692753 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.692675 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-99562\" (UID: \"a88ad1f8-2002-4e56-abcb-47c68c0a1fbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-99562" Oct 30 08:52:54.692753 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.692720 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72tnd\" (UniqueName: \"kubernetes.io/projected/80da5ad0-0b1d-40da-82b8-97202a58ee9f-kube-api-access-72tnd\") pod \"insights-operator-7c4986d449-46mmb\" (UID: \"80da5ad0-0b1d-40da-82b8-97202a58ee9f\") " pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:52:54.692973 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.692774 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0994c04f-63a8-4b19-a4a1-9a0c288a26f5-nginx-conf\") pod \"networking-console-plugin-86c478bb88-8q4xg\" (UID: \"0994c04f-63a8-4b19-a4a1-9a0c288a26f5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8q4xg" Oct 30 08:52:54.692973 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.692796 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq7cl\" (UniqueName: \"kubernetes.io/projected/55ed1a9f-f5a7-44fd-8b91-01d4e25f651a-kube-api-access-gq7cl\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9\" (UID: \"55ed1a9f-f5a7-44fd-8b91-01d4e25f651a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9" Oct 30 08:52:54.692973 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.692813 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80da5ad0-0b1d-40da-82b8-97202a58ee9f-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-46mmb\" (UID: \"80da5ad0-0b1d-40da-82b8-97202a58ee9f\") " pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:52:54.692973 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.692841 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-ca-trust-extracted\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:52:54.692973 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.692895 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0994c04f-63a8-4b19-a4a1-9a0c288a26f5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8q4xg\" (UID: \"0994c04f-63a8-4b19-a4a1-9a0c288a26f5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8q4xg" Oct 30 08:52:54.692973 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.692970 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-certificates\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:52:54.693871 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.693005 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e02c520e-2276-440e-8f36-1047f78af40a-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-r95n6\" (UID: \"e02c520e-2276-440e-8f36-1047f78af40a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-r95n6" Oct 30 08:52:54.693871 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.693109 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80da5ad0-0b1d-40da-82b8-97202a58ee9f-serving-cert\") pod \"insights-operator-7c4986d449-46mmb\" (UID: \"80da5ad0-0b1d-40da-82b8-97202a58ee9f\") " pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:52:54.693871 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.693282 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Oct 30 08:52:54.695916 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.695892 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 30 08:52:54.696014 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.696001 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Oct 30 08:52:54.696078 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.696010 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Oct 30 08:52:54.696193 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.696087 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Oct 30 08:52:54.696193 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.696151 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 08:52:54.696459 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.696438 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Oct 30 08:52:54.696580 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.696567 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Oct 30 08:52:54.696669 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.696564 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Oct 30 08:52:54.696728 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.696676 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 30 08:52:54.696801 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.696736 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Oct 30 08:52:54.696855 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.696800 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 30 08:52:54.696900 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.696855 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\"" Oct 30 08:52:54.696900 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.696875 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Oct 30 08:52:54.696900 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.696879 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Oct 30 08:52:54.697083 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.697068 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Oct 30 08:52:54.697172 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.697160 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 30 08:52:54.697246 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.697168 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 08:52:54.697307 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.697247 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Oct 30 08:52:54.697307 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.697260 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Oct 30 08:52:54.697307 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.697268 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Oct 30 08:52:54.697423 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.697328 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Oct 30 08:52:54.697423 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.697359 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Oct 30 08:52:54.697423 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.697390 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Oct 30 08:52:54.697423 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.697405 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Oct 30 08:52:54.697596 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.697438 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Oct 30 08:52:54.697596 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.697446 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Oct 30 08:52:54.697596 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.697593 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Oct 30 08:52:54.697696 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.697613 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Oct 30 08:52:54.697696 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.697624 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Oct 30 08:52:54.697696 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.697613 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Oct 30 08:52:54.697820 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.697807 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Oct 30 08:52:54.697932 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.697914 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Oct 30 08:52:54.697980 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.697953 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Oct 30 08:52:54.697980 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.697956 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 30 08:52:54.697980 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.697956 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Oct 30 08:52:54.698085 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.698002 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 30 08:52:54.698085 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.698011 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vphtr\"" Oct 30 08:52:54.698085 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.698040 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Oct 30 08:52:54.710179 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.710158 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Oct 30 08:52:54.710365 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.710346 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 30 08:52:54.710446 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.710406 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 30 08:52:54.710491 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.710456 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xsbkc\"" Oct 30 08:52:54.710523 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.710498 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 30 08:52:54.710564 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.710518 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Oct 30 08:52:54.721913 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.721894 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-xvwnz\"" Oct 30 08:52:54.721992 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.721911 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Oct 30 08:52:54.721992 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.721942 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Oct 30 08:52:54.722214 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.722188 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Oct 30 08:52:54.793967 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.793919 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/55ed1a9f-f5a7-44fd-8b91-01d4e25f651a-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9\" (UID: \"55ed1a9f-f5a7-44fd-8b91-01d4e25f651a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9" Oct 30 08:52:54.793967 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.793947 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55ed1a9f-f5a7-44fd-8b91-01d4e25f651a-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9\" (UID: \"55ed1a9f-f5a7-44fd-8b91-01d4e25f651a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9" Oct 30 08:52:54.793967 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.793965 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/80da5ad0-0b1d-40da-82b8-97202a58ee9f-snapshots\") pod \"insights-operator-7c4986d449-46mmb\" (UID: \"80da5ad0-0b1d-40da-82b8-97202a58ee9f\") " pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:52:54.794160 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.793984 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh7rw\" (UniqueName: \"kubernetes.io/projected/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-kube-api-access-zh7rw\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:52:54.794160 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.794005 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-trusted-ca\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:52:54.794160 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.794029 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-bound-sa-token\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:52:54.794160 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.794142 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-stats-auth\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:52:54.794389 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.794174 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e02c520e-2276-440e-8f36-1047f78af40a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-r95n6\" (UID: \"e02c520e-2276-440e-8f36-1047f78af40a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-r95n6" Oct 30 08:52:54.794389 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.794196 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wlpn\" (UniqueName: \"kubernetes.io/projected/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb-kube-api-access-7wlpn\") pod \"cluster-samples-operator-6ddb6c8b94-99562\" (UID: \"a88ad1f8-2002-4e56-abcb-47c68c0a1fbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-99562" Oct 30 08:52:54.794389 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.794236 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tlk8\" (UniqueName: \"kubernetes.io/projected/e5371073-8444-4462-93f1-2cb7cfd54d9f-kube-api-access-4tlk8\") pod \"kas-connection-checker-685895c7c9-q4sp5\" (UID: \"e5371073-8444-4462-93f1-2cb7cfd54d9f\") " pod="kube-system/kas-connection-checker-685895c7c9-q4sp5" Oct 30 08:52:54.794389 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.794264 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-99562\" (UID: \"a88ad1f8-2002-4e56-abcb-47c68c0a1fbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-99562" Oct 30 08:52:54.794389 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.794288 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-image-registry-private-configuration\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:52:54.794389 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.794312 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97b9l\" (UniqueName: \"kubernetes.io/projected/0a14ed2f-0a6c-4ed6-b05a-54f733f19453-kube-api-access-97b9l\") pod \"volume-data-source-validator-58c9f5f46d-jxz7s\" (UID: \"0a14ed2f-0a6c-4ed6-b05a-54f733f19453\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-jxz7s" Oct 30 08:52:54.794389 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:54.794375 2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 30 08:52:54.794713 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:54.794432 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb-samples-operator-tls podName:a88ad1f8-2002-4e56-abcb-47c68c0a1fbb nodeName:}" failed. No retries permitted until 2026-10-30 08:52:55.294414 +0000 UTC m=+31.047476045 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-99562" (UID: "a88ad1f8-2002-4e56-abcb-47c68c0a1fbb") : secret "samples-operator-tls" not found Oct 30 08:52:54.794713 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.794569 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt6ng\" (UniqueName: \"kubernetes.io/projected/fdbaa900-aa36-4984-a2f3-c5c973e75d8a-kube-api-access-mt6ng\") pod \"network-check-source-6f78d59f99-qvd5x\" (UID: \"fdbaa900-aa36-4984-a2f3-c5c973e75d8a\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-qvd5x" Oct 30 08:52:54.794713 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.794608 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-tls\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:52:54.794713 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.794651 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzbp9\" (UniqueName: \"kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-kube-api-access-hzbp9\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:52:54.794713 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.794657 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55ed1a9f-f5a7-44fd-8b91-01d4e25f651a-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9\" (UID: \"55ed1a9f-f5a7-44fd-8b91-01d4e25f651a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9" Oct 30 08:52:54.794713 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:54.794702 2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 08:52:54.795010 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:54.794745 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 08:52:54.795010 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:54.794759 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c5bffb4d-x885p: secret "image-registry-tls" not found Oct 30 08:52:54.795010 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:54.794811 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-tls podName:9e5c0d3f-6e6c-44d8-b50d-cecacd28474d nodeName:}" failed. No retries permitted until 2026-10-30 08:52:55.294795268 +0000 UTC m=+31.047857309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-tls") pod "image-registry-7c5bffb4d-x885p" (UID: "9e5c0d3f-6e6c-44d8-b50d-cecacd28474d") : secret "image-registry-tls" not found Oct 30 08:52:54.795010 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.794809 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/80da5ad0-0b1d-40da-82b8-97202a58ee9f-snapshots\") pod \"insights-operator-7c4986d449-46mmb\" (UID: \"80da5ad0-0b1d-40da-82b8-97202a58ee9f\") " pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:52:54.795010 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.794826 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80da5ad0-0b1d-40da-82b8-97202a58ee9f-service-ca-bundle\") pod \"insights-operator-7c4986d449-46mmb\" (UID: \"80da5ad0-0b1d-40da-82b8-97202a58ee9f\") " pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:52:54.795010 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.794853 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e5ddc593-a1bb-4f35-be9e-77b6f9486945-config-volume\") pod \"dns-default-vbv2z\" (UID: \"e5ddc593-a1bb-4f35-be9e-77b6f9486945\") " pod="openshift-dns/dns-default-vbv2z" Oct 30 08:52:54.795010 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:54.794866 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02c520e-2276-440e-8f36-1047f78af40a-cluster-monitoring-operator-tls podName:e02c520e-2276-440e-8f36-1047f78af40a nodeName:}" failed. No retries permitted until 2026-10-30 08:52:55.294851896 +0000 UTC m=+31.047913944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e02c520e-2276-440e-8f36-1047f78af40a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-r95n6" (UID: "e02c520e-2276-440e-8f36-1047f78af40a") : secret "cluster-monitoring-operator-tls" not found Oct 30 08:52:54.795010 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.794920 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-trusted-ca\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:52:54.795010 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.794964 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80da5ad0-0b1d-40da-82b8-97202a58ee9f-tmp\") pod \"insights-operator-7c4986d449-46mmb\" (UID: \"80da5ad0-0b1d-40da-82b8-97202a58ee9f\") " pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:52:54.795010 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.794996 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cd1a7b7e-e1dd-4361-9091-b2983dff06da-trusted-ca\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:52:54.795520 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.795018 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrlct\" (UniqueName: \"kubernetes.io/projected/06e7e9e5-ebd3-4e67-95ba-03eeebcee619-kube-api-access-wrlct\") pod \"ingress-canary-j4lkv\" (UID: \"06e7e9e5-ebd3-4e67-95ba-03eeebcee619\") " pod="openshift-ingress-canary/ingress-canary-j4lkv" Oct 30 08:52:54.795520 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.795063 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c3e38a1c-cf20-4170-a71e-5fdc414e2343-config\") pod \"service-ca-operator-544d749c8c-cdnwr\" (UID: \"c3e38a1c-cf20-4170-a71e-5fdc414e2343\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-cdnwr" Oct 30 08:52:54.795520 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.795088 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-installation-pull-secrets\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:52:54.795520 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.795116 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm8s9\" (UniqueName: \"kubernetes.io/projected/0e9e7178-b316-431d-851b-565dfc341afa-kube-api-access-tm8s9\") pod \"kas-connection-checker-685895c7c9-mzwbj\" (UID: \"0e9e7178-b316-431d-851b-565dfc341afa\") " pod="kube-system/kas-connection-checker-685895c7c9-mzwbj" Oct 30 08:52:54.795520 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.795139 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cd1a7b7e-e1dd-4361-9091-b2983dff06da-ca-trust-extracted\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:52:54.795520 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.795158 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-tls\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:52:54.795520 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.795183 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpszg\" (UniqueName: \"kubernetes.io/projected/e02c520e-2276-440e-8f36-1047f78af40a-kube-api-access-dpszg\") pod \"cluster-monitoring-operator-884576c57-r95n6\" (UID: \"e02c520e-2276-440e-8f36-1047f78af40a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-r95n6" Oct 30 08:52:54.795520 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.795230 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwwbq\" (UniqueName: \"kubernetes.io/projected/d4b82adb-d2fe-406a-a9e9-ea28cb3679ff-kube-api-access-lwwbq\") pod \"kas-connection-checker-685895c7c9-prnqf\" (UID: \"d4b82adb-d2fe-406a-a9e9-ea28cb3679ff\") " pod="kube-system/kas-connection-checker-685895c7c9-prnqf" Oct 30 08:52:54.795520 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.795264 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5ddc593-a1bb-4f35-be9e-77b6f9486945-tmp-dir\") pod \"dns-default-vbv2z\" (UID: \"e5ddc593-a1bb-4f35-be9e-77b6f9486945\") " pod="openshift-dns/dns-default-vbv2z" Oct 30 08:52:54.795520 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.795290 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh9pf\" (UniqueName: \"kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-kube-api-access-nh9pf\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:52:54.795520 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.795311 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2w8s\" (UniqueName: \"kubernetes.io/projected/e5ddc593-a1bb-4f35-be9e-77b6f9486945-kube-api-access-b2w8s\") pod \"dns-default-vbv2z\" (UID: \"e5ddc593-a1bb-4f35-be9e-77b6f9486945\") " pod="openshift-dns/dns-default-vbv2z" Oct 30 08:52:54.795520 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.795333 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0c1ebb77-bd76-4329-ac03-87f60b688431-serving-cert\") pod \"console-operator-7cd56b8dbc-6jb9v\" (UID: \"0c1ebb77-bd76-4329-ac03-87f60b688431\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" Oct 30 08:52:54.795520 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.795355 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-service-ca-bundle\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:52:54.795520 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.795383 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-99562\" (UID: \"a88ad1f8-2002-4e56-abcb-47c68c0a1fbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-99562" Oct 30 08:52:54.795520 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.795407 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0c1ebb77-bd76-4329-ac03-87f60b688431-config\") pod \"console-operator-7cd56b8dbc-6jb9v\" (UID: \"0c1ebb77-bd76-4329-ac03-87f60b688431\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" Oct 30 08:52:54.795520 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.795430 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06e7e9e5-ebd3-4e67-95ba-03eeebcee619-cert\") pod \"ingress-canary-j4lkv\" (UID: \"06e7e9e5-ebd3-4e67-95ba-03eeebcee619\") " pod="openshift-ingress-canary/ingress-canary-j4lkv" Oct 30 08:52:54.796275 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.795458 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72tnd\" (UniqueName: \"kubernetes.io/projected/80da5ad0-0b1d-40da-82b8-97202a58ee9f-kube-api-access-72tnd\") pod \"insights-operator-7c4986d449-46mmb\" (UID: \"80da5ad0-0b1d-40da-82b8-97202a58ee9f\") " pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:52:54.796275 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.795464 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80da5ad0-0b1d-40da-82b8-97202a58ee9f-tmp\") pod \"insights-operator-7c4986d449-46mmb\" (UID: \"80da5ad0-0b1d-40da-82b8-97202a58ee9f\") " pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:52:54.796275 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.795484 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xlkp\" (UniqueName: \"kubernetes.io/projected/0c1ebb77-bd76-4329-ac03-87f60b688431-kube-api-access-9xlkp\") pod \"console-operator-7cd56b8dbc-6jb9v\" (UID: \"0c1ebb77-bd76-4329-ac03-87f60b688431\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" Oct 30 08:52:54.796275 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.795492 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80da5ad0-0b1d-40da-82b8-97202a58ee9f-service-ca-bundle\") pod \"insights-operator-7c4986d449-46mmb\" (UID: \"80da5ad0-0b1d-40da-82b8-97202a58ee9f\") " pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:52:54.796275 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.795546 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c3e38a1c-cf20-4170-a71e-5fdc414e2343-serving-cert\") pod \"service-ca-operator-544d749c8c-cdnwr\" (UID: \"c3e38a1c-cf20-4170-a71e-5fdc414e2343\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-cdnwr" Oct 30 08:52:54.796275 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.795908 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-certificates\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:52:54.796275 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.795977 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0994c04f-63a8-4b19-a4a1-9a0c288a26f5-nginx-conf\") pod \"networking-console-plugin-86c478bb88-8q4xg\" (UID: \"0994c04f-63a8-4b19-a4a1-9a0c288a26f5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8q4xg" Oct 30 08:52:54.796275 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.796028 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-default-certificate\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:52:54.796275 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.796124 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq7cl\" (UniqueName: \"kubernetes.io/projected/55ed1a9f-f5a7-44fd-8b91-01d4e25f651a-kube-api-access-gq7cl\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9\" (UID: \"55ed1a9f-f5a7-44fd-8b91-01d4e25f651a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9" Oct 30 08:52:54.796275 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.796221 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80da5ad0-0b1d-40da-82b8-97202a58ee9f-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-46mmb\" (UID: \"80da5ad0-0b1d-40da-82b8-97202a58ee9f\") " pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:52:54.796759 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.796372 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cd1a7b7e-e1dd-4361-9091-b2983dff06da-installation-pull-secrets\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:52:54.796759 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.796429 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-99562\" (UID: \"a88ad1f8-2002-4e56-abcb-47c68c0a1fbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-99562" Oct 30 08:52:54.796759 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.796446 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwf4v\" (UniqueName: \"kubernetes.io/projected/c3e38a1c-cf20-4170-a71e-5fdc414e2343-kube-api-access-rwf4v\") pod \"service-ca-operator-544d749c8c-cdnwr\" (UID: \"c3e38a1c-cf20-4170-a71e-5fdc414e2343\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-cdnwr" Oct 30 08:52:54.796759 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.796541 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-ca-trust-extracted\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:52:54.796759 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.796589 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0994c04f-63a8-4b19-a4a1-9a0c288a26f5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8q4xg\" (UID: \"0994c04f-63a8-4b19-a4a1-9a0c288a26f5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8q4xg" Oct 30 08:52:54.796759 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.796625 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-metrics-certs\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:52:54.796759 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.796673 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0994c04f-63a8-4b19-a4a1-9a0c288a26f5-nginx-conf\") pod \"networking-console-plugin-86c478bb88-8q4xg\" (UID: \"0994c04f-63a8-4b19-a4a1-9a0c288a26f5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8q4xg" Oct 30 08:52:54.796759 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:54.796753 2585 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 30 08:52:54.797131 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:54.796815 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0994c04f-63a8-4b19-a4a1-9a0c288a26f5-networking-console-plugin-cert podName:0994c04f-63a8-4b19-a4a1-9a0c288a26f5 nodeName:}" failed. No retries permitted until 2026-10-30 08:52:55.29680132 +0000 UTC m=+31.049863366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0994c04f-63a8-4b19-a4a1-9a0c288a26f5-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-8q4xg" (UID: "0994c04f-63a8-4b19-a4a1-9a0c288a26f5") : secret "networking-console-plugin-cert" not found Oct 30 08:52:54.797131 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.796865 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-certificates\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:52:54.797131 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.796904 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80da5ad0-0b1d-40da-82b8-97202a58ee9f-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-46mmb\" (UID: \"80da5ad0-0b1d-40da-82b8-97202a58ee9f\") " pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:52:54.797131 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.796907 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5ddc593-a1bb-4f35-be9e-77b6f9486945-metrics-tls\") pod \"dns-default-vbv2z\" (UID: \"e5ddc593-a1bb-4f35-be9e-77b6f9486945\") " pod="openshift-dns/dns-default-vbv2z" Oct 30 08:52:54.797131 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.796928 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-ca-trust-extracted\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:52:54.797131 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.796945 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e02c520e-2276-440e-8f36-1047f78af40a-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-r95n6\" (UID: \"e02c520e-2276-440e-8f36-1047f78af40a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-r95n6" Oct 30 08:52:54.797454 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.797394 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-certificates\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:52:54.797454 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.797443 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80da5ad0-0b1d-40da-82b8-97202a58ee9f-serving-cert\") pod \"insights-operator-7c4986d449-46mmb\" (UID: \"80da5ad0-0b1d-40da-82b8-97202a58ee9f\") " pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:52:54.797663 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.797606 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e02c520e-2276-440e-8f36-1047f78af40a-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-r95n6\" (UID: \"e02c520e-2276-440e-8f36-1047f78af40a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-r95n6" Oct 30 08:52:54.797723 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.797692 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cd1a7b7e-e1dd-4361-9091-b2983dff06da-image-registry-private-configuration\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:52:54.797777 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.797724 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0c1ebb77-bd76-4329-ac03-87f60b688431-trusted-ca\") pod \"console-operator-7cd56b8dbc-6jb9v\" (UID: \"0c1ebb77-bd76-4329-ac03-87f60b688431\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" Oct 30 08:52:54.797824 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.797781 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-bound-sa-token\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:52:54.798638 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.798396 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-image-registry-private-configuration\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:52:54.798638 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.798606 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/55ed1a9f-f5a7-44fd-8b91-01d4e25f651a-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9\" (UID: \"55ed1a9f-f5a7-44fd-8b91-01d4e25f651a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9" Oct 30 08:52:54.798781 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.798659 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-installation-pull-secrets\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:52:54.800975 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.800952 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80da5ad0-0b1d-40da-82b8-97202a58ee9f-serving-cert\") pod \"insights-operator-7c4986d449-46mmb\" (UID: \"80da5ad0-0b1d-40da-82b8-97202a58ee9f\") " pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:52:54.817730 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.817702 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97b9l\" (UniqueName: \"kubernetes.io/projected/0a14ed2f-0a6c-4ed6-b05a-54f733f19453-kube-api-access-97b9l\") pod \"volume-data-source-validator-58c9f5f46d-jxz7s\" (UID: \"0a14ed2f-0a6c-4ed6-b05a-54f733f19453\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-jxz7s" Oct 30 08:52:54.817944 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.817922 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tlk8\" (UniqueName: \"kubernetes.io/projected/e5371073-8444-4462-93f1-2cb7cfd54d9f-kube-api-access-4tlk8\") pod \"kas-connection-checker-685895c7c9-q4sp5\" (UID: \"e5371073-8444-4462-93f1-2cb7cfd54d9f\") " pod="kube-system/kas-connection-checker-685895c7c9-q4sp5" Oct 30 08:52:54.818603 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.818396 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wlpn\" (UniqueName: \"kubernetes.io/projected/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb-kube-api-access-7wlpn\") pod \"cluster-samples-operator-6ddb6c8b94-99562\" (UID: \"a88ad1f8-2002-4e56-abcb-47c68c0a1fbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-99562" Oct 30 08:52:54.819140 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.819096 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpszg\" (UniqueName: \"kubernetes.io/projected/e02c520e-2276-440e-8f36-1047f78af40a-kube-api-access-dpszg\") pod \"cluster-monitoring-operator-884576c57-r95n6\" (UID: \"e02c520e-2276-440e-8f36-1047f78af40a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-r95n6" Oct 30 08:52:54.819813 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.819791 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzbp9\" (UniqueName: \"kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-kube-api-access-hzbp9\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:52:54.820196 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.820176 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm8s9\" (UniqueName: \"kubernetes.io/projected/0e9e7178-b316-431d-851b-565dfc341afa-kube-api-access-tm8s9\") pod \"kas-connection-checker-685895c7c9-mzwbj\" (UID: \"0e9e7178-b316-431d-851b-565dfc341afa\") " pod="kube-system/kas-connection-checker-685895c7c9-mzwbj" Oct 30 08:52:54.820406 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.820386 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq7cl\" (UniqueName: \"kubernetes.io/projected/55ed1a9f-f5a7-44fd-8b91-01d4e25f651a-kube-api-access-gq7cl\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9\" (UID: \"55ed1a9f-f5a7-44fd-8b91-01d4e25f651a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9" Oct 30 08:52:54.820726 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.820710 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwwbq\" (UniqueName: \"kubernetes.io/projected/d4b82adb-d2fe-406a-a9e9-ea28cb3679ff-kube-api-access-lwwbq\") pod \"kas-connection-checker-685895c7c9-prnqf\" (UID: \"d4b82adb-d2fe-406a-a9e9-ea28cb3679ff\") " pod="kube-system/kas-connection-checker-685895c7c9-prnqf" Oct 30 08:52:54.821301 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.821280 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72tnd\" (UniqueName: \"kubernetes.io/projected/80da5ad0-0b1d-40da-82b8-97202a58ee9f-kube-api-access-72tnd\") pod \"insights-operator-7c4986d449-46mmb\" (UID: \"80da5ad0-0b1d-40da-82b8-97202a58ee9f\") " pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:52:54.821409 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.821392 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-bound-sa-token\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:52:54.891577 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.891556 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-q4sp5" Oct 30 08:52:54.898345 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.898326 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cd1a7b7e-e1dd-4361-9091-b2983dff06da-ca-trust-extracted\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:52:54.898399 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.898353 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-tls\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:52:54.898399 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.898374 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5ddc593-a1bb-4f35-be9e-77b6f9486945-tmp-dir\") pod \"dns-default-vbv2z\" (UID: \"e5ddc593-a1bb-4f35-be9e-77b6f9486945\") " pod="openshift-dns/dns-default-vbv2z" Oct 30 08:52:54.898399 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.898394 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh9pf\" (UniqueName: \"kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-kube-api-access-nh9pf\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:52:54.898599 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.898415 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2w8s\" (UniqueName: \"kubernetes.io/projected/e5ddc593-a1bb-4f35-be9e-77b6f9486945-kube-api-access-b2w8s\") pod \"dns-default-vbv2z\" (UID: \"e5ddc593-a1bb-4f35-be9e-77b6f9486945\") " pod="openshift-dns/dns-default-vbv2z" Oct 30 08:52:54.898599 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.898437 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0c1ebb77-bd76-4329-ac03-87f60b688431-serving-cert\") pod \"console-operator-7cd56b8dbc-6jb9v\" (UID: \"0c1ebb77-bd76-4329-ac03-87f60b688431\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" Oct 30 08:52:54.898599 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.898462 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-service-ca-bundle\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:52:54.898599 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.898485 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0c1ebb77-bd76-4329-ac03-87f60b688431-config\") pod \"console-operator-7cd56b8dbc-6jb9v\" (UID: \"0c1ebb77-bd76-4329-ac03-87f60b688431\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" Oct 30 08:52:54.898599 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:54.898494 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 08:52:54.898599 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:54.898513 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b77f4b5fc-fdtlw: secret "image-registry-tls" not found Oct 30 08:52:54.898599 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:54.898561 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-tls podName:cd1a7b7e-e1dd-4361-9091-b2983dff06da nodeName:}" failed. No retries permitted until 2026-10-30 08:52:55.398542668 +0000 UTC m=+31.151604697 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-tls") pod "image-registry-b77f4b5fc-fdtlw" (UID: "cd1a7b7e-e1dd-4361-9091-b2983dff06da") : secret "image-registry-tls" not found Oct 30 08:52:54.898599 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.898500 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06e7e9e5-ebd3-4e67-95ba-03eeebcee619-cert\") pod \"ingress-canary-j4lkv\" (UID: \"06e7e9e5-ebd3-4e67-95ba-03eeebcee619\") " pod="openshift-ingress-canary/ingress-canary-j4lkv" Oct 30 08:52:54.899000 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.898623 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xlkp\" (UniqueName: \"kubernetes.io/projected/0c1ebb77-bd76-4329-ac03-87f60b688431-kube-api-access-9xlkp\") pod \"console-operator-7cd56b8dbc-6jb9v\" (UID: \"0c1ebb77-bd76-4329-ac03-87f60b688431\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" Oct 30 08:52:54.899000 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.898655 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c3e38a1c-cf20-4170-a71e-5fdc414e2343-serving-cert\") pod \"service-ca-operator-544d749c8c-cdnwr\" (UID: \"c3e38a1c-cf20-4170-a71e-5fdc414e2343\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-cdnwr" Oct 30 08:52:54.899000 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.898686 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-certificates\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:52:54.899000 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.898718 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-default-certificate\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:52:54.899000 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.898747 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cd1a7b7e-e1dd-4361-9091-b2983dff06da-installation-pull-secrets\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:52:54.899000 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:54.898777 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-service-ca-bundle podName:f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f nodeName:}" failed. No retries permitted until 2026-10-30 08:52:55.398761783 +0000 UTC m=+31.151823838 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-service-ca-bundle") pod "router-default-777d6b9d77-br8dn" (UID: "f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f") : configmap references non-existent config key: service-ca.crt Oct 30 08:52:54.899000 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.898802 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwf4v\" (UniqueName: \"kubernetes.io/projected/c3e38a1c-cf20-4170-a71e-5fdc414e2343-kube-api-access-rwf4v\") pod \"service-ca-operator-544d749c8c-cdnwr\" (UID: \"c3e38a1c-cf20-4170-a71e-5fdc414e2343\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-cdnwr" Oct 30 08:52:54.899000 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.898859 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-metrics-certs\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:52:54.899000 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.898891 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5ddc593-a1bb-4f35-be9e-77b6f9486945-metrics-tls\") pod \"dns-default-vbv2z\" (UID: \"e5ddc593-a1bb-4f35-be9e-77b6f9486945\") " pod="openshift-dns/dns-default-vbv2z" Oct 30 08:52:54.899000 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.898934 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cd1a7b7e-e1dd-4361-9091-b2983dff06da-image-registry-private-configuration\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:52:54.899000 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.898952 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cd1a7b7e-e1dd-4361-9091-b2983dff06da-ca-trust-extracted\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:52:54.899000 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.898958 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0c1ebb77-bd76-4329-ac03-87f60b688431-trusted-ca\") pod \"console-operator-7cd56b8dbc-6jb9v\" (UID: \"0c1ebb77-bd76-4329-ac03-87f60b688431\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" Oct 30 08:52:54.899818 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:54.899038 2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 08:52:54.899818 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.899038 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh7rw\" (UniqueName: \"kubernetes.io/projected/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-kube-api-access-zh7rw\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:52:54.899818 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:54.899060 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 08:52:54.899818 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:54.899078 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-metrics-certs podName:f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f nodeName:}" failed. No retries permitted until 2026-10-30 08:52:55.399065067 +0000 UTC m=+31.152127155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-metrics-certs") pod "router-default-777d6b9d77-br8dn" (UID: "f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f") : secret "router-metrics-certs-default" not found Oct 30 08:52:54.899818 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.899095 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-bound-sa-token\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:52:54.899818 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:54.899112 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5ddc593-a1bb-4f35-be9e-77b6f9486945-metrics-tls podName:e5ddc593-a1bb-4f35-be9e-77b6f9486945 nodeName:}" failed. No retries permitted until 2026-10-30 08:52:55.399095959 +0000 UTC m=+31.152157987 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5ddc593-a1bb-4f35-be9e-77b6f9486945-metrics-tls") pod "dns-default-vbv2z" (UID: "e5ddc593-a1bb-4f35-be9e-77b6f9486945") : secret "dns-default-metrics-tls" not found Oct 30 08:52:54.899818 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.899142 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-stats-auth\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:52:54.899818 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.899226 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt6ng\" (UniqueName: \"kubernetes.io/projected/fdbaa900-aa36-4984-a2f3-c5c973e75d8a-kube-api-access-mt6ng\") pod \"network-check-source-6f78d59f99-qvd5x\" (UID: \"fdbaa900-aa36-4984-a2f3-c5c973e75d8a\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-qvd5x" Oct 30 08:52:54.899818 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.899274 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e5ddc593-a1bb-4f35-be9e-77b6f9486945-config-volume\") pod \"dns-default-vbv2z\" (UID: \"e5ddc593-a1bb-4f35-be9e-77b6f9486945\") " pod="openshift-dns/dns-default-vbv2z" Oct 30 08:52:54.899818 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.899322 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cd1a7b7e-e1dd-4361-9091-b2983dff06da-trusted-ca\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:52:54.899818 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.899345 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrlct\" (UniqueName: \"kubernetes.io/projected/06e7e9e5-ebd3-4e67-95ba-03eeebcee619-kube-api-access-wrlct\") pod \"ingress-canary-j4lkv\" (UID: \"06e7e9e5-ebd3-4e67-95ba-03eeebcee619\") " pod="openshift-ingress-canary/ingress-canary-j4lkv" Oct 30 08:52:54.899818 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.899369 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c3e38a1c-cf20-4170-a71e-5fdc414e2343-config\") pod \"service-ca-operator-544d749c8c-cdnwr\" (UID: \"c3e38a1c-cf20-4170-a71e-5fdc414e2343\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-cdnwr" Oct 30 08:52:54.899818 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.899476 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0c1ebb77-bd76-4329-ac03-87f60b688431-config\") pod \"console-operator-7cd56b8dbc-6jb9v\" (UID: \"0c1ebb77-bd76-4329-ac03-87f60b688431\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" Oct 30 08:52:54.899818 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.898685 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5ddc593-a1bb-4f35-be9e-77b6f9486945-tmp-dir\") pod \"dns-default-vbv2z\" (UID: \"e5ddc593-a1bb-4f35-be9e-77b6f9486945\") " pod="openshift-dns/dns-default-vbv2z" Oct 30 08:52:54.900548 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.899835 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-certificates\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:52:54.900548 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.899873 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c3e38a1c-cf20-4170-a71e-5fdc414e2343-config\") pod \"service-ca-operator-544d749c8c-cdnwr\" (UID: \"c3e38a1c-cf20-4170-a71e-5fdc414e2343\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-cdnwr" Oct 30 08:52:54.901316 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.901249 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0c1ebb77-bd76-4329-ac03-87f60b688431-trusted-ca\") pod \"console-operator-7cd56b8dbc-6jb9v\" (UID: \"0c1ebb77-bd76-4329-ac03-87f60b688431\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" Oct 30 08:52:54.901721 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.901397 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0c1ebb77-bd76-4329-ac03-87f60b688431-serving-cert\") pod \"console-operator-7cd56b8dbc-6jb9v\" (UID: \"0c1ebb77-bd76-4329-ac03-87f60b688431\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" Oct 30 08:52:54.901812 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.901732 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06e7e9e5-ebd3-4e67-95ba-03eeebcee619-cert\") pod \"ingress-canary-j4lkv\" (UID: \"06e7e9e5-ebd3-4e67-95ba-03eeebcee619\") " pod="openshift-ingress-canary/ingress-canary-j4lkv" Oct 30 08:52:54.901812 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.901788 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cd1a7b7e-e1dd-4361-9091-b2983dff06da-image-registry-private-configuration\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:52:54.902159 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.902114 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e5ddc593-a1bb-4f35-be9e-77b6f9486945-config-volume\") pod \"dns-default-vbv2z\" (UID: \"e5ddc593-a1bb-4f35-be9e-77b6f9486945\") " pod="openshift-dns/dns-default-vbv2z" Oct 30 08:52:54.902344 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.902325 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-default-certificate\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:52:54.902781 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.902761 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cd1a7b7e-e1dd-4361-9091-b2983dff06da-trusted-ca\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:52:54.903105 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.903082 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cd1a7b7e-e1dd-4361-9091-b2983dff06da-installation-pull-secrets\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:52:54.903749 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.903730 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-stats-auth\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:52:54.904093 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.904073 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c3e38a1c-cf20-4170-a71e-5fdc414e2343-serving-cert\") pod \"service-ca-operator-544d749c8c-cdnwr\" (UID: \"c3e38a1c-cf20-4170-a71e-5fdc414e2343\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-cdnwr" Oct 30 08:52:54.914068 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.914049 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-mzwbj" Oct 30 08:52:54.922086 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.922066 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-prnqf" Oct 30 08:52:54.922958 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.922896 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2w8s\" (UniqueName: \"kubernetes.io/projected/e5ddc593-a1bb-4f35-be9e-77b6f9486945-kube-api-access-b2w8s\") pod \"dns-default-vbv2z\" (UID: \"e5ddc593-a1bb-4f35-be9e-77b6f9486945\") " pod="openshift-dns/dns-default-vbv2z" Oct 30 08:52:54.923419 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.923400 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwf4v\" (UniqueName: \"kubernetes.io/projected/c3e38a1c-cf20-4170-a71e-5fdc414e2343-kube-api-access-rwf4v\") pod \"service-ca-operator-544d749c8c-cdnwr\" (UID: \"c3e38a1c-cf20-4170-a71e-5fdc414e2343\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-cdnwr" Oct 30 08:52:54.924935 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.924748 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xlkp\" (UniqueName: \"kubernetes.io/projected/0c1ebb77-bd76-4329-ac03-87f60b688431-kube-api-access-9xlkp\") pod \"console-operator-7cd56b8dbc-6jb9v\" (UID: \"0c1ebb77-bd76-4329-ac03-87f60b688431\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" Oct 30 08:52:54.924935 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.924816 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh9pf\" (UniqueName: \"kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-kube-api-access-nh9pf\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:52:54.925301 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.925272 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrlct\" (UniqueName: \"kubernetes.io/projected/06e7e9e5-ebd3-4e67-95ba-03eeebcee619-kube-api-access-wrlct\") pod \"ingress-canary-j4lkv\" (UID: \"06e7e9e5-ebd3-4e67-95ba-03eeebcee619\") " pod="openshift-ingress-canary/ingress-canary-j4lkv" Oct 30 08:52:54.926116 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.925598 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh7rw\" (UniqueName: \"kubernetes.io/projected/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-kube-api-access-zh7rw\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:52:54.926623 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.926595 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-bound-sa-token\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:52:54.929244 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.929192 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt6ng\" (UniqueName: \"kubernetes.io/projected/fdbaa900-aa36-4984-a2f3-c5c973e75d8a-kube-api-access-mt6ng\") pod \"network-check-source-6f78d59f99-qvd5x\" (UID: \"fdbaa900-aa36-4984-a2f3-c5c973e75d8a\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-qvd5x" Oct 30 08:52:54.984669 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.984489 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-jxz7s" Oct 30 08:52:54.995722 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:54.995603 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9" Oct 30 08:52:55.001843 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:55.001698 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:52:55.023163 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:55.022874 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-cdnwr" Oct 30 08:52:55.032469 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:55.032444 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-qvd5x" Oct 30 08:52:55.039641 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:55.039619 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" Oct 30 08:52:55.055568 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:55.052454 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j4lkv" Oct 30 08:52:55.206039 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:55.206017 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-q4sp5"] Oct 30 08:52:55.209843 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:55.209816 2585 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5371073_8444_4462_93f1_2cb7cfd54d9f.slice/crio-7e9f5df8528b565fc34b85fc03d86bcde956c215f195c2e8cdd9c47a99a54ee7 WatchSource:0}: Error finding container 7e9f5df8528b565fc34b85fc03d86bcde956c215f195c2e8cdd9c47a99a54ee7: Status 404 returned error can't find the container with id 7e9f5df8528b565fc34b85fc03d86bcde956c215f195c2e8cdd9c47a99a54ee7 Oct 30 08:52:55.227081 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:55.227056 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-mzwbj"] Oct 30 08:52:55.233549 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:55.233523 2585 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e9e7178_b316_431d_851b_565dfc341afa.slice/crio-09b3233893c8d89b74bf0284dbde4a79ce46329a6a7aef10730003bf21088352 WatchSource:0}: Error finding container 09b3233893c8d89b74bf0284dbde4a79ce46329a6a7aef10730003bf21088352: Status 404 returned error can't find the container with id 09b3233893c8d89b74bf0284dbde4a79ce46329a6a7aef10730003bf21088352 Oct 30 08:52:55.240025 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:55.239955 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-prnqf"] Oct 30 08:52:55.245484 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:55.245457 2585 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4b82adb_d2fe_406a_a9e9_ea28cb3679ff.slice/crio-e5bda62c1d72ceaf8519d55f19e57128fd5be926be6b851cbd54463048f1879a WatchSource:0}: Error finding container e5bda62c1d72ceaf8519d55f19e57128fd5be926be6b851cbd54463048f1879a: Status 404 returned error can't find the container with id e5bda62c1d72ceaf8519d55f19e57128fd5be926be6b851cbd54463048f1879a Oct 30 08:52:55.304141 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:55.303080 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-tls\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:52:55.304141 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:55.303245 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0994c04f-63a8-4b19-a4a1-9a0c288a26f5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8q4xg\" (UID: \"0994c04f-63a8-4b19-a4a1-9a0c288a26f5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8q4xg" Oct 30 08:52:55.304141 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:55.303327 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e02c520e-2276-440e-8f36-1047f78af40a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-r95n6\" (UID: \"e02c520e-2276-440e-8f36-1047f78af40a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-r95n6" Oct 30 08:52:55.304141 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:55.303361 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-99562\" (UID: \"a88ad1f8-2002-4e56-abcb-47c68c0a1fbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-99562" Oct 30 08:52:55.304141 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:55.303483 2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 30 08:52:55.304141 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:55.303537 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb-samples-operator-tls podName:a88ad1f8-2002-4e56-abcb-47c68c0a1fbb nodeName:}" failed. No retries permitted until 2026-10-30 08:52:56.303520363 +0000 UTC m=+32.056582410 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-99562" (UID: "a88ad1f8-2002-4e56-abcb-47c68c0a1fbb") : secret "samples-operator-tls" not found Oct 30 08:52:55.304141 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:55.303880 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 08:52:55.304141 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:55.303895 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c5bffb4d-x885p: secret "image-registry-tls" not found Oct 30 08:52:55.304141 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:55.303943 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-tls podName:9e5c0d3f-6e6c-44d8-b50d-cecacd28474d nodeName:}" failed. No retries permitted until 2026-10-30 08:52:56.303926787 +0000 UTC m=+32.056988815 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-tls") pod "image-registry-7c5bffb4d-x885p" (UID: "9e5c0d3f-6e6c-44d8-b50d-cecacd28474d") : secret "image-registry-tls" not found Oct 30 08:52:55.304141 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:55.304003 2585 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 30 08:52:55.304141 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:55.304036 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0994c04f-63a8-4b19-a4a1-9a0c288a26f5-networking-console-plugin-cert podName:0994c04f-63a8-4b19-a4a1-9a0c288a26f5 nodeName:}" failed. No retries permitted until 2026-10-30 08:52:56.304024105 +0000 UTC m=+32.057086131 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0994c04f-63a8-4b19-a4a1-9a0c288a26f5-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-8q4xg" (UID: "0994c04f-63a8-4b19-a4a1-9a0c288a26f5") : secret "networking-console-plugin-cert" not found Oct 30 08:52:55.304141 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:55.304084 2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 08:52:55.304141 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:55.304114 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02c520e-2276-440e-8f36-1047f78af40a-cluster-monitoring-operator-tls podName:e02c520e-2276-440e-8f36-1047f78af40a nodeName:}" failed. No retries permitted until 2026-10-30 08:52:56.304103967 +0000 UTC m=+32.057166012 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e02c520e-2276-440e-8f36-1047f78af40a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-r95n6" (UID: "e02c520e-2276-440e-8f36-1047f78af40a") : secret "cluster-monitoring-operator-tls" not found Oct 30 08:52:55.321618 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:55.321595 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-jxz7s"] Oct 30 08:52:55.324954 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:55.324893 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9"] Oct 30 08:52:55.326285 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:55.326263 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-46mmb"] Oct 30 08:52:55.328696 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:55.328612 2585 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a14ed2f_0a6c_4ed6_b05a_54f733f19453.slice/crio-2f6f21bda934ec6d1430dc441faaf1f443cdfde905181713a4c7f9f0ba19c7ca WatchSource:0}: Error finding container 2f6f21bda934ec6d1430dc441faaf1f443cdfde905181713a4c7f9f0ba19c7ca: Status 404 returned error can't find the container with id 2f6f21bda934ec6d1430dc441faaf1f443cdfde905181713a4c7f9f0ba19c7ca Oct 30 08:52:55.356169 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:55.356151 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-cdnwr"] Oct 30 08:52:55.360253 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:55.360228 2585 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3e38a1c_cf20_4170_a71e_5fdc414e2343.slice/crio-3a4e0aecdc43d988d2cb18885041202b00500214f0601e37b37c02aea69116a1 WatchSource:0}: Error finding container 3a4e0aecdc43d988d2cb18885041202b00500214f0601e37b37c02aea69116a1: Status 404 returned error can't find the container with id 3a4e0aecdc43d988d2cb18885041202b00500214f0601e37b37c02aea69116a1 Oct 30 08:52:55.403890 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:55.403869 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-tls\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:52:55.403994 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:55.403903 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-service-ca-bundle\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:52:55.403994 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:55.403946 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-metrics-certs\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:52:55.403994 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:55.403963 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5ddc593-a1bb-4f35-be9e-77b6f9486945-metrics-tls\") pod \"dns-default-vbv2z\" (UID: \"e5ddc593-a1bb-4f35-be9e-77b6f9486945\") " pod="openshift-dns/dns-default-vbv2z" Oct 30 08:52:55.404143 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:55.404008 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 08:52:55.404143 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:55.404029 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b77f4b5fc-fdtlw: secret "image-registry-tls" not found Oct 30 08:52:55.404143 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:55.404075 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 08:52:55.404143 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:55.404082 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-tls podName:cd1a7b7e-e1dd-4361-9091-b2983dff06da nodeName:}" failed. No retries permitted until 2026-10-30 08:52:56.404067513 +0000 UTC m=+32.157129559 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-tls") pod "image-registry-b77f4b5fc-fdtlw" (UID: "cd1a7b7e-e1dd-4361-9091-b2983dff06da") : secret "image-registry-tls" not found Oct 30 08:52:55.404143 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:55.404083 2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 08:52:55.404143 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:55.404098 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-service-ca-bundle podName:f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f nodeName:}" failed. No retries permitted until 2026-10-30 08:52:56.404090823 +0000 UTC m=+32.157152850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-service-ca-bundle") pod "router-default-777d6b9d77-br8dn" (UID: "f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f") : configmap references non-existent config key: service-ca.crt Oct 30 08:52:55.404143 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:55.404109 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5ddc593-a1bb-4f35-be9e-77b6f9486945-metrics-tls podName:e5ddc593-a1bb-4f35-be9e-77b6f9486945 nodeName:}" failed. No retries permitted until 2026-10-30 08:52:56.404104324 +0000 UTC m=+32.157166351 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5ddc593-a1bb-4f35-be9e-77b6f9486945-metrics-tls") pod "dns-default-vbv2z" (UID: "e5ddc593-a1bb-4f35-be9e-77b6f9486945") : secret "dns-default-metrics-tls" not found Oct 30 08:52:55.404143 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:55.404138 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-metrics-certs podName:f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f nodeName:}" failed. No retries permitted until 2026-10-30 08:52:56.404115625 +0000 UTC m=+32.157177652 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-metrics-certs") pod "router-default-777d6b9d77-br8dn" (UID: "f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f") : secret "router-metrics-certs-default" not found Oct 30 08:52:55.404966 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:55.404945 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-qvd5x"] Oct 30 08:52:55.407544 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:55.407528 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-6jb9v"] Oct 30 08:52:55.409042 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:55.409022 2585 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdbaa900_aa36_4984_a2f3_c5c973e75d8a.slice/crio-e8efe18bd3be6067ec0c76817f186926c793f7daaf79a269b6ed68c641a6ff71 WatchSource:0}: Error finding container e8efe18bd3be6067ec0c76817f186926c793f7daaf79a269b6ed68c641a6ff71: Status 404 returned error can't find the container with id e8efe18bd3be6067ec0c76817f186926c793f7daaf79a269b6ed68c641a6ff71 Oct 30 08:52:55.411815 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:55.411797 2585 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c1ebb77_bd76_4329_ac03_87f60b688431.slice/crio-43a7f3829f40c80176e91493d652c16208ee301faf26f992addec5eafbf5c463 WatchSource:0}: Error finding container 43a7f3829f40c80176e91493d652c16208ee301faf26f992addec5eafbf5c463: Status 404 returned error can't find the container with id 43a7f3829f40c80176e91493d652c16208ee301faf26f992addec5eafbf5c463 Oct 30 08:52:55.440844 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:55.440826 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j4lkv"] Oct 30 08:52:55.445235 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:55.445195 2585 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06e7e9e5_ebd3_4e67_95ba_03eeebcee619.slice/crio-776acc559fef33bc0c0e47f3cf3756b2fbb7441efb3820ec8909eeb782ec13a7 WatchSource:0}: Error finding container 776acc559fef33bc0c0e47f3cf3756b2fbb7441efb3820ec8909eeb782ec13a7: Status 404 returned error can't find the container with id 776acc559fef33bc0c0e47f3cf3756b2fbb7441efb3820ec8909eeb782ec13a7 Oct 30 08:52:55.848499 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:55.848470 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gn6v4" Oct 30 08:52:55.848902 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:55.848887 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:55.849316 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:55.849301 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:52:55.863882 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:55.863789 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 08:52:55.869286 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:55.869265 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 08:52:55.869753 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:55.869737 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-b8hf4\"" Oct 30 08:52:55.869845 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:55.869754 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-l5kmc\"" Oct 30 08:52:55.869845 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:55.869814 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-csfq5\"" Oct 30 08:52:56.122110 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:56.122027 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-mzwbj" event={"ID":"0e9e7178-b316-431d-851b-565dfc341afa","Type":"ContainerStarted","Data":"1431e6939e9b1ab3b0230ed5d5bd4576340b5e120601326eddf141cca657aa2b"} Oct 30 08:52:56.122554 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:56.122128 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-mzwbj" event={"ID":"0e9e7178-b316-431d-851b-565dfc341afa","Type":"ContainerStarted","Data":"09b3233893c8d89b74bf0284dbde4a79ce46329a6a7aef10730003bf21088352"} Oct 30 08:52:56.124922 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:56.124849 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j4lkv" event={"ID":"06e7e9e5-ebd3-4e67-95ba-03eeebcee619","Type":"ContainerStarted","Data":"776acc559fef33bc0c0e47f3cf3756b2fbb7441efb3820ec8909eeb782ec13a7"} Oct 30 08:52:56.132898 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:56.132869 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9" event={"ID":"55ed1a9f-f5a7-44fd-8b91-01d4e25f651a","Type":"ContainerStarted","Data":"8d11ce2c4efb606e91c0daf3eec2604caf3c01f0af9d441c969e4031bdbb9ed5"} Oct 30 08:52:56.135993 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:56.135964 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-prnqf" event={"ID":"d4b82adb-d2fe-406a-a9e9-ea28cb3679ff","Type":"ContainerStarted","Data":"1773bde7b2bf2eb37a2b9dd1a046367e28c2d419fa2898baea7f0b835d4546e4"} Oct 30 08:52:56.136109 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:56.136012 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-prnqf" event={"ID":"d4b82adb-d2fe-406a-a9e9-ea28cb3679ff","Type":"ContainerStarted","Data":"e5bda62c1d72ceaf8519d55f19e57128fd5be926be6b851cbd54463048f1879a"} Oct 30 08:52:56.139959 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:56.139932 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-q4sp5" event={"ID":"e5371073-8444-4462-93f1-2cb7cfd54d9f","Type":"ContainerStarted","Data":"7213452a6fd3be62aa47678913337b986974ba68db8080ff58dd686734f0abad"} Oct 30 08:52:56.140075 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:56.139976 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-q4sp5" event={"ID":"e5371073-8444-4462-93f1-2cb7cfd54d9f","Type":"ContainerStarted","Data":"7e9f5df8528b565fc34b85fc03d86bcde956c215f195c2e8cdd9c47a99a54ee7"} Oct 30 08:52:56.141788 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:56.141763 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-qvd5x" event={"ID":"fdbaa900-aa36-4984-a2f3-c5c973e75d8a","Type":"ContainerStarted","Data":"e8efe18bd3be6067ec0c76817f186926c793f7daaf79a269b6ed68c641a6ff71"} Oct 30 08:52:56.146459 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:56.146429 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-46mmb" event={"ID":"80da5ad0-0b1d-40da-82b8-97202a58ee9f","Type":"ContainerStarted","Data":"9eaa07ad7d6305787b984aa73fde69d5e3e099b54082b4e79bdbaba59fea49bf"} Oct 30 08:52:56.150868 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:56.150820 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" event={"ID":"0c1ebb77-bd76-4329-ac03-87f60b688431","Type":"ContainerStarted","Data":"43a7f3829f40c80176e91493d652c16208ee301faf26f992addec5eafbf5c463"} Oct 30 08:52:56.152233 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:56.152191 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-cdnwr" event={"ID":"c3e38a1c-cf20-4170-a71e-5fdc414e2343","Type":"ContainerStarted","Data":"3a4e0aecdc43d988d2cb18885041202b00500214f0601e37b37c02aea69116a1"} Oct 30 08:52:56.156809 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:56.156781 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-jxz7s" event={"ID":"0a14ed2f-0a6c-4ed6-b05a-54f733f19453","Type":"ContainerStarted","Data":"2f6f21bda934ec6d1430dc441faaf1f443cdfde905181713a4c7f9f0ba19c7ca"} Oct 30 08:52:56.209324 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:56.209263 2585 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-mzwbj" podStartSLOduration=415.209232834 podStartE2EDuration="6m55.209232834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:46:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:52:56.168408329 +0000 UTC m=+31.921470379" watchObservedRunningTime="2026-10-30 08:52:56.209232834 +0000 UTC m=+31.962294883" Oct 30 08:52:56.210015 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:56.209982 2585 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-q4sp5" podStartSLOduration=415.209975922 podStartE2EDuration="6m55.209975922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:46:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:52:56.20887422 +0000 UTC m=+31.961936268" watchObservedRunningTime="2026-10-30 08:52:56.209975922 +0000 UTC m=+31.963037992" Oct 30 08:52:56.249146 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:56.249074 2585 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-prnqf" podStartSLOduration=415.24905781 podStartE2EDuration="6m55.24905781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:46:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:52:56.248200261 +0000 UTC m=+32.001262312" watchObservedRunningTime="2026-10-30 08:52:56.24905781 +0000 UTC m=+32.002119862" Oct 30 08:52:56.312831 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:56.312794 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e02c520e-2276-440e-8f36-1047f78af40a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-r95n6\" (UID: \"e02c520e-2276-440e-8f36-1047f78af40a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-r95n6" Oct 30 08:52:56.312957 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:56.312866 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-99562\" (UID: \"a88ad1f8-2002-4e56-abcb-47c68c0a1fbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-99562" Oct 30 08:52:56.312957 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:56.312899 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-tls\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:52:56.313075 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:56.313041 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0994c04f-63a8-4b19-a4a1-9a0c288a26f5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8q4xg\" (UID: \"0994c04f-63a8-4b19-a4a1-9a0c288a26f5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8q4xg" Oct 30 08:52:56.313324 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:56.313263 2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 30 08:52:56.313324 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:56.313322 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb-samples-operator-tls podName:a88ad1f8-2002-4e56-abcb-47c68c0a1fbb nodeName:}" failed. No retries permitted until 2026-10-30 08:52:58.313307677 +0000 UTC m=+34.066369717 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-99562" (UID: "a88ad1f8-2002-4e56-abcb-47c68c0a1fbb") : secret "samples-operator-tls" not found Oct 30 08:52:56.313575 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:56.313269 2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 08:52:56.313624 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:56.313600 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02c520e-2276-440e-8f36-1047f78af40a-cluster-monitoring-operator-tls podName:e02c520e-2276-440e-8f36-1047f78af40a nodeName:}" failed. No retries permitted until 2026-10-30 08:52:58.313589929 +0000 UTC m=+34.066651956 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e02c520e-2276-440e-8f36-1047f78af40a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-r95n6" (UID: "e02c520e-2276-440e-8f36-1047f78af40a") : secret "cluster-monitoring-operator-tls" not found Oct 30 08:52:56.313688 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:56.313657 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 08:52:56.313688 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:56.313665 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c5bffb4d-x885p: secret "image-registry-tls" not found Oct 30 08:52:56.313688 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:56.313685 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-tls podName:9e5c0d3f-6e6c-44d8-b50d-cecacd28474d nodeName:}" failed. No retries permitted until 2026-10-30 08:52:58.313678426 +0000 UTC m=+34.066740466 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-tls") pod "image-registry-7c5bffb4d-x885p" (UID: "9e5c0d3f-6e6c-44d8-b50d-cecacd28474d") : secret "image-registry-tls" not found Oct 30 08:52:56.314472 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:56.314452 2585 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 30 08:52:56.314586 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:56.314499 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0994c04f-63a8-4b19-a4a1-9a0c288a26f5-networking-console-plugin-cert podName:0994c04f-63a8-4b19-a4a1-9a0c288a26f5 nodeName:}" failed. No retries permitted until 2026-10-30 08:52:58.314487959 +0000 UTC m=+34.067549986 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0994c04f-63a8-4b19-a4a1-9a0c288a26f5-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-8q4xg" (UID: "0994c04f-63a8-4b19-a4a1-9a0c288a26f5") : secret "networking-console-plugin-cert" not found Oct 30 08:52:56.414008 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:56.413945 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-service-ca-bundle\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:52:56.414008 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:56.414004 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-metrics-certs\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:52:56.414188 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:56.414029 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5ddc593-a1bb-4f35-be9e-77b6f9486945-metrics-tls\") pod \"dns-default-vbv2z\" (UID: \"e5ddc593-a1bb-4f35-be9e-77b6f9486945\") " pod="openshift-dns/dns-default-vbv2z" Oct 30 08:52:56.414188 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:56.414107 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-tls\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:52:56.414314 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:56.414196 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 08:52:56.414314 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:56.414221 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b77f4b5fc-fdtlw: secret "image-registry-tls" not found Oct 30 08:52:56.414314 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:56.414258 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-tls podName:cd1a7b7e-e1dd-4361-9091-b2983dff06da nodeName:}" failed. No retries permitted until 2026-10-30 08:52:58.414248194 +0000 UTC m=+34.167310235 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-tls") pod "image-registry-b77f4b5fc-fdtlw" (UID: "cd1a7b7e-e1dd-4361-9091-b2983dff06da") : secret "image-registry-tls" not found Oct 30 08:52:56.414508 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:56.414493 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-service-ca-bundle podName:f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f nodeName:}" failed. No retries permitted until 2026-10-30 08:52:58.414483331 +0000 UTC m=+34.167545371 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-service-ca-bundle") pod "router-default-777d6b9d77-br8dn" (UID: "f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f") : configmap references non-existent config key: service-ca.crt Oct 30 08:52:56.414571 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:56.414548 2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 08:52:56.414571 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:56.414570 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-metrics-certs podName:f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f nodeName:}" failed. No retries permitted until 2026-10-30 08:52:58.414563437 +0000 UTC m=+34.167625464 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-metrics-certs") pod "router-default-777d6b9d77-br8dn" (UID: "f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f") : secret "router-metrics-certs-default" not found Oct 30 08:52:56.414660 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:56.414604 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 08:52:56.414660 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:56.414620 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5ddc593-a1bb-4f35-be9e-77b6f9486945-metrics-tls podName:e5ddc593-a1bb-4f35-be9e-77b6f9486945 nodeName:}" failed. No retries permitted until 2026-10-30 08:52:58.414615333 +0000 UTC m=+34.167677360 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5ddc593-a1bb-4f35-be9e-77b6f9486945-metrics-tls") pod "dns-default-vbv2z" (UID: "e5ddc593-a1bb-4f35-be9e-77b6f9486945") : secret "dns-default-metrics-tls" not found Oct 30 08:52:58.172818 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:58.172770 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-jxz7s" event={"ID":"0a14ed2f-0a6c-4ed6-b05a-54f733f19453","Type":"ContainerStarted","Data":"74468a9339c7e4b950a3894cd79ae5eeea0e0c2576a8a92fb3c5cfbe713c4e2a"} Oct 30 08:52:58.213868 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:58.213764 2585 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-jxz7s" podStartSLOduration=386.161962406 podStartE2EDuration="6m28.213747027s" totalImagesPullingTime="2.051784621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:52:58.213646339 +0000 UTC m=+33.966708391" watchObservedRunningTime="2026-10-30 08:52:58.213747027 +0000 UTC m=+33.966809101" Oct 30 08:52:58.338340 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:58.338296 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e02c520e-2276-440e-8f36-1047f78af40a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-r95n6\" (UID: \"e02c520e-2276-440e-8f36-1047f78af40a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-r95n6" Oct 30 08:52:58.338503 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:58.338363 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-99562\" (UID: \"a88ad1f8-2002-4e56-abcb-47c68c0a1fbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-99562" Oct 30 08:52:58.338503 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:58.338415 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-tls\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:52:58.338598 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:58.338572 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0994c04f-63a8-4b19-a4a1-9a0c288a26f5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8q4xg\" (UID: \"0994c04f-63a8-4b19-a4a1-9a0c288a26f5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8q4xg" Oct 30 08:52:58.338777 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:58.338750 2585 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 30 08:52:58.338872 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:58.338830 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0994c04f-63a8-4b19-a4a1-9a0c288a26f5-networking-console-plugin-cert podName:0994c04f-63a8-4b19-a4a1-9a0c288a26f5 nodeName:}" failed. No retries permitted until 2026-10-30 08:53:02.338810071 +0000 UTC m=+38.091872123 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0994c04f-63a8-4b19-a4a1-9a0c288a26f5-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-8q4xg" (UID: "0994c04f-63a8-4b19-a4a1-9a0c288a26f5") : secret "networking-console-plugin-cert" not found Oct 30 08:52:58.339338 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:58.339316 2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 08:52:58.339396 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:58.339382 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02c520e-2276-440e-8f36-1047f78af40a-cluster-monitoring-operator-tls podName:e02c520e-2276-440e-8f36-1047f78af40a nodeName:}" failed. No retries permitted until 2026-10-30 08:53:02.339366142 +0000 UTC m=+38.092428188 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e02c520e-2276-440e-8f36-1047f78af40a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-r95n6" (UID: "e02c520e-2276-440e-8f36-1047f78af40a") : secret "cluster-monitoring-operator-tls" not found Oct 30 08:52:58.339457 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:58.339447 2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 30 08:52:58.339508 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:58.339484 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb-samples-operator-tls podName:a88ad1f8-2002-4e56-abcb-47c68c0a1fbb nodeName:}" failed. No retries permitted until 2026-10-30 08:53:02.339473101 +0000 UTC m=+38.092535129 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-99562" (UID: "a88ad1f8-2002-4e56-abcb-47c68c0a1fbb") : secret "samples-operator-tls" not found Oct 30 08:52:58.339907 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:58.339884 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 08:52:58.339907 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:58.339908 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c5bffb4d-x885p: secret "image-registry-tls" not found Oct 30 08:52:58.340013 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:58.339961 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-tls podName:9e5c0d3f-6e6c-44d8-b50d-cecacd28474d nodeName:}" failed. No retries permitted until 2026-10-30 08:53:02.339946457 +0000 UTC m=+38.093008501 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-tls") pod "image-registry-7c5bffb4d-x885p" (UID: "9e5c0d3f-6e6c-44d8-b50d-cecacd28474d") : secret "image-registry-tls" not found Oct 30 08:52:58.439945 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:58.439906 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-tls\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:52:58.440106 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:58.439959 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-service-ca-bundle\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:52:58.440106 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:58.440025 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-metrics-certs\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:52:58.440106 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:58.440055 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5ddc593-a1bb-4f35-be9e-77b6f9486945-metrics-tls\") pod \"dns-default-vbv2z\" (UID: \"e5ddc593-a1bb-4f35-be9e-77b6f9486945\") " pod="openshift-dns/dns-default-vbv2z" Oct 30 08:52:58.440279 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:58.440193 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 08:52:58.440279 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:58.440276 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5ddc593-a1bb-4f35-be9e-77b6f9486945-metrics-tls podName:e5ddc593-a1bb-4f35-be9e-77b6f9486945 nodeName:}" failed. No retries permitted until 2026-10-30 08:53:02.440258859 +0000 UTC m=+38.193320899 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5ddc593-a1bb-4f35-be9e-77b6f9486945-metrics-tls") pod "dns-default-vbv2z" (UID: "e5ddc593-a1bb-4f35-be9e-77b6f9486945") : secret "dns-default-metrics-tls" not found Oct 30 08:52:58.440553 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:58.440489 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-service-ca-bundle podName:f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f nodeName:}" failed. No retries permitted until 2026-10-30 08:53:02.440473204 +0000 UTC m=+38.193535245 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-service-ca-bundle") pod "router-default-777d6b9d77-br8dn" (UID: "f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f") : configmap references non-existent config key: service-ca.crt Oct 30 08:52:58.440553 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:58.440514 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 08:52:58.440553 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:58.440536 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b77f4b5fc-fdtlw: secret "image-registry-tls" not found Oct 30 08:52:58.440747 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:58.440513 2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 08:52:58.440747 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:58.440596 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-tls podName:cd1a7b7e-e1dd-4361-9091-b2983dff06da nodeName:}" failed. No retries permitted until 2026-10-30 08:53:02.440579972 +0000 UTC m=+38.193642023 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-tls") pod "image-registry-b77f4b5fc-fdtlw" (UID: "cd1a7b7e-e1dd-4361-9091-b2983dff06da") : secret "image-registry-tls" not found Oct 30 08:52:58.440747 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:58.440678 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-metrics-certs podName:f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f nodeName:}" failed. No retries permitted until 2026-10-30 08:53:02.440659467 +0000 UTC m=+38.193721506 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-metrics-certs") pod "router-default-777d6b9d77-br8dn" (UID: "f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f") : secret "router-metrics-certs-default" not found Oct 30 08:52:58.541279 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:58.540688 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f039cecc-3f4f-4e9b-94e5-5d46918f9487-original-pull-secret\") pod \"global-pull-secret-syncer-xgdfr\" (UID: \"f039cecc-3f4f-4e9b-94e5-5d46918f9487\") " pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:58.541279 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:58.540870 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fece1d69-0824-4ecc-ad78-cea4e19bde61-metrics-certs\") pod \"network-metrics-daemon-rtjs6\" (UID: \"fece1d69-0824-4ecc-ad78-cea4e19bde61\") " pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:52:58.541279 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:58.541021 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 08:52:58.541279 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:52:58.541075 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fece1d69-0824-4ecc-ad78-cea4e19bde61-metrics-certs podName:fece1d69-0824-4ecc-ad78-cea4e19bde61 nodeName:}" failed. No retries permitted until 2026-10-30 08:53:30.541060427 +0000 UTC m=+66.294122469 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fece1d69-0824-4ecc-ad78-cea4e19bde61-metrics-certs") pod "network-metrics-daemon-rtjs6" (UID: "fece1d69-0824-4ecc-ad78-cea4e19bde61") : secret "metrics-daemon-secret" not found Oct 30 08:52:58.544021 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:58.543964 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f039cecc-3f4f-4e9b-94e5-5d46918f9487-original-pull-secret\") pod \"global-pull-secret-syncer-xgdfr\" (UID: \"f039cecc-3f4f-4e9b-94e5-5d46918f9487\") " pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:58.597542 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:58.597352 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:52:58.642083 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:58.642054 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttr59\" (UniqueName: \"kubernetes.io/projected/26e2f6af-5dbf-44c2-9acf-58c70be503bf-kube-api-access-ttr59\") pod \"network-check-target-gn6v4\" (UID: \"26e2f6af-5dbf-44c2-9acf-58c70be503bf\") " pod="openshift-network-diagnostics/network-check-target-gn6v4" Oct 30 08:52:58.646474 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:58.646451 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttr59\" (UniqueName: \"kubernetes.io/projected/26e2f6af-5dbf-44c2-9acf-58c70be503bf-kube-api-access-ttr59\") pod \"network-check-target-gn6v4\" (UID: \"26e2f6af-5dbf-44c2-9acf-58c70be503bf\") " pod="openshift-network-diagnostics/network-check-target-gn6v4" Oct 30 08:52:58.879819 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:58.879787 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gn6v4" Oct 30 08:52:58.942904 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:58.942823 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xgdfr"] Oct 30 08:52:58.946131 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:58.946063 2585 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf039cecc_3f4f_4e9b_94e5_5d46918f9487.slice/crio-41c9d832bdb850330f9fd2eab85b954340c405b2febfbf6fd93d1a4d97e07764 WatchSource:0}: Error finding container 41c9d832bdb850330f9fd2eab85b954340c405b2febfbf6fd93d1a4d97e07764: Status 404 returned error can't find the container with id 41c9d832bdb850330f9fd2eab85b954340c405b2febfbf6fd93d1a4d97e07764 Oct 30 08:52:59.179421 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:59.179321 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xgdfr" event={"ID":"f039cecc-3f4f-4e9b-94e5-5d46918f9487","Type":"ContainerStarted","Data":"41c9d832bdb850330f9fd2eab85b954340c405b2febfbf6fd93d1a4d97e07764"} Oct 30 08:52:59.213899 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:52:59.213860 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gn6v4"] Oct 30 08:52:59.257794 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:52:59.257751 2585 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26e2f6af_5dbf_44c2_9acf_58c70be503bf.slice/crio-b0b71ab7a72b2b833d5442fc6da25a210b12377be96050ceafaccc869e4069d6 WatchSource:0}: Error finding container b0b71ab7a72b2b833d5442fc6da25a210b12377be96050ceafaccc869e4069d6: Status 404 returned error can't find the container with id b0b71ab7a72b2b833d5442fc6da25a210b12377be96050ceafaccc869e4069d6 Oct 30 08:53:00.183777 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.183701 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gn6v4" event={"ID":"26e2f6af-5dbf-44c2-9acf-58c70be503bf","Type":"ContainerStarted","Data":"b0b71ab7a72b2b833d5442fc6da25a210b12377be96050ceafaccc869e4069d6"} Oct 30 08:53:00.185709 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.185677 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-46mmb" event={"ID":"80da5ad0-0b1d-40da-82b8-97202a58ee9f","Type":"ContainerStarted","Data":"9bf71404274abe588d79708b640ee8776f3a492cdfa836901403448ba8f39503"} Oct 30 08:53:00.231096 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.231044 2585 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-46mmb" podStartSLOduration=385.221958832 podStartE2EDuration="6m29.231028988s" totalImagesPullingTime="4.009070156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:46:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:53:00.230387537 +0000 UTC m=+35.983449612" watchObservedRunningTime="2026-10-30 08:53:00.231028988 +0000 UTC m=+35.984091038" Oct 30 08:53:00.547808 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.547784 2585 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wphsz"] Oct 30 08:53:00.575593 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.575565 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wphsz"] Oct 30 08:53:00.575706 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.575696 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:00.590460 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.590440 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 30 08:53:00.590627 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.590609 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qg8jt\"" Oct 30 08:53:00.590703 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.590664 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 30 08:53:00.627460 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.627435 2585 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-948ql-pgchp"] Oct 30 08:53:00.650936 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.650289 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-948ql-pgchp"] Oct 30 08:53:00.650936 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.650381 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-948ql-pgchp" Oct 30 08:53:00.673263 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.672977 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8c3809a-d264-4139-8805-9b25c0f50f6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:00.673263 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.673063 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f8c3809a-d264-4139-8805-9b25c0f50f6a-crio-socket\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:00.673263 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.673096 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-archives-path\") pod \"periodic-gathering-948ql-pgchp\" (UID: \"fc5de6fe-b01e-4773-acc5-e04e5af9e11a\") " pod="openshift-insights/periodic-gathering-948ql-pgchp" Oct 30 08:53:00.673263 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.673114 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-trusted-ca-bundle\") pod \"periodic-gathering-948ql-pgchp\" (UID: \"fc5de6fe-b01e-4773-acc5-e04e5af9e11a\") " pod="openshift-insights/periodic-gathering-948ql-pgchp" Oct 30 08:53:00.673263 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.673137 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-service-ca-bundle\") pod \"periodic-gathering-948ql-pgchp\" (UID: \"fc5de6fe-b01e-4773-acc5-e04e5af9e11a\") " pod="openshift-insights/periodic-gathering-948ql-pgchp" Oct 30 08:53:00.674086 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.673787 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mq2k\" (UniqueName: \"kubernetes.io/projected/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-kube-api-access-6mq2k\") pod \"periodic-gathering-948ql-pgchp\" (UID: \"fc5de6fe-b01e-4773-acc5-e04e5af9e11a\") " pod="openshift-insights/periodic-gathering-948ql-pgchp" Oct 30 08:53:00.674086 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.673836 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8c3809a-d264-4139-8805-9b25c0f50f6a-data-volume\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:00.674086 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.673870 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f8c3809a-d264-4139-8805-9b25c0f50f6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:00.674086 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.673959 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqwgq\" (UniqueName: \"kubernetes.io/projected/f8c3809a-d264-4139-8805-9b25c0f50f6a-kube-api-access-hqwgq\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:00.703870 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.693039 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-z8lm4\"" Oct 30 08:53:00.777862 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.774616 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mq2k\" (UniqueName: \"kubernetes.io/projected/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-kube-api-access-6mq2k\") pod \"periodic-gathering-948ql-pgchp\" (UID: \"fc5de6fe-b01e-4773-acc5-e04e5af9e11a\") " pod="openshift-insights/periodic-gathering-948ql-pgchp" Oct 30 08:53:00.777862 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.774646 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8c3809a-d264-4139-8805-9b25c0f50f6a-data-volume\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:00.777862 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.774674 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f8c3809a-d264-4139-8805-9b25c0f50f6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:00.777862 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.774719 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqwgq\" (UniqueName: \"kubernetes.io/projected/f8c3809a-d264-4139-8805-9b25c0f50f6a-kube-api-access-hqwgq\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:00.777862 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.774739 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8c3809a-d264-4139-8805-9b25c0f50f6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:00.777862 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.774774 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f8c3809a-d264-4139-8805-9b25c0f50f6a-crio-socket\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:00.777862 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.774808 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-archives-path\") pod \"periodic-gathering-948ql-pgchp\" (UID: \"fc5de6fe-b01e-4773-acc5-e04e5af9e11a\") " pod="openshift-insights/periodic-gathering-948ql-pgchp" Oct 30 08:53:00.777862 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.774832 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-trusted-ca-bundle\") pod \"periodic-gathering-948ql-pgchp\" (UID: \"fc5de6fe-b01e-4773-acc5-e04e5af9e11a\") " pod="openshift-insights/periodic-gathering-948ql-pgchp" Oct 30 08:53:00.777862 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.774847 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-service-ca-bundle\") pod \"periodic-gathering-948ql-pgchp\" (UID: \"fc5de6fe-b01e-4773-acc5-e04e5af9e11a\") " pod="openshift-insights/periodic-gathering-948ql-pgchp" Oct 30 08:53:00.777862 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.775320 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-service-ca-bundle\") pod \"periodic-gathering-948ql-pgchp\" (UID: \"fc5de6fe-b01e-4773-acc5-e04e5af9e11a\") " pod="openshift-insights/periodic-gathering-948ql-pgchp" Oct 30 08:53:00.777862 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.775706 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8c3809a-d264-4139-8805-9b25c0f50f6a-data-volume\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:00.777862 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:00.775756 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 08:53:00.777862 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:00.775794 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f8c3809a-d264-4139-8805-9b25c0f50f6a-kube-rbac-proxy-cm podName:f8c3809a-d264-4139-8805-9b25c0f50f6a nodeName:}" failed. No retries permitted until 2026-10-30 08:53:01.275782159 +0000 UTC m=+37.028844185 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f8c3809a-d264-4139-8805-9b25c0f50f6a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wphsz" (UID: "f8c3809a-d264-4139-8805-9b25c0f50f6a") : configmap "kube-rbac-proxy" not found Oct 30 08:53:00.777862 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:00.775984 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 08:53:00.777862 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:00.776013 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8c3809a-d264-4139-8805-9b25c0f50f6a-insights-runtime-extractor-tls podName:f8c3809a-d264-4139-8805-9b25c0f50f6a nodeName:}" failed. No retries permitted until 2026-10-30 08:53:01.276002389 +0000 UTC m=+37.029064428 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f8c3809a-d264-4139-8805-9b25c0f50f6a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wphsz" (UID: "f8c3809a-d264-4139-8805-9b25c0f50f6a") : secret "insights-runtime-extractor-tls" not found Oct 30 08:53:00.777862 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.776059 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f8c3809a-d264-4139-8805-9b25c0f50f6a-crio-socket\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:00.778670 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.776335 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-archives-path\") pod \"periodic-gathering-948ql-pgchp\" (UID: \"fc5de6fe-b01e-4773-acc5-e04e5af9e11a\") " pod="openshift-insights/periodic-gathering-948ql-pgchp" Oct 30 08:53:00.778670 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.777031 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-trusted-ca-bundle\") pod \"periodic-gathering-948ql-pgchp\" (UID: \"fc5de6fe-b01e-4773-acc5-e04e5af9e11a\") " pod="openshift-insights/periodic-gathering-948ql-pgchp" Oct 30 08:53:00.799628 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.799566 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqwgq\" (UniqueName: \"kubernetes.io/projected/f8c3809a-d264-4139-8805-9b25c0f50f6a-kube-api-access-hqwgq\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:00.800925 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:00.800875 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mq2k\" (UniqueName: \"kubernetes.io/projected/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-kube-api-access-6mq2k\") pod \"periodic-gathering-948ql-pgchp\" (UID: \"fc5de6fe-b01e-4773-acc5-e04e5af9e11a\") " pod="openshift-insights/periodic-gathering-948ql-pgchp" Oct 30 08:53:01.004047 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:01.004015 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-948ql-pgchp" Oct 30 08:53:01.194170 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:01.193550 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6jb9v_0c1ebb77-bd76-4329-ac03-87f60b688431/console-operator/0.log" Oct 30 08:53:01.194170 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:01.193591 2585 generic.go:356] "Generic (PLEG): container finished" podID="0c1ebb77-bd76-4329-ac03-87f60b688431" containerID="156a10aab380e579554d7f9302e23b70fa142a5f6781cbe05e637bcae705c435" exitCode=255 Oct 30 08:53:01.194170 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:01.193666 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" event={"ID":"0c1ebb77-bd76-4329-ac03-87f60b688431","Type":"ContainerDied","Data":"156a10aab380e579554d7f9302e23b70fa142a5f6781cbe05e637bcae705c435"} Oct 30 08:53:01.194701 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:01.194426 2585 scope.go:122] "RemoveContainer" containerID="156a10aab380e579554d7f9302e23b70fa142a5f6781cbe05e637bcae705c435" Oct 30 08:53:01.196734 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:01.196705 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-cdnwr" event={"ID":"c3e38a1c-cf20-4170-a71e-5fdc414e2343","Type":"ContainerStarted","Data":"3957c36c3a1558e16f31ace2ad9ff350445252a88f3de4e6b518c057cb9e8eac"} Oct 30 08:53:01.199126 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:01.199104 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j4lkv" event={"ID":"06e7e9e5-ebd3-4e67-95ba-03eeebcee619","Type":"ContainerStarted","Data":"10a59cf269eb43c20b8841e80ca7d1c5febc59803b8e018eb7ce47e46f93d541"} Oct 30 08:53:01.202615 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:01.202375 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9" event={"ID":"55ed1a9f-f5a7-44fd-8b91-01d4e25f651a","Type":"ContainerStarted","Data":"edb1b18d79970d52edaf78c8f908b9d6ee819cebd4cd6db1cc8dcd50875d3bea"} Oct 30 08:53:01.280876 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:01.280601 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8c3809a-d264-4139-8805-9b25c0f50f6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:01.281008 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:01.280916 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 08:53:01.281008 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:01.280940 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f8c3809a-d264-4139-8805-9b25c0f50f6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:01.281008 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:01.280976 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8c3809a-d264-4139-8805-9b25c0f50f6a-insights-runtime-extractor-tls podName:f8c3809a-d264-4139-8805-9b25c0f50f6a nodeName:}" failed. No retries permitted until 2026-10-30 08:53:02.280957873 +0000 UTC m=+38.034019901 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f8c3809a-d264-4139-8805-9b25c0f50f6a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wphsz" (UID: "f8c3809a-d264-4139-8805-9b25c0f50f6a") : secret "insights-runtime-extractor-tls" not found Oct 30 08:53:01.281156 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:01.281092 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 08:53:01.281156 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:01.281129 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f8c3809a-d264-4139-8805-9b25c0f50f6a-kube-rbac-proxy-cm podName:f8c3809a-d264-4139-8805-9b25c0f50f6a nodeName:}" failed. No retries permitted until 2026-10-30 08:53:02.281118498 +0000 UTC m=+38.034180550 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f8c3809a-d264-4139-8805-9b25c0f50f6a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wphsz" (UID: "f8c3809a-d264-4139-8805-9b25c0f50f6a") : configmap "kube-rbac-proxy" not found Oct 30 08:53:01.281284 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:01.279841 2585 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-j4lkv" podStartSLOduration=2.200261765 podStartE2EDuration="7.279823749s" totalImagesPullingTime="5.079561984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:52:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:53:01.278655201 +0000 UTC m=+37.031717253" watchObservedRunningTime="2026-10-30 08:53:01.279823749 +0000 UTC m=+37.032885801" Oct 30 08:53:01.319326 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:01.318968 2585 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9" podStartSLOduration=385.140902582 podStartE2EDuration="6m30.318952462s" totalImagesPullingTime="5.17804988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:46:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:53:01.318750227 +0000 UTC m=+37.071812281" watchObservedRunningTime="2026-10-30 08:53:01.318952462 +0000 UTC m=+37.072014513" Oct 30 08:53:01.329092 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:01.329015 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-948ql-pgchp"] Oct 30 08:53:01.365365 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:53:01.365289 2585 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc5de6fe_b01e_4773_acc5_e04e5af9e11a.slice/crio-ab9b5428b175e275b196cbd5eba6bf78a9f024864a577e072f21f12f280eb063 WatchSource:0}: Error finding container ab9b5428b175e275b196cbd5eba6bf78a9f024864a577e072f21f12f280eb063: Status 404 returned error can't find the container with id ab9b5428b175e275b196cbd5eba6bf78a9f024864a577e072f21f12f280eb063 Oct 30 08:53:01.657131 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:01.657069 2585 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-cdnwr" podStartSLOduration=381.506721446 podStartE2EDuration="6m26.657047619s" totalImagesPullingTime="5.150326173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:53:01.361277995 +0000 UTC m=+37.114340073" watchObservedRunningTime="2026-10-30 08:53:01.657047619 +0000 UTC m=+37.410109669" Oct 30 08:53:01.657552 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:01.657527 2585 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-vwfzm"] Oct 30 08:53:01.683456 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:01.683396 2585 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-24gg7"] Oct 30 08:53:01.683594 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:01.683513 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vwfzm" Oct 30 08:53:01.702139 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:01.702114 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-vwfzm"] Oct 30 08:53:01.702259 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:01.702145 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-24gg7"] Oct 30 08:53:01.702259 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:01.702228 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-24gg7" Oct 30 08:53:01.702833 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:01.702815 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Oct 30 08:53:01.702988 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:01.702972 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Oct 30 08:53:01.703283 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:01.703266 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-dg55c\"" Oct 30 08:53:01.786215 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:01.786165 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rh8c\" (UniqueName: \"kubernetes.io/projected/cc213059-e0bc-4602-8d5c-6c79e962d6a5-kube-api-access-5rh8c\") pod \"migrator-66df5d496b-vwfzm\" (UID: \"cc213059-e0bc-4602-8d5c-6c79e962d6a5\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vwfzm" Oct 30 08:53:01.786347 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:01.786273 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xwjk\" (UniqueName: \"kubernetes.io/projected/401c58ab-82cc-4baf-9d77-31e18a3a5cb7-kube-api-access-6xwjk\") pod \"migrator-66df5d496b-24gg7\" (UID: \"401c58ab-82cc-4baf-9d77-31e18a3a5cb7\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-24gg7" Oct 30 08:53:01.887114 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:01.887039 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rh8c\" (UniqueName: \"kubernetes.io/projected/cc213059-e0bc-4602-8d5c-6c79e962d6a5-kube-api-access-5rh8c\") pod \"migrator-66df5d496b-vwfzm\" (UID: \"cc213059-e0bc-4602-8d5c-6c79e962d6a5\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vwfzm" Oct 30 08:53:01.887114 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:01.887104 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xwjk\" (UniqueName: \"kubernetes.io/projected/401c58ab-82cc-4baf-9d77-31e18a3a5cb7-kube-api-access-6xwjk\") pod \"migrator-66df5d496b-24gg7\" (UID: \"401c58ab-82cc-4baf-9d77-31e18a3a5cb7\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-24gg7" Oct 30 08:53:01.911087 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:01.911030 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rh8c\" (UniqueName: \"kubernetes.io/projected/cc213059-e0bc-4602-8d5c-6c79e962d6a5-kube-api-access-5rh8c\") pod \"migrator-66df5d496b-vwfzm\" (UID: \"cc213059-e0bc-4602-8d5c-6c79e962d6a5\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vwfzm" Oct 30 08:53:01.915224 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:01.915113 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xwjk\" (UniqueName: \"kubernetes.io/projected/401c58ab-82cc-4baf-9d77-31e18a3a5cb7-kube-api-access-6xwjk\") pod \"migrator-66df5d496b-24gg7\" (UID: \"401c58ab-82cc-4baf-9d77-31e18a3a5cb7\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-24gg7" Oct 30 08:53:02.013404 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.013372 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vwfzm" Oct 30 08:53:02.031567 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.031538 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-24gg7" Oct 30 08:53:02.147512 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.147442 2585 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-bjczz"] Oct 30 08:53:02.185130 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.185096 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-bjczz"] Oct 30 08:53:02.185284 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.185238 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-bjczz" Oct 30 08:53:02.191351 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.191326 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/da1dbfc6-084c-467f-84c2-4cf1cdea8c54-signing-cabundle\") pod \"service-ca-5fffc97bdf-bjczz\" (UID: \"da1dbfc6-084c-467f-84c2-4cf1cdea8c54\") " pod="openshift-service-ca/service-ca-5fffc97bdf-bjczz" Oct 30 08:53:02.191466 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.191367 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsdlm\" (UniqueName: \"kubernetes.io/projected/da1dbfc6-084c-467f-84c2-4cf1cdea8c54-kube-api-access-nsdlm\") pod \"service-ca-5fffc97bdf-bjczz\" (UID: \"da1dbfc6-084c-467f-84c2-4cf1cdea8c54\") " pod="openshift-service-ca/service-ca-5fffc97bdf-bjczz" Oct 30 08:53:02.191466 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.191429 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/da1dbfc6-084c-467f-84c2-4cf1cdea8c54-signing-key\") pod \"service-ca-5fffc97bdf-bjczz\" (UID: \"da1dbfc6-084c-467f-84c2-4cf1cdea8c54\") " pod="openshift-service-ca/service-ca-5fffc97bdf-bjczz" Oct 30 08:53:02.208383 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.208358 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-948ql-pgchp" event={"ID":"fc5de6fe-b01e-4773-acc5-e04e5af9e11a","Type":"ContainerStarted","Data":"0d12810b0a62f9593aa21aa026b7979cb8112636a024cf1ed8156da4e532983e"} Oct 30 08:53:02.208712 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.208407 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-948ql-pgchp" event={"ID":"fc5de6fe-b01e-4773-acc5-e04e5af9e11a","Type":"ContainerStarted","Data":"ab9b5428b175e275b196cbd5eba6bf78a9f024864a577e072f21f12f280eb063"} Oct 30 08:53:02.211118 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.210689 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-qvd5x" event={"ID":"fdbaa900-aa36-4984-a2f3-c5c973e75d8a","Type":"ContainerStarted","Data":"d3a8c217ebaf84e26bc5abd6b67c484437b619a97c295d13c056b73de23ae274"} Oct 30 08:53:02.212771 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.212740 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Oct 30 08:53:02.213099 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.213079 2585 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-vrjk7\"" Oct 30 08:53:02.213443 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.213423 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6jb9v_0c1ebb77-bd76-4329-ac03-87f60b688431/console-operator/1.log" Oct 30 08:53:02.213892 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.213875 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6jb9v_0c1ebb77-bd76-4329-ac03-87f60b688431/console-operator/0.log" Oct 30 08:53:02.213977 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.213915 2585 generic.go:356] "Generic (PLEG): container finished" podID="0c1ebb77-bd76-4329-ac03-87f60b688431" containerID="f1033586986f47ff6f946cc9a123fa0e7182cff004274b45e877e858a7e2d2c2" exitCode=255 Oct 30 08:53:02.214029 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.213986 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" event={"ID":"0c1ebb77-bd76-4329-ac03-87f60b688431","Type":"ContainerDied","Data":"f1033586986f47ff6f946cc9a123fa0e7182cff004274b45e877e858a7e2d2c2"} Oct 30 08:53:02.214085 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.214040 2585 scope.go:122] "RemoveContainer" containerID="156a10aab380e579554d7f9302e23b70fa142a5f6781cbe05e637bcae705c435" Oct 30 08:53:02.214632 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.214234 2585 scope.go:122] "RemoveContainer" containerID="f1033586986f47ff6f946cc9a123fa0e7182cff004274b45e877e858a7e2d2c2" Oct 30 08:53:02.214632 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:02.214427 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-6jb9v_openshift-console-operator(0c1ebb77-bd76-4329-ac03-87f60b688431)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" podUID="0c1ebb77-bd76-4329-ac03-87f60b688431" Oct 30 08:53:02.258659 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.258463 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Oct 30 08:53:02.258659 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.258546 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Oct 30 08:53:02.258659 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.258629 2585 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Oct 30 08:53:02.295245 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.292040 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f8c3809a-d264-4139-8805-9b25c0f50f6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:02.295245 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.292145 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8c3809a-d264-4139-8805-9b25c0f50f6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:02.295245 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.292245 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/da1dbfc6-084c-467f-84c2-4cf1cdea8c54-signing-cabundle\") pod \"service-ca-5fffc97bdf-bjczz\" (UID: \"da1dbfc6-084c-467f-84c2-4cf1cdea8c54\") " pod="openshift-service-ca/service-ca-5fffc97bdf-bjczz" Oct 30 08:53:02.295245 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.292270 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsdlm\" (UniqueName: \"kubernetes.io/projected/da1dbfc6-084c-467f-84c2-4cf1cdea8c54-kube-api-access-nsdlm\") pod \"service-ca-5fffc97bdf-bjczz\" (UID: \"da1dbfc6-084c-467f-84c2-4cf1cdea8c54\") " pod="openshift-service-ca/service-ca-5fffc97bdf-bjczz" Oct 30 08:53:02.295245 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:02.293968 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 08:53:02.295245 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:02.294548 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 08:53:02.295654 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.295301 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/da1dbfc6-084c-467f-84c2-4cf1cdea8c54-signing-cabundle\") pod \"service-ca-5fffc97bdf-bjczz\" (UID: \"da1dbfc6-084c-467f-84c2-4cf1cdea8c54\") " pod="openshift-service-ca/service-ca-5fffc97bdf-bjczz" Oct 30 08:53:02.296363 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.296171 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/da1dbfc6-084c-467f-84c2-4cf1cdea8c54-signing-key\") pod \"service-ca-5fffc97bdf-bjczz\" (UID: \"da1dbfc6-084c-467f-84c2-4cf1cdea8c54\") " pod="openshift-service-ca/service-ca-5fffc97bdf-bjczz" Oct 30 08:53:02.296363 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:02.296234 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f8c3809a-d264-4139-8805-9b25c0f50f6a-kube-rbac-proxy-cm podName:f8c3809a-d264-4139-8805-9b25c0f50f6a nodeName:}" failed. No retries permitted until 2026-10-30 08:53:04.296199601 +0000 UTC m=+40.049277560 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f8c3809a-d264-4139-8805-9b25c0f50f6a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wphsz" (UID: "f8c3809a-d264-4139-8805-9b25c0f50f6a") : configmap "kube-rbac-proxy" not found Oct 30 08:53:02.296552 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:02.296403 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8c3809a-d264-4139-8805-9b25c0f50f6a-insights-runtime-extractor-tls podName:f8c3809a-d264-4139-8805-9b25c0f50f6a nodeName:}" failed. No retries permitted until 2026-10-30 08:53:04.296383142 +0000 UTC m=+40.049445169 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f8c3809a-d264-4139-8805-9b25c0f50f6a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wphsz" (UID: "f8c3809a-d264-4139-8805-9b25c0f50f6a") : secret "insights-runtime-extractor-tls" not found Oct 30 08:53:02.300034 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.299989 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/da1dbfc6-084c-467f-84c2-4cf1cdea8c54-signing-key\") pod \"service-ca-5fffc97bdf-bjczz\" (UID: \"da1dbfc6-084c-467f-84c2-4cf1cdea8c54\") " pod="openshift-service-ca/service-ca-5fffc97bdf-bjczz" Oct 30 08:53:02.338101 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.338076 2585 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsdlm\" (UniqueName: \"kubernetes.io/projected/da1dbfc6-084c-467f-84c2-4cf1cdea8c54-kube-api-access-nsdlm\") pod \"service-ca-5fffc97bdf-bjczz\" (UID: \"da1dbfc6-084c-467f-84c2-4cf1cdea8c54\") " pod="openshift-service-ca/service-ca-5fffc97bdf-bjczz" Oct 30 08:53:02.343399 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.343374 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-vwfzm"] Oct 30 08:53:02.346575 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:53:02.346542 2585 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc213059_e0bc_4602_8d5c_6c79e962d6a5.slice/crio-64e9d993e448bcd3f06d71a3ccba8c09a0d57ff5d70f299377cde93671d14242 WatchSource:0}: Error finding container 64e9d993e448bcd3f06d71a3ccba8c09a0d57ff5d70f299377cde93671d14242: Status 404 returned error can't find the container with id 64e9d993e448bcd3f06d71a3ccba8c09a0d57ff5d70f299377cde93671d14242 Oct 30 08:53:02.363125 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.362805 2585 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-qvd5x" podStartSLOduration=377.366906149 podStartE2EDuration="6m23.362794051s" totalImagesPullingTime="5.995887902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:46:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:53:02.360410688 +0000 UTC m=+38.113472736" watchObservedRunningTime="2026-10-30 08:53:02.362794051 +0000 UTC m=+38.115856101" Oct 30 08:53:02.397854 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.397798 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0994c04f-63a8-4b19-a4a1-9a0c288a26f5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8q4xg\" (UID: \"0994c04f-63a8-4b19-a4a1-9a0c288a26f5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8q4xg" Oct 30 08:53:02.397941 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.397899 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e02c520e-2276-440e-8f36-1047f78af40a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-r95n6\" (UID: \"e02c520e-2276-440e-8f36-1047f78af40a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-r95n6" Oct 30 08:53:02.397941 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.397932 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-99562\" (UID: \"a88ad1f8-2002-4e56-abcb-47c68c0a1fbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-99562" Oct 30 08:53:02.398027 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:02.397943 2585 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Oct 30 08:53:02.398027 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.397960 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-tls\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:53:02.398027 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:02.398011 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0994c04f-63a8-4b19-a4a1-9a0c288a26f5-networking-console-plugin-cert podName:0994c04f-63a8-4b19-a4a1-9a0c288a26f5 nodeName:}" failed. No retries permitted until 2026-10-30 08:53:10.397991415 +0000 UTC m=+46.151053552 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0994c04f-63a8-4b19-a4a1-9a0c288a26f5-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-8q4xg" (UID: "0994c04f-63a8-4b19-a4a1-9a0c288a26f5") : secret "networking-console-plugin-cert" not found Oct 30 08:53:02.398117 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:02.398064 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 08:53:02.398117 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:02.398076 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c5bffb4d-x885p: secret "image-registry-tls" not found Oct 30 08:53:02.398197 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:02.398134 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-tls podName:9e5c0d3f-6e6c-44d8-b50d-cecacd28474d nodeName:}" failed. No retries permitted until 2026-10-30 08:53:10.398119939 +0000 UTC m=+46.151181980 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-tls") pod "image-registry-7c5bffb4d-x885p" (UID: "9e5c0d3f-6e6c-44d8-b50d-cecacd28474d") : secret "image-registry-tls" not found Oct 30 08:53:02.398295 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:02.398228 2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 08:53:02.398295 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:02.398265 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02c520e-2276-440e-8f36-1047f78af40a-cluster-monitoring-operator-tls podName:e02c520e-2276-440e-8f36-1047f78af40a nodeName:}" failed. No retries permitted until 2026-10-30 08:53:10.398254576 +0000 UTC m=+46.151316606 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e02c520e-2276-440e-8f36-1047f78af40a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-r95n6" (UID: "e02c520e-2276-440e-8f36-1047f78af40a") : secret "cluster-monitoring-operator-tls" not found Oct 30 08:53:02.398364 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:02.398315 2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Oct 30 08:53:02.398364 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:02.398345 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb-samples-operator-tls podName:a88ad1f8-2002-4e56-abcb-47c68c0a1fbb nodeName:}" failed. No retries permitted until 2026-10-30 08:53:10.398335617 +0000 UTC m=+46.151397675 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-99562" (UID: "a88ad1f8-2002-4e56-abcb-47c68c0a1fbb") : secret "samples-operator-tls" not found Oct 30 08:53:02.402023 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.402002 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-24gg7"] Oct 30 08:53:02.404832 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.404792 2585 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-948ql-pgchp" podStartSLOduration=2.404777517 podStartE2EDuration="2.404777517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:53:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:53:02.403287013 +0000 UTC m=+38.156349052" watchObservedRunningTime="2026-10-30 08:53:02.404777517 +0000 UTC m=+38.157839567" Oct 30 08:53:02.406746 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:53:02.406713 2585 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod401c58ab_82cc_4baf_9d77_31e18a3a5cb7.slice/crio-dc2d5bcd8177a7109bebf4d61f6dca0efdee0b671164accf50bc26f405175519 WatchSource:0}: Error finding container dc2d5bcd8177a7109bebf4d61f6dca0efdee0b671164accf50bc26f405175519: Status 404 returned error can't find the container with id dc2d5bcd8177a7109bebf4d61f6dca0efdee0b671164accf50bc26f405175519 Oct 30 08:53:02.499269 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.499240 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-tls\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:53:02.499414 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.499304 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-service-ca-bundle\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:53:02.499414 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.499378 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-metrics-certs\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:53:02.499414 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.499404 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5ddc593-a1bb-4f35-be9e-77b6f9486945-metrics-tls\") pod \"dns-default-vbv2z\" (UID: \"e5ddc593-a1bb-4f35-be9e-77b6f9486945\") " pod="openshift-dns/dns-default-vbv2z" Oct 30 08:53:02.500187 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:02.499705 2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Oct 30 08:53:02.500187 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:02.499723 2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b77f4b5fc-fdtlw: secret "image-registry-tls" not found Oct 30 08:53:02.500187 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:02.499758 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-tls podName:cd1a7b7e-e1dd-4361-9091-b2983dff06da nodeName:}" failed. No retries permitted until 2026-10-30 08:53:10.499747324 +0000 UTC m=+46.252809351 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-tls") pod "image-registry-b77f4b5fc-fdtlw" (UID: "cd1a7b7e-e1dd-4361-9091-b2983dff06da") : secret "image-registry-tls" not found Oct 30 08:53:02.500187 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:02.500075 2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Oct 30 08:53:02.500187 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:02.500120 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-metrics-certs podName:f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f nodeName:}" failed. No retries permitted until 2026-10-30 08:53:10.500106187 +0000 UTC m=+46.253168217 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-metrics-certs") pod "router-default-777d6b9d77-br8dn" (UID: "f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f") : secret "router-metrics-certs-default" not found Oct 30 08:53:02.500187 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:02.500170 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-service-ca-bundle podName:f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f nodeName:}" failed. No retries permitted until 2026-10-30 08:53:10.500158528 +0000 UTC m=+46.253220560 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-service-ca-bundle") pod "router-default-777d6b9d77-br8dn" (UID: "f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f") : configmap references non-existent config key: service-ca.crt Oct 30 08:53:02.500632 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:02.500606 2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 08:53:02.500698 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:02.500668 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5ddc593-a1bb-4f35-be9e-77b6f9486945-metrics-tls podName:e5ddc593-a1bb-4f35-be9e-77b6f9486945 nodeName:}" failed. No retries permitted until 2026-10-30 08:53:10.50065518 +0000 UTC m=+46.253717226 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5ddc593-a1bb-4f35-be9e-77b6f9486945-metrics-tls") pod "dns-default-vbv2z" (UID: "e5ddc593-a1bb-4f35-be9e-77b6f9486945") : secret "dns-default-metrics-tls" not found Oct 30 08:53:02.508704 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.508682 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-bjczz" Oct 30 08:53:02.832692 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:02.832567 2585 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-bjczz"] Oct 30 08:53:02.837387 ip-10-0-140-65 kubenswrapper[2585]: W1030 08:53:02.837357 2585 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda1dbfc6_084c_467f_84c2_4cf1cdea8c54.slice/crio-07d862f38c631a13985bebe9c8cc32ab4213a01ecb767999275d0cc2ab1408e8 WatchSource:0}: Error finding container 07d862f38c631a13985bebe9c8cc32ab4213a01ecb767999275d0cc2ab1408e8: Status 404 returned error can't find the container with id 07d862f38c631a13985bebe9c8cc32ab4213a01ecb767999275d0cc2ab1408e8 Oct 30 08:53:03.221254 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:03.220671 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-bjczz" event={"ID":"da1dbfc6-084c-467f-84c2-4cf1cdea8c54","Type":"ContainerStarted","Data":"0970045771deac5a46c3ffe2040ceff3524a3ff32295a6638c0fe85bf57fcc67"} Oct 30 08:53:03.221254 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:03.220736 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-bjczz" event={"ID":"da1dbfc6-084c-467f-84c2-4cf1cdea8c54","Type":"ContainerStarted","Data":"07d862f38c631a13985bebe9c8cc32ab4213a01ecb767999275d0cc2ab1408e8"} Oct 30 08:53:03.223484 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:03.223412 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-24gg7" event={"ID":"401c58ab-82cc-4baf-9d77-31e18a3a5cb7","Type":"ContainerStarted","Data":"dc2d5bcd8177a7109bebf4d61f6dca0efdee0b671164accf50bc26f405175519"} Oct 30 08:53:03.225823 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:03.225734 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vwfzm" event={"ID":"cc213059-e0bc-4602-8d5c-6c79e962d6a5","Type":"ContainerStarted","Data":"64e9d993e448bcd3f06d71a3ccba8c09a0d57ff5d70f299377cde93671d14242"} Oct 30 08:53:03.230828 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:03.228860 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6jb9v_0c1ebb77-bd76-4329-ac03-87f60b688431/console-operator/1.log" Oct 30 08:53:03.230828 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:03.229817 2585 scope.go:122] "RemoveContainer" containerID="f1033586986f47ff6f946cc9a123fa0e7182cff004274b45e877e858a7e2d2c2" Oct 30 08:53:03.230828 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:03.229993 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-6jb9v_openshift-console-operator(0c1ebb77-bd76-4329-ac03-87f60b688431)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" podUID="0c1ebb77-bd76-4329-ac03-87f60b688431" Oct 30 08:53:03.263790 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:03.263503 2585 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca/service-ca-5fffc97bdf-bjczz" podStartSLOduration=1.263485625 podStartE2EDuration="1.263485625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:53:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:53:03.262097538 +0000 UTC m=+39.015159587" watchObservedRunningTime="2026-10-30 08:53:03.263485625 +0000 UTC m=+39.016547675" Oct 30 08:53:03.883274 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:03.883148 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bqlk7_094983e9-88e8-4881-be25-8ba5d8bc0979/dns-node-resolver/0.log" Oct 30 08:53:04.236091 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:04.236025 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gn6v4" event={"ID":"26e2f6af-5dbf-44c2-9acf-58c70be503bf","Type":"ContainerStarted","Data":"5b1bef3456bd0f17779a261ec7f1ed8435bf94e2619d94bdead64ad035a81c12"} Oct 30 08:53:04.278321 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:04.278280 2585 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gn6v4" podStartSLOduration=35.330725644 podStartE2EDuration="39.278267387s" totalImagesPullingTime="3.947541743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:52:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:53:04.276947899 +0000 UTC m=+40.030009945" watchObservedRunningTime="2026-10-30 08:53:04.278267387 +0000 UTC m=+40.031329435" Oct 30 08:53:04.317800 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:04.317778 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8c3809a-d264-4139-8805-9b25c0f50f6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:04.317964 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:04.317949 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f8c3809a-d264-4139-8805-9b25c0f50f6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:04.318059 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:04.318019 2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 08:53:04.318113 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:04.318071 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f8c3809a-d264-4139-8805-9b25c0f50f6a-kube-rbac-proxy-cm podName:f8c3809a-d264-4139-8805-9b25c0f50f6a nodeName:}" failed. No retries permitted until 2026-10-30 08:53:08.318054363 +0000 UTC m=+44.071116409 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f8c3809a-d264-4139-8805-9b25c0f50f6a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wphsz" (UID: "f8c3809a-d264-4139-8805-9b25c0f50f6a") : configmap "kube-rbac-proxy" not found Oct 30 08:53:04.318181 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:04.318116 2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 08:53:04.318254 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:04.318172 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8c3809a-d264-4139-8805-9b25c0f50f6a-insights-runtime-extractor-tls podName:f8c3809a-d264-4139-8805-9b25c0f50f6a nodeName:}" failed. No retries permitted until 2026-10-30 08:53:08.318154653 +0000 UTC m=+44.071216694 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f8c3809a-d264-4139-8805-9b25c0f50f6a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wphsz" (UID: "f8c3809a-d264-4139-8805-9b25c0f50f6a") : secret "insights-runtime-extractor-tls" not found Oct 30 08:53:04.882789 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:04.882761 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9fzvv_af7f9e2a-c57b-4396-bd6e-40c05cf1ef42/node-ca/0.log" Oct 30 08:53:05.040133 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:05.040102 2585 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" Oct 30 08:53:05.040320 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:05.040162 2585 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" Oct 30 08:53:05.040541 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:05.040525 2585 scope.go:122] "RemoveContainer" containerID="f1033586986f47ff6f946cc9a123fa0e7182cff004274b45e877e858a7e2d2c2" Oct 30 08:53:05.040752 ip-10-0-140-65 kubenswrapper[2585]: E1030 08:53:05.040730 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-6jb9v_openshift-console-operator(0c1ebb77-bd76-4329-ac03-87f60b688431)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" podUID="0c1ebb77-bd76-4329-ac03-87f60b688431" Oct 30 08:53:05.240694 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:05.240621 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-24gg7" event={"ID":"401c58ab-82cc-4baf-9d77-31e18a3a5cb7","Type":"ContainerStarted","Data":"75ff549756694454dd2eb6f90a3073a345335ddf4eb94fbb7cac79084b3bd613"} Oct 30 08:53:05.242032 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:05.242007 2585 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vwfzm" event={"ID":"cc213059-e0bc-4602-8d5c-6c79e962d6a5","Type":"ContainerStarted","Data":"e4c6c8021241a486ee154d8a265ecea6415b3f7a75d3b97cb262635953de7bc0"} Oct 30 08:53:05.242166 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:05.242150 2585 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gn6v4" Oct 30 08:53:05.279402 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:05.279357 2585 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-24gg7" podStartSLOduration=2.4742235040000002 podStartE2EDuration="4.279344356s" totalImagesPullingTime="1.805120852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:53:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:53:05.279276483 +0000 UTC m=+41.032338532" watchObservedRunningTime="2026-10-30 08:53:05.279344356 +0000 UTC m=+41.032406407" Oct 30 08:53:05.321601 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:05.321560 2585 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vwfzm" podStartSLOduration=2.469031878 podStartE2EDuration="4.321548924s" totalImagesPullingTime="1.852517046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:53:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:53:05.320565792 +0000 UTC m=+41.073627843" watchObservedRunningTime="2026-10-30 08:53:05.321548924 +0000 UTC m=+41.074610972" Oct 30 08:53:05.483219 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:05.483176 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j4lkv_06e7e9e5-ebd3-4e67-95ba-03eeebcee619/serve-healthcheck-canary/0.log" Oct 30 08:53:05.685628 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:05.685596 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-24gg7_401c58ab-82cc-4baf-9d77-31e18a3a5cb7/migrator/0.log" Oct 30 08:53:05.724580 ip-10-0-140-65 kubenswrapper[2585]: I1030 08:53:05.724479 2585 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 08:53:05.724686 ip-10-0-140-65 systemd[1]: Stopping Kubernetes Kubelet... Oct 30 08:53:05.734570 ip-10-0-140-65 systemd[1]: kubelet.service: Deactivated successfully. Oct 30 08:53:05.734736 ip-10-0-140-65 systemd[1]: Stopped Kubernetes Kubelet. Oct 30 08:53:05.734786 ip-10-0-140-65 systemd[1]: kubelet.service: Consumed 3.086s CPU time. Oct 30 08:53:05.745883 ip-10-0-140-65 systemd[1]: Starting Kubernetes Kubelet... Oct 30 08:53:05.827506 ip-10-0-140-65 kubenswrapper[5028]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 08:53:05.827506 ip-10-0-140-65 kubenswrapper[5028]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 30 08:53:05.827506 ip-10-0-140-65 kubenswrapper[5028]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 08:53:05.827506 ip-10-0-140-65 kubenswrapper[5028]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 08:53:05.829492 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829421 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 08:53:05.829492 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829487 5028 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 08:53:05.829492 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829491 5028 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 08:53:05.829492 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829495 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 08:53:05.829492 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829498 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 08:53:05.829703 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829501 5028 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 08:53:05.829703 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829504 5028 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 08:53:05.829703 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829506 5028 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 08:53:05.829703 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829510 5028 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 08:53:05.829703 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829512 5028 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 08:53:05.829703 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829516 5028 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 08:53:05.829703 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829519 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 08:53:05.829703 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829522 5028 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 08:53:05.829703 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829525 5028 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 08:53:05.829703 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829528 5028 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 08:53:05.829703 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829532 5028 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 08:53:05.829703 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829536 5028 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 08:53:05.829703 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829539 5028 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 08:53:05.829703 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829541 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 08:53:05.829703 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829545 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 08:53:05.829703 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829547 5028 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 08:53:05.829703 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829549 5028 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 08:53:05.829703 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829552 5028 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 08:53:05.829703 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829555 5028 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 08:53:05.830182 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829557 5028 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 08:53:05.830182 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829560 5028 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 08:53:05.830182 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829562 5028 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 08:53:05.830182 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829565 5028 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 08:53:05.830182 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829568 5028 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 08:53:05.830182 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829570 5028 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 08:53:05.830182 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829573 5028 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 08:53:05.830182 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829575 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 08:53:05.830182 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829583 5028 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 08:53:05.830182 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829586 5028 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 08:53:05.830182 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829589 5028 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 08:53:05.830182 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829593 5028 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 08:53:05.830182 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829596 5028 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 08:53:05.830182 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829599 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 08:53:05.830182 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829602 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 08:53:05.830182 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829605 5028 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 08:53:05.830182 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829608 5028 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 08:53:05.830182 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829610 5028 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 08:53:05.830182 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829613 5028 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 08:53:05.830182 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829616 5028 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 08:53:05.830724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829618 5028 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 08:53:05.830724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829621 5028 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 08:53:05.830724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829624 5028 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 08:53:05.830724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829626 5028 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 08:53:05.830724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829629 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 08:53:05.830724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829632 5028 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 08:53:05.830724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829634 5028 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 08:53:05.830724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829637 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 08:53:05.830724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829640 5028 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 08:53:05.830724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829642 5028 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 08:53:05.830724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829645 5028 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 08:53:05.830724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829647 5028 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 08:53:05.830724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829650 5028 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 08:53:05.830724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829653 5028 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 08:53:05.830724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829655 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 08:53:05.830724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829658 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 08:53:05.830724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829660 5028 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 08:53:05.830724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829663 5028 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 08:53:05.830724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829665 5028 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 08:53:05.830724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829668 5028 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 08:53:05.831221 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829673 5028 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 08:53:05.831221 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829676 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 08:53:05.831221 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829678 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 08:53:05.831221 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829681 5028 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 08:53:05.831221 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829683 5028 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 08:53:05.831221 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829687 5028 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 08:53:05.831221 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829690 5028 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 08:53:05.831221 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829693 5028 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 08:53:05.831221 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829696 5028 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 08:53:05.831221 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829698 5028 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 08:53:05.831221 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829701 5028 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 08:53:05.831221 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829703 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 08:53:05.831221 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829706 5028 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 08:53:05.831221 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829709 5028 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 08:53:05.831221 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829712 5028 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 08:53:05.831221 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829715 5028 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 08:53:05.831221 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829717 5028 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 08:53:05.831221 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829720 5028 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 08:53:05.831221 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829723 5028 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 08:53:05.831221 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829725 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 08:53:05.831731 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829728 5028 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 08:53:05.831731 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829730 5028 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 08:53:05.831731 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829732 5028 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 08:53:05.831731 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829735 5028 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 08:53:05.831731 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829738 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 08:53:05.831731 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829741 5028 feature_gate.go:386] unrecognized feature gate: Example Oct 30 08:53:05.831731 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829743 5028 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 08:53:05.831731 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829746 5028 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 08:53:05.831731 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829748 5028 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 08:53:05.831731 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829751 5028 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 08:53:05.831731 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829753 5028 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 08:53:05.831731 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829757 5028 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 08:53:05.831731 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829761 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 08:53:05.831731 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829763 5028 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 08:53:05.831731 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829766 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 08:53:05.831731 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829769 5028 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 08:53:05.831731 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829771 5028 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 08:53:05.831731 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829774 5028 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 08:53:05.831731 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829777 5028 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 08:53:05.832199 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829780 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 08:53:05.832199 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829783 5028 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 08:53:05.832199 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.829785 5028 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 08:53:05.832199 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830570 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 08:53:05.832199 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830577 5028 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 08:53:05.832199 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830581 5028 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 08:53:05.832199 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830584 5028 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 08:53:05.832199 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830586 5028 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 08:53:05.832199 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830589 5028 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 08:53:05.832199 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830592 5028 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 08:53:05.832199 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830595 5028 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 08:53:05.832199 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830597 5028 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 08:53:05.832199 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830600 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 08:53:05.832199 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830603 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 08:53:05.832199 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830605 5028 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 08:53:05.832199 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830608 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 08:53:05.832199 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830611 5028 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 08:53:05.832199 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830614 5028 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 08:53:05.832199 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830616 5028 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 08:53:05.832724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830619 5028 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 08:53:05.832724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830621 5028 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 08:53:05.832724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830624 5028 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 08:53:05.832724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830627 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 08:53:05.832724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830629 5028 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 08:53:05.832724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830632 5028 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 08:53:05.832724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830637 5028 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 08:53:05.832724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830639 5028 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 08:53:05.832724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830642 5028 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 08:53:05.832724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830644 5028 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 08:53:05.832724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830647 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 08:53:05.832724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830649 5028 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 08:53:05.832724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830652 5028 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 08:53:05.832724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830655 5028 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 08:53:05.832724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830659 5028 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 08:53:05.832724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830663 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 08:53:05.832724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830666 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 08:53:05.832724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830669 5028 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 08:53:05.832724 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830673 5028 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 08:53:05.833214 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830677 5028 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 08:53:05.833214 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830680 5028 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 08:53:05.833214 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830683 5028 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 08:53:05.833214 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830685 5028 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 08:53:05.833214 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830688 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 08:53:05.833214 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830690 5028 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 08:53:05.833214 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830693 5028 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 08:53:05.833214 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830696 5028 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 08:53:05.833214 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830698 5028 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 08:53:05.833214 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830701 5028 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 08:53:05.833214 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830703 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 08:53:05.833214 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830706 5028 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 08:53:05.833214 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830709 5028 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 08:53:05.833214 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830712 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 08:53:05.833214 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830715 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 08:53:05.833214 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830718 5028 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 08:53:05.833214 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830720 5028 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 08:53:05.833214 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830723 5028 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 08:53:05.833214 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830725 5028 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 08:53:05.833728 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830729 5028 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 08:53:05.833728 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830732 5028 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 08:53:05.833728 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830735 5028 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 08:53:05.833728 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830738 5028 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 08:53:05.833728 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830740 5028 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 08:53:05.833728 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830743 5028 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 08:53:05.833728 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830746 5028 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 08:53:05.833728 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830748 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 08:53:05.833728 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830750 5028 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 08:53:05.833728 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830756 5028 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 08:53:05.833728 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830758 5028 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 08:53:05.833728 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830761 5028 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 08:53:05.833728 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830763 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 08:53:05.833728 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830766 5028 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 08:53:05.833728 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830768 5028 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 08:53:05.833728 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830771 5028 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 08:53:05.833728 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830774 5028 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 08:53:05.833728 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830776 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 08:53:05.833728 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830779 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 08:53:05.833728 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830781 5028 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 08:53:05.834247 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830784 5028 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 08:53:05.834247 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830786 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 08:53:05.834247 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830789 5028 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 08:53:05.834247 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830791 5028 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 08:53:05.834247 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830794 5028 feature_gate.go:386] unrecognized feature gate: Example Oct 30 08:53:05.834247 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830796 5028 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 08:53:05.834247 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830799 5028 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 08:53:05.834247 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830802 5028 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 08:53:05.834247 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830804 5028 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 08:53:05.834247 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830807 5028 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 08:53:05.834247 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830809 5028 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 08:53:05.834247 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830812 5028 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 08:53:05.834247 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830816 5028 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 08:53:05.834247 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830819 5028 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 08:53:05.834247 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830821 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 08:53:05.834247 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830824 5028 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 08:53:05.834247 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830826 5028 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 08:53:05.834247 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830829 5028 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 08:53:05.834247 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830832 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 08:53:05.834247 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830834 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 08:53:05.835018 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830837 5028 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 08:53:05.835018 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830840 5028 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 08:53:05.835018 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830844 5028 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 08:53:05.835018 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830846 5028 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 08:53:05.835018 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830849 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 08:53:05.835018 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830852 5028 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 08:53:05.835018 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830855 5028 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 08:53:05.835018 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830858 5028 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 08:53:05.835018 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830860 5028 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 08:53:05.835018 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830863 5028 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 08:53:05.835018 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830865 5028 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 08:53:05.835018 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.830868 5028 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 08:53:05.835018 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831372 5028 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 08:53:05.835018 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831378 5028 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 08:53:05.835018 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831381 5028 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 08:53:05.835018 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831383 5028 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 08:53:05.835018 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831386 5028 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 08:53:05.835018 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831389 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 08:53:05.835018 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831392 5028 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 08:53:05.835018 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831395 5028 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 08:53:05.835848 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831397 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 08:53:05.835848 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831400 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 08:53:05.835848 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831402 5028 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 08:53:05.835848 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831405 5028 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 08:53:05.835848 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831410 5028 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 08:53:05.835848 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831412 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 08:53:05.835848 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831415 5028 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 08:53:05.835848 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831417 5028 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 08:53:05.835848 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831420 5028 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 08:53:05.835848 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831423 5028 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 08:53:05.835848 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831425 5028 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 08:53:05.835848 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831428 5028 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 08:53:05.835848 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831430 5028 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 08:53:05.835848 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831433 5028 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 08:53:05.835848 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831442 5028 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 08:53:05.835848 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831444 5028 feature_gate.go:386] unrecognized feature gate: Example Oct 30 08:53:05.835848 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831447 5028 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 08:53:05.835848 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831449 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 08:53:05.835848 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831452 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 08:53:05.836540 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831455 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 08:53:05.836540 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831457 5028 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 08:53:05.836540 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831460 5028 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 08:53:05.836540 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831462 5028 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 08:53:05.836540 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831465 5028 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 08:53:05.836540 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831467 5028 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 08:53:05.836540 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831470 5028 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 08:53:05.836540 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831472 5028 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 08:53:05.836540 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831475 5028 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 08:53:05.836540 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831477 5028 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 08:53:05.836540 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831480 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 08:53:05.836540 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831482 5028 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 08:53:05.836540 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831485 5028 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 08:53:05.836540 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831487 5028 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 08:53:05.836540 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831490 5028 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 08:53:05.836540 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831492 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 08:53:05.836540 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831495 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 08:53:05.836540 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831499 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 08:53:05.836540 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831501 5028 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 08:53:05.837026 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831504 5028 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 08:53:05.837026 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831506 5028 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 08:53:05.837026 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831509 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 08:53:05.837026 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831511 5028 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 08:53:05.837026 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831514 5028 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 08:53:05.837026 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831517 5028 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 08:53:05.837026 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831519 5028 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 08:53:05.837026 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831522 5028 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 08:53:05.837026 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831525 5028 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 08:53:05.837026 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831533 5028 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 08:53:05.837026 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831536 5028 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 08:53:05.837026 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831538 5028 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 08:53:05.837026 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831541 5028 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 08:53:05.837026 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831544 5028 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 08:53:05.837026 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831547 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 08:53:05.837026 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831549 5028 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 08:53:05.837026 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831552 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 08:53:05.837026 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831554 5028 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 08:53:05.837026 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831557 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 08:53:05.837026 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831559 5028 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 08:53:05.837569 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831562 5028 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 08:53:05.837569 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831564 5028 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 08:53:05.837569 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831567 5028 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 08:53:05.837569 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831569 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 08:53:05.837569 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831572 5028 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 08:53:05.837569 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831574 5028 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 08:53:05.837569 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831577 5028 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 08:53:05.837569 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831580 5028 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 08:53:05.837569 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831583 5028 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 08:53:05.837569 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831585 5028 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 08:53:05.837569 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831589 5028 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 08:53:05.837569 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831591 5028 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 08:53:05.837569 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831594 5028 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 08:53:05.837569 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831597 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 08:53:05.837569 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831600 5028 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 08:53:05.837569 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831602 5028 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 08:53:05.837569 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831605 5028 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 08:53:05.837569 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831610 5028 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 08:53:05.837569 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831613 5028 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 08:53:05.837569 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831616 5028 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 08:53:05.838378 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831619 5028 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 08:53:05.838378 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831622 5028 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 08:53:05.838378 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831625 5028 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 08:53:05.838378 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831628 5028 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 08:53:05.838378 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831630 5028 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 08:53:05.838378 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831633 5028 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 08:53:05.838378 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831635 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 08:53:05.838378 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831638 5028 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 08:53:05.838378 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831641 5028 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 08:53:05.838378 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831643 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 08:53:05.838378 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831646 5028 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 08:53:05.838378 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831648 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 08:53:05.838378 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831651 5028 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 08:53:05.838378 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831653 5028 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 08:53:05.838378 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831656 5028 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 08:53:05.838378 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831658 5028 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 08:53:05.838378 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831661 5028 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 08:53:05.838378 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831663 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 08:53:05.838378 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831668 5028 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 08:53:05.840004 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.831671 5028 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 08:53:05.840004 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831767 5028 flags.go:64] FLAG: --address="0.0.0.0" Oct 30 08:53:05.840004 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831774 5028 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 30 08:53:05.840004 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831781 5028 flags.go:64] FLAG: --anonymous-auth="true" Oct 30 08:53:05.840004 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831785 5028 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 30 08:53:05.840004 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831790 5028 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 30 08:53:05.840004 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831793 5028 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 30 08:53:05.840004 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831797 5028 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 30 08:53:05.840004 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831802 5028 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 30 08:53:05.840004 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831805 5028 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 30 08:53:05.840004 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831808 5028 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 30 08:53:05.840004 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831811 5028 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 30 08:53:05.840004 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831815 5028 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 30 08:53:05.840004 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831818 5028 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 30 08:53:05.840004 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831821 5028 flags.go:64] FLAG: --cgroup-root="" Oct 30 08:53:05.840004 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831823 5028 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 30 08:53:05.840004 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831827 5028 flags.go:64] FLAG: --client-ca-file="" Oct 30 08:53:05.840004 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831830 5028 flags.go:64] FLAG: --cloud-provider="external" Oct 30 08:53:05.840004 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831833 5028 flags.go:64] FLAG: --cluster-dns="[]" Oct 30 08:53:05.840004 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831838 5028 flags.go:64] FLAG: --cluster-domain="" Oct 30 08:53:05.840004 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831841 5028 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 30 08:53:05.840004 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831845 5028 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 30 08:53:05.840004 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831848 5028 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 30 08:53:05.840004 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831851 5028 flags.go:64] FLAG: --container-log-max-files="5" Oct 30 08:53:05.840772 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831855 5028 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 30 08:53:05.840772 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831858 5028 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 30 08:53:05.840772 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831861 5028 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 30 08:53:05.840772 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831864 5028 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 30 08:53:05.840772 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831867 5028 flags.go:64] FLAG: --contention-profiling="false" Oct 30 08:53:05.840772 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831870 5028 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 30 08:53:05.840772 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831873 5028 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 30 08:53:05.840772 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831878 5028 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 30 08:53:05.840772 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831881 5028 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 30 08:53:05.840772 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831885 5028 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 30 08:53:05.840772 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831888 5028 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 30 08:53:05.840772 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831891 5028 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 30 08:53:05.840772 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831895 5028 flags.go:64] FLAG: --enable-load-reader="false" Oct 30 08:53:05.840772 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831898 5028 flags.go:64] FLAG: --enable-server="true" Oct 30 08:53:05.840772 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831901 5028 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 30 08:53:05.840772 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831908 5028 flags.go:64] FLAG: --event-burst="100" Oct 30 08:53:05.840772 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831911 5028 flags.go:64] FLAG: --event-qps="50" Oct 30 08:53:05.840772 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831914 5028 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 30 08:53:05.840772 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831917 5028 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 30 08:53:05.840772 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831920 5028 flags.go:64] FLAG: --eviction-hard="" Oct 30 08:53:05.840772 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831924 5028 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 30 08:53:05.840772 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831928 5028 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 30 08:53:05.840772 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831931 5028 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 30 08:53:05.840772 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831934 5028 flags.go:64] FLAG: --eviction-soft="" Oct 30 08:53:05.840772 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831937 5028 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 30 08:53:05.841411 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831945 5028 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 30 08:53:05.841411 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831949 5028 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 30 08:53:05.841411 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831952 5028 flags.go:64] FLAG: --experimental-mounter-path="" Oct 30 08:53:05.841411 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831956 5028 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 30 08:53:05.841411 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831958 5028 flags.go:64] FLAG: --fail-swap-on="true" Oct 30 08:53:05.841411 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831962 5028 flags.go:64] FLAG: --feature-gates="" Oct 30 08:53:05.841411 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831966 5028 flags.go:64] FLAG: --file-check-frequency="20s" Oct 30 08:53:05.841411 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831969 5028 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 30 08:53:05.841411 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831972 5028 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 30 08:53:05.841411 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831975 5028 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 30 08:53:05.841411 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831978 5028 flags.go:64] FLAG: --healthz-port="10248" Oct 30 08:53:05.841411 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831981 5028 flags.go:64] FLAG: --help="false" Oct 30 08:53:05.841411 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831984 5028 flags.go:64] FLAG: --hostname-override="ip-10-0-140-65.ec2.internal" Oct 30 08:53:05.841411 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831987 5028 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 30 08:53:05.841411 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831992 5028 flags.go:64] FLAG: --http-check-frequency="20s" Oct 30 08:53:05.841411 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831995 5028 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 30 08:53:05.841411 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.831999 5028 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 30 08:53:05.841411 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832002 5028 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 30 08:53:05.841411 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832005 5028 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 30 08:53:05.841411 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832008 5028 flags.go:64] FLAG: --image-service-endpoint="" Oct 30 08:53:05.841411 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832011 5028 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 30 08:53:05.841411 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832014 5028 flags.go:64] FLAG: --kube-api-burst="100" Oct 30 08:53:05.841411 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832017 5028 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 30 08:53:05.841966 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832020 5028 flags.go:64] FLAG: --kube-api-qps="50" Oct 30 08:53:05.841966 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832023 5028 flags.go:64] FLAG: --kube-reserved="" Oct 30 08:53:05.841966 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832026 5028 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 30 08:53:05.841966 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832029 5028 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 30 08:53:05.841966 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832032 5028 flags.go:64] FLAG: --kubelet-cgroups="" Oct 30 08:53:05.841966 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832034 5028 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 30 08:53:05.841966 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832037 5028 flags.go:64] FLAG: --lock-file="" Oct 30 08:53:05.841966 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832040 5028 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 30 08:53:05.841966 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832043 5028 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 30 08:53:05.841966 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832046 5028 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 30 08:53:05.841966 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832057 5028 flags.go:64] FLAG: --log-json-split-stream="false" Oct 30 08:53:05.841966 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832060 5028 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 30 08:53:05.841966 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832063 5028 flags.go:64] FLAG: --log-text-split-stream="false" Oct 30 08:53:05.841966 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832066 5028 flags.go:64] FLAG: --logging-format="text" Oct 30 08:53:05.841966 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832069 5028 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 30 08:53:05.841966 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832072 5028 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 30 08:53:05.841966 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832075 5028 flags.go:64] FLAG: --manifest-url="" Oct 30 08:53:05.841966 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832078 5028 flags.go:64] FLAG: --manifest-url-header="" Oct 30 08:53:05.841966 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832082 5028 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 30 08:53:05.841966 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832085 5028 flags.go:64] FLAG: --max-open-files="1000000" Oct 30 08:53:05.841966 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832089 5028 flags.go:64] FLAG: --max-pods="110" Oct 30 08:53:05.841966 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832092 5028 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 30 08:53:05.841966 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832095 5028 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 30 08:53:05.841966 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832100 5028 flags.go:64] FLAG: --memory-manager-policy="None" Oct 30 08:53:05.841966 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832103 5028 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 30 08:53:05.842628 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832106 5028 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 30 08:53:05.842628 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832109 5028 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 30 08:53:05.842628 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832112 5028 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 30 08:53:05.842628 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832118 5028 flags.go:64] FLAG: --node-status-max-images="50" Oct 30 08:53:05.842628 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832121 5028 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 30 08:53:05.842628 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832124 5028 flags.go:64] FLAG: --oom-score-adj="-999" Oct 30 08:53:05.842628 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832127 5028 flags.go:64] FLAG: --pod-cidr="" Oct 30 08:53:05.842628 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832130 5028 flags.go:64] FLAG: --pod-manifest-path="" Oct 30 08:53:05.842628 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832133 5028 flags.go:64] FLAG: --pod-max-pids="-1" Oct 30 08:53:05.842628 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832136 5028 flags.go:64] FLAG: --pods-per-core="0" Oct 30 08:53:05.842628 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832139 5028 flags.go:64] FLAG: --port="10250" Oct 30 08:53:05.842628 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832142 5028 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 30 08:53:05.842628 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832145 5028 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-020214f56190d89ab" Oct 30 08:53:05.842628 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832148 5028 flags.go:64] FLAG: --qos-reserved="" Oct 30 08:53:05.842628 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832151 5028 flags.go:64] FLAG: --read-only-port="10255" Oct 30 08:53:05.842628 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832156 5028 flags.go:64] FLAG: --register-node="true" Oct 30 08:53:05.842628 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832159 5028 flags.go:64] FLAG: --register-with-taints="" Oct 30 08:53:05.842628 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832163 5028 flags.go:64] FLAG: --registry-burst="10" Oct 30 08:53:05.842628 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832171 5028 flags.go:64] FLAG: --registry-qps="5" Oct 30 08:53:05.842628 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832174 5028 flags.go:64] FLAG: --reserved-cpus="" Oct 30 08:53:05.842628 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832177 5028 flags.go:64] FLAG: --reserved-memory="" Oct 30 08:53:05.842628 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832181 5028 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 30 08:53:05.842628 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832185 5028 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 30 08:53:05.842628 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832188 5028 flags.go:64] FLAG: --rotate-certificates="false" Oct 30 08:53:05.842628 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832191 5028 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 30 08:53:05.842628 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832194 5028 flags.go:64] FLAG: --runonce="false" Oct 30 08:53:05.843272 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832197 5028 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 30 08:53:05.843272 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832213 5028 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 30 08:53:05.843272 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832216 5028 flags.go:64] FLAG: --seccomp-default="false" Oct 30 08:53:05.843272 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832219 5028 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 30 08:53:05.843272 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832224 5028 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 30 08:53:05.843272 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832227 5028 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 30 08:53:05.843272 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832230 5028 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 30 08:53:05.843272 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832233 5028 flags.go:64] FLAG: --storage-driver-password="root" Oct 30 08:53:05.843272 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832236 5028 flags.go:64] FLAG: --storage-driver-secure="false" Oct 30 08:53:05.843272 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832245 5028 flags.go:64] FLAG: --storage-driver-table="stats" Oct 30 08:53:05.843272 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832248 5028 flags.go:64] FLAG: --storage-driver-user="root" Oct 30 08:53:05.843272 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832251 5028 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 30 08:53:05.843272 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832254 5028 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 30 08:53:05.843272 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832257 5028 flags.go:64] FLAG: --system-cgroups="" Oct 30 08:53:05.843272 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832260 5028 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 30 08:53:05.843272 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832266 5028 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 30 08:53:05.843272 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832269 5028 flags.go:64] FLAG: --tls-cert-file="" Oct 30 08:53:05.843272 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832271 5028 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 30 08:53:05.843272 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832276 5028 flags.go:64] FLAG: --tls-min-version="" Oct 30 08:53:05.843272 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832279 5028 flags.go:64] FLAG: --tls-private-key-file="" Oct 30 08:53:05.843272 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832282 5028 flags.go:64] FLAG: --topology-manager-policy="none" Oct 30 08:53:05.843272 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832286 5028 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 30 08:53:05.843272 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832289 5028 flags.go:64] FLAG: --topology-manager-scope="container" Oct 30 08:53:05.843272 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832292 5028 flags.go:64] FLAG: --v="2" Oct 30 08:53:05.843272 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832296 5028 flags.go:64] FLAG: --version="false" Oct 30 08:53:05.843967 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832303 5028 flags.go:64] FLAG: --vmodule="" Oct 30 08:53:05.843967 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832307 5028 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 30 08:53:05.843967 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832310 5028 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 30 08:53:05.843967 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832456 5028 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 08:53:05.843967 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832460 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 08:53:05.843967 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832464 5028 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 08:53:05.843967 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832467 5028 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 08:53:05.843967 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832470 5028 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 08:53:05.843967 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832473 5028 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 08:53:05.843967 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832475 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 08:53:05.843967 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832478 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 08:53:05.843967 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832482 5028 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 08:53:05.843967 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832485 5028 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 08:53:05.843967 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832487 5028 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 08:53:05.843967 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832490 5028 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 08:53:05.843967 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832493 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 08:53:05.843967 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832495 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 08:53:05.843967 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832498 5028 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 08:53:05.843967 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832501 5028 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 08:53:05.843967 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832503 5028 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 08:53:05.844563 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832506 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 08:53:05.844563 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832509 5028 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 08:53:05.844563 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832512 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 08:53:05.844563 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832514 5028 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 08:53:05.844563 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832517 5028 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 08:53:05.844563 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832519 5028 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 08:53:05.844563 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832522 5028 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 08:53:05.844563 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832525 5028 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 08:53:05.844563 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832529 5028 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 08:53:05.844563 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832532 5028 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 08:53:05.844563 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832534 5028 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 08:53:05.844563 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832537 5028 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 08:53:05.844563 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832539 5028 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 08:53:05.844563 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832543 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 08:53:05.844563 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832545 5028 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 08:53:05.844563 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832548 5028 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 08:53:05.844563 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832551 5028 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 08:53:05.844563 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832554 5028 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 08:53:05.844563 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832556 5028 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 08:53:05.844563 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832559 5028 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 08:53:05.845136 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832562 5028 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 08:53:05.845136 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832564 5028 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 08:53:05.845136 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832567 5028 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 08:53:05.845136 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832571 5028 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 08:53:05.845136 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832574 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 08:53:05.845136 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832577 5028 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 08:53:05.845136 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832579 5028 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 08:53:05.845136 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832582 5028 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 08:53:05.845136 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832584 5028 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 08:53:05.845136 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832587 5028 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 08:53:05.845136 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832590 5028 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 08:53:05.845136 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832592 5028 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 08:53:05.845136 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832595 5028 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 08:53:05.845136 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832597 5028 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 08:53:05.845136 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832600 5028 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 08:53:05.845136 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832603 5028 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 08:53:05.845136 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832605 5028 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 08:53:05.845136 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832608 5028 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 08:53:05.845136 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832610 5028 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 08:53:05.845136 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832613 5028 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 08:53:05.845957 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832616 5028 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 08:53:05.845957 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832620 5028 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 08:53:05.845957 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832624 5028 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 08:53:05.845957 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832627 5028 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 08:53:05.845957 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832663 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 08:53:05.845957 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832666 5028 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 08:53:05.845957 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832670 5028 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 08:53:05.845957 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832673 5028 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 08:53:05.845957 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832676 5028 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 08:53:05.845957 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832679 5028 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 08:53:05.845957 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832681 5028 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 08:53:05.845957 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832684 5028 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 08:53:05.845957 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832687 5028 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 08:53:05.845957 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832690 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 08:53:05.845957 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832692 5028 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 08:53:05.845957 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832696 5028 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 08:53:05.845957 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832702 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 08:53:05.845957 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832706 5028 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 08:53:05.845957 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832709 5028 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 08:53:05.846494 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832712 5028 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 08:53:05.846494 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832715 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 08:53:05.846494 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832717 5028 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 08:53:05.846494 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832720 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 08:53:05.846494 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832723 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 08:53:05.846494 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832725 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 08:53:05.846494 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832728 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 08:53:05.846494 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832731 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 08:53:05.846494 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832733 5028 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 08:53:05.846494 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832736 5028 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 08:53:05.846494 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832739 5028 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 08:53:05.846494 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832741 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 08:53:05.846494 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832744 5028 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 08:53:05.846494 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832748 5028 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 08:53:05.846494 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832750 5028 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 08:53:05.846494 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832753 5028 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 08:53:05.846494 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832756 5028 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 08:53:05.846494 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832758 5028 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 08:53:05.846494 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832761 5028 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 08:53:05.847030 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832763 5028 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 08:53:05.847030 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832766 5028 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 08:53:05.847030 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832769 5028 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 08:53:05.847030 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832772 5028 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 08:53:05.847030 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832774 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 08:53:05.847030 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832777 5028 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 08:53:05.847030 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832779 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 08:53:05.847030 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832782 5028 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 08:53:05.847030 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832784 5028 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 08:53:05.847030 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832787 5028 feature_gate.go:386] unrecognized feature gate: Example Oct 30 08:53:05.847030 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832791 5028 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 08:53:05.847030 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.832817 5028 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 08:53:05.847030 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832851 5028 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 08:53:05.847030 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832856 5028 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 08:53:05.847030 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832859 5028 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 08:53:05.847030 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832863 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 08:53:05.847473 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832880 5028 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 08:53:05.847473 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832883 5028 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 08:53:05.847473 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832885 5028 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 08:53:05.847473 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832889 5028 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 08:53:05.847473 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832892 5028 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 08:53:05.847473 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832894 5028 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 08:53:05.847473 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832897 5028 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 08:53:05.847473 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832900 5028 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 08:53:05.847473 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832902 5028 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 08:53:05.847473 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832905 5028 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 08:53:05.847473 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832908 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 08:53:05.847473 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832913 5028 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 08:53:05.847473 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832916 5028 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 08:53:05.847473 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832918 5028 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 08:53:05.847473 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832921 5028 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 08:53:05.847473 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832924 5028 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 08:53:05.847473 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832926 5028 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 08:53:05.847473 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832929 5028 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 08:53:05.847473 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832932 5028 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 08:53:05.847473 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832935 5028 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 08:53:05.848092 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832938 5028 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 08:53:05.848092 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832940 5028 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 08:53:05.848092 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832943 5028 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 08:53:05.848092 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832946 5028 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 08:53:05.848092 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832948 5028 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 08:53:05.848092 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832951 5028 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 08:53:05.848092 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832954 5028 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 08:53:05.848092 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832957 5028 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 08:53:05.848092 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832961 5028 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 08:53:05.848092 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832964 5028 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 08:53:05.848092 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832967 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 08:53:05.848092 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832969 5028 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 08:53:05.848092 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832972 5028 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 08:53:05.848092 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832975 5028 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 08:53:05.848092 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832977 5028 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 08:53:05.848092 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832980 5028 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 08:53:05.848092 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832983 5028 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 08:53:05.848092 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832985 5028 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 08:53:05.848092 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832988 5028 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 08:53:05.848092 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832990 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 08:53:05.848726 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832993 5028 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 08:53:05.848726 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.832997 5028 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 08:53:05.848726 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833000 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 08:53:05.848726 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833005 5028 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 08:53:05.848726 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833009 5028 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 08:53:05.848726 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833012 5028 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 08:53:05.848726 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833015 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 08:53:05.848726 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833017 5028 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 08:53:05.848726 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833021 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 08:53:05.848726 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833024 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 08:53:05.848726 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833027 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 08:53:05.848726 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833030 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 08:53:05.848726 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833032 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 08:53:05.848726 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833035 5028 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 08:53:05.848726 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833038 5028 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 08:53:05.848726 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833040 5028 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 08:53:05.848726 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833043 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 08:53:05.848726 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833046 5028 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 08:53:05.848726 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833048 5028 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 08:53:05.849319 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833051 5028 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 08:53:05.849319 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833053 5028 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 08:53:05.849319 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833056 5028 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 08:53:05.849319 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833059 5028 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 08:53:05.849319 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833061 5028 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 08:53:05.849319 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833064 5028 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 08:53:05.849319 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833067 5028 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 08:53:05.849319 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833069 5028 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 08:53:05.849319 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833072 5028 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 08:53:05.849319 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833074 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 08:53:05.849319 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833077 5028 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 08:53:05.849319 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833079 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 08:53:05.849319 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833082 5028 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 08:53:05.849319 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833085 5028 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 08:53:05.849319 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833087 5028 feature_gate.go:386] unrecognized feature gate: Example Oct 30 08:53:05.849319 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833090 5028 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 08:53:05.849319 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833096 5028 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 08:53:05.849319 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833099 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 08:53:05.849319 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833101 5028 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 08:53:05.849319 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833104 5028 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 08:53:05.849803 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833106 5028 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 08:53:05.849803 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833109 5028 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 08:53:05.849803 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833112 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 08:53:05.849803 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833114 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 08:53:05.849803 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833117 5028 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 08:53:05.849803 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833120 5028 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 08:53:05.849803 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833123 5028 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 08:53:05.849803 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833125 5028 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 08:53:05.849803 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833128 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 08:53:05.849803 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833131 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 08:53:05.849803 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833134 5028 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 08:53:05.849803 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833137 5028 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 08:53:05.849803 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833140 5028 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 08:53:05.849803 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833143 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 08:53:05.849803 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833145 5028 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 08:53:05.849803 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833148 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 08:53:05.849803 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833151 5028 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 08:53:05.849803 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833154 5028 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 08:53:05.849803 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833156 5028 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 08:53:05.850309 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833159 5028 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 08:53:05.850309 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833162 5028 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 08:53:05.850309 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833165 5028 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 08:53:05.850309 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.833168 5028 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 08:53:05.850309 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.840784 5028 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 30 08:53:05.850309 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.840798 5028 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 30 08:53:05.850309 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.840816 5028 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 30 08:53:05.850309 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.840821 5028 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 30 08:53:05.850309 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840875 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 08:53:05.850309 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840881 5028 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 08:53:05.850309 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840884 5028 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 08:53:05.850309 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840888 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 08:53:05.850309 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840892 5028 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 08:53:05.850309 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840895 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 08:53:05.850309 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840898 5028 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 08:53:05.850309 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840901 5028 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 08:53:05.850309 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840903 5028 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 08:53:05.850309 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840906 5028 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 08:53:05.850309 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840908 5028 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 08:53:05.850775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840911 5028 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 08:53:05.850775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840914 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 08:53:05.850775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840918 5028 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 08:53:05.850775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840922 5028 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 08:53:05.850775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840942 5028 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 08:53:05.850775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840946 5028 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 08:53:05.850775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840950 5028 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 08:53:05.850775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840952 5028 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 08:53:05.850775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840955 5028 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 08:53:05.850775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840958 5028 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 08:53:05.850775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840961 5028 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 08:53:05.850775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840963 5028 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 08:53:05.850775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840971 5028 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 08:53:05.850775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840974 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 08:53:05.850775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840977 5028 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 08:53:05.850775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840979 5028 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 08:53:05.850775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840982 5028 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 08:53:05.850775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840984 5028 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 08:53:05.850775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840987 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 08:53:05.850775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840990 5028 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 08:53:05.851263 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840992 5028 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 08:53:05.851263 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840995 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 08:53:05.851263 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.840998 5028 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 08:53:05.851263 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841001 5028 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 08:53:05.851263 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841004 5028 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 08:53:05.851263 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841006 5028 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 08:53:05.851263 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841009 5028 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 08:53:05.851263 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841011 5028 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 08:53:05.851263 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841014 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 08:53:05.851263 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841016 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 08:53:05.851263 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841019 5028 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 08:53:05.851263 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841021 5028 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 08:53:05.851263 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841024 5028 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 08:53:05.851263 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841027 5028 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 08:53:05.851263 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841030 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 08:53:05.851263 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841032 5028 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 08:53:05.851263 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841035 5028 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 08:53:05.851263 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841038 5028 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 08:53:05.851263 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841040 5028 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 08:53:05.851263 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841043 5028 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 08:53:05.851746 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841047 5028 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 08:53:05.851746 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841050 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 08:53:05.851746 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841053 5028 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 08:53:05.851746 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841056 5028 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 08:53:05.851746 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841059 5028 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 08:53:05.851746 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841062 5028 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 08:53:05.851746 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841064 5028 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 08:53:05.851746 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841067 5028 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 08:53:05.851746 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841069 5028 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 08:53:05.851746 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841072 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 08:53:05.851746 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841074 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 08:53:05.851746 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841077 5028 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 08:53:05.851746 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841080 5028 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 08:53:05.851746 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841083 5028 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 08:53:05.851746 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841085 5028 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 08:53:05.851746 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841088 5028 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 08:53:05.851746 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841090 5028 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 08:53:05.851746 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841093 5028 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 08:53:05.851746 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841096 5028 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 08:53:05.852272 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841098 5028 feature_gate.go:386] unrecognized feature gate: Example Oct 30 08:53:05.852272 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841101 5028 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 08:53:05.852272 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841104 5028 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 08:53:05.852272 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841106 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 08:53:05.852272 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841109 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 08:53:05.852272 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841111 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 08:53:05.852272 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841114 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 08:53:05.852272 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841116 5028 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 08:53:05.852272 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841119 5028 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 08:53:05.852272 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841123 5028 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 08:53:05.852272 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841125 5028 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 08:53:05.852272 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841128 5028 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 08:53:05.852272 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841130 5028 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 08:53:05.852272 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841133 5028 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 08:53:05.852272 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841135 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 08:53:05.852272 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841138 5028 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 08:53:05.852272 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841140 5028 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 08:53:05.852272 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841143 5028 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 08:53:05.852272 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841146 5028 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 08:53:05.852272 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841148 5028 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 08:53:05.852775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841151 5028 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 08:53:05.852775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841153 5028 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 08:53:05.852775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841156 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 08:53:05.852775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841158 5028 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 08:53:05.852775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841161 5028 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 08:53:05.852775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841163 5028 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 08:53:05.852775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841166 5028 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 08:53:05.852775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841169 5028 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 08:53:05.852775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841171 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 08:53:05.852775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841174 5028 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 08:53:05.852775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841176 5028 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 08:53:05.852775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841179 5028 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 08:53:05.852775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841182 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 08:53:05.852775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841184 5028 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 08:53:05.852775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841187 5028 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 08:53:05.852775 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841189 5028 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 08:53:05.853149 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.841233 5028 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 08:53:05.853149 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841379 5028 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 08:53:05.853149 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841384 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 08:53:05.853149 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841388 5028 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 08:53:05.853149 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841391 5028 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 08:53:05.853149 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841393 5028 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 08:53:05.853149 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841397 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 08:53:05.853149 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841399 5028 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 08:53:05.853149 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841402 5028 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 08:53:05.853149 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841405 5028 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 08:53:05.853149 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841407 5028 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 08:53:05.853149 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841410 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 08:53:05.853149 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841413 5028 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 08:53:05.853149 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841416 5028 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 08:53:05.853149 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841418 5028 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 08:53:05.853149 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841426 5028 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 08:53:05.853554 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841428 5028 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 08:53:05.853554 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841431 5028 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 08:53:05.853554 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841434 5028 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 08:53:05.853554 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841436 5028 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 08:53:05.853554 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841439 5028 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 08:53:05.853554 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841441 5028 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 08:53:05.853554 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841444 5028 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 08:53:05.853554 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841447 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 08:53:05.853554 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841450 5028 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 08:53:05.853554 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841453 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 08:53:05.853554 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841455 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 08:53:05.853554 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841458 5028 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 08:53:05.853554 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841462 5028 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 08:53:05.853554 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841466 5028 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 08:53:05.853554 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841470 5028 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 08:53:05.853554 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841473 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 08:53:05.853554 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841476 5028 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 08:53:05.853554 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841478 5028 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 08:53:05.853554 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841481 5028 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 08:53:05.854217 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841483 5028 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 08:53:05.854217 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841486 5028 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 08:53:05.854217 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841489 5028 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 08:53:05.854217 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841491 5028 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 08:53:05.854217 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841495 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 08:53:05.854217 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841497 5028 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 08:53:05.854217 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841500 5028 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 08:53:05.854217 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841502 5028 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 08:53:05.854217 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841505 5028 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 08:53:05.854217 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841507 5028 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 08:53:05.854217 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841510 5028 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 08:53:05.854217 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841513 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 08:53:05.854217 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841517 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 08:53:05.854217 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841520 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 08:53:05.854217 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841522 5028 feature_gate.go:386] unrecognized feature gate: Example Oct 30 08:53:05.854217 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841525 5028 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 08:53:05.854217 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841527 5028 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 08:53:05.854217 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841530 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 08:53:05.854217 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841532 5028 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 08:53:05.854217 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841535 5028 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 08:53:05.854819 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841537 5028 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 08:53:05.854819 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841542 5028 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 08:53:05.854819 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841545 5028 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 08:53:05.854819 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841548 5028 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 08:53:05.854819 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841550 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 08:53:05.854819 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841553 5028 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 08:53:05.854819 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841556 5028 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 08:53:05.854819 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841558 5028 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 08:53:05.854819 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841561 5028 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 08:53:05.854819 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841563 5028 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 08:53:05.854819 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841566 5028 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 08:53:05.854819 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841569 5028 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 08:53:05.854819 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841571 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 08:53:05.854819 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841574 5028 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 08:53:05.854819 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841577 5028 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 08:53:05.854819 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841580 5028 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 08:53:05.854819 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841582 5028 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 08:53:05.854819 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841585 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 08:53:05.854819 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841588 5028 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 08:53:05.855499 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841591 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 08:53:05.855499 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841594 5028 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 08:53:05.855499 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841596 5028 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 08:53:05.855499 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841599 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 08:53:05.855499 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841602 5028 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 08:53:05.855499 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841605 5028 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 08:53:05.855499 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841609 5028 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 08:53:05.855499 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841613 5028 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 08:53:05.855499 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841616 5028 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 08:53:05.855499 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841618 5028 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 08:53:05.855499 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841621 5028 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 08:53:05.855499 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841625 5028 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 08:53:05.855499 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841628 5028 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 08:53:05.855499 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841631 5028 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 08:53:05.855499 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841635 5028 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 08:53:05.855499 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841638 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 08:53:05.855499 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841641 5028 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 08:53:05.855499 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841644 5028 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 08:53:05.855499 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841647 5028 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 08:53:05.856065 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841649 5028 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 08:53:05.856065 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841652 5028 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 08:53:05.856065 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841655 5028 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 08:53:05.856065 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841657 5028 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 08:53:05.856065 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841660 5028 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 08:53:05.856065 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841663 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 08:53:05.856065 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841665 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 08:53:05.856065 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841668 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 08:53:05.856065 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841670 5028 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 08:53:05.856065 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841673 5028 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 08:53:05.856065 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841676 5028 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 08:53:05.856065 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841678 5028 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 08:53:05.856065 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841684 5028 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 08:53:05.856065 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841687 5028 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 08:53:05.856065 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.841710 5028 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 08:53:05.856065 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841739 5028 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 08:53:05.856603 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841743 5028 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 08:53:05.856603 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841746 5028 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 08:53:05.856603 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841751 5028 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 08:53:05.856603 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841754 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 08:53:05.856603 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841757 5028 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 08:53:05.856603 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841760 5028 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 08:53:05.856603 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841763 5028 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 08:53:05.856603 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841765 5028 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 08:53:05.856603 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841768 5028 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 08:53:05.856603 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841771 5028 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 08:53:05.856603 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841773 5028 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 08:53:05.856603 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841776 5028 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 08:53:05.856603 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841780 5028 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 08:53:05.856603 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841782 5028 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 08:53:05.856603 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841785 5028 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 08:53:05.856603 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841787 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 08:53:05.856603 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841790 5028 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 08:53:05.856603 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841793 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 08:53:05.856603 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841795 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 08:53:05.856603 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841798 5028 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 08:53:05.857310 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841802 5028 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 08:53:05.857310 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841806 5028 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 08:53:05.857310 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841809 5028 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 08:53:05.857310 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841812 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 08:53:05.857310 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841814 5028 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 08:53:05.857310 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841817 5028 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 08:53:05.857310 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841819 5028 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 08:53:05.857310 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841822 5028 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 08:53:05.857310 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841825 5028 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 08:53:05.857310 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841828 5028 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 08:53:05.857310 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841830 5028 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 08:53:05.857310 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841833 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 08:53:05.857310 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841836 5028 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 08:53:05.857310 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841838 5028 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 08:53:05.857310 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841841 5028 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 08:53:05.857310 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841844 5028 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 08:53:05.857310 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841847 5028 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 08:53:05.857310 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841849 5028 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 08:53:05.857310 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841852 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 08:53:05.858048 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841854 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 08:53:05.858048 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841857 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 08:53:05.858048 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841860 5028 feature_gate.go:386] unrecognized feature gate: Example Oct 30 08:53:05.858048 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841862 5028 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 08:53:05.858048 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841865 5028 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 08:53:05.858048 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841869 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 08:53:05.858048 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841871 5028 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 08:53:05.858048 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841874 5028 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 08:53:05.858048 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841876 5028 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 08:53:05.858048 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841879 5028 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 08:53:05.858048 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841882 5028 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 08:53:05.858048 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841884 5028 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 08:53:05.858048 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841887 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 08:53:05.858048 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841889 5028 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 08:53:05.858048 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841892 5028 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 08:53:05.858048 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841894 5028 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 08:53:05.858048 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841897 5028 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 08:53:05.858048 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841900 5028 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 08:53:05.858048 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841902 5028 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 08:53:05.858048 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841905 5028 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 08:53:05.858871 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841907 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 08:53:05.858871 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841910 5028 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 08:53:05.858871 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841914 5028 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 08:53:05.858871 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841917 5028 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 08:53:05.858871 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841919 5028 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 08:53:05.858871 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841922 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 08:53:05.858871 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841924 5028 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 08:53:05.858871 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841927 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 08:53:05.858871 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841930 5028 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 08:53:05.858871 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841933 5028 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 08:53:05.858871 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841936 5028 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 08:53:05.858871 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841938 5028 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 08:53:05.858871 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841941 5028 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 08:53:05.858871 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841945 5028 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 08:53:05.858871 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841948 5028 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 08:53:05.858871 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841951 5028 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 08:53:05.858871 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841954 5028 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 08:53:05.858871 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841958 5028 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 08:53:05.858871 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841961 5028 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 08:53:05.859788 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841964 5028 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 08:53:05.859788 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841967 5028 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 08:53:05.859788 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841970 5028 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 08:53:05.859788 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841973 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 08:53:05.859788 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841975 5028 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 08:53:05.859788 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841978 5028 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 08:53:05.859788 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841981 5028 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 08:53:05.859788 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841984 5028 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 08:53:05.859788 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841987 5028 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 08:53:05.859788 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841989 5028 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 08:53:05.859788 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841992 5028 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 08:53:05.859788 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841994 5028 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 08:53:05.859788 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841997 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 08:53:05.859788 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.841999 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 08:53:05.859788 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.842002 5028 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 08:53:05.859788 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.842004 5028 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 08:53:05.859788 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.842007 5028 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 08:53:05.859788 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.842011 5028 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 08:53:05.859788 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.842014 5028 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 08:53:05.860468 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.842017 5028 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 08:53:05.860468 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.842021 5028 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 08:53:05.860468 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.842024 5028 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 08:53:05.860468 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.842026 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 08:53:05.860468 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.842029 5028 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 08:53:05.860468 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.842031 5028 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 08:53:05.860468 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.842034 5028 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 08:53:05.860468 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:05.842036 5028 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 08:53:05.860468 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.842087 5028 server.go:957] "Client rotation is on, will bootstrap in background" Oct 30 08:53:05.860468 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.843018 5028 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Oct 30 08:53:05.860468 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.843080 5028 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Oct 30 08:53:05.860468 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.843271 5028 server.go:1014] "Starting client certificate rotation" Oct 30 08:53:05.860468 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.843439 5028 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 08:53:05.860468 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.843497 5028 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 08:47:25 +0000 UTC" deadline="2028-06-26 20:43:40.194589651 +0000 UTC" Oct 30 08:53:05.860468 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.843535 5028 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14531h50m34.35105819s" Oct 30 08:53:05.860468 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.843741 5028 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 08:53:05.860880 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.844852 5028 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 08:53:05.860880 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.846161 5028 log.go:25] "Validated CRI v1 runtime API" Oct 30 08:53:05.860880 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.847831 5028 log.go:25] "Validated CRI v1 image API" Oct 30 08:53:05.860880 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.848505 5028 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 30 08:53:05.860880 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.850885 5028 fs.go:135] Filesystem UUIDs: map[24637759-fa63-4973-b3f8-564ac474b0a9:/dev/nvme0n1p4 561aa8b2-00a8-4a79-9474-41dd58af7988:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Oct 30 08:53:05.861100 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.850904 5028 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/07d862f38c631a13985bebe9c8cc32ab4213a01ecb767999275d0cc2ab1408e8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/07d862f38c631a13985bebe9c8cc32ab4213a01ecb767999275d0cc2ab1408e8/userdata/shm major:0 minor:356 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/09b3233893c8d89b74bf0284dbde4a79ce46329a6a7aef10730003bf21088352/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/09b3233893c8d89b74bf0284dbde4a79ce46329a6a7aef10730003bf21088352/userdata/shm major:0 minor:226 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/121f7fab5bb1e5a04f36ea661e038f35cd811b86c3fe91ce5023a9f0988cd0e7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/121f7fab5bb1e5a04f36ea661e038f35cd811b86c3fe91ce5023a9f0988cd0e7/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/268bad2dccb160593df725bc54f203be808816c33bbc079bd36baff74535eebe/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/268bad2dccb160593df725bc54f203be808816c33bbc079bd36baff74535eebe/userdata/shm major:0 minor:78 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/26cf68cf2779d64cedc600a9d7c405c7fa201e6dc5701586d2c476d63ff5761c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/26cf68cf2779d64cedc600a9d7c405c7fa201e6dc5701586d2c476d63ff5761c/userdata/shm major:0 minor:91 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2f6f21bda934ec6d1430dc441faaf1f443cdfde905181713a4c7f9f0ba19c7ca/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2f6f21bda934ec6d1430dc441faaf1f443cdfde905181713a4c7f9f0ba19c7ca/userdata/shm major:0 minor:234 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3246ff75e3a8ecdd66a5d5b3519c4d7e8c04396a5db54a8021811a7c0388235d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3246ff75e3a8ecdd66a5d5b3519c4d7e8c04396a5db54a8021811a7c0388235d/userdata/shm major:0 minor:79 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3a4e0aecdc43d988d2cb18885041202b00500214f0601e37b37c02aea69116a1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3a4e0aecdc43d988d2cb18885041202b00500214f0601e37b37c02aea69116a1/userdata/shm major:0 minor:240 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/412765416b673a60659d5b15104da378252c47976ca249b70bd4ffb93e201404/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/412765416b673a60659d5b15104da378252c47976ca249b70bd4ffb93e201404/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/41c9d832bdb850330f9fd2eab85b954340c405b2febfbf6fd93d1a4d97e07764/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/41c9d832bdb850330f9fd2eab85b954340c405b2febfbf6fd93d1a4d97e07764/userdata/shm major:0 minor:293 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/43a7f3829f40c80176e91493d652c16208ee301faf26f992addec5eafbf5c463/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/43a7f3829f40c80176e91493d652c16208ee301faf26f992addec5eafbf5c463/userdata/shm major:0 minor:242 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5945c4e50cabb13a2578a7442d267550039459ddf667bf50c10bdbb79de1a588/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5945c4e50cabb13a2578a7442d267550039459ddf667bf50c10bdbb79de1a588/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/637c8cb7d8f5c83b8ae118fd9e09ba89952b3df9ecd1e395a6025274cde8d31d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/637c8cb7d8f5c83b8ae118fd9e09ba89952b3df9ecd1e395a6025274cde8d31d/userdata/shm major:0 minor:51 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/64e9d993e448bcd3f06d71a3ccba8c09a0d57ff5d70f299377cde93671d14242/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/64e9d993e448bcd3f06d71a3ccba8c09a0d57ff5d70f299377cde93671d14242/userdata/shm major:0 minor:338 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/776acc559fef33bc0c0e47f3cf3756b2fbb7441efb3820ec8909eeb782ec13a7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/776acc559fef33bc0c0e47f3cf3756b2fbb7441efb3820ec8909eeb782ec13a7/userdata/shm major:0 minor:246 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7e9f5df8528b565fc34b85fc03d86bcde956c215f195c2e8cdd9c47a99a54ee7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7e9f5df8528b565fc34b85fc03d86bcde956c215f195c2e8cdd9c47a99a54ee7/userdata/shm major:0 minor:213 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7f9636f0e5c062922c70425d1f25451433182f735903ca2da75023ab1aacae3b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7f9636f0e5c062922c70425d1f25451433182f735903ca2da75023ab1aacae3b/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8d11ce2c4efb606e91c0daf3eec2604caf3c01f0af9d441c969e4031bdbb9ed5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8d11ce2c4efb606e91c0daf3eec2604caf3c01f0af9d441c969e4031bdbb9ed5/userdata/shm major:0 minor:236 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9eaa07ad7d6305787b984aa73fde69d5e3e099b54082b4e79bdbaba59fea49bf/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9eaa07ad7d6305787b984aa73fde69d5e3e099b54082b4e79bdbaba59fea49bf/userdata/shm major:0 minor:238 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ab9b5428b175e275b196cbd5eba6bf78a9f024864a577e072f21f12f280eb063/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ab9b5428b175e275b196cbd5eba6bf78a9f024864a577e072f21f12f280eb063/userdata/shm major:0 minor:316 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b0b71ab7a72b2b833d5442fc6da25a210b12377be96050ceafaccc869e4069d6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b0b71ab7a72b2b833d5442fc6da25a210b12377be96050ceafaccc869e4069d6/userdata/shm major:0 minor:296 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c62189c32b3cc816fe6a0e7861b154718b899119ced51829b3ffa2e44217f4fe/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c62189c32b3cc816fe6a0e7861b154718b899119ced51829b3ffa2e44217f4fe/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d3a65f5bada964910f26e970d3c955245fca061b87d40b8d86fa7e504140c716/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d3a65f5bada964910f26e970d3c955245fca061b87d40b8d86fa7e504140c716/userdata/shm major:0 minor:74 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/dc2d5bcd8177a7109bebf4d61f6dca0efdee0b671164accf50bc26f405175519/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/dc2d5bcd8177a7109bebf4d61f6dca0efdee0b671164accf50bc26f405175519/userdata/shm major:0 minor:340 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e5bda62c1d72ceaf8519d55f19e57128fd5be926be6b851cbd54463048f1879a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e5bda62c1d72ceaf8519d55f19e57128fd5be926be6b851cbd54463048f1879a/userdata/shm major:0 minor:232 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e8efe18bd3be6067ec0c76817f186926c793f7daaf79a269b6ed68c641a6ff71/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e8efe18bd3be6067ec0c76817f186926c793f7daaf79a269b6ed68c641a6ff71/userdata/shm major:0 minor:243 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/06e7e9e5-ebd3-4e67-95ba-03eeebcee619/volumes/kubernetes.io~projected/kube-api-access-wrlct:{mountpoint:/var/lib/kubelet/pods/06e7e9e5-ebd3-4e67-95ba-03eeebcee619/volumes/kubernetes.io~projected/kube-api-access-wrlct major:0 minor:228 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/06e7e9e5-ebd3-4e67-95ba-03eeebcee619/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/06e7e9e5-ebd3-4e67-95ba-03eeebcee619/volumes/kubernetes.io~secret/cert major:0 minor:214 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/094983e9-88e8-4881-be25-8ba5d8bc0979/volumes/kubernetes.io~projected/kube-api-access-vwsgv:{mountpoint:/var/lib/kubelet/pods/094983e9-88e8-4881-be25-8ba5d8bc0979/volumes/kubernetes.io~projected/kube-api-access-vwsgv major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/097227b5-19cd-449b-88a1-ce703f741481/volumes/kubernetes.io~projected/kube-api-access-f529x:{mountpoint:/var/lib/kubelet/pods/097227b5-19cd-449b-88a1-ce703f741481/volumes/kubernetes.io~projected/kube-api-access-f529x major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0a14ed2f-0a6c-4ed6-b05a-54f733f19453/volumes/kubernetes.io~projected/kube-api-access-97b9l:{mountpoint:/var/lib/kubelet/pods/0a14ed2f-0a6c-4ed6-b05a-54f733f19453/volumes/kubernetes.io~projected/kube-api-access-97b9l major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0c1ebb77-bd76-4329-ac03-87f60b688431/volumes/kubernetes.io~projected/kube-api-access-9xlkp:{mountpoint:/var/lib/kubelet/pods/0c1ebb77-bd76-4329-ac03-87f60b688431/volumes/kubernetes.io~projected/kube-api-access-9xlkp major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0c1ebb77-bd76-4329-ac03-87f60b688431/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/0c1ebb77-bd76-4329-ac03-87f60b688431/volumes/kubernetes.io~secret/serving-cert major:0 minor:215 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0df87d60-113c-4039-93a4-06205c202a73/volumes/kubernetes.io~projected/kube-api-access-dvxv8:{mountpoint:/var/lib/kubelet/pods/0df87d60-113c-4039-93a4-06205c202a73/volumes/kubernetes.io~projected/kube-api-access-dvxv8 major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0e9e7178-b316-431d-851b-565dfc341afa/volumes/kubernetes.io~projected/kube-api-access-tm8s9:{mountpoint:/var/lib/kubelet/pods/0e9e7178-b316-431d-851b-565dfc341afa/volumes/kubernetes.io~projected/kube-api-access-tm8s9 major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/26e2f6af-5dbf-44c2-9acf-58c70be503bf/volumes/kubernetes.io~projected/kube-api-access-ttr59:{mountpoint:/var/lib/kubelet/pods/26e2f6af-5dbf-44c2-9acf-58c70be503bf/volumes/kubernetes.io~projected/kube-api-access-ttr59 major:0 minor:295 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3447411a-b1de-406a-9df8-4d5e565add87/volumes/kubernetes.io~projected/kube-api-access-sxv9t:{mountpoint:/var/lib/kubelet/pods/3447411a-b1de-406a-9df8-4d5e565add87/volumes/kubernetes.io~projected/kube-api-access-sxv9t major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/401c58ab-82cc-4baf-9d77-31e18a3a5cb7/volumes/kubernetes.io~projected/kube-api-access-6xwjk:{mountpoint:/var/lib/kubelet/pods/401c58ab-82cc-4baf-9d77-31e18a3a5cb7/volumes/kubernetes.io~projected/kube-api-access-6xwjk major:0 minor:327 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/55ed1a9f-f5a7-44fd-8b91-01d4e25f651a/volumes/kubernetes.io~projected/kube-api-access-gq7cl:{mountpoint:/var/lib/kubelet/pods/55ed1a9f-f5a7-44fd-8b91-01d4e25f651a/volumes/kubernetes.io~projected/kube-api-access-gq7cl major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/55ed1a9f-f5a7-44fd-8b91-01d4e25f651a/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/55ed1a9f-f5a7-44fd-8b91-01d4e25f651a/volumes/kubernetes.io~secret/serving-cert major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/80da5ad0-0b1d-40da-82b8-97202a58ee9f/volumes/kubernetes.io~projected/kube-api-access-72tnd:{mountpoint:/var/lib/kubelet/pods/80da5ad0-0b1d-40da-82b8-97202a58ee9f/volumes/kubernetes.io~projected/kube-api-access-72tnd major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/80da5ad0-0b1d-40da-82b8-97202a58ee9f/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/80da5ad0-0b1d-40da-82b8-97202a58ee9f/volumes/kubernetes.io~secret/serving-cert major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d/volumes/kubernetes.io~projected/kube-api-access-hzbp9:{mountpoint:/var/lib/kubelet/pods/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d/volumes/kubernetes.io~projected/kube-api-access-hzbp9 major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb/volumes/kubernetes.io~projected/kube-api-access-7wlpn:{mountpoint:/var/lib/kubelet/pods/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb/volumes/kubernetes.io~projected/kube-api-access-7wlpn major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/af7f9e2a-c57b-4396-bd6e-40c05cf1ef42/volumes/kubernetes.io~projected/kube-api-access-zvpsp:{mountpoint:/var/lib/kubelet/pods/af7f9e2a-c57b-4396-bd6e-40c05cf1ef42/volumes/kubernetes.io~projected/kube-api-access-zvpsp major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c3e38a1c-cf20-4170-a71e-5fdc414e2343/volumes/kubernetes.io~projected/kube-api-access-rwf4v:{mountpoint:/var/lib/kubelet/pods/c3e38a1c-cf20-4170-a71e-5fdc414e2343/volumes/kubernetes.io~projected/kube-api-access-rwf4v major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c3e38a1c-cf20-4170-a71e-5fdc414e2343/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/c3e38a1c-cf20-4170-a71e-5fdc414e2343/volumes/kubernetes.io~secret/serving-cert major:0 minor:221 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c444edaf-cb41-4707-a33f-f181873a6b01/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/c444edaf-cb41-4707-a33f-f181873a6b01/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c444edaf-cb41-4707-a33f-f181873a6b01/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/c444edaf-cb41-4707-a33f-f181873a6b01/volumes/kubernetes.io~empty-dir/tmp major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c444edaf-cb41-4707-a33f-f181873a6b01/volumes/kubernetes.io~projected/kube-api-access-4q2kt:{mountpoint:/var/lib/kubelet/pods/c444edaf-cb41-4707-a33f-f181873a6b01/volumes/kubernetes.io~projected/kube-api-access-4q2kt major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cc213059-e0bc-4602-8d5c-6c79e962d6a5/volumes/kubernetes.io~projected/kube-api-access-5rh8c:{mountpoint:/var/lib/kubelet/pods/cc213059-e0bc-4602-8d5c-6c79e962d6a5/volumes/kubernetes.io~projected/kube-api-access-5rh8c major:0 minor:326 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cd1a7b7e-e1dd-4361-9091-b2983dff06da/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/cd1a7b7e-e1dd-4361-9091-b2983dff06da/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:230 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cd1a7b7e-e1dd-4361-9091-b2983dff06da/volumes/kubernetes.io~projected/kube-api-access-nh9pf:{mountpoint:/var/lib/kubelet/pods/cd1a7b7e-e1dd-4361-9091-b2983dff06da/volumes/kubernetes.io~projected/kube-api-access-nh9pf major:0 minor:222 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cd1a7b7e-e1dd-4361-9091-b2983dff06da/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/cd1a7b7e-e1dd-4361-9091-b2983dff06da/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:216 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cd1a7b7e-e1dd-4361-9091-b2983dff06da/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/cd1a7b7e-e1dd-4361-9091-b2983dff06da/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:219 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d03bffbe-b198-427f-86cb-e854d42260a5/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/d03bffbe-b198-427f-86cb-e854d42260a5/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d03bffbe-b198-427f-86cb-e854d42260a5/volumes/kubernetes.io~projected/kube-api-access-gxbkp:{mountpoint:/var/lib/kubelet/pods/d03bffbe-b198-427f-86cb-e854d42260a5/volumes/kubernetes.io~projected/kube-api-access-gxbkp major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d03bffbe-b198-427f-86cb-e854d42260a5/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/d03bffbe-b198-427f-86cb-e854d42260a5/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d4b82adb-d2fe-406a-a9e9-ea28cb3679ff/volumes/kubernetes.io~projected/kube-api-access-lwwbq:{mountpoint:/var/lib/kubelet/pods/d4b82adb-d2fe-406a-a9e9-ea28cb3679ff/volumes/kubernetes.io~projected/kube-api-access-lwwbq major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/da1dbfc6-084c-467f-84c2-4cf1cdea8c54/volumes/kubernetes.io~projected/kube-api-access-nsdlm:{mountpoint:/var/lib/kubelet/pods/da1dbfc6-084c-467f-84c2-4cf1cdea8c54/volumes/kubernetes.io~projected/kube-api-access-nsdlm major:0 minor:351 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/da1dbfc6-084c-467f-84c2-4cf1cdea8c54/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/da1dbfc6-084c-467f-84c2-4cf1cdea8c54/volumes/kubernetes.io~secret/signing-key major:0 minor:349 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e02c520e-2276-440e-8f36-1047f78af40a/volumes/kubernetes.io~projected/kube-api-access-dpszg:{mountpoint:/var/lib/kubelet/pods/e02c520e-2276-440e-8f36-1047f78af40a/volumes/kubernetes.io~projected/kube-api-access-dpszg major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e0eac401-f877-428f-b85c-271fa0aca679/volumes/kubernetes.io~projected/kube-api-access-6z9bt:{mountpoint:/var/lib/kubelet/pods/e0eac401-f877-428f-b85c-271fa0aca679/volumes/kubernetes.io~projected/kube-api-access-6z9bt major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e1be1b32-6246-4b96-a707-6df15d3d950f/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/e1be1b32-6246-4b96-a707-6df15d3d950f/volumes/kubernetes.io~secret/agent-certs major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e5371073-8444-4462-93f1-2cb7cfd54d9f/volumes/kubernetes.io~projected/kube-api-access-4tlk8:{mountpoint:/var/lib/kubelet/pods/e5371073-8444-4462-93f1-2cb7cfd54d9f/volumes/kubernetes.io~projected/kube-api-access-4tlk8 major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e5ddc593-a1bb-4f35-be9e-77b6f9486945/volumes/kubernetes.io~projected/kube-api-access-b2w8s:{mountpoint:/var/lib/kubelet/pods/e5ddc593-a1bb-4f35-be9e-77b6f9486945/volumes/kubernetes.io~projected/kube-api-access-b2w8s major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f039cecc-3f4f-4e9b-94e5-5d46918f9487/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/f039cecc-3f4f-4e9b-94e5-5d46918f9487/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f/volumes/kubernetes.io~projected/kube-api-access-zh7rw:{mountpoint:/var/lib/kubelet/pods/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f/volumes/kubernetes.io~projected/kube-api-access-zh7rw major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f/volumes/kubernetes.io~secret/default-certificate major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f/volumes/kubernetes.io~secret/stats-auth major:0 minor:220 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f8c3809a-d264-4139-8805-9b25c0f50f6a/volumes/kubernetes.io~projected/kube-api-access-hqwgq:{mountpoint:/var/lib/kubelet/pods/f8c3809a-d264-4139-8805-9b25c0f50f6a/volumes/kubernetes.io~projected/kube-api-access-hqwgq major:0 minor:304 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fc5de6fe-b01e-4773-acc5-e04e5af9e11a/volumes/kubernetes.io~projected/kube-api-access-6mq2k:{mountpoint:/var/lib/kubelet/pods/fc5de6fe-b01e-4773-acc5-e04e5af9e11a/volumes/kubernetes.io~projected/kube-api-access-6mq2k major:0 minor:309 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fdbaa900-aa36-4984-a2f3-c5c973e75d8a/volumes/kubernetes.io~projected/kube-api-access-mt6ng:{mountpoint:/var/lib/kubelet/pods/fdbaa900-aa36-4984-a2f3-c5c973e75d8a/volumes/kubernetes.io~projected/kube-api-access-mt6ng major:0 minor:231 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fece1d69-0824-4ecc-ad78-cea4e19bde61/volumes/kubernetes.io~projected/kube-api-access-wlspr:{mountpoint:/var/lib/kubelet/pods/fece1d69-0824-4ecc-ad78-cea4e19bde61/volumes/kubernetes.io~projected/kube-api-access-wlspr major:0 minor:61 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/860abb982989681d1ae6d7ec6f4a67afef71f512081b874809d8ce247b1ae1e0/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/db09e93521017f9eb242168340d5c41076c70e93404dc13376c077b82197570c/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/c6bd9e5a745a7ed0d22fe7b36c1c11228e161f263cc654e1f15aec5d451ca79c/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/37f72d19973c236aa60319a7c02a98aa29940739de52e662c5e310449d51c17f/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/4a1cd8150750b91b0b7d1611ca3a6fa7acfd639e18bc9450a662f75d3dca142e/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/80d2939c8308113a4d8e8a3f4c104b056502086e4e2b826378b2263192f0d484/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/cfca62343b5053f17c1dd350976b4e588fcd5b45a6cf87d483b341268ac7dbf0/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/21b0ae86cb9cff7d7f49a51200481480b354d5a28a2ff8b373b36cdae43f2fa4/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/9394f2d3709b97da6f7c6774cf1229067f88763dbd21f12fc7a63ea858bbb78d/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/66af2eb6e98ff0ebefa8a04680a3c5496e04511e475899ae0fc6949b8d5ce360/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/2eca365d391de7ab857b3be842220219262f475f1142d6d2de253e102d467d8b/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-143:{mountpoint:/var/lib/containers/storage/overlay/503d8d4d80b94bb4aeb3c343eec6f2690253625c54f608d50434b0373e403044/merged major:0 minor:143 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/195f66ad5358801a7b22b4fafa60e6ef6819aa1260a2d09f581e208d2ce66963/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/ecba3e0901adec2f87a4b31279c277e548e6835b23052b850fb04b798e81139f/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/a47dbbd2067d66725abef91db30546af208a50e3bfbdaf206d5aab54addf9637/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/5025102c1a956b159d2a3a3361b01a87796cacabe03beda0bcc030aab7abc5b9/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/9d6b4855f2f4fe537920f1d02a600f6f524fa9625d23219173196adb66a68ba3/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/415843ed4fe42d4b9202b1807d177c25cb08a5b96a4db81dda6154ccc1a86e47/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/35b27b6647c1874d76651f58dae399b4e2f1e2809ca3be52225aba01d8e8912f/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-184:{mountpoint:/var/lib/containers/storage/overlay/40bfaa45ebe42bb1171442897f27320826b4d0267b146ddd15e5ca6e2c24a9d4/merged major:0 minor:184 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/78ee7ee65ede703be601c8671c6196aa9b7a4acc358f5e3c4a15786d9d8e2133/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/f1c8ac9b6b144d74a16a155ce135c17e84ea6f4988a03b4c59a446a5a710cff7/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/2734ebc8ff3afb217b0efba64adf881da13e79327b0bca6b86062e287d9510c9/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/14315a5cda6dcfdb9e56f3af6ab002bb70f65ce8cd649d2daeedca812008e167/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/d4366be69f5b9bca470251c2e3eb52d41b332178d26945d98a13eebb901caf83/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/cf74fe60055b63f4201b1d669f9b3d4dc7f5a2f472be521cea10d0d9617c57cf/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/d084253ceb6256ad0a8404d08df3703968adc3febc32e83519e8d5709a5a4bad/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/a8d1a83171298c7844de662c2da51ac79cb3995136ec0718084508112dfcbdf4/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-265:{mountpoint:/var/lib/containers/storage/overlay/4d5f7166c47920e7b64199e3df52198769153c1d07caa64bb145576041997b00/merged major:0 minor:265 fsType:overlay blockSize:0} overlay_0-268:{mountpoint:/var/lib/containers/storage/overlay/37478d4085fe8cf2dc0ed1d229e8aaff067573cac256aea9ccdb24d77cc6e8bd/merged major:0 minor:268 fsType:overlay blockSize:0} overlay_0-270:{mountpoint:/var/lib/containers/storage/overlay/2bb41debf5c22975a3bc141210c5b63a60713f5b2882696fd8159f0266dcf398/merged major:0 minor:270 fsType:overlay blockSize:0} overlay_0-276:{mountpoint:/var/lib/containers/storage/overlay/1266bca0f7b584c5933a919f5b36e918d70824469426da89b6a73bb9089c3fab/merged major:0 minor:276 fsType:overlay blockSize:0} overlay_0-281:{mountpoint:/var/lib/containers/storage/overlay/db68578087d9d951ea4b194e27b250ed645ea58dcf89e3fb9654a0fe2b1e015f/merged major:0 minor:281 fsType:overlay blockSize:0} overlay_0-284:{mountpoint:/var/lib/containers/storage/overlay/3888d94d7201839d6ec82408d8be4a969a11d27f790b875ad19649cd23fdc01a/merged major:0 minor:284 fsType:overlay blockSize:0} overlay_0-286:{mountpoint:/var/lib/containers/storage/overlay/aea7069b67ecfe3f84663a4b0772421cc714d48a920541e8c0bb48427cb8036c/merged major:0 minor:286 fsType:overlay blockSize:0} overlay_0-298:{mountpoint:/var/lib/containers/storage/overlay/061b760b6c03072084e9d58c6dad6b298a40c849c7c10ed29a090bc86011d7a2/merged major:0 minor:298 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/43592314d2f870aa4ed0f026ac794c07b2af014e55d127f539903833430c582d/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-302:{mountpoint:/var/lib/containers/storage/overlay/be982c8ba0b8222550722a4061bdf208189b04f0e0aa51bf3a6f08fa456a9d58/merged major:0 minor:302 fsType:overlay blockSize:0} overlay_0-310:{mountpoint:/var/lib/containers/storage/overlay/db5632517205c4e9d0624d385e7dd1b5d11912cdcd76a88aef26098dc047bfb8/merged major:0 minor:310 fsType:overlay blockSize:0} overlay_0-312:{mountpoint:/var/lib/containers/storage/overlay/88e94b17289c2a7752237d0da5c425e4ea4655896d4ea9087588072211517cfa/merged major:0 minor:312 fsType:overlay blockSize:0} overlay_0-314:{mountpoint:/var/lib/containers/storage/overlay/f1aee82e132bde1f4b6854d22d9cadebad66779fdc71be1b6e769cbebc5b2c08/merged major:0 minor:314 fsType:overlay blockSize:0} overlay_0-318:{mountpoint:/var/lib/containers/storage/overlay/4369681dd6cd30c8a8f19944dbdf18e2fdf4e58d0a15f406e40dc51b01516b94/merged major:0 minor:318 fsType:overlay blockSize:0} overlay_0-324:{mountpoint:/var/lib/containers/storage/overlay/4033ce9e27273f29d1fdff0d1db1e8410fdfea74f14126eb0175300c94522ced/merged major:0 minor:324 fsType:overlay blockSize:0} overlay_0-336:{mountpoint:/var/lib/containers/storage/overlay/7816b7efd902bff6dea6a0bd3725a13f17a9082d3ebab3bd77db27044d95acc4/merged major:0 minor:336 fsType:overlay blockSize:0} overlay_0-352:{mountpoint:/var/lib/containers/storage/overlay/1621b620ce2fd8f2d2493cc569ffe4ea4f6f46b7db7abca9f4853433fff04b7a/merged major:0 minor:352 fsType:overlay blockSize:0} overlay_0-354:{mountpoint:/var/lib/containers/storage/overlay/380ffebaaa00ba35bb481506ba2280dcac9e03174cc19e02486a51eea078d198/merged major:0 minor:354 fsType:overlay blockSize:0} overlay_0-358:{mountpoint:/var/lib/containers/storage/overlay/dd36d221e8a901ad25cd0e78fb0de5caa4b9c716fa423d3bf332d3328ac41094/merged major:0 minor:358 fsType:overlay blockSize:0} overlay_0-360:{mountpoint:/var/lib/containers/storage/overlay/f5359067ca06a72216895b6cab24d5b62b298ad78e538876c9b47edfb62f1123/merged major:0 minor:360 fsType:overlay blockSize:0} overlay_0-362:{mountpoint:/var/lib/containers/storage/overlay/7639aa44dd85cd3cd90f37e6a26061d949cff6821939b640dc17da30f8ba9aaa/merged major:0 minor:362 fsType:overlay blockSize:0} overlay_0-368:{mountpoint:/var/lib/containers/storage/overlay/1765a46b2facf918ec37263306a470f3460757e623b593f1b9f134abdc20d731/merged major:0 minor:368 fsType:overlay blockSize:0} overlay_0-374:{mountpoint:/var/lib/containers/storage/overlay/72c805eca83d8c4a0d3dc56219a2179227802fe1dd69785a2873194edb3f1d03/merged major:0 minor:374 fsType:overlay blockSize:0} overlay_0-376:{mountpoint:/var/lib/containers/storage/overlay/5013b155a8be32ff7dd1323de513f27a86f1a62c49dc71f5789c3d58f8baf3c4/merged major:0 minor:376 fsType:overlay blockSize:0} overlay_0-49:{mountpoint:/var/lib/containers/storage/overlay/c8a298209e1633fa15555d6b507d1ade225fb2ddb71b45f00239a3ac21c91a6a/merged major:0 minor:49 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/f6fc932d4a862076d638a498dce120788e7aae9551781a7a9e998fbb057a28ae/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/0028adbf375a9dd57ba3c33e4dec3419a33e403ed56a9df3d59c8b35122140b1/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-72:{mountpoint:/var/lib/containers/storage/overlay/9e194b7f2aef59b92b8c620ff6e85844f1c44015ed1d30900aeeda04720ae8d5/merged major:0 minor:72 fsType:overlay blockSize:0} overlay_0-76:{mountpoint:/var/lib/containers/storage/overlay/18df8b8c7854bda9be3de06caa5beacbf670a1852835f9d296b975a0b9e271f7/merged major:0 minor:76 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/b09703e02bae4c8fa58aa74ae4424ccb733b273c7a94958c07454196e47095a0/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/1e6dce700faae4a83cca12e49fdbba1d5f7e5dcdadce473d02b9dcb3f189b298/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/67f47ec4275386bd8f0b48d62083da8cae41258cd0a106e73954889c8227a821/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-94:{mountpoint:/var/lib/containers/storage/overlay/ce0292312b67a4370503b6a20b06aaee1f914a911e4794bd71b46e32be77ec7a/merged major:0 minor:94 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/7367fe24cb98143033983cc0b2e3ceebf1b85d0f6dfb9cd22ba76c9187ada3d9/merged major:0 minor:96 fsType:overlay blockSize:0}] Oct 30 08:53:05.861522 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.859479 5028 manager.go:217] Machine: {Timestamp:2026-10-30 08:53:05.858493607 +0000 UTC m=+0.074605964 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102954 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27eeb944fb90d19bdcb2f164757b65 SystemUUID:ec27eeb9-44fb-90d1-9bdc-b2f164757b65 BootID:7d7dda57-ffc8-4a7f-8f0f-e08d7eaa0aa4 Filesystems:[{Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d/volumes/kubernetes.io~projected/kube-api-access-hzbp9 DeviceMajor:0 DeviceMinor:206 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/c3e38a1c-cf20-4170-a71e-5fdc414e2343/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:221 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/fdbaa900-aa36-4984-a2f3-c5c973e75d8a/volumes/kubernetes.io~projected/kube-api-access-mt6ng DeviceMajor:0 DeviceMinor:231 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3447411a-b1de-406a-9df8-4d5e565add87/volumes/kubernetes.io~projected/kube-api-access-sxv9t DeviceMajor:0 DeviceMinor:62 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e5ddc593-a1bb-4f35-be9e-77b6f9486945/volumes/kubernetes.io~projected/kube-api-access-b2w8s DeviceMajor:0 DeviceMinor:224 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/da1dbfc6-084c-467f-84c2-4cf1cdea8c54/volumes/kubernetes.io~projected/kube-api-access-nsdlm DeviceMajor:0 DeviceMinor:351 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/26cf68cf2779d64cedc600a9d7c405c7fa201e6dc5701586d2c476d63ff5761c/userdata/shm DeviceMajor:0 DeviceMinor:91 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-94 DeviceMajor:0 DeviceMinor:94 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-270 DeviceMajor:0 DeviceMinor:270 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c62189c32b3cc816fe6a0e7861b154718b899119ced51829b3ffa2e44217f4fe/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d03bffbe-b198-427f-86cb-e854d42260a5/volumes/kubernetes.io~projected/kube-api-access-gxbkp DeviceMajor:0 DeviceMinor:60 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cd1a7b7e-e1dd-4361-9091-b2983dff06da/volumes/kubernetes.io~projected/kube-api-access-nh9pf DeviceMajor:0 DeviceMinor:222 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-314 DeviceMajor:0 DeviceMinor:314 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-358 DeviceMajor:0 DeviceMinor:358 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d4b82adb-d2fe-406a-a9e9-ea28cb3679ff/volumes/kubernetes.io~projected/kube-api-access-lwwbq DeviceMajor:0 DeviceMinor:210 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0a14ed2f-0a6c-4ed6-b05a-54f733f19453/volumes/kubernetes.io~projected/kube-api-access-97b9l DeviceMajor:0 DeviceMinor:203 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ab9b5428b175e275b196cbd5eba6bf78a9f024864a577e072f21f12f280eb063/userdata/shm DeviceMajor:0 DeviceMinor:316 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-336 DeviceMajor:0 DeviceMinor:336 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-76 DeviceMajor:0 DeviceMinor:76 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/80da5ad0-0b1d-40da-82b8-97202a58ee9f/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:202 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/06e7e9e5-ebd3-4e67-95ba-03eeebcee619/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:214 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-268 DeviceMajor:0 DeviceMinor:268 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/637c8cb7d8f5c83b8ae118fd9e09ba89952b3df9ecd1e395a6025274cde8d31d/userdata/shm DeviceMajor:0 DeviceMinor:51 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/fece1d69-0824-4ecc-ad78-cea4e19bde61/volumes/kubernetes.io~projected/kube-api-access-wlspr DeviceMajor:0 DeviceMinor:61 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e8efe18bd3be6067ec0c76817f186926c793f7daaf79a269b6ed68c641a6ff71/userdata/shm DeviceMajor:0 DeviceMinor:243 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e5bda62c1d72ceaf8519d55f19e57128fd5be926be6b851cbd54463048f1879a/userdata/shm DeviceMajor:0 DeviceMinor:232 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-302 DeviceMajor:0 DeviceMinor:302 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/64e9d993e448bcd3f06d71a3ccba8c09a0d57ff5d70f299377cde93671d14242/userdata/shm DeviceMajor:0 DeviceMinor:338 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-281 DeviceMajor:0 DeviceMinor:281 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/268bad2dccb160593df725bc54f203be808816c33bbc079bd36baff74535eebe/userdata/shm DeviceMajor:0 DeviceMinor:78 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/55ed1a9f-f5a7-44fd-8b91-01d4e25f651a/volumes/kubernetes.io~projected/kube-api-access-gq7cl DeviceMajor:0 DeviceMinor:208 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/0c1ebb77-bd76-4329-ac03-87f60b688431/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:215 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/06e7e9e5-ebd3-4e67-95ba-03eeebcee619/volumes/kubernetes.io~projected/kube-api-access-wrlct DeviceMajor:0 DeviceMinor:228 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-284 DeviceMajor:0 DeviceMinor:284 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/dc2d5bcd8177a7109bebf4d61f6dca0efdee0b671164accf50bc26f405175519/userdata/shm DeviceMajor:0 DeviceMinor:340 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-49 DeviceMajor:0 DeviceMinor:49 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e0eac401-f877-428f-b85c-271fa0aca679/volumes/kubernetes.io~projected/kube-api-access-6z9bt DeviceMajor:0 DeviceMinor:66 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-143 DeviceMajor:0 DeviceMinor:143 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e02c520e-2276-440e-8f36-1047f78af40a/volumes/kubernetes.io~projected/kube-api-access-dpszg DeviceMajor:0 DeviceMinor:207 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f/volumes/kubernetes.io~projected/kube-api-access-zh7rw DeviceMajor:0 DeviceMinor:223 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9eaa07ad7d6305787b984aa73fde69d5e3e099b54082b4e79bdbaba59fea49bf/userdata/shm DeviceMajor:0 DeviceMinor:238 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cd1a7b7e-e1dd-4361-9091-b2983dff06da/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:230 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2f6f21bda934ec6d1430dc441faaf1f443cdfde905181713a4c7f9f0ba19c7ca/userdata/shm DeviceMajor:0 DeviceMinor:234 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/c444edaf-cb41-4707-a33f-f181873a6b01/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:55 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d03bffbe-b198-427f-86cb-e854d42260a5/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:58 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/0df87d60-113c-4039-93a4-06205c202a73/volumes/kubernetes.io~projected/kube-api-access-dvxv8 DeviceMajor:0 DeviceMinor:63 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/c444edaf-cb41-4707-a33f-f181873a6b01/volumes/kubernetes.io~projected/kube-api-access-4q2kt DeviceMajor:0 DeviceMinor:64 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/094983e9-88e8-4881-be25-8ba5d8bc0979/volumes/kubernetes.io~projected/kube-api-access-vwsgv DeviceMajor:0 DeviceMinor:65 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:45 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/55ed1a9f-f5a7-44fd-8b91-01d4e25f651a/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:201 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/c3e38a1c-cf20-4170-a71e-5fdc414e2343/volumes/kubernetes.io~projected/kube-api-access-rwf4v DeviceMajor:0 DeviceMinor:225 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:197 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/43a7f3829f40c80176e91493d652c16208ee301faf26f992addec5eafbf5c463/userdata/shm DeviceMajor:0 DeviceMinor:242 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/412765416b673a60659d5b15104da378252c47976ca249b70bd4ffb93e201404/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-310 DeviceMajor:0 DeviceMinor:310 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/401c58ab-82cc-4baf-9d77-31e18a3a5cb7/volumes/kubernetes.io~projected/kube-api-access-6xwjk DeviceMajor:0 DeviceMinor:327 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-184 DeviceMajor:0 DeviceMinor:184 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7e9f5df8528b565fc34b85fc03d86bcde956c215f195c2e8cdd9c47a99a54ee7/userdata/shm DeviceMajor:0 DeviceMinor:213 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/26e2f6af-5dbf-44c2-9acf-58c70be503bf/volumes/kubernetes.io~projected/kube-api-access-ttr59 DeviceMajor:0 DeviceMinor:295 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:220 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3246ff75e3a8ecdd66a5d5b3519c4d7e8c04396a5db54a8021811a7c0388235d/userdata/shm DeviceMajor:0 DeviceMinor:79 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7f9636f0e5c062922c70425d1f25451433182f735903ca2da75023ab1aacae3b/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/0e9e7178-b316-431d-851b-565dfc341afa/volumes/kubernetes.io~projected/kube-api-access-tm8s9 DeviceMajor:0 DeviceMinor:209 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/cd1a7b7e-e1dd-4361-9091-b2983dff06da/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:216 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8d11ce2c4efb606e91c0daf3eec2604caf3c01f0af9d441c969e4031bdbb9ed5/userdata/shm DeviceMajor:0 DeviceMinor:236 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-265 DeviceMajor:0 DeviceMinor:265 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-72 DeviceMajor:0 DeviceMinor:72 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d03bffbe-b198-427f-86cb-e854d42260a5/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/776acc559fef33bc0c0e47f3cf3756b2fbb7441efb3820ec8909eeb782ec13a7/userdata/shm DeviceMajor:0 DeviceMinor:246 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f039cecc-3f4f-4e9b-94e5-5d46918f9487/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:288 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b0b71ab7a72b2b833d5442fc6da25a210b12377be96050ceafaccc869e4069d6/userdata/shm DeviceMajor:0 DeviceMinor:296 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-298 DeviceMajor:0 DeviceMinor:298 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-318 DeviceMajor:0 DeviceMinor:318 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/da1dbfc6-084c-467f-84c2-4cf1cdea8c54/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:349 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:212 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-324 DeviceMajor:0 DeviceMinor:324 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-352 DeviceMajor:0 DeviceMinor:352 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-368 DeviceMajor:0 DeviceMinor:368 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-286 DeviceMajor:0 DeviceMinor:286 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f8c3809a-d264-4139-8805-9b25c0f50f6a/volumes/kubernetes.io~projected/kube-api-access-hqwgq DeviceMajor:0 DeviceMinor:304 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-362 DeviceMajor:0 DeviceMinor:362 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-376 DeviceMajor:0 DeviceMinor:376 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/097227b5-19cd-449b-88a1-ce703f741481/volumes/kubernetes.io~projected/kube-api-access-f529x DeviceMajor:0 DeviceMinor:59 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/41c9d832bdb850330f9fd2eab85b954340c405b2febfbf6fd93d1a4d97e07764/userdata/shm DeviceMajor:0 DeviceMinor:293 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5945c4e50cabb13a2578a7442d267550039459ddf667bf50c10bdbb79de1a588/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/09b3233893c8d89b74bf0284dbde4a79ce46329a6a7aef10730003bf21088352/userdata/shm DeviceMajor:0 DeviceMinor:226 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/cc213059-e0bc-4602-8d5c-6c79e962d6a5/volumes/kubernetes.io~projected/kube-api-access-5rh8c DeviceMajor:0 DeviceMinor:326 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-360 DeviceMajor:0 DeviceMinor:360 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-374 DeviceMajor:0 DeviceMinor:374 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0c1ebb77-bd76-4329-ac03-87f60b688431/volumes/kubernetes.io~projected/kube-api-access-9xlkp DeviceMajor:0 DeviceMinor:227 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cd1a7b7e-e1dd-4361-9091-b2983dff06da/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:219 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/af7f9e2a-c57b-4396-bd6e-40c05cf1ef42/volumes/kubernetes.io~projected/kube-api-access-zvpsp DeviceMajor:0 DeviceMinor:67 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/121f7fab5bb1e5a04f36ea661e038f35cd811b86c3fe91ce5023a9f0988cd0e7/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/80da5ad0-0b1d-40da-82b8-97202a58ee9f/volumes/kubernetes.io~projected/kube-api-access-72tnd DeviceMajor:0 DeviceMinor:211 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:217 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-276 DeviceMajor:0 DeviceMinor:276 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb/volumes/kubernetes.io~projected/kube-api-access-7wlpn DeviceMajor:0 DeviceMinor:205 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/07d862f38c631a13985bebe9c8cc32ab4213a01ecb767999275d0cc2ab1408e8/userdata/shm DeviceMajor:0 DeviceMinor:356 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d3a65f5bada964910f26e970d3c955245fca061b87d40b8d86fa7e504140c716/userdata/shm DeviceMajor:0 DeviceMinor:74 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e5371073-8444-4462-93f1-2cb7cfd54d9f/volumes/kubernetes.io~projected/kube-api-access-4tlk8 DeviceMajor:0 DeviceMinor:204 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3a4e0aecdc43d988d2cb18885041202b00500214f0601e37b37c02aea69116a1/userdata/shm DeviceMajor:0 DeviceMinor:240 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-312 DeviceMajor:0 DeviceMinor:312 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e1be1b32-6246-4b96-a707-6df15d3d950f/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:56 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/fc5de6fe-b01e-4773-acc5-e04e5af9e11a/volumes/kubernetes.io~projected/kube-api-access-6mq2k DeviceMajor:0 DeviceMinor:309 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-354 DeviceMajor:0 DeviceMinor:354 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c444edaf-cb41-4707-a33f-f181873a6b01/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:57 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:07d862f38c631a1 MacAddress:9e:2c:c9:68:5c:6e Speed:10000 Mtu:8901} {Name:09b3233893c8d89 MacAddress:aa:d4:38:5b:66:05 Speed:10000 Mtu:8901} {Name:2f6f21bda934ec6 MacAddress:76:f2:b7:f6:5f:32 Speed:10000 Mtu:8901} {Name:3a4e0aecdc43d98 MacAddress:ae:e1:6f:d0:be:b0 Speed:10000 Mtu:8901} {Name:41c9d832bdb8503 MacAddress:ce:7d:d5:44:e6:29 Speed:10000 Mtu:8901} {Name:43a7f3829f40c80 MacAddress:0a:41:18:30:81:a8 Speed:10000 Mtu:8901} {Name:64e9d993e448bcd MacAddress:fa:6c:3a:a9:18:12 Speed:10000 Mtu:8901} {Name:776acc559fef33b MacAddress:06:2d:e4:00:26:3a Speed:10000 Mtu:8901} {Name:7e9f5df8528b565 MacAddress:96:52:d2:15:5a:2a Speed:10000 Mtu:8901} {Name:8d11ce2c4efb606 MacAddress:9e:63:35:bd:7f:fa Speed:10000 Mtu:8901} {Name:9eaa07ad7d63057 MacAddress:0a:6f:ce:22:b7:ce Speed:10000 Mtu:8901} {Name:ab9b5428b175e27 MacAddress:96:72:73:2d:bc:ad Speed:10000 Mtu:8901} {Name:b0b71ab7a72b2b8 MacAddress:42:b3:86:74:73:f9 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:ca:24:c9:f3 Speed:0 Mtu:9001} {Name:br-int MacAddress:7e:a9:b2:3a:d3:e8 Speed:0 Mtu:8901} {Name:dc2d5bcd8177a71 MacAddress:fe:5f:53:7b:fe:80 Speed:10000 Mtu:8901} {Name:e5bda62c1d72cea MacAddress:5e:37:5a:58:b9:39 Speed:10000 Mtu:8901} {Name:e8efe18bd3be606 MacAddress:9a:6f:d7:99:62:b8 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:ca:24:c9:f3 Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:e6:15:11:c8:5e:5f Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:3a:71:7e:df:42:a5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 30 08:53:05.861522 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.860122 5028 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 30 08:53:05.861522 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.860176 5028 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 30 08:53:05.861522 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.860466 5028 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 30 08:53:05.861522 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.860486 5028 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-65.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 30 08:53:05.861522 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.860608 5028 topology_manager.go:143] "Creating topology manager with none policy" Oct 30 08:53:05.861522 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.860615 5028 container_manager_linux.go:311] "Creating device plugin manager" Oct 30 08:53:05.861522 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.860625 5028 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 08:53:05.861522 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.860652 5028 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 08:53:05.861522 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.860671 5028 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 30 08:53:05.861522 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.860812 5028 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 30 08:53:05.861522 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.860914 5028 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 30 08:53:05.861522 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.860946 5028 kubelet.go:493] "Attempting to sync node with API server" Oct 30 08:53:05.861522 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.860955 5028 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 30 08:53:05.861522 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.860964 5028 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 30 08:53:05.861522 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.860972 5028 kubelet.go:405] "Adding apiserver pod source" Oct 30 08:53:05.861522 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.860980 5028 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 30 08:53:05.862584 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.861649 5028 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 30 08:53:05.862584 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.861659 5028 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 08:53:05.862584 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.862054 5028 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 30 08:53:05.865326 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.865308 5028 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 30 08:53:05.865326 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.865324 5028 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 08:53:05.865451 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.865439 5028 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Oct 30 08:53:05.865686 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.865674 5028 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 30 08:53:05.865731 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.865721 5028 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 30 08:53:05.865834 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.865824 5028 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 30 08:53:05.865866 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.865843 5028 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 30 08:53:05.865866 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.865852 5028 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 30 08:53:05.865866 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.865860 5028 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 30 08:53:05.865948 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.865869 5028 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 30 08:53:05.865948 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.865878 5028 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 30 08:53:05.865948 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.865888 5028 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 30 08:53:05.865948 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.865897 5028 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 30 08:53:05.865948 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.865908 5028 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 30 08:53:05.865948 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.865917 5028 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 30 08:53:05.865948 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.865929 5028 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 30 08:53:05.865948 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.865942 5028 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 30 08:53:05.866299 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.865972 5028 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 30 08:53:05.866299 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.865981 5028 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 30 08:53:05.870175 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.870124 5028 server.go:1263] "Started kubelet" Oct 30 08:53:05.870265 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.870196 5028 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 30 08:53:05.870777 ip-10-0-140-65 systemd[1]: Started Kubernetes Kubelet. Oct 30 08:53:05.870899 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.870842 5028 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 30 08:53:05.870955 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.870902 5028 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 30 08:53:05.871317 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.871283 5028 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 30 08:53:05.871402 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.871386 5028 server.go:317] "Adding debug handlers to kubelet server" Oct 30 08:53:05.878242 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.875795 5028 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 30 08:53:05.878242 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.875876 5028 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 30 08:53:05.878242 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.876152 5028 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 08:47:27 +0000 UTC" deadline="2028-05-04 20:04:38.418699553 +0000 UTC" Oct 30 08:53:05.878242 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.876188 5028 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13259h11m32.542514869s" Oct 30 08:53:05.878242 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:53:05.876187 5028 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-65.ec2.internal\" not found" Oct 30 08:53:05.878242 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.876236 5028 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 30 08:53:05.878242 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.876244 5028 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 30 08:53:05.878242 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.876312 5028 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 30 08:53:05.878242 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.877706 5028 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 30 08:53:05.878242 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.877722 5028 factory.go:55] Registering systemd factory Oct 30 08:53:05.878242 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.877731 5028 factory.go:223] Registration of the systemd container factory successfully Oct 30 08:53:05.878242 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.877973 5028 factory.go:153] Registering CRI-O factory Oct 30 08:53:05.878242 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.878027 5028 factory.go:223] Registration of the crio container factory successfully Oct 30 08:53:05.878242 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.878049 5028 factory.go:103] Registering Raw factory Oct 30 08:53:05.878242 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.878059 5028 manager.go:1199] Started watching for new ooms in manager Oct 30 08:53:05.878959 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.878597 5028 manager.go:319] Starting recovery of all containers Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883123 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9e5c0d3f-6e6c-44d8-b50d-cecacd28474d" volumeName="kubernetes.io/configmap/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-certificates" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883160 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c3e38a1c-cf20-4170-a71e-5fdc414e2343" volumeName="kubernetes.io/configmap/c3e38a1c-cf20-4170-a71e-5fdc414e2343-config" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883173 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e1be1b32-6246-4b96-a707-6df15d3d950f" volumeName="kubernetes.io/configmap/e1be1b32-6246-4b96-a707-6df15d3d950f-konnectivity-ca" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883186 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f8c3809a-d264-4139-8805-9b25c0f50f6a" volumeName="kubernetes.io/empty-dir/f8c3809a-d264-4139-8805-9b25c0f50f6a-data-volume" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883199 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f8c3809a-d264-4139-8805-9b25c0f50f6a" volumeName="kubernetes.io/projected/f8c3809a-d264-4139-8805-9b25c0f50f6a-kube-api-access-hqwgq" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883230 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc5de6fe-b01e-4773-acc5-e04e5af9e11a" volumeName="kubernetes.io/projected/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-kube-api-access-6mq2k" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883241 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0df87d60-113c-4039-93a4-06205c202a73" volumeName="kubernetes.io/configmap/0df87d60-113c-4039-93a4-06205c202a73-cni-binary-copy" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883275 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c444edaf-cb41-4707-a33f-f181873a6b01" volumeName="kubernetes.io/projected/c444edaf-cb41-4707-a33f-f181873a6b01-kube-api-access-4q2kt" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883289 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e0eac401-f877-428f-b85c-271fa0aca679" volumeName="kubernetes.io/configmap/e0eac401-f877-428f-b85c-271fa0aca679-cni-sysctl-allowlist" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883300 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f039cecc-3f4f-4e9b-94e5-5d46918f9487" volumeName="kubernetes.io/secret/f039cecc-3f4f-4e9b-94e5-5d46918f9487-original-pull-secret" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883312 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0df87d60-113c-4039-93a4-06205c202a73" volumeName="kubernetes.io/projected/0df87d60-113c-4039-93a4-06205c202a73-kube-api-access-dvxv8" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883322 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0e9e7178-b316-431d-851b-565dfc341afa" volumeName="kubernetes.io/projected/0e9e7178-b316-431d-851b-565dfc341afa-kube-api-access-tm8s9" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883334 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="55ed1a9f-f5a7-44fd-8b91-01d4e25f651a" volumeName="kubernetes.io/secret/55ed1a9f-f5a7-44fd-8b91-01d4e25f651a-serving-cert" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883347 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a88ad1f8-2002-4e56-abcb-47c68c0a1fbb" volumeName="kubernetes.io/configmap/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb-samples-operator-config" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883362 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06e7e9e5-ebd3-4e67-95ba-03eeebcee619" volumeName="kubernetes.io/secret/06e7e9e5-ebd3-4e67-95ba-03eeebcee619-cert" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883374 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9e5c0d3f-6e6c-44d8-b50d-cecacd28474d" volumeName="kubernetes.io/empty-dir/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-ca-trust-extracted" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883408 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d4b82adb-d2fe-406a-a9e9-ea28cb3679ff" volumeName="kubernetes.io/projected/d4b82adb-d2fe-406a-a9e9-ea28cb3679ff-kube-api-access-lwwbq" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883419 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cd1a7b7e-e1dd-4361-9091-b2983dff06da" volumeName="kubernetes.io/secret/cd1a7b7e-e1dd-4361-9091-b2983dff06da-image-registry-private-configuration" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883431 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc5de6fe-b01e-4773-acc5-e04e5af9e11a" volumeName="kubernetes.io/configmap/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-service-ca-bundle" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883442 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0df87d60-113c-4039-93a4-06205c202a73" volumeName="kubernetes.io/configmap/0df87d60-113c-4039-93a4-06205c202a73-multus-daemon-config" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883455 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3447411a-b1de-406a-9df8-4d5e565add87" volumeName="kubernetes.io/configmap/3447411a-b1de-406a-9df8-4d5e565add87-iptables-alerter-script" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883467 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="80da5ad0-0b1d-40da-82b8-97202a58ee9f" volumeName="kubernetes.io/projected/80da5ad0-0b1d-40da-82b8-97202a58ee9f-kube-api-access-72tnd" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883480 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="80da5ad0-0b1d-40da-82b8-97202a58ee9f" volumeName="kubernetes.io/secret/80da5ad0-0b1d-40da-82b8-97202a58ee9f-serving-cert" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883492 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9e5c0d3f-6e6c-44d8-b50d-cecacd28474d" volumeName="kubernetes.io/secret/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-image-registry-private-configuration" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883505 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d03bffbe-b198-427f-86cb-e854d42260a5" volumeName="kubernetes.io/configmap/d03bffbe-b198-427f-86cb-e854d42260a5-ovnkube-script-lib" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883516 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e02c520e-2276-440e-8f36-1047f78af40a" volumeName="kubernetes.io/configmap/e02c520e-2276-440e-8f36-1047f78af40a-telemetry-config" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883527 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e1be1b32-6246-4b96-a707-6df15d3d950f" volumeName="kubernetes.io/secret/e1be1b32-6246-4b96-a707-6df15d3d950f-agent-certs" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883538 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0994c04f-63a8-4b19-a4a1-9a0c288a26f5" volumeName="kubernetes.io/configmap/0994c04f-63a8-4b19-a4a1-9a0c288a26f5-nginx-conf" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883556 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0c1ebb77-bd76-4329-ac03-87f60b688431" volumeName="kubernetes.io/projected/0c1ebb77-bd76-4329-ac03-87f60b688431-kube-api-access-9xlkp" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883568 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9e5c0d3f-6e6c-44d8-b50d-cecacd28474d" volumeName="kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-bound-sa-token" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883581 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a88ad1f8-2002-4e56-abcb-47c68c0a1fbb" volumeName="kubernetes.io/projected/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb-kube-api-access-7wlpn" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883592 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="da1dbfc6-084c-467f-84c2-4cf1cdea8c54" volumeName="kubernetes.io/projected/da1dbfc6-084c-467f-84c2-4cf1cdea8c54-kube-api-access-nsdlm" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883603 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e5ddc593-a1bb-4f35-be9e-77b6f9486945" volumeName="kubernetes.io/empty-dir/e5ddc593-a1bb-4f35-be9e-77b6f9486945-tmp-dir" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883614 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9e5c0d3f-6e6c-44d8-b50d-cecacd28474d" volumeName="kubernetes.io/configmap/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-trusted-ca" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883625 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c444edaf-cb41-4707-a33f-f181873a6b01" volumeName="kubernetes.io/empty-dir/c444edaf-cb41-4707-a33f-f181873a6b01-etc-tuned" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883638 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e02c520e-2276-440e-8f36-1047f78af40a" volumeName="kubernetes.io/projected/e02c520e-2276-440e-8f36-1047f78af40a-kube-api-access-dpszg" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883651 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e5371073-8444-4462-93f1-2cb7cfd54d9f" volumeName="kubernetes.io/projected/e5371073-8444-4462-93f1-2cb7cfd54d9f-kube-api-access-4tlk8" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883664 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0a14ed2f-0a6c-4ed6-b05a-54f733f19453" volumeName="kubernetes.io/projected/0a14ed2f-0a6c-4ed6-b05a-54f733f19453-kube-api-access-97b9l" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883676 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="55ed1a9f-f5a7-44fd-8b91-01d4e25f651a" volumeName="kubernetes.io/configmap/55ed1a9f-f5a7-44fd-8b91-01d4e25f651a-config" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883687 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="af7f9e2a-c57b-4396-bd6e-40c05cf1ef42" volumeName="kubernetes.io/projected/af7f9e2a-c57b-4396-bd6e-40c05cf1ef42-kube-api-access-zvpsp" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883699 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cc213059-e0bc-4602-8d5c-6c79e962d6a5" volumeName="kubernetes.io/projected/cc213059-e0bc-4602-8d5c-6c79e962d6a5-kube-api-access-5rh8c" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883710 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e0eac401-f877-428f-b85c-271fa0aca679" volumeName="kubernetes.io/configmap/e0eac401-f877-428f-b85c-271fa0aca679-cni-binary-copy" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883722 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="097227b5-19cd-449b-88a1-ce703f741481" volumeName="kubernetes.io/projected/097227b5-19cd-449b-88a1-ce703f741481-kube-api-access-f529x" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883734 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="80da5ad0-0b1d-40da-82b8-97202a58ee9f" volumeName="kubernetes.io/configmap/80da5ad0-0b1d-40da-82b8-97202a58ee9f-trusted-ca-bundle" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883747 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="80da5ad0-0b1d-40da-82b8-97202a58ee9f" volumeName="kubernetes.io/empty-dir/80da5ad0-0b1d-40da-82b8-97202a58ee9f-tmp" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883760 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c3e38a1c-cf20-4170-a71e-5fdc414e2343" volumeName="kubernetes.io/projected/c3e38a1c-cf20-4170-a71e-5fdc414e2343-kube-api-access-rwf4v" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883774 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c444edaf-cb41-4707-a33f-f181873a6b01" volumeName="kubernetes.io/empty-dir/c444edaf-cb41-4707-a33f-f181873a6b01-tmp" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883816 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cd1a7b7e-e1dd-4361-9091-b2983dff06da" volumeName="kubernetes.io/configmap/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-certificates" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883833 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d03bffbe-b198-427f-86cb-e854d42260a5" volumeName="kubernetes.io/configmap/d03bffbe-b198-427f-86cb-e854d42260a5-env-overrides" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883845 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f" volumeName="kubernetes.io/secret/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-default-certificate" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883856 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cd1a7b7e-e1dd-4361-9091-b2983dff06da" volumeName="kubernetes.io/configmap/cd1a7b7e-e1dd-4361-9091-b2983dff06da-trusted-ca" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883870 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cd1a7b7e-e1dd-4361-9091-b2983dff06da" volumeName="kubernetes.io/secret/cd1a7b7e-e1dd-4361-9091-b2983dff06da-installation-pull-secrets" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883884 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e0eac401-f877-428f-b85c-271fa0aca679" volumeName="kubernetes.io/projected/e0eac401-f877-428f-b85c-271fa0aca679-kube-api-access-6z9bt" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883897 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f" volumeName="kubernetes.io/secret/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-stats-auth" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883911 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc5de6fe-b01e-4773-acc5-e04e5af9e11a" volumeName="kubernetes.io/empty-dir/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-archives-path" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883925 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fdbaa900-aa36-4984-a2f3-c5c973e75d8a" volumeName="kubernetes.io/projected/fdbaa900-aa36-4984-a2f3-c5c973e75d8a-kube-api-access-mt6ng" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883948 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06e7e9e5-ebd3-4e67-95ba-03eeebcee619" volumeName="kubernetes.io/projected/06e7e9e5-ebd3-4e67-95ba-03eeebcee619-kube-api-access-wrlct" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883962 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0c1ebb77-bd76-4329-ac03-87f60b688431" volumeName="kubernetes.io/secret/0c1ebb77-bd76-4329-ac03-87f60b688431-serving-cert" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883977 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="80da5ad0-0b1d-40da-82b8-97202a58ee9f" volumeName="kubernetes.io/empty-dir/80da5ad0-0b1d-40da-82b8-97202a58ee9f-snapshots" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.883989 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cd1a7b7e-e1dd-4361-9091-b2983dff06da" volumeName="kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-kube-api-access-nh9pf" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.884003 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f" volumeName="kubernetes.io/projected/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-kube-api-access-zh7rw" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.884017 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc5de6fe-b01e-4773-acc5-e04e5af9e11a" volumeName="kubernetes.io/configmap/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-trusted-ca-bundle" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.884029 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="401c58ab-82cc-4baf-9d77-31e18a3a5cb7" volumeName="kubernetes.io/projected/401c58ab-82cc-4baf-9d77-31e18a3a5cb7-kube-api-access-6xwjk" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.884042 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="55ed1a9f-f5a7-44fd-8b91-01d4e25f651a" volumeName="kubernetes.io/projected/55ed1a9f-f5a7-44fd-8b91-01d4e25f651a-kube-api-access-gq7cl" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.884057 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9e5c0d3f-6e6c-44d8-b50d-cecacd28474d" volumeName="kubernetes.io/secret/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-installation-pull-secrets" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.884070 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e5ddc593-a1bb-4f35-be9e-77b6f9486945" volumeName="kubernetes.io/configmap/e5ddc593-a1bb-4f35-be9e-77b6f9486945-config-volume" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.884082 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="094983e9-88e8-4881-be25-8ba5d8bc0979" volumeName="kubernetes.io/projected/094983e9-88e8-4881-be25-8ba5d8bc0979-kube-api-access-vwsgv" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.884096 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0c1ebb77-bd76-4329-ac03-87f60b688431" volumeName="kubernetes.io/configmap/0c1ebb77-bd76-4329-ac03-87f60b688431-trusted-ca" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.884109 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3447411a-b1de-406a-9df8-4d5e565add87" volumeName="kubernetes.io/projected/3447411a-b1de-406a-9df8-4d5e565add87-kube-api-access-sxv9t" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.884121 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9e5c0d3f-6e6c-44d8-b50d-cecacd28474d" volumeName="kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-kube-api-access-hzbp9" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.884136 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cd1a7b7e-e1dd-4361-9091-b2983dff06da" volumeName="kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-bound-sa-token" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.884151 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d03bffbe-b198-427f-86cb-e854d42260a5" volumeName="kubernetes.io/projected/d03bffbe-b198-427f-86cb-e854d42260a5-kube-api-access-gxbkp" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.884163 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c3e38a1c-cf20-4170-a71e-5fdc414e2343" volumeName="kubernetes.io/secret/c3e38a1c-cf20-4170-a71e-5fdc414e2343-serving-cert" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.884175 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d03bffbe-b198-427f-86cb-e854d42260a5" volumeName="kubernetes.io/secret/d03bffbe-b198-427f-86cb-e854d42260a5-ovn-node-metrics-cert" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.884189 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="da1dbfc6-084c-467f-84c2-4cf1cdea8c54" volumeName="kubernetes.io/secret/da1dbfc6-084c-467f-84c2-4cf1cdea8c54-signing-key" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.884225 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e5ddc593-a1bb-4f35-be9e-77b6f9486945" volumeName="kubernetes.io/projected/e5ddc593-a1bb-4f35-be9e-77b6f9486945-kube-api-access-b2w8s" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.884239 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fece1d69-0824-4ecc-ad78-cea4e19bde61" volumeName="kubernetes.io/projected/fece1d69-0824-4ecc-ad78-cea4e19bde61-kube-api-access-wlspr" seLinuxMountContext="" Oct 30 08:53:05.884182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.884251 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0c1ebb77-bd76-4329-ac03-87f60b688431" volumeName="kubernetes.io/configmap/0c1ebb77-bd76-4329-ac03-87f60b688431-config" seLinuxMountContext="" Oct 30 08:53:05.887442 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.884263 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="26e2f6af-5dbf-44c2-9acf-58c70be503bf" volumeName="kubernetes.io/projected/26e2f6af-5dbf-44c2-9acf-58c70be503bf-kube-api-access-ttr59" seLinuxMountContext="" Oct 30 08:53:05.887442 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.884274 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="80da5ad0-0b1d-40da-82b8-97202a58ee9f" volumeName="kubernetes.io/configmap/80da5ad0-0b1d-40da-82b8-97202a58ee9f-service-ca-bundle" seLinuxMountContext="" Oct 30 08:53:05.887442 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.884285 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="af7f9e2a-c57b-4396-bd6e-40c05cf1ef42" volumeName="kubernetes.io/configmap/af7f9e2a-c57b-4396-bd6e-40c05cf1ef42-serviceca" seLinuxMountContext="" Oct 30 08:53:05.887442 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.884297 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cd1a7b7e-e1dd-4361-9091-b2983dff06da" volumeName="kubernetes.io/empty-dir/cd1a7b7e-e1dd-4361-9091-b2983dff06da-ca-trust-extracted" seLinuxMountContext="" Oct 30 08:53:05.887442 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.884309 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d03bffbe-b198-427f-86cb-e854d42260a5" volumeName="kubernetes.io/configmap/d03bffbe-b198-427f-86cb-e854d42260a5-ovnkube-config" seLinuxMountContext="" Oct 30 08:53:05.887442 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.884320 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="da1dbfc6-084c-467f-84c2-4cf1cdea8c54" volumeName="kubernetes.io/configmap/da1dbfc6-084c-467f-84c2-4cf1cdea8c54-signing-cabundle" seLinuxMountContext="" Oct 30 08:53:05.887442 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.884331 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e0eac401-f877-428f-b85c-271fa0aca679" volumeName="kubernetes.io/configmap/e0eac401-f877-428f-b85c-271fa0aca679-whereabouts-flatfile-configmap" seLinuxMountContext="" Oct 30 08:53:05.887442 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.884342 5028 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="094983e9-88e8-4881-be25-8ba5d8bc0979" volumeName="kubernetes.io/empty-dir/094983e9-88e8-4881-be25-8ba5d8bc0979-tmp-dir" seLinuxMountContext="" Oct 30 08:53:05.887442 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.884354 5028 reconstruct.go:97] "Volume reconstruction finished" Oct 30 08:53:05.887442 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.884360 5028 reconciler.go:29] "Reconciler: start to sync state" Oct 30 08:53:05.895130 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.895105 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6jb9v_0c1ebb77-bd76-4329-ac03-87f60b688431/console-operator/1.log" Oct 30 08:53:05.895303 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.895170 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6jb9v_0c1ebb77-bd76-4329-ac03-87f60b688431/console-operator/1.log" Oct 30 08:53:05.901980 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.901940 5028 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 30 08:53:05.903469 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.903452 5028 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 30 08:53:05.903562 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.903472 5028 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 30 08:53:05.903562 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.903492 5028 kubelet.go:2521] "Starting kubelet main sync loop" Oct 30 08:53:05.903562 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:53:05.903536 5028 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Oct 30 08:53:05.912705 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.912679 5028 generic.go:356] "Generic (PLEG): container finished" podID="ef96270cb9f6591ce2fc63b09dc321b6" containerID="17a96e7c10fedf31bda42d75021f67daf03ea50c43c79873d179680657713dba" exitCode=0 Oct 30 08:53:05.921964 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.921945 5028 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Oct 30 08:53:05.922500 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.922464 5028 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 08:53:05.922580 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.922505 5028 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 08:53:05.934313 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.934290 5028 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 08:53:05.934648 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.934610 5028 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 08:53:05.936049 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.936022 5028 generic.go:356] "Generic (PLEG): container finished" podID="e0eac401-f877-428f-b85c-271fa0aca679" containerID="4e84b63d9d8a89b5122df5f235de439b7c8a5111a279b62a5403e3040d473066" exitCode=0 Oct 30 08:53:05.936119 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.936051 5028 generic.go:356] "Generic (PLEG): container finished" podID="e0eac401-f877-428f-b85c-271fa0aca679" containerID="98bc5a76eb267dcfd38aa1a7a145c99d2c1010109f40982fff277ec336fb21e8" exitCode=0 Oct 30 08:53:05.936119 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.936063 5028 generic.go:356] "Generic (PLEG): container finished" podID="e0eac401-f877-428f-b85c-271fa0aca679" containerID="0aaeb7572c43f7ab3f568497e513b8beb563d10e97cff37aacba4497407d21b3" exitCode=0 Oct 30 08:53:05.936119 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.936073 5028 generic.go:356] "Generic (PLEG): container finished" podID="e0eac401-f877-428f-b85c-271fa0aca679" containerID="29527a4a722056368c942fc9516cae1603c6cb11bf43ee60de3ab27ea8cafc3d" exitCode=0 Oct 30 08:53:05.936119 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.936083 5028 generic.go:356] "Generic (PLEG): container finished" podID="e0eac401-f877-428f-b85c-271fa0aca679" containerID="fe832321602258851dda453ad03ed3b97623b0990de3ea2d0d38d67b385efe82" exitCode=0 Oct 30 08:53:05.936119 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.936091 5028 generic.go:356] "Generic (PLEG): container finished" podID="e0eac401-f877-428f-b85c-271fa0aca679" containerID="cef3ac9f20c7d33502c2574d421dc4f42db22161029606ccb767a6edbe7d3721" exitCode=0 Oct 30 08:53:05.960417 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.960391 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6jb9v_0c1ebb77-bd76-4329-ac03-87f60b688431/console-operator/1.log" Oct 30 08:53:05.960503 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.960434 5028 generic.go:356] "Generic (PLEG): container finished" podID="0c1ebb77-bd76-4329-ac03-87f60b688431" containerID="f1033586986f47ff6f946cc9a123fa0e7182cff004274b45e877e858a7e2d2c2" exitCode=255 Oct 30 08:53:05.984017 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:05.984000 5028 manager.go:324] Recovery completed Oct 30 08:53:06.004385 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:53:06.004364 5028 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Oct 30 08:53:06.006536 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.006519 5028 cpu_manager.go:226] "Starting" policy="none" Oct 30 08:53:06.006577 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.006537 5028 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 30 08:53:06.006577 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.006556 5028 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 30 08:53:06.006687 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.006673 5028 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Oct 30 08:53:06.007107 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.006688 5028 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Oct 30 08:53:06.007148 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.007109 5028 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Oct 30 08:53:06.007148 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.007115 5028 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Oct 30 08:53:06.007148 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.007122 5028 policy_none.go:50] "Start" Oct 30 08:53:06.007148 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.007131 5028 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 30 08:53:06.007148 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.007143 5028 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 30 08:53:06.009409 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.009388 5028 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Oct 30 08:53:06.009409 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.009409 5028 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Oct 30 08:53:06.009509 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.009418 5028 policy_none.go:44] "Start" Oct 30 08:53:06.013911 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.013885 5028 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 30 08:53:06.016427 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.016411 5028 manager.go:341] "Starting Device Plugin manager" Oct 30 08:53:06.016515 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:53:06.016434 5028 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 30 08:53:06.016515 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.016446 5028 server.go:87] "Starting device plugin registration server" Oct 30 08:53:06.016707 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.016693 5028 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 30 08:53:06.016767 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.016708 5028 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 30 08:53:06.016815 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.016795 5028 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 30 08:53:06.016957 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.016902 5028 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 30 08:53:06.016957 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.016960 5028 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 30 08:53:06.017232 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.016967 5028 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 30 08:53:06.017232 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.017000 5028 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T08:53:06.016950417Z","UUID":"7e7473d6-5c28-46e5-beca-b9e535b60ea0","Handler":null,"Name":"","Endpoint":""} Oct 30 08:53:06.018387 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.018369 5028 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 30 08:53:06.018473 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.018398 5028 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 30 08:53:06.019052 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:53:06.019027 5028 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 30 08:53:06.117020 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.116996 5028 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 08:53:06.118738 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.118723 5028 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-65.ec2.internal" event="NodeHasSufficientMemory" Oct 30 08:53:06.118818 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.118749 5028 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-65.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 08:53:06.118818 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.118761 5028 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-65.ec2.internal" event="NodeHasSufficientPID" Oct 30 08:53:06.118818 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.118807 5028 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-140-65.ec2.internal" Oct 30 08:53:06.154533 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.154514 5028 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-140-65.ec2.internal" Oct 30 08:53:06.154602 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.154568 5028 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-140-65.ec2.internal" Oct 30 08:53:06.205490 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.205457 5028 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-65.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal"] Oct 30 08:53:06.206011 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.205977 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal" event={"ID":"ef96270cb9f6591ce2fc63b09dc321b6","Type":"ContainerStarted","Data":"cf7835f472df21842a393bd19e7f822c76415d670c2f16250b8b74d3fa018450"} Oct 30 08:53:06.206077 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.206023 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal" event={"ID":"ef96270cb9f6591ce2fc63b09dc321b6","Type":"ContainerDied","Data":"17a96e7c10fedf31bda42d75021f67daf03ea50c43c79873d179680657713dba"} Oct 30 08:53:06.206077 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.206045 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal" event={"ID":"ef96270cb9f6591ce2fc63b09dc321b6","Type":"ContainerStarted","Data":"c62189c32b3cc816fe6a0e7861b154718b899119ced51829b3ffa2e44217f4fe"} Oct 30 08:53:06.206133 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.205995 5028 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-65.ec2.internal" Oct 30 08:53:06.206168 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.206137 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-65.ec2.internal" event={"ID":"95a72c37fac53f4d285523d303757dc7","Type":"ContainerStarted","Data":"0b9a0d9e62b91413e9deaca959ee50fb6dda0c0447e0223a3c91bfc9cf36c873"} Oct 30 08:53:06.206168 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.206158 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-65.ec2.internal" event={"ID":"95a72c37fac53f4d285523d303757dc7","Type":"ContainerStarted","Data":"637c8cb7d8f5c83b8ae118fd9e09ba89952b3df9ecd1e395a6025274cde8d31d"} Oct 30 08:53:06.206262 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.206235 5028 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal" Oct 30 08:53:06.230448 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.230427 5028 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 08:53:06.230542 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:53:06.230468 5028 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-140-65.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-65.ec2.internal" Oct 30 08:53:06.231182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.231168 5028 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 08:53:06.231240 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:53:06.231201 5028 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal" Oct 30 08:53:06.323446 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.323424 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ef96270cb9f6591ce2fc63b09dc321b6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal\" (UID: \"ef96270cb9f6591ce2fc63b09dc321b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal" Oct 30 08:53:06.323519 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.323449 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef96270cb9f6591ce2fc63b09dc321b6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal\" (UID: \"ef96270cb9f6591ce2fc63b09dc321b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal" Oct 30 08:53:06.323519 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.323465 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/95a72c37fac53f4d285523d303757dc7-config\") pod \"kube-apiserver-proxy-ip-10-0-140-65.ec2.internal\" (UID: \"95a72c37fac53f4d285523d303757dc7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-65.ec2.internal" Oct 30 08:53:06.424483 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.424436 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/95a72c37fac53f4d285523d303757dc7-config\") pod \"kube-apiserver-proxy-ip-10-0-140-65.ec2.internal\" (UID: \"95a72c37fac53f4d285523d303757dc7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-65.ec2.internal" Oct 30 08:53:06.424483 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.424461 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ef96270cb9f6591ce2fc63b09dc321b6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal\" (UID: \"ef96270cb9f6591ce2fc63b09dc321b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal" Oct 30 08:53:06.424483 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.424479 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef96270cb9f6591ce2fc63b09dc321b6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal\" (UID: \"ef96270cb9f6591ce2fc63b09dc321b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal" Oct 30 08:53:06.424655 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.424515 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef96270cb9f6591ce2fc63b09dc321b6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal\" (UID: \"ef96270cb9f6591ce2fc63b09dc321b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal" Oct 30 08:53:06.424655 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.424553 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/95a72c37fac53f4d285523d303757dc7-config\") pod \"kube-apiserver-proxy-ip-10-0-140-65.ec2.internal\" (UID: \"95a72c37fac53f4d285523d303757dc7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-65.ec2.internal" Oct 30 08:53:06.424655 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.424557 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ef96270cb9f6591ce2fc63b09dc321b6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal\" (UID: \"ef96270cb9f6591ce2fc63b09dc321b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal" Oct 30 08:53:06.861146 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.861124 5028 apiserver.go:52] "Watching apiserver" Oct 30 08:53:06.915588 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.915564 5028 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 30 08:53:06.916267 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.916244 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal","openshift-console-operator/console-operator-7cd56b8dbc-6jb9v","openshift-ingress-canary/ingress-canary-j4lkv","kube-system/kube-apiserver-proxy-ip-10-0-140-65.ec2.internal","openshift-image-registry/node-ca-9fzvv","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9","openshift-image-registry/image-registry-b77f4b5fc-fdtlw","openshift-kube-storage-version-migrator/migrator-66df5d496b-vwfzm","kube-system/kas-connection-checker-685895c7c9-q4sp5","openshift-network-operator/iptables-alerter-nnwhb","kube-system/kas-connection-checker-685895c7c9-mzwbj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc","openshift-cluster-node-tuning-operator/tuned-kw85k","openshift-dns/node-resolver-bqlk7","kube-system/global-pull-secret-syncer-xgdfr","openshift-network-diagnostics/network-check-target-gn6v4","openshift-image-registry/image-registry-7c5bffb4d-x885p","openshift-insights/insights-runtime-extractor-wphsz","openshift-kube-storage-version-migrator/migrator-66df5d496b-24gg7","openshift-dns/dns-default-vbv2z","kube-system/kas-connection-checker-685895c7c9-prnqf","openshift-monitoring/cluster-monitoring-operator-884576c57-r95n6","kube-system/konnectivity-agent-wzfpw","openshift-ovn-kubernetes/ovnkube-node-gdgzh","openshift-multus/multus-additional-cni-plugins-xwrk9","openshift-network-diagnostics/network-check-source-6f78d59f99-qvd5x","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-99562","openshift-insights/insights-operator-7c4986d449-46mmb","openshift-multus/network-metrics-daemon-rtjs6","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-jxz7s","openshift-multus/multus-s9pz8","openshift-service-ca-operator/service-ca-operator-544d749c8c-cdnwr","openshift-network-console/networking-console-plugin-86c478bb88-8q4xg","openshift-insights/periodic-gathering-948ql-pgchp","openshift-service-ca/service-ca-5fffc97bdf-bjczz","openshift-ingress/router-default-777d6b9d77-br8dn"] Oct 30 08:53:06.917575 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.917558 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:53:06.918456 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.918435 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:53:06.919552 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.919534 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-r95n6" Oct 30 08:53:06.920027 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.920010 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-99562" Oct 30 08:53:06.920891 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.920876 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-8q4xg" Oct 30 08:53:06.926902 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.926877 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:53:06.929844 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.929826 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:53:06.930286 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.930272 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vbv2z" Oct 30 08:53:06.931194 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.931181 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:06.932356 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.932333 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Oct 30 08:53:06.932487 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.932449 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\"" Oct 30 08:53:06.932616 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.932521 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 30 08:53:06.932616 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.932535 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\"" Oct 30 08:53:06.932616 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.932662 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Oct 30 08:53:06.933240 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.932735 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Oct 30 08:53:06.933240 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.932854 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Oct 30 08:53:06.933240 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.932894 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Oct 30 08:53:06.933409 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.933388 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Oct 30 08:53:06.933454 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.933416 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Oct 30 08:53:06.933516 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.933504 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 30 08:53:06.933598 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.933555 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Oct 30 08:53:06.933598 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.933592 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 30 08:53:06.933736 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.933686 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Oct 30 08:53:06.933736 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.933718 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Oct 30 08:53:06.933942 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.933775 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Oct 30 08:53:06.945340 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.945314 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 30 08:53:06.945432 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.945368 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 08:53:06.945432 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.945409 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Oct 30 08:53:06.945432 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.945428 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 30 08:53:06.945581 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.945491 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Oct 30 08:53:06.945581 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.945499 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 30 08:53:06.945581 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.945532 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Oct 30 08:53:06.945581 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.945554 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Oct 30 08:53:06.945581 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.945521 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Oct 30 08:53:06.945818 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.945638 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 30 08:53:06.945818 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.945682 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 30 08:53:06.945818 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.945770 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 30 08:53:06.945818 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.945776 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Oct 30 08:53:06.945818 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.945778 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Oct 30 08:53:06.945818 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.945802 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 30 08:53:06.946061 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.945828 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Oct 30 08:53:06.946061 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.945836 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 30 08:53:06.946061 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.945686 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 30 08:53:06.946061 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.945860 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\"" Oct 30 08:53:06.946061 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.945879 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 30 08:53:06.946061 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.945904 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 30 08:53:06.946283 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.946195 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 30 08:53:06.946435 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.946422 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Oct 30 08:53:06.946480 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.946448 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 30 08:53:06.946689 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.946673 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 08:53:06.946689 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.946684 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Oct 30 08:53:06.946864 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.946709 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Oct 30 08:53:06.946864 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.946729 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 30 08:53:06.946864 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.946764 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 30 08:53:06.946864 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.946789 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Oct 30 08:53:06.946864 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.946743 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 30 08:53:06.946864 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.946857 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 30 08:53:06.947152 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.946870 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 30 08:53:06.947152 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.946893 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 30 08:53:06.947152 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.946926 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 30 08:53:06.947152 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.946928 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 30 08:53:06.947152 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.946942 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 30 08:53:06.947152 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.946893 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 30 08:53:06.947152 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.946987 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 30 08:53:06.947152 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.946999 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 30 08:53:06.947152 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.946945 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Oct 30 08:53:06.947152 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.947033 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 30 08:53:06.947152 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.947002 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Oct 30 08:53:06.947152 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.947066 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 30 08:53:06.947152 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.947104 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 30 08:53:06.947659 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.947517 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Oct 30 08:53:06.947659 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.947595 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Oct 30 08:53:06.947861 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.947836 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Oct 30 08:53:06.947926 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.947885 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Oct 30 08:53:06.948359 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.948344 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Oct 30 08:53:06.948612 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.948595 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 30 08:53:06.952282 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.952263 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Oct 30 08:53:06.952384 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.952355 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Oct 30 08:53:06.964173 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.964151 5028 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-65.ec2.internal" Oct 30 08:53:06.964363 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.964347 5028 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal" Oct 30 08:53:06.978469 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.978455 5028 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 30 08:53:06.986471 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.986453 5028 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 08:53:06.986527 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:53:06.986501 5028 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-140-65.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-65.ec2.internal" Oct 30 08:53:06.986946 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:06.986934 5028 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 08:53:06.986979 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:53:06.986967 5028 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-65.ec2.internal" Oct 30 08:53:07.027359 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.027340 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-archives-path\") pod \"periodic-gathering-948ql-pgchp\" (UID: \"fc5de6fe-b01e-4773-acc5-e04e5af9e11a\") " pod="openshift-insights/periodic-gathering-948ql-pgchp" Oct 30 08:53:07.027450 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.027367 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f039cecc-3f4f-4e9b-94e5-5d46918f9487-original-pull-secret\") pod \"global-pull-secret-syncer-xgdfr\" (UID: \"f039cecc-3f4f-4e9b-94e5-5d46918f9487\") " pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:53:07.027450 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.027386 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-var-lib-cni-bin\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.027450 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.027401 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-modprobe-d\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.027450 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.027416 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/da1dbfc6-084c-467f-84c2-4cf1cdea8c54-signing-key\") pod \"service-ca-5fffc97bdf-bjczz\" (UID: \"da1dbfc6-084c-467f-84c2-4cf1cdea8c54\") " pod="openshift-service-ca/service-ca-5fffc97bdf-bjczz" Oct 30 08:53:07.027450 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.027437 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mq2k\" (UniqueName: \"kubernetes.io/projected/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-kube-api-access-6mq2k\") pod \"periodic-gathering-948ql-pgchp\" (UID: \"fc5de6fe-b01e-4773-acc5-e04e5af9e11a\") " pod="openshift-insights/periodic-gathering-948ql-pgchp" Oct 30 08:53:07.027674 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.027480 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0eac401-f877-428f-b85c-271fa0aca679-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:53:07.027674 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.027605 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-run-systemd\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.027674 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.027642 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-archives-path\") pod \"periodic-gathering-948ql-pgchp\" (UID: \"fc5de6fe-b01e-4773-acc5-e04e5af9e11a\") " pod="openshift-insights/periodic-gathering-948ql-pgchp" Oct 30 08:53:07.027674 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.027643 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e0eac401-f877-428f-b85c-271fa0aca679-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:53:07.027840 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.027698 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttr59\" (UniqueName: \"kubernetes.io/projected/26e2f6af-5dbf-44c2-9acf-58c70be503bf-kube-api-access-ttr59\") pod \"network-check-target-gn6v4\" (UID: \"26e2f6af-5dbf-44c2-9acf-58c70be503bf\") " pod="openshift-network-diagnostics/network-check-target-gn6v4" Oct 30 08:53:07.027840 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.027718 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-multus-cni-dir\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.027840 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.027735 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/55ed1a9f-f5a7-44fd-8b91-01d4e25f651a-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9\" (UID: \"55ed1a9f-f5a7-44fd-8b91-01d4e25f651a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9" Oct 30 08:53:07.027840 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.027757 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xlkp\" (UniqueName: \"kubernetes.io/projected/0c1ebb77-bd76-4329-ac03-87f60b688431-kube-api-access-9xlkp\") pod \"console-operator-7cd56b8dbc-6jb9v\" (UID: \"0c1ebb77-bd76-4329-ac03-87f60b688431\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" Oct 30 08:53:07.027840 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.027773 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-99562\" (UID: \"a88ad1f8-2002-4e56-abcb-47c68c0a1fbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-99562" Oct 30 08:53:07.027840 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.027793 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/da1dbfc6-084c-467f-84c2-4cf1cdea8c54-signing-cabundle\") pod \"service-ca-5fffc97bdf-bjczz\" (UID: \"da1dbfc6-084c-467f-84c2-4cf1cdea8c54\") " pod="openshift-service-ca/service-ca-5fffc97bdf-bjczz" Oct 30 08:53:07.028050 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.027914 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3447411a-b1de-406a-9df8-4d5e565add87-iptables-alerter-script\") pod \"iptables-alerter-nnwhb\" (UID: \"3447411a-b1de-406a-9df8-4d5e565add87\") " pod="openshift-network-operator/iptables-alerter-nnwhb" Oct 30 08:53:07.028050 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.028002 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e0eac401-f877-428f-b85c-271fa0aca679-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:53:07.028050 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.028003 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-multus-conf-dir\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.028146 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.028049 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-stats-auth\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:53:07.028146 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.028064 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/da1dbfc6-084c-467f-84c2-4cf1cdea8c54-signing-cabundle\") pod \"service-ca-5fffc97bdf-bjczz\" (UID: \"da1dbfc6-084c-467f-84c2-4cf1cdea8c54\") " pod="openshift-service-ca/service-ca-5fffc97bdf-bjczz" Oct 30 08:53:07.028146 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.028095 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z9bt\" (UniqueName: \"kubernetes.io/projected/e0eac401-f877-428f-b85c-271fa0aca679-kube-api-access-6z9bt\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:53:07.028146 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.028120 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/55ed1a9f-f5a7-44fd-8b91-01d4e25f651a-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9\" (UID: \"55ed1a9f-f5a7-44fd-8b91-01d4e25f651a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9" Oct 30 08:53:07.028329 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.028123 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsdlm\" (UniqueName: \"kubernetes.io/projected/da1dbfc6-084c-467f-84c2-4cf1cdea8c54-kube-api-access-nsdlm\") pod \"service-ca-5fffc97bdf-bjczz\" (UID: \"da1dbfc6-084c-467f-84c2-4cf1cdea8c54\") " pod="openshift-service-ca/service-ca-5fffc97bdf-bjczz" Oct 30 08:53:07.028329 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.028219 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-tls\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:53:07.028329 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.028227 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3447411a-b1de-406a-9df8-4d5e565add87-iptables-alerter-script\") pod \"iptables-alerter-nnwhb\" (UID: \"3447411a-b1de-406a-9df8-4d5e565add87\") " pod="openshift-network-operator/iptables-alerter-nnwhb" Oct 30 08:53:07.028329 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.028276 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0df87d60-113c-4039-93a4-06205c202a73-multus-daemon-config\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.028329 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.028325 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fece1d69-0824-4ecc-ad78-cea4e19bde61-metrics-certs\") pod \"network-metrics-daemon-rtjs6\" (UID: \"fece1d69-0824-4ecc-ad78-cea4e19bde61\") " pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:53:07.028541 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.028361 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlspr\" (UniqueName: \"kubernetes.io/projected/fece1d69-0824-4ecc-ad78-cea4e19bde61-kube-api-access-wlspr\") pod \"network-metrics-daemon-rtjs6\" (UID: \"fece1d69-0824-4ecc-ad78-cea4e19bde61\") " pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:53:07.028541 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.028388 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e0eac401-f877-428f-b85c-271fa0aca679-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:53:07.028541 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.028414 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-systemd-units\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.028541 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.028438 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-slash\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.028541 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.028464 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-run-multus-certs\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.028541 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.028488 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpszg\" (UniqueName: \"kubernetes.io/projected/e02c520e-2276-440e-8f36-1047f78af40a-kube-api-access-dpszg\") pod \"cluster-monitoring-operator-884576c57-r95n6\" (UID: \"e02c520e-2276-440e-8f36-1047f78af40a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-r95n6" Oct 30 08:53:07.028541 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.028535 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0df87d60-113c-4039-93a4-06205c202a73-multus-daemon-config\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.028788 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.028569 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f8c3809a-d264-4139-8805-9b25c0f50f6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:07.028788 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.028589 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e0eac401-f877-428f-b85c-271fa0aca679-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:53:07.028788 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.028620 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-var-lib-cni-multus\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.028788 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.028662 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0c1ebb77-bd76-4329-ac03-87f60b688431-serving-cert\") pod \"console-operator-7cd56b8dbc-6jb9v\" (UID: \"0c1ebb77-bd76-4329-ac03-87f60b688431\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" Oct 30 08:53:07.028788 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.028693 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwsgv\" (UniqueName: \"kubernetes.io/projected/094983e9-88e8-4881-be25-8ba5d8bc0979-kube-api-access-vwsgv\") pod \"node-resolver-bqlk7\" (UID: \"094983e9-88e8-4881-be25-8ba5d8bc0979\") " pod="openshift-dns/node-resolver-bqlk7" Oct 30 08:53:07.028788 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.028718 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wlpn\" (UniqueName: \"kubernetes.io/projected/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb-kube-api-access-7wlpn\") pod \"cluster-samples-operator-6ddb6c8b94-99562\" (UID: \"a88ad1f8-2002-4e56-abcb-47c68c0a1fbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-99562" Oct 30 08:53:07.028788 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.028742 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af7f9e2a-c57b-4396-bd6e-40c05cf1ef42-host\") pod \"node-ca-9fzvv\" (UID: \"af7f9e2a-c57b-4396-bd6e-40c05cf1ef42\") " pod="openshift-image-registry/node-ca-9fzvv" Oct 30 08:53:07.028788 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.028764 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-sysconfig\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.028788 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.028788 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80da5ad0-0b1d-40da-82b8-97202a58ee9f-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-46mmb\" (UID: \"80da5ad0-0b1d-40da-82b8-97202a58ee9f\") " pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:53:07.029155 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.028819 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f039cecc-3f4f-4e9b-94e5-5d46918f9487-dbus\") pod \"global-pull-secret-syncer-xgdfr\" (UID: \"f039cecc-3f4f-4e9b-94e5-5d46918f9487\") " pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:53:07.029155 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.028956 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-sys-fs\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:53:07.029155 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029019 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e5ddc593-a1bb-4f35-be9e-77b6f9486945-config-volume\") pod \"dns-default-vbv2z\" (UID: \"e5ddc593-a1bb-4f35-be9e-77b6f9486945\") " pod="openshift-dns/dns-default-vbv2z" Oct 30 08:53:07.029155 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029043 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xwjk\" (UniqueName: \"kubernetes.io/projected/401c58ab-82cc-4baf-9d77-31e18a3a5cb7-kube-api-access-6xwjk\") pod \"migrator-66df5d496b-24gg7\" (UID: \"401c58ab-82cc-4baf-9d77-31e18a3a5cb7\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-24gg7" Oct 30 08:53:07.029155 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029068 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-kubernetes\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.029155 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029099 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrlct\" (UniqueName: \"kubernetes.io/projected/06e7e9e5-ebd3-4e67-95ba-03eeebcee619-kube-api-access-wrlct\") pod \"ingress-canary-j4lkv\" (UID: \"06e7e9e5-ebd3-4e67-95ba-03eeebcee619\") " pod="openshift-ingress-canary/ingress-canary-j4lkv" Oct 30 08:53:07.029155 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029124 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80da5ad0-0b1d-40da-82b8-97202a58ee9f-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-46mmb\" (UID: \"80da5ad0-0b1d-40da-82b8-97202a58ee9f\") " pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:53:07.029155 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029137 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-ca-trust-extracted\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:53:07.029505 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029178 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0eac401-f877-428f-b85c-271fa0aca679-cnibin\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:53:07.029505 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029195 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c3e38a1c-cf20-4170-a71e-5fdc414e2343-serving-cert\") pod \"service-ca-operator-544d749c8c-cdnwr\" (UID: \"c3e38a1c-cf20-4170-a71e-5fdc414e2343\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-cdnwr" Oct 30 08:53:07.029505 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029200 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-ca-trust-extracted\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:53:07.029505 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029237 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e02c520e-2276-440e-8f36-1047f78af40a-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-r95n6\" (UID: \"e02c520e-2276-440e-8f36-1047f78af40a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-r95n6" Oct 30 08:53:07.029505 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029264 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-sysctl-d\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.029505 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029271 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e5ddc593-a1bb-4f35-be9e-77b6f9486945-config-volume\") pod \"dns-default-vbv2z\" (UID: \"e5ddc593-a1bb-4f35-be9e-77b6f9486945\") " pod="openshift-dns/dns-default-vbv2z" Oct 30 08:53:07.029505 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029289 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-run\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.029505 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029314 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-kubelet\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.029505 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029340 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-run-ovn-kubernetes\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.029505 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029378 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxbkp\" (UniqueName: \"kubernetes.io/projected/d03bffbe-b198-427f-86cb-e854d42260a5-kube-api-access-gxbkp\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.029505 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029430 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tlk8\" (UniqueName: \"kubernetes.io/projected/e5371073-8444-4462-93f1-2cb7cfd54d9f-kube-api-access-4tlk8\") pod \"kas-connection-checker-685895c7c9-q4sp5\" (UID: \"e5371073-8444-4462-93f1-2cb7cfd54d9f\") " pod="kube-system/kas-connection-checker-685895c7c9-q4sp5" Oct 30 08:53:07.029505 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029465 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e02c520e-2276-440e-8f36-1047f78af40a-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-r95n6\" (UID: \"e02c520e-2276-440e-8f36-1047f78af40a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-r95n6" Oct 30 08:53:07.029505 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029487 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwf4v\" (UniqueName: \"kubernetes.io/projected/c3e38a1c-cf20-4170-a71e-5fdc414e2343-kube-api-access-rwf4v\") pod \"service-ca-operator-544d749c8c-cdnwr\" (UID: \"c3e38a1c-cf20-4170-a71e-5fdc414e2343\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-cdnwr" Oct 30 08:53:07.030109 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029519 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-device-dir\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:53:07.030109 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029546 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-var-lib-kubelet\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.030109 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029586 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80da5ad0-0b1d-40da-82b8-97202a58ee9f-serving-cert\") pod \"insights-operator-7c4986d449-46mmb\" (UID: \"80da5ad0-0b1d-40da-82b8-97202a58ee9f\") " pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:53:07.030109 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029701 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72tnd\" (UniqueName: \"kubernetes.io/projected/80da5ad0-0b1d-40da-82b8-97202a58ee9f-kube-api-access-72tnd\") pod \"insights-operator-7c4986d449-46mmb\" (UID: \"80da5ad0-0b1d-40da-82b8-97202a58ee9f\") " pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:53:07.030109 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029720 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq7cl\" (UniqueName: \"kubernetes.io/projected/55ed1a9f-f5a7-44fd-8b91-01d4e25f651a-kube-api-access-gq7cl\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9\" (UID: \"55ed1a9f-f5a7-44fd-8b91-01d4e25f651a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9" Oct 30 08:53:07.030109 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029736 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0c1ebb77-bd76-4329-ac03-87f60b688431-trusted-ca\") pod \"console-operator-7cd56b8dbc-6jb9v\" (UID: \"0c1ebb77-bd76-4329-ac03-87f60b688431\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" Oct 30 08:53:07.030109 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029739 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80da5ad0-0b1d-40da-82b8-97202a58ee9f-serving-cert\") pod \"insights-operator-7c4986d449-46mmb\" (UID: \"80da5ad0-0b1d-40da-82b8-97202a58ee9f\") " pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:53:07.030109 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029751 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-trusted-ca\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:53:07.030109 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029772 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-cni-bin\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.030109 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029879 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f529x\" (UniqueName: \"kubernetes.io/projected/097227b5-19cd-449b-88a1-ce703f741481-kube-api-access-f529x\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:53:07.030109 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029908 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5ddc593-a1bb-4f35-be9e-77b6f9486945-metrics-tls\") pod \"dns-default-vbv2z\" (UID: \"e5ddc593-a1bb-4f35-be9e-77b6f9486945\") " pod="openshift-dns/dns-default-vbv2z" Oct 30 08:53:07.030109 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029935 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm8s9\" (UniqueName: \"kubernetes.io/projected/0e9e7178-b316-431d-851b-565dfc341afa-kube-api-access-tm8s9\") pod \"kas-connection-checker-685895c7c9-mzwbj\" (UID: \"0e9e7178-b316-431d-851b-565dfc341afa\") " pod="kube-system/kas-connection-checker-685895c7c9-mzwbj" Oct 30 08:53:07.030109 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029962 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e1be1b32-6246-4b96-a707-6df15d3d950f-agent-certs\") pod \"konnectivity-agent-wzfpw\" (UID: \"e1be1b32-6246-4b96-a707-6df15d3d950f\") " pod="kube-system/konnectivity-agent-wzfpw" Oct 30 08:53:07.030109 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.029993 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e1be1b32-6246-4b96-a707-6df15d3d950f-konnectivity-ca\") pod \"konnectivity-agent-wzfpw\" (UID: \"e1be1b32-6246-4b96-a707-6df15d3d950f\") " pod="kube-system/konnectivity-agent-wzfpw" Oct 30 08:53:07.030109 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.030031 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0c1ebb77-bd76-4329-ac03-87f60b688431-trusted-ca\") pod \"console-operator-7cd56b8dbc-6jb9v\" (UID: \"0c1ebb77-bd76-4329-ac03-87f60b688431\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" Oct 30 08:53:07.030109 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.030063 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0eac401-f877-428f-b85c-271fa0aca679-cni-binary-copy\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:53:07.030109 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.030091 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55ed1a9f-f5a7-44fd-8b91-01d4e25f651a-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9\" (UID: \"55ed1a9f-f5a7-44fd-8b91-01d4e25f651a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9" Oct 30 08:53:07.030109 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.030100 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-trusted-ca\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:53:07.030693 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.030151 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-etc-selinux\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:53:07.030693 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.030224 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2w8s\" (UniqueName: \"kubernetes.io/projected/e5ddc593-a1bb-4f35-be9e-77b6f9486945-kube-api-access-b2w8s\") pod \"dns-default-vbv2z\" (UID: \"e5ddc593-a1bb-4f35-be9e-77b6f9486945\") " pod="openshift-dns/dns-default-vbv2z" Oct 30 08:53:07.030693 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.030232 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e1be1b32-6246-4b96-a707-6df15d3d950f-konnectivity-ca\") pod \"konnectivity-agent-wzfpw\" (UID: \"e1be1b32-6246-4b96-a707-6df15d3d950f\") " pod="kube-system/konnectivity-agent-wzfpw" Oct 30 08:53:07.030693 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.030269 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3447411a-b1de-406a-9df8-4d5e565add87-host-slash\") pod \"iptables-alerter-nnwhb\" (UID: \"3447411a-b1de-406a-9df8-4d5e565add87\") " pod="openshift-network-operator/iptables-alerter-nnwhb" Oct 30 08:53:07.030693 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.030286 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55ed1a9f-f5a7-44fd-8b91-01d4e25f651a-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9\" (UID: \"55ed1a9f-f5a7-44fd-8b91-01d4e25f651a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9" Oct 30 08:53:07.030693 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.030329 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-run-netns\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.030693 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.030363 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvxv8\" (UniqueName: \"kubernetes.io/projected/0df87d60-113c-4039-93a4-06205c202a73-kube-api-access-dvxv8\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.030693 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.030413 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh7rw\" (UniqueName: \"kubernetes.io/projected/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-kube-api-access-zh7rw\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:53:07.030693 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.030433 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0eac401-f877-428f-b85c-271fa0aca679-cni-binary-copy\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:53:07.030693 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.030444 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt6ng\" (UniqueName: \"kubernetes.io/projected/fdbaa900-aa36-4984-a2f3-c5c973e75d8a-kube-api-access-mt6ng\") pod \"network-check-source-6f78d59f99-qvd5x\" (UID: \"fdbaa900-aa36-4984-a2f3-c5c973e75d8a\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-qvd5x" Oct 30 08:53:07.030693 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.030571 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-run-netns\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.030693 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.030604 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cd1a7b7e-e1dd-4361-9091-b2983dff06da-ca-trust-extracted\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:53:07.030693 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.030637 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-system-cni-dir\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.031025 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.030702 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cd1a7b7e-e1dd-4361-9091-b2983dff06da-ca-trust-extracted\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:53:07.031025 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.030719 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/094983e9-88e8-4881-be25-8ba5d8bc0979-tmp-dir\") pod \"node-resolver-bqlk7\" (UID: \"094983e9-88e8-4881-be25-8ba5d8bc0979\") " pod="openshift-dns/node-resolver-bqlk7" Oct 30 08:53:07.031025 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.030748 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-trusted-ca-bundle\") pod \"periodic-gathering-948ql-pgchp\" (UID: \"fc5de6fe-b01e-4773-acc5-e04e5af9e11a\") " pod="openshift-insights/periodic-gathering-948ql-pgchp" Oct 30 08:53:07.031025 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.030760 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/094983e9-88e8-4881-be25-8ba5d8bc0979-tmp-dir\") pod \"node-resolver-bqlk7\" (UID: \"094983e9-88e8-4881-be25-8ba5d8bc0979\") " pod="openshift-dns/node-resolver-bqlk7" Oct 30 08:53:07.031025 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.030778 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-node-log\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.031025 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.030803 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-socket-dir\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:53:07.031025 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.030838 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5ddc593-a1bb-4f35-be9e-77b6f9486945-tmp-dir\") pod \"dns-default-vbv2z\" (UID: \"e5ddc593-a1bb-4f35-be9e-77b6f9486945\") " pod="openshift-dns/dns-default-vbv2z" Oct 30 08:53:07.031025 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.030915 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5ddc593-a1bb-4f35-be9e-77b6f9486945-tmp-dir\") pod \"dns-default-vbv2z\" (UID: \"e5ddc593-a1bb-4f35-be9e-77b6f9486945\") " pod="openshift-dns/dns-default-vbv2z" Oct 30 08:53:07.031025 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.030982 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0994c04f-63a8-4b19-a4a1-9a0c288a26f5-nginx-conf\") pod \"networking-console-plugin-86c478bb88-8q4xg\" (UID: \"0994c04f-63a8-4b19-a4a1-9a0c288a26f5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8q4xg" Oct 30 08:53:07.031025 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.031002 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-etc-openvswitch\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.031025 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.031018 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-cni-netd\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.031025 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.031018 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-trusted-ca-bundle\") pod \"periodic-gathering-948ql-pgchp\" (UID: \"fc5de6fe-b01e-4773-acc5-e04e5af9e11a\") " pod="openshift-insights/periodic-gathering-948ql-pgchp" Oct 30 08:53:07.031357 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.031115 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d03bffbe-b198-427f-86cb-e854d42260a5-env-overrides\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.031357 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.031135 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-bound-sa-token\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:53:07.031357 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.031150 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/80da5ad0-0b1d-40da-82b8-97202a58ee9f-snapshots\") pod \"insights-operator-7c4986d449-46mmb\" (UID: \"80da5ad0-0b1d-40da-82b8-97202a58ee9f\") " pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:53:07.031357 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.031167 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f039cecc-3f4f-4e9b-94e5-5d46918f9487-kubelet-config\") pod \"global-pull-secret-syncer-xgdfr\" (UID: \"f039cecc-3f4f-4e9b-94e5-5d46918f9487\") " pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:53:07.031357 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.031178 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0994c04f-63a8-4b19-a4a1-9a0c288a26f5-nginx-conf\") pod \"networking-console-plugin-86c478bb88-8q4xg\" (UID: \"0994c04f-63a8-4b19-a4a1-9a0c288a26f5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8q4xg" Oct 30 08:53:07.031357 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.031182 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-etc-kubernetes\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.031357 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.031242 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f8c3809a-d264-4139-8805-9b25c0f50f6a-crio-socket\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:07.031357 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.031319 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/80da5ad0-0b1d-40da-82b8-97202a58ee9f-snapshots\") pod \"insights-operator-7c4986d449-46mmb\" (UID: \"80da5ad0-0b1d-40da-82b8-97202a58ee9f\") " pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:53:07.031357 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.031346 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06e7e9e5-ebd3-4e67-95ba-03eeebcee619-cert\") pod \"ingress-canary-j4lkv\" (UID: \"06e7e9e5-ebd3-4e67-95ba-03eeebcee619\") " pod="openshift-ingress-canary/ingress-canary-j4lkv" Oct 30 08:53:07.031703 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.031364 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-bound-sa-token\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:53:07.031703 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.031411 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0eac401-f877-428f-b85c-271fa0aca679-system-cni-dir\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:53:07.031703 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.031448 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cd1a7b7e-e1dd-4361-9091-b2983dff06da-image-registry-private-configuration\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:53:07.031703 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.031479 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cd1a7b7e-e1dd-4361-9091-b2983dff06da-installation-pull-secrets\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:53:07.031703 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.031553 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d03bffbe-b198-427f-86cb-e854d42260a5-env-overrides\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.031703 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.031558 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-hostroot\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.031703 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.031598 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-default-certificate\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:53:07.031703 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.031636 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cd1a7b7e-e1dd-4361-9091-b2983dff06da-image-registry-private-configuration\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:53:07.031703 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.031638 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-sysctl-conf\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.031703 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.031693 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cd1a7b7e-e1dd-4361-9091-b2983dff06da-installation-pull-secrets\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:53:07.032186 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.031717 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-systemd\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.032186 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.031758 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-run-ovn\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.032186 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.031793 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-run-k8s-cni-cncf-io\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.032186 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.031840 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:53:07.032186 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.031875 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-image-registry-private-configuration\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:53:07.032186 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.031906 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d03bffbe-b198-427f-86cb-e854d42260a5-ovnkube-config\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.032186 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.032014 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d03bffbe-b198-427f-86cb-e854d42260a5-ovnkube-script-lib\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.032186 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.032031 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cd1a7b7e-e1dd-4361-9091-b2983dff06da-trusted-ca\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:53:07.032186 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.032045 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-image-registry-private-configuration\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:53:07.032186 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.032047 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-99562\" (UID: \"a88ad1f8-2002-4e56-abcb-47c68c0a1fbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-99562" Oct 30 08:53:07.032186 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.032077 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e02c520e-2276-440e-8f36-1047f78af40a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-r95n6\" (UID: \"e02c520e-2276-440e-8f36-1047f78af40a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-r95n6" Oct 30 08:53:07.032186 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.032101 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q2kt\" (UniqueName: \"kubernetes.io/projected/c444edaf-cb41-4707-a33f-f181873a6b01-kube-api-access-4q2kt\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.032186 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.032109 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d03bffbe-b198-427f-86cb-e854d42260a5-ovnkube-config\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.032186 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.032146 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzbp9\" (UniqueName: \"kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-kube-api-access-hzbp9\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:53:07.032186 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.032178 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwwbq\" (UniqueName: \"kubernetes.io/projected/d4b82adb-d2fe-406a-a9e9-ea28cb3679ff-kube-api-access-lwwbq\") pod \"kas-connection-checker-685895c7c9-prnqf\" (UID: \"d4b82adb-d2fe-406a-a9e9-ea28cb3679ff\") " pod="kube-system/kas-connection-checker-685895c7c9-prnqf" Oct 30 08:53:07.032717 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.032241 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-99562\" (UID: \"a88ad1f8-2002-4e56-abcb-47c68c0a1fbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-99562" Oct 30 08:53:07.032717 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.032322 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-service-ca-bundle\") pod \"periodic-gathering-948ql-pgchp\" (UID: \"fc5de6fe-b01e-4773-acc5-e04e5af9e11a\") " pod="openshift-insights/periodic-gathering-948ql-pgchp" Oct 30 08:53:07.032717 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.032343 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d03bffbe-b198-427f-86cb-e854d42260a5-ovnkube-script-lib\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.032717 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.032353 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0c1ebb77-bd76-4329-ac03-87f60b688431-config\") pod \"console-operator-7cd56b8dbc-6jb9v\" (UID: \"0c1ebb77-bd76-4329-ac03-87f60b688431\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" Oct 30 08:53:07.032717 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.032384 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-multus-socket-dir-parent\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.032717 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.032390 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cd1a7b7e-e1dd-4361-9091-b2983dff06da-trusted-ca\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:53:07.032717 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.032415 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqwgq\" (UniqueName: \"kubernetes.io/projected/f8c3809a-d264-4139-8805-9b25c0f50f6a-kube-api-access-hqwgq\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:07.032717 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.032447 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-service-ca-bundle\") pod \"periodic-gathering-948ql-pgchp\" (UID: \"fc5de6fe-b01e-4773-acc5-e04e5af9e11a\") " pod="openshift-insights/periodic-gathering-948ql-pgchp" Oct 30 08:53:07.032717 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.032469 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0994c04f-63a8-4b19-a4a1-9a0c288a26f5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8q4xg\" (UID: \"0994c04f-63a8-4b19-a4a1-9a0c288a26f5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8q4xg" Oct 30 08:53:07.032717 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.032498 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8c3809a-d264-4139-8805-9b25c0f50f6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:07.032717 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.032548 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0c1ebb77-bd76-4329-ac03-87f60b688431-config\") pod \"console-operator-7cd56b8dbc-6jb9v\" (UID: \"0c1ebb77-bd76-4329-ac03-87f60b688431\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" Oct 30 08:53:07.032717 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.032605 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/094983e9-88e8-4881-be25-8ba5d8bc0979-hosts-file\") pod \"node-resolver-bqlk7\" (UID: \"094983e9-88e8-4881-be25-8ba5d8bc0979\") " pod="openshift-dns/node-resolver-bqlk7" Oct 30 08:53:07.032717 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.032655 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvpsp\" (UniqueName: \"kubernetes.io/projected/af7f9e2a-c57b-4396-bd6e-40c05cf1ef42-kube-api-access-zvpsp\") pod \"node-ca-9fzvv\" (UID: \"af7f9e2a-c57b-4396-bd6e-40c05cf1ef42\") " pod="openshift-image-registry/node-ca-9fzvv" Oct 30 08:53:07.032717 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.032688 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c444edaf-cb41-4707-a33f-f181873a6b01-tmp\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.032717 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.032706 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-installation-pull-secrets\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:53:07.032717 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.032722 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxv9t\" (UniqueName: \"kubernetes.io/projected/3447411a-b1de-406a-9df8-4d5e565add87-kube-api-access-sxv9t\") pod \"iptables-alerter-nnwhb\" (UID: \"3447411a-b1de-406a-9df8-4d5e565add87\") " pod="openshift-network-operator/iptables-alerter-nnwhb" Oct 30 08:53:07.033405 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.032746 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-log-socket\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.033405 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.032772 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0df87d60-113c-4039-93a4-06205c202a73-cni-binary-copy\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.033405 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.032843 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-certificates\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:53:07.033405 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.032865 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c444edaf-cb41-4707-a33f-f181873a6b01-tmp\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.033405 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.032930 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-installation-pull-secrets\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:53:07.033405 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.033062 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Oct 30 08:53:07.033405 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.033070 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0df87d60-113c-4039-93a4-06205c202a73-cni-binary-copy\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.033405 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.033117 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-run-openvswitch\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.033405 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.033148 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.033405 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.033181 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-certificates\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:53:07.033405 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.033227 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c3e38a1c-cf20-4170-a71e-5fdc414e2343-config\") pod \"service-ca-operator-544d749c8c-cdnwr\" (UID: \"c3e38a1c-cf20-4170-a71e-5fdc414e2343\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-cdnwr" Oct 30 08:53:07.033405 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.033228 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-certificates\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:53:07.033405 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.033370 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-certificates\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:53:07.033949 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.033421 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c3e38a1c-cf20-4170-a71e-5fdc414e2343-config\") pod \"service-ca-operator-544d749c8c-cdnwr\" (UID: \"c3e38a1c-cf20-4170-a71e-5fdc414e2343\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-cdnwr" Oct 30 08:53:07.033949 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.033458 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-registration-dir\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:53:07.033949 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.033468 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 30 08:53:07.033949 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.033463 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Oct 30 08:53:07.033949 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.033489 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97b9l\" (UniqueName: \"kubernetes.io/projected/0a14ed2f-0a6c-4ed6-b05a-54f733f19453-kube-api-access-97b9l\") pod \"volume-data-source-validator-58c9f5f46d-jxz7s\" (UID: \"0a14ed2f-0a6c-4ed6-b05a-54f733f19453\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-jxz7s" Oct 30 08:53:07.033949 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.033545 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/af7f9e2a-c57b-4396-bd6e-40c05cf1ef42-serviceca\") pod \"node-ca-9fzvv\" (UID: \"af7f9e2a-c57b-4396-bd6e-40c05cf1ef42\") " pod="openshift-image-registry/node-ca-9fzvv" Oct 30 08:53:07.033949 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.033579 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-host\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.033949 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.033602 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80da5ad0-0b1d-40da-82b8-97202a58ee9f-service-ca-bundle\") pod \"insights-operator-7c4986d449-46mmb\" (UID: \"80da5ad0-0b1d-40da-82b8-97202a58ee9f\") " pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:53:07.033949 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.033635 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-lib-modules\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.033949 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.033697 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rh8c\" (UniqueName: \"kubernetes.io/projected/cc213059-e0bc-4602-8d5c-6c79e962d6a5-kube-api-access-5rh8c\") pod \"migrator-66df5d496b-vwfzm\" (UID: \"cc213059-e0bc-4602-8d5c-6c79e962d6a5\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vwfzm" Oct 30 08:53:07.033949 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.033745 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-tls\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:53:07.033949 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.033757 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/af7f9e2a-c57b-4396-bd6e-40c05cf1ef42-serviceca\") pod \"node-ca-9fzvv\" (UID: \"af7f9e2a-c57b-4396-bd6e-40c05cf1ef42\") " pod="openshift-image-registry/node-ca-9fzvv" Oct 30 08:53:07.033949 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.033799 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d03bffbe-b198-427f-86cb-e854d42260a5-ovn-node-metrics-cert\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.033949 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.033842 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80da5ad0-0b1d-40da-82b8-97202a58ee9f-service-ca-bundle\") pod \"insights-operator-7c4986d449-46mmb\" (UID: \"80da5ad0-0b1d-40da-82b8-97202a58ee9f\") " pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:53:07.033949 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.033916 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-metrics-certs\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:53:07.033949 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.033944 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-sys\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.034574 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.033968 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-var-lib-openvswitch\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.034574 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034007 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh9pf\" (UniqueName: \"kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-kube-api-access-nh9pf\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:53:07.034574 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034046 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8c3809a-d264-4139-8805-9b25c0f50f6a-data-volume\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:07.034574 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034062 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 08:53:07.034574 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034066 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8gzrt\"" Oct 30 08:53:07.034574 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034073 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-cnibin\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.034574 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034126 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8c3809a-d264-4139-8805-9b25c0f50f6a-data-volume\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:07.034574 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034123 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-service-ca-bundle\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:53:07.034574 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034166 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c444edaf-cb41-4707-a33f-f181873a6b01-etc-tuned\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.034574 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034192 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80da5ad0-0b1d-40da-82b8-97202a58ee9f-tmp\") pod \"insights-operator-7c4986d449-46mmb\" (UID: \"80da5ad0-0b1d-40da-82b8-97202a58ee9f\") " pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:53:07.034574 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034236 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-var-lib-kubelet\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.034574 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034259 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c444edaf-cb41-4707-a33f-f181873a6b01-etc-tuned\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.034574 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034309 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Oct 30 08:53:07.034574 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034330 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Oct 30 08:53:07.034574 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034337 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80da5ad0-0b1d-40da-82b8-97202a58ee9f-tmp\") pod \"insights-operator-7c4986d449-46mmb\" (UID: \"80da5ad0-0b1d-40da-82b8-97202a58ee9f\") " pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:53:07.034574 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034352 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 30 08:53:07.034574 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034378 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 30 08:53:07.034574 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034409 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 08:53:07.034574 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034410 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-l5kmc\"" Oct 30 08:53:07.034574 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034427 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-b8hf4\"" Oct 30 08:53:07.034574 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034432 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-xvwnz\"" Oct 30 08:53:07.034574 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034454 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zg48k\"" Oct 30 08:53:07.034574 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034459 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-mkl4r\"" Oct 30 08:53:07.034574 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034467 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 30 08:53:07.034574 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034562 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-82c76\"" Oct 30 08:53:07.035233 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034636 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-csfq5\"" Oct 30 08:53:07.035233 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034711 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gmnvz\"" Oct 30 08:53:07.035233 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034715 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-dg55c\"" Oct 30 08:53:07.035233 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034777 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Oct 30 08:53:07.035233 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034815 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hkwvt\"" Oct 30 08:53:07.035233 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034892 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Oct 30 08:53:07.035233 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034906 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-8kjgd\"" Oct 30 08:53:07.035233 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034957 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 30 08:53:07.035233 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.034993 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qg8jt\"" Oct 30 08:53:07.035233 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.035028 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-z8lm4\"" Oct 30 08:53:07.035233 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.035068 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Oct 30 08:53:07.035233 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.035115 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Oct 30 08:53:07.035233 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.035168 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sjrcm\"" Oct 30 08:53:07.035233 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.035199 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xsbkc\"" Oct 30 08:53:07.035578 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.035261 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vphtr\"" Oct 30 08:53:07.035578 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.035306 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Oct 30 08:53:07.035578 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.035380 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-vrjk7\"" Oct 30 08:53:07.035578 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.035416 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8d9hk\"" Oct 30 08:53:07.035578 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.035487 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 30 08:53:07.038240 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.038225 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/da1dbfc6-084c-467f-84c2-4cf1cdea8c54-signing-key\") pod \"service-ca-5fffc97bdf-bjczz\" (UID: \"da1dbfc6-084c-467f-84c2-4cf1cdea8c54\") " pod="openshift-service-ca/service-ca-5fffc97bdf-bjczz" Oct 30 08:53:07.038309 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.038273 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f039cecc-3f4f-4e9b-94e5-5d46918f9487-original-pull-secret\") pod \"global-pull-secret-syncer-xgdfr\" (UID: \"f039cecc-3f4f-4e9b-94e5-5d46918f9487\") " pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:53:07.038355 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.038305 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-stats-auth\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:53:07.039440 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.039426 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0c1ebb77-bd76-4329-ac03-87f60b688431-serving-cert\") pod \"console-operator-7cd56b8dbc-6jb9v\" (UID: \"0c1ebb77-bd76-4329-ac03-87f60b688431\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" Oct 30 08:53:07.039440 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.039432 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c3e38a1c-cf20-4170-a71e-5fdc414e2343-serving-cert\") pod \"service-ca-operator-544d749c8c-cdnwr\" (UID: \"c3e38a1c-cf20-4170-a71e-5fdc414e2343\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-cdnwr" Oct 30 08:53:07.040762 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.040745 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e1be1b32-6246-4b96-a707-6df15d3d950f-agent-certs\") pod \"konnectivity-agent-wzfpw\" (UID: \"e1be1b32-6246-4b96-a707-6df15d3d950f\") " pod="kube-system/konnectivity-agent-wzfpw" Oct 30 08:53:07.041907 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.041891 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-default-certificate\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:53:07.041945 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.041929 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06e7e9e5-ebd3-4e67-95ba-03eeebcee619-cert\") pod \"ingress-canary-j4lkv\" (UID: \"06e7e9e5-ebd3-4e67-95ba-03eeebcee619\") " pod="openshift-ingress-canary/ingress-canary-j4lkv" Oct 30 08:53:07.044269 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.044252 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d03bffbe-b198-427f-86cb-e854d42260a5-ovn-node-metrics-cert\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.048435 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.048416 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mq2k\" (UniqueName: \"kubernetes.io/projected/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-kube-api-access-6mq2k\") pod \"periodic-gathering-948ql-pgchp\" (UID: \"fc5de6fe-b01e-4773-acc5-e04e5af9e11a\") " pod="openshift-insights/periodic-gathering-948ql-pgchp" Oct 30 08:53:07.048504 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.048451 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttr59\" (UniqueName: \"kubernetes.io/projected/26e2f6af-5dbf-44c2-9acf-58c70be503bf-kube-api-access-ttr59\") pod \"network-check-target-gn6v4\" (UID: \"26e2f6af-5dbf-44c2-9acf-58c70be503bf\") " pod="openshift-network-diagnostics/network-check-target-gn6v4" Oct 30 08:53:07.049285 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.049267 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z9bt\" (UniqueName: \"kubernetes.io/projected/e0eac401-f877-428f-b85c-271fa0aca679-kube-api-access-6z9bt\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:53:07.049364 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.049301 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xlkp\" (UniqueName: \"kubernetes.io/projected/0c1ebb77-bd76-4329-ac03-87f60b688431-kube-api-access-9xlkp\") pod \"console-operator-7cd56b8dbc-6jb9v\" (UID: \"0c1ebb77-bd76-4329-ac03-87f60b688431\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" Oct 30 08:53:07.050042 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.050020 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsdlm\" (UniqueName: \"kubernetes.io/projected/da1dbfc6-084c-467f-84c2-4cf1cdea8c54-kube-api-access-nsdlm\") pod \"service-ca-5fffc97bdf-bjczz\" (UID: \"da1dbfc6-084c-467f-84c2-4cf1cdea8c54\") " pod="openshift-service-ca/service-ca-5fffc97bdf-bjczz" Oct 30 08:53:07.056530 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.056502 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xwjk\" (UniqueName: \"kubernetes.io/projected/401c58ab-82cc-4baf-9d77-31e18a3a5cb7-kube-api-access-6xwjk\") pod \"migrator-66df5d496b-24gg7\" (UID: \"401c58ab-82cc-4baf-9d77-31e18a3a5cb7\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-24gg7" Oct 30 08:53:07.056846 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.056820 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlspr\" (UniqueName: \"kubernetes.io/projected/fece1d69-0824-4ecc-ad78-cea4e19bde61-kube-api-access-wlspr\") pod \"network-metrics-daemon-rtjs6\" (UID: \"fece1d69-0824-4ecc-ad78-cea4e19bde61\") " pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:53:07.056951 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.056859 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpszg\" (UniqueName: \"kubernetes.io/projected/e02c520e-2276-440e-8f36-1047f78af40a-kube-api-access-dpszg\") pod \"cluster-monitoring-operator-884576c57-r95n6\" (UID: \"e02c520e-2276-440e-8f36-1047f78af40a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-r95n6" Oct 30 08:53:07.057459 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.057434 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm8s9\" (UniqueName: \"kubernetes.io/projected/0e9e7178-b316-431d-851b-565dfc341afa-kube-api-access-tm8s9\") pod \"kas-connection-checker-685895c7c9-mzwbj\" (UID: \"0e9e7178-b316-431d-851b-565dfc341afa\") " pod="kube-system/kas-connection-checker-685895c7c9-mzwbj" Oct 30 08:53:07.057705 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.057685 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tlk8\" (UniqueName: \"kubernetes.io/projected/e5371073-8444-4462-93f1-2cb7cfd54d9f-kube-api-access-4tlk8\") pod \"kas-connection-checker-685895c7c9-q4sp5\" (UID: \"e5371073-8444-4462-93f1-2cb7cfd54d9f\") " pod="kube-system/kas-connection-checker-685895c7c9-q4sp5" Oct 30 08:53:07.058104 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.058086 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72tnd\" (UniqueName: \"kubernetes.io/projected/80da5ad0-0b1d-40da-82b8-97202a58ee9f-kube-api-access-72tnd\") pod \"insights-operator-7c4986d449-46mmb\" (UID: \"80da5ad0-0b1d-40da-82b8-97202a58ee9f\") " pod="openshift-insights/insights-operator-7c4986d449-46mmb" Oct 30 08:53:07.058251 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.058235 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvxv8\" (UniqueName: \"kubernetes.io/projected/0df87d60-113c-4039-93a4-06205c202a73-kube-api-access-dvxv8\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.058917 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.058894 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwf4v\" (UniqueName: \"kubernetes.io/projected/c3e38a1c-cf20-4170-a71e-5fdc414e2343-kube-api-access-rwf4v\") pod \"service-ca-operator-544d749c8c-cdnwr\" (UID: \"c3e38a1c-cf20-4170-a71e-5fdc414e2343\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-cdnwr" Oct 30 08:53:07.059051 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.059014 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxbkp\" (UniqueName: \"kubernetes.io/projected/d03bffbe-b198-427f-86cb-e854d42260a5-kube-api-access-gxbkp\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.059148 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.059126 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq7cl\" (UniqueName: \"kubernetes.io/projected/55ed1a9f-f5a7-44fd-8b91-01d4e25f651a-kube-api-access-gq7cl\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9\" (UID: \"55ed1a9f-f5a7-44fd-8b91-01d4e25f651a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9" Oct 30 08:53:07.059319 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.058851 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f529x\" (UniqueName: \"kubernetes.io/projected/097227b5-19cd-449b-88a1-ce703f741481-kube-api-access-f529x\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:53:07.059382 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.059308 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwsgv\" (UniqueName: \"kubernetes.io/projected/094983e9-88e8-4881-be25-8ba5d8bc0979-kube-api-access-vwsgv\") pod \"node-resolver-bqlk7\" (UID: \"094983e9-88e8-4881-be25-8ba5d8bc0979\") " pod="openshift-dns/node-resolver-bqlk7" Oct 30 08:53:07.059834 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.059818 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wlpn\" (UniqueName: \"kubernetes.io/projected/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb-kube-api-access-7wlpn\") pod \"cluster-samples-operator-6ddb6c8b94-99562\" (UID: \"a88ad1f8-2002-4e56-abcb-47c68c0a1fbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-99562" Oct 30 08:53:07.061756 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.061735 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqwgq\" (UniqueName: \"kubernetes.io/projected/f8c3809a-d264-4139-8805-9b25c0f50f6a-kube-api-access-hqwgq\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:07.062060 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.062045 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh9pf\" (UniqueName: \"kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-kube-api-access-nh9pf\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:53:07.062109 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.062089 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvpsp\" (UniqueName: \"kubernetes.io/projected/af7f9e2a-c57b-4396-bd6e-40c05cf1ef42-kube-api-access-zvpsp\") pod \"node-ca-9fzvv\" (UID: \"af7f9e2a-c57b-4396-bd6e-40c05cf1ef42\") " pod="openshift-image-registry/node-ca-9fzvv" Oct 30 08:53:07.062976 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.062952 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrlct\" (UniqueName: \"kubernetes.io/projected/06e7e9e5-ebd3-4e67-95ba-03eeebcee619-kube-api-access-wrlct\") pod \"ingress-canary-j4lkv\" (UID: \"06e7e9e5-ebd3-4e67-95ba-03eeebcee619\") " pod="openshift-ingress-canary/ingress-canary-j4lkv" Oct 30 08:53:07.069788 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.068810 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q2kt\" (UniqueName: \"kubernetes.io/projected/c444edaf-cb41-4707-a33f-f181873a6b01-kube-api-access-4q2kt\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.069788 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.068852 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwwbq\" (UniqueName: \"kubernetes.io/projected/d4b82adb-d2fe-406a-a9e9-ea28cb3679ff-kube-api-access-lwwbq\") pod \"kas-connection-checker-685895c7c9-prnqf\" (UID: \"d4b82adb-d2fe-406a-a9e9-ea28cb3679ff\") " pod="kube-system/kas-connection-checker-685895c7c9-prnqf" Oct 30 08:53:07.069788 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.068901 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh7rw\" (UniqueName: \"kubernetes.io/projected/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-kube-api-access-zh7rw\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:53:07.069788 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.068934 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2w8s\" (UniqueName: \"kubernetes.io/projected/e5ddc593-a1bb-4f35-be9e-77b6f9486945-kube-api-access-b2w8s\") pod \"dns-default-vbv2z\" (UID: \"e5ddc593-a1bb-4f35-be9e-77b6f9486945\") " pod="openshift-dns/dns-default-vbv2z" Oct 30 08:53:07.069788 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.069113 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzbp9\" (UniqueName: \"kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-kube-api-access-hzbp9\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:53:07.069788 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.069239 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-bound-sa-token\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:53:07.069788 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.069328 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rh8c\" (UniqueName: \"kubernetes.io/projected/cc213059-e0bc-4602-8d5c-6c79e962d6a5-kube-api-access-5rh8c\") pod \"migrator-66df5d496b-vwfzm\" (UID: \"cc213059-e0bc-4602-8d5c-6c79e962d6a5\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vwfzm" Oct 30 08:53:07.069788 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.069535 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97b9l\" (UniqueName: \"kubernetes.io/projected/0a14ed2f-0a6c-4ed6-b05a-54f733f19453-kube-api-access-97b9l\") pod \"volume-data-source-validator-58c9f5f46d-jxz7s\" (UID: \"0a14ed2f-0a6c-4ed6-b05a-54f733f19453\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-jxz7s" Oct 30 08:53:07.069788 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.069570 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxv9t\" (UniqueName: \"kubernetes.io/projected/3447411a-b1de-406a-9df8-4d5e565add87-kube-api-access-sxv9t\") pod \"iptables-alerter-nnwhb\" (UID: \"3447411a-b1de-406a-9df8-4d5e565add87\") " pod="openshift-network-operator/iptables-alerter-nnwhb" Oct 30 08:53:07.069788 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.069658 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt6ng\" (UniqueName: \"kubernetes.io/projected/fdbaa900-aa36-4984-a2f3-c5c973e75d8a-kube-api-access-mt6ng\") pod \"network-check-source-6f78d59f99-qvd5x\" (UID: \"fdbaa900-aa36-4984-a2f3-c5c973e75d8a\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-qvd5x" Oct 30 08:53:07.070293 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.070274 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-bound-sa-token\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:53:07.135133 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135071 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-var-lib-kubelet\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.135133 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135104 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-var-lib-cni-bin\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.135133 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135120 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-modprobe-d\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.135310 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135141 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0eac401-f877-428f-b85c-271fa0aca679-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:53:07.135310 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135162 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-run-systemd\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.135310 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135182 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-var-lib-cni-bin\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.135310 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135185 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-multus-cni-dir\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.135310 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135227 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-var-lib-kubelet\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.135310 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135243 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0eac401-f877-428f-b85c-271fa0aca679-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:53:07.135310 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135260 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-multus-cni-dir\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.135310 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135270 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-modprobe-d\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.135310 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135247 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-99562\" (UID: \"a88ad1f8-2002-4e56-abcb-47c68c0a1fbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-99562" Oct 30 08:53:07.135310 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135309 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-multus-conf-dir\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.135707 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135263 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-run-systemd\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.135707 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135336 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-tls\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:53:07.135707 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135357 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-multus-conf-dir\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.135707 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135364 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fece1d69-0824-4ecc-ad78-cea4e19bde61-metrics-certs\") pod \"network-metrics-daemon-rtjs6\" (UID: \"fece1d69-0824-4ecc-ad78-cea4e19bde61\") " pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:53:07.135707 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135391 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-systemd-units\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.135707 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135413 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-slash\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.135707 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135436 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-run-multus-certs\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.135707 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135452 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-systemd-units\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.135707 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135464 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f8c3809a-d264-4139-8805-9b25c0f50f6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:07.135707 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135462 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-slash\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.135707 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135480 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-run-multus-certs\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.135707 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:53:07.135444 5028 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 08:53:07.135707 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135503 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-var-lib-cni-multus\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.135707 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135548 5028 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 30 08:53:07.135707 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:53:07.135564 5028 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fece1d69-0824-4ecc-ad78-cea4e19bde61-metrics-certs podName:fece1d69-0824-4ecc-ad78-cea4e19bde61 nodeName:}" failed. No retries permitted until 2026-10-30 08:53:07.635541202 +0000 UTC m=+1.851653559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fece1d69-0824-4ecc-ad78-cea4e19bde61-metrics-certs") pod "network-metrics-daemon-rtjs6" (UID: "fece1d69-0824-4ecc-ad78-cea4e19bde61") : secret "metrics-daemon-secret" not found Oct 30 08:53:07.135707 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135533 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af7f9e2a-c57b-4396-bd6e-40c05cf1ef42-host\") pod \"node-ca-9fzvv\" (UID: \"af7f9e2a-c57b-4396-bd6e-40c05cf1ef42\") " pod="openshift-image-registry/node-ca-9fzvv" Oct 30 08:53:07.135707 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135582 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-var-lib-cni-multus\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.135707 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135593 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-sysconfig\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.135707 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135597 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af7f9e2a-c57b-4396-bd6e-40c05cf1ef42-host\") pod \"node-ca-9fzvv\" (UID: \"af7f9e2a-c57b-4396-bd6e-40c05cf1ef42\") " pod="openshift-image-registry/node-ca-9fzvv" Oct 30 08:53:07.135707 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135619 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f039cecc-3f4f-4e9b-94e5-5d46918f9487-dbus\") pod \"global-pull-secret-syncer-xgdfr\" (UID: \"f039cecc-3f4f-4e9b-94e5-5d46918f9487\") " pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:53:07.135707 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135642 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-sys-fs\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:53:07.135707 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135650 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-sysconfig\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.135707 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135667 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-kubernetes\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.135707 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135690 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0eac401-f877-428f-b85c-271fa0aca679-cnibin\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:53:07.135707 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135703 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f039cecc-3f4f-4e9b-94e5-5d46918f9487-dbus\") pod \"global-pull-secret-syncer-xgdfr\" (UID: \"f039cecc-3f4f-4e9b-94e5-5d46918f9487\") " pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:53:07.135707 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135715 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-sysctl-d\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135737 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-run\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135757 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-kubernetes\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135760 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-kubelet\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135793 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-run-ovn-kubernetes\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135797 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-kubelet\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135817 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-device-dir\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135839 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-sys-fs\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135861 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-device-dir\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135895 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-run\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135902 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-run-ovn-kubernetes\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135921 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-var-lib-kubelet\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135939 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0eac401-f877-428f-b85c-271fa0aca679-cnibin\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135950 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-sysctl-d\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135955 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-cni-bin\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135991 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5ddc593-a1bb-4f35-be9e-77b6f9486945-metrics-tls\") pod \"dns-default-vbv2z\" (UID: \"e5ddc593-a1bb-4f35-be9e-77b6f9486945\") " pod="openshift-dns/dns-default-vbv2z" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135966 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f8c3809a-d264-4139-8805-9b25c0f50f6a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136011 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-cni-bin\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136019 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-etc-selinux\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.135991 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-var-lib-kubelet\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136043 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3447411a-b1de-406a-9df8-4d5e565add87-host-slash\") pod \"iptables-alerter-nnwhb\" (UID: \"3447411a-b1de-406a-9df8-4d5e565add87\") " pod="openshift-network-operator/iptables-alerter-nnwhb" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136066 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-run-netns\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:53:07.136076 5028 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136090 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-etc-selinux\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136092 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-run-netns\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:53:07.136125 5028 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5ddc593-a1bb-4f35-be9e-77b6f9486945-metrics-tls podName:e5ddc593-a1bb-4f35-be9e-77b6f9486945 nodeName:}" failed. No retries permitted until 2026-10-30 08:53:07.636109081 +0000 UTC m=+1.852221419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5ddc593-a1bb-4f35-be9e-77b6f9486945-metrics-tls") pod "dns-default-vbv2z" (UID: "e5ddc593-a1bb-4f35-be9e-77b6f9486945") : secret "dns-default-metrics-tls" not found Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136128 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-run-netns\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136138 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3447411a-b1de-406a-9df8-4d5e565add87-host-slash\") pod \"iptables-alerter-nnwhb\" (UID: \"3447411a-b1de-406a-9df8-4d5e565add87\") " pod="openshift-network-operator/iptables-alerter-nnwhb" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136152 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-system-cni-dir\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136153 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-run-netns\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136221 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-node-log\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136227 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-system-cni-dir\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136242 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-socket-dir\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136258 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-etc-openvswitch\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136267 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-node-log\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136275 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-cni-netd\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136303 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f039cecc-3f4f-4e9b-94e5-5d46918f9487-kubelet-config\") pod \"global-pull-secret-syncer-xgdfr\" (UID: \"f039cecc-3f4f-4e9b-94e5-5d46918f9487\") " pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136313 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-etc-openvswitch\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136317 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-socket-dir\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136326 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-etc-kubernetes\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136346 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-cni-netd\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136353 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f8c3809a-d264-4139-8805-9b25c0f50f6a-crio-socket\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136358 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-etc-kubernetes\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136381 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0eac401-f877-428f-b85c-271fa0aca679-system-cni-dir\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136390 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f8c3809a-d264-4139-8805-9b25c0f50f6a-crio-socket\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136387 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f039cecc-3f4f-4e9b-94e5-5d46918f9487-kubelet-config\") pod \"global-pull-secret-syncer-xgdfr\" (UID: \"f039cecc-3f4f-4e9b-94e5-5d46918f9487\") " pod="kube-system/global-pull-secret-syncer-xgdfr" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136411 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0eac401-f877-428f-b85c-271fa0aca679-system-cni-dir\") pod \"multus-additional-cni-plugins-xwrk9\" (UID: \"e0eac401-f877-428f-b85c-271fa0aca679\") " pod="openshift-multus/multus-additional-cni-plugins-xwrk9" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136407 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-hostroot\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136450 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-sysctl-conf\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136457 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-hostroot\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136473 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-systemd\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136494 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-run-ovn\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136512 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-run-k8s-cni-cncf-io\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136531 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136563 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-run-ovn\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136565 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e02c520e-2276-440e-8f36-1047f78af40a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-r95n6\" (UID: \"e02c520e-2276-440e-8f36-1047f78af40a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-r95n6" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136595 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-host-run-k8s-cni-cncf-io\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136604 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-multus-socket-dir-parent\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:53:07.136642 5028 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136654 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-multus-socket-dir-parent\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136664 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0994c04f-63a8-4b19-a4a1-9a0c288a26f5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8q4xg\" (UID: \"0994c04f-63a8-4b19-a4a1-9a0c288a26f5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8q4xg" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:53:07.136688 5028 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02c520e-2276-440e-8f36-1047f78af40a-cluster-monitoring-operator-tls podName:e02c520e-2276-440e-8f36-1047f78af40a nodeName:}" failed. No retries permitted until 2026-10-30 08:53:07.636673743 +0000 UTC m=+1.852786091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e02c520e-2276-440e-8f36-1047f78af40a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-r95n6" (UID: "e02c520e-2276-440e-8f36-1047f78af40a") : secret "cluster-monitoring-operator-tls" not found Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136685 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136701 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-systemd\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136716 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8c3809a-d264-4139-8805-9b25c0f50f6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136741 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-etc-sysctl-conf\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136743 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/094983e9-88e8-4881-be25-8ba5d8bc0979-hosts-file\") pod \"node-resolver-bqlk7\" (UID: \"094983e9-88e8-4881-be25-8ba5d8bc0979\") " pod="openshift-dns/node-resolver-bqlk7" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136787 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/094983e9-88e8-4881-be25-8ba5d8bc0979-hosts-file\") pod \"node-resolver-bqlk7\" (UID: \"094983e9-88e8-4881-be25-8ba5d8bc0979\") " pod="openshift-dns/node-resolver-bqlk7" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136792 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-log-socket\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136830 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-log-socket\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:53:07.136843 5028 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:53:07.136889 5028 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8c3809a-d264-4139-8805-9b25c0f50f6a-insights-runtime-extractor-tls podName:f8c3809a-d264-4139-8805-9b25c0f50f6a nodeName:}" failed. No retries permitted until 2026-10-30 08:53:07.636873388 +0000 UTC m=+1.852985724 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f8c3809a-d264-4139-8805-9b25c0f50f6a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wphsz" (UID: "f8c3809a-d264-4139-8805-9b25c0f50f6a") : secret "insights-runtime-extractor-tls" not found Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136905 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-run-openvswitch\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136932 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136941 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-run-openvswitch\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136957 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-registration-dir\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:53:07.136908 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136981 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-host\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.140073 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.136986 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.140073 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.137021 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/097227b5-19cd-449b-88a1-ce703f741481-registration-dir\") pod \"aws-ebs-csi-driver-node-wr6kc\" (UID: \"097227b5-19cd-449b-88a1-ce703f741481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wr6kc" Oct 30 08:53:07.140073 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.137029 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-host\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.140073 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.137047 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-lib-modules\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.140073 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.137068 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-tls\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:53:07.140073 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.137096 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-metrics-certs\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:53:07.140073 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.137118 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-sys\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.140073 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.137139 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-var-lib-openvswitch\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.140073 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.137163 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-cnibin\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.140073 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.137171 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-lib-modules\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.140073 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.137184 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-service-ca-bundle\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:53:07.140073 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.137237 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d03bffbe-b198-427f-86cb-e854d42260a5-var-lib-openvswitch\") pod \"ovnkube-node-gdgzh\" (UID: \"d03bffbe-b198-427f-86cb-e854d42260a5\") " pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:07.140073 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.137286 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0df87d60-113c-4039-93a4-06205c202a73-cnibin\") pod \"multus-s9pz8\" (UID: \"0df87d60-113c-4039-93a4-06205c202a73\") " pod="openshift-multus/multus-s9pz8" Oct 30 08:53:07.140073 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.137342 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c444edaf-cb41-4707-a33f-f181873a6b01-sys\") pod \"tuned-kw85k\" (UID: \"c444edaf-cb41-4707-a33f-f181873a6b01\") " pod="openshift-cluster-node-tuning-operator/tuned-kw85k" Oct 30 08:53:07.140073 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.137996 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-service-ca-bundle\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:53:07.140073 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.138241 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-tls\") pod \"image-registry-b77f4b5fc-fdtlw\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:53:07.140073 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.139054 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a88ad1f8-2002-4e56-abcb-47c68c0a1fbb-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-99562\" (UID: \"a88ad1f8-2002-4e56-abcb-47c68c0a1fbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-99562" Oct 30 08:53:07.140073 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.139224 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0994c04f-63a8-4b19-a4a1-9a0c288a26f5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-8q4xg\" (UID: \"0994c04f-63a8-4b19-a4a1-9a0c288a26f5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-8q4xg" Oct 30 08:53:07.140073 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.139683 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f-metrics-certs\") pod \"router-default-777d6b9d77-br8dn\" (UID: \"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f\") " pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:53:07.140073 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.139797 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-tls\") pod \"image-registry-7c5bffb4d-x885p\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:53:07.217846 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.217825 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:53:07.218797 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.218776 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:53:07.219990 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.219974 5028 scope.go:122] "RemoveContainer" containerID="f1033586986f47ff6f946cc9a123fa0e7182cff004274b45e877e858a7e2d2c2" Oct 30 08:53:07.220292 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.220274 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-99562" Oct 30 08:53:07.221077 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.221056 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-8q4xg" Oct 30 08:53:07.230052 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.230037 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:53:07.565460 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.565431 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c5bffb4d-x885p"] Oct 30 08:53:07.570672 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:07.570639 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e5c0d3f_6e6c_44d8_b50d_cecacd28474d.slice/crio-9dc2547001f7c4319c0976628dbf1b5d3dcec462bc1139124da15cad4ff1cb33 WatchSource:0}: Error finding container 9dc2547001f7c4319c0976628dbf1b5d3dcec462bc1139124da15cad4ff1cb33: Status 404 returned error can't find the container with id 9dc2547001f7c4319c0976628dbf1b5d3dcec462bc1139124da15cad4ff1cb33 Oct 30 08:53:07.584445 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.584425 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-777d6b9d77-br8dn"] Oct 30 08:53:07.600016 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:07.599583 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf26f2650_b317_4a4b_8dbc_0c1aa2e80f1f.slice/crio-62cfdb284a852eebb5e879aca227c5411d116f96ade18d1097eaf2e48ec7bb73 WatchSource:0}: Error finding container 62cfdb284a852eebb5e879aca227c5411d116f96ade18d1097eaf2e48ec7bb73: Status 404 returned error can't find the container with id 62cfdb284a852eebb5e879aca227c5411d116f96ade18d1097eaf2e48ec7bb73 Oct 30 08:53:07.644617 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.644572 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5ddc593-a1bb-4f35-be9e-77b6f9486945-metrics-tls\") pod \"dns-default-vbv2z\" (UID: \"e5ddc593-a1bb-4f35-be9e-77b6f9486945\") " pod="openshift-dns/dns-default-vbv2z" Oct 30 08:53:07.644710 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.644615 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e02c520e-2276-440e-8f36-1047f78af40a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-r95n6\" (UID: \"e02c520e-2276-440e-8f36-1047f78af40a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-r95n6" Oct 30 08:53:07.644710 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.644645 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8c3809a-d264-4139-8805-9b25c0f50f6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:07.644710 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.644692 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fece1d69-0824-4ecc-ad78-cea4e19bde61-metrics-certs\") pod \"network-metrics-daemon-rtjs6\" (UID: \"fece1d69-0824-4ecc-ad78-cea4e19bde61\") " pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:53:07.644824 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:53:07.644717 5028 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Oct 30 08:53:07.644824 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:53:07.644725 5028 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 08:53:07.644824 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:53:07.644771 5028 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02c520e-2276-440e-8f36-1047f78af40a-cluster-monitoring-operator-tls podName:e02c520e-2276-440e-8f36-1047f78af40a nodeName:}" failed. No retries permitted until 2026-10-30 08:53:08.6447575 +0000 UTC m=+2.860869862 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e02c520e-2276-440e-8f36-1047f78af40a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-r95n6" (UID: "e02c520e-2276-440e-8f36-1047f78af40a") : secret "cluster-monitoring-operator-tls" not found Oct 30 08:53:07.644824 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:53:07.644779 5028 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 08:53:07.644824 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:53:07.644786 5028 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5ddc593-a1bb-4f35-be9e-77b6f9486945-metrics-tls podName:e5ddc593-a1bb-4f35-be9e-77b6f9486945 nodeName:}" failed. No retries permitted until 2026-10-30 08:53:08.644780257 +0000 UTC m=+2.860892593 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5ddc593-a1bb-4f35-be9e-77b6f9486945-metrics-tls") pod "dns-default-vbv2z" (UID: "e5ddc593-a1bb-4f35-be9e-77b6f9486945") : secret "dns-default-metrics-tls" not found Oct 30 08:53:07.644973 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:53:07.644837 5028 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8c3809a-d264-4139-8805-9b25c0f50f6a-insights-runtime-extractor-tls podName:f8c3809a-d264-4139-8805-9b25c0f50f6a nodeName:}" failed. No retries permitted until 2026-10-30 08:53:08.644822296 +0000 UTC m=+2.860934638 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f8c3809a-d264-4139-8805-9b25c0f50f6a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wphsz" (UID: "f8c3809a-d264-4139-8805-9b25c0f50f6a") : secret "insights-runtime-extractor-tls" not found Oct 30 08:53:07.646837 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.646808 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fece1d69-0824-4ecc-ad78-cea4e19bde61-metrics-certs\") pod \"network-metrics-daemon-rtjs6\" (UID: \"fece1d69-0824-4ecc-ad78-cea4e19bde61\") " pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:53:07.647441 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.647422 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b77f4b5fc-fdtlw"] Oct 30 08:53:07.652408 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:07.652387 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd1a7b7e_e1dd_4361_9091_b2983dff06da.slice/crio-dd57350e5c0fc27ee2262762904af138c63e2402628a66e3b68dfafcdac6b44e WatchSource:0}: Error finding container dd57350e5c0fc27ee2262762904af138c63e2402628a66e3b68dfafcdac6b44e: Status 404 returned error can't find the container with id dd57350e5c0fc27ee2262762904af138c63e2402628a66e3b68dfafcdac6b44e Oct 30 08:53:07.674121 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.674098 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-99562"] Oct 30 08:53:07.677529 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.677512 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-8q4xg"] Oct 30 08:53:07.687628 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.687609 5028 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 08:53:07.827878 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.827850 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtjs6" Oct 30 08:53:07.970135 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.969633 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" event={"ID":"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d","Type":"ContainerStarted","Data":"112f9c12384833aae1b8f9239557bb23699d7ce48d8e268580aa17cb00f2e405"} Oct 30 08:53:07.970135 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.969699 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" event={"ID":"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d","Type":"ContainerStarted","Data":"9dc2547001f7c4319c0976628dbf1b5d3dcec462bc1139124da15cad4ff1cb33"} Oct 30 08:53:07.971225 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.971179 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-8q4xg" event={"ID":"0994c04f-63a8-4b19-a4a1-9a0c288a26f5","Type":"ContainerStarted","Data":"96eea6e6aae852d40c2f9de704317debfe8fde75ca54f11bfdbeec481cb95327"} Oct 30 08:53:07.972539 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.972513 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-99562" event={"ID":"a88ad1f8-2002-4e56-abcb-47c68c0a1fbb","Type":"ContainerStarted","Data":"47471f88adeeb67109cac499103afc1c20340a39f10c5df0644f48c948b72a11"} Oct 30 08:53:07.974872 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.974853 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6jb9v_0c1ebb77-bd76-4329-ac03-87f60b688431/console-operator/1.log" Oct 30 08:53:07.974972 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.974945 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" event={"ID":"0c1ebb77-bd76-4329-ac03-87f60b688431","Type":"ContainerStarted","Data":"573dc87b906ca7b61eb62155e1a144f7bd5385a8f9d02007cea4bb0d547843a2"} Oct 30 08:53:07.976834 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.976808 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-777d6b9d77-br8dn" event={"ID":"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f","Type":"ContainerStarted","Data":"38e6e5e5c0da5c670061f298b5d2ebadd74146226c50f72d44a2c8dee5be9354"} Oct 30 08:53:07.976934 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.976849 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-777d6b9d77-br8dn" event={"ID":"f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f","Type":"ContainerStarted","Data":"62cfdb284a852eebb5e879aca227c5411d116f96ade18d1097eaf2e48ec7bb73"} Oct 30 08:53:07.983340 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.983311 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" event={"ID":"cd1a7b7e-e1dd-4361-9091-b2983dff06da","Type":"ContainerStarted","Data":"c8042f309a7ffecf99284f109e0aeba51fce60db2e1ed3d67489c312652e5f39"} Oct 30 08:53:07.983436 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:07.983381 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" event={"ID":"cd1a7b7e-e1dd-4361-9091-b2983dff06da","Type":"ContainerStarted","Data":"dd57350e5c0fc27ee2262762904af138c63e2402628a66e3b68dfafcdac6b44e"} Oct 30 08:53:08.144451 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:08.144373 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rtjs6"] Oct 30 08:53:08.219514 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:08.219492 5028 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:53:08.222147 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:08.222124 5028 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:53:08.655639 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:08.655603 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e02c520e-2276-440e-8f36-1047f78af40a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-r95n6\" (UID: \"e02c520e-2276-440e-8f36-1047f78af40a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-r95n6" Oct 30 08:53:08.655805 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:08.655653 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8c3809a-d264-4139-8805-9b25c0f50f6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:08.655805 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:08.655732 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5ddc593-a1bb-4f35-be9e-77b6f9486945-metrics-tls\") pod \"dns-default-vbv2z\" (UID: \"e5ddc593-a1bb-4f35-be9e-77b6f9486945\") " pod="openshift-dns/dns-default-vbv2z" Oct 30 08:53:08.655894 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:53:08.655854 5028 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 08:53:08.655964 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:53:08.655952 5028 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5ddc593-a1bb-4f35-be9e-77b6f9486945-metrics-tls podName:e5ddc593-a1bb-4f35-be9e-77b6f9486945 nodeName:}" failed. No retries permitted until 2026-10-30 08:53:10.655934227 +0000 UTC m=+4.872046585 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e5ddc593-a1bb-4f35-be9e-77b6f9486945-metrics-tls") pod "dns-default-vbv2z" (UID: "e5ddc593-a1bb-4f35-be9e-77b6f9486945") : secret "dns-default-metrics-tls" not found Oct 30 08:53:08.656834 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:53:08.656734 5028 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 08:53:08.656834 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:53:08.656810 5028 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8c3809a-d264-4139-8805-9b25c0f50f6a-insights-runtime-extractor-tls podName:f8c3809a-d264-4139-8805-9b25c0f50f6a nodeName:}" failed. No retries permitted until 2026-10-30 08:53:10.656792972 +0000 UTC m=+4.872905324 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f8c3809a-d264-4139-8805-9b25c0f50f6a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wphsz" (UID: "f8c3809a-d264-4139-8805-9b25c0f50f6a") : secret "insights-runtime-extractor-tls" not found Oct 30 08:53:08.668064 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:08.668038 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e02c520e-2276-440e-8f36-1047f78af40a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-r95n6\" (UID: \"e02c520e-2276-440e-8f36-1047f78af40a\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-r95n6" Oct 30 08:53:08.719874 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:08.719848 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-r95n6" Oct 30 08:53:08.991195 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:08.991121 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-8q4xg" event={"ID":"0994c04f-63a8-4b19-a4a1-9a0c288a26f5","Type":"ContainerStarted","Data":"f718435eb93cf989d791a20bcc904229f1c94577d4a36d06bb2697d3dfa08e2f"} Oct 30 08:53:08.993576 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:08.993547 5028 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 08:53:08.993576 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:08.993553 5028 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 08:53:08.993576 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:08.993568 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rtjs6" event={"ID":"fece1d69-0824-4ecc-ad78-cea4e19bde61","Type":"ContainerStarted","Data":"8bc52cab1a9589bb827456799b3fb8aa36caef04f998defd6135b490da210ad6"} Oct 30 08:53:09.036175 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:09.036143 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-r95n6"] Oct 30 08:53:09.042696 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:09.042668 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode02c520e_2276_440e_8f36_1047f78af40a.slice/crio-c381eb0681651ebb6b0f89cea3a40236f09ecc083412f8ce06329a00216a39b8 WatchSource:0}: Error finding container c381eb0681651ebb6b0f89cea3a40236f09ecc083412f8ce06329a00216a39b8: Status 404 returned error can't find the container with id c381eb0681651ebb6b0f89cea3a40236f09ecc083412f8ce06329a00216a39b8 Oct 30 08:53:09.999625 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:09.999579 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-r95n6" event={"ID":"e02c520e-2276-440e-8f36-1047f78af40a","Type":"ContainerStarted","Data":"c381eb0681651ebb6b0f89cea3a40236f09ecc083412f8ce06329a00216a39b8"} Oct 30 08:53:10.001623 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:10.001586 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-99562" event={"ID":"a88ad1f8-2002-4e56-abcb-47c68c0a1fbb","Type":"ContainerStarted","Data":"d38cd4e886a887041ed39515bc2dc1644b24778788222f1f70915239a9cd546a"} Oct 30 08:53:10.001764 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:10.001636 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-99562" event={"ID":"a88ad1f8-2002-4e56-abcb-47c68c0a1fbb","Type":"ContainerStarted","Data":"6ddd858021b4f6c29352a0bb7502ae8c834d27c137a27eac92a317426472e865"} Oct 30 08:53:10.003857 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:10.003830 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rtjs6" event={"ID":"fece1d69-0824-4ecc-ad78-cea4e19bde61","Type":"ContainerStarted","Data":"731f7bcaadc60425dcbc8dc8709e050c403aa81a4d1ac9d7262941d013c3eb6b"} Oct 30 08:53:10.003857 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:10.003878 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rtjs6" event={"ID":"fece1d69-0824-4ecc-ad78-cea4e19bde61","Type":"ContainerStarted","Data":"f1fd78da42c50385ec42f82058b98ac24a11a20884c67350f817c5c7a8134abf"} Oct 30 08:53:10.004109 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:10.004082 5028 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 08:53:10.106672 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:10.106645 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:10.306040 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:10.305976 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:53:10.307441 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:10.307417 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-777d6b9d77-br8dn" Oct 30 08:53:10.674512 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:10.674479 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8c3809a-d264-4139-8805-9b25c0f50f6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:10.674659 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:10.674557 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5ddc593-a1bb-4f35-be9e-77b6f9486945-metrics-tls\") pod \"dns-default-vbv2z\" (UID: \"e5ddc593-a1bb-4f35-be9e-77b6f9486945\") " pod="openshift-dns/dns-default-vbv2z" Oct 30 08:53:10.674659 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:53:10.674591 5028 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 08:53:10.674736 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:53:10.674670 5028 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8c3809a-d264-4139-8805-9b25c0f50f6a-insights-runtime-extractor-tls podName:f8c3809a-d264-4139-8805-9b25c0f50f6a nodeName:}" failed. No retries permitted until 2026-10-30 08:53:14.674654958 +0000 UTC m=+8.890767295 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f8c3809a-d264-4139-8805-9b25c0f50f6a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wphsz" (UID: "f8c3809a-d264-4139-8805-9b25c0f50f6a") : secret "insights-runtime-extractor-tls" not found Oct 30 08:53:10.676746 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:10.676724 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5ddc593-a1bb-4f35-be9e-77b6f9486945-metrics-tls\") pod \"dns-default-vbv2z\" (UID: \"e5ddc593-a1bb-4f35-be9e-77b6f9486945\") " pod="openshift-dns/dns-default-vbv2z" Oct 30 08:53:10.830857 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:10.830832 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vbv2z" Oct 30 08:53:10.905838 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:10.905809 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:11.009692 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:11.009621 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-r95n6" event={"ID":"e02c520e-2276-440e-8f36-1047f78af40a","Type":"ContainerStarted","Data":"07f6b7e5d39526111b0ee66f4892e394db0bf8ce6f4c815233d57acb24f7b6d2"} Oct 30 08:53:11.009692 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:11.009663 5028 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 08:53:11.129170 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:11.129144 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vbv2z"] Oct 30 08:53:11.130882 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:11.130855 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5ddc593_a1bb_4f35_be9e_77b6f9486945.slice/crio-942f375478a202b30b793816634788b4c5889b360d47833cdc9ea73fb01ea4aa WatchSource:0}: Error finding container 942f375478a202b30b793816634788b4c5889b360d47833cdc9ea73fb01ea4aa: Status 404 returned error can't find the container with id 942f375478a202b30b793816634788b4c5889b360d47833cdc9ea73fb01ea4aa Oct 30 08:53:11.834312 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:11.834281 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gdgzh" Oct 30 08:53:12.016605 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:12.016570 5028 generic.go:356] "Generic (PLEG): container finished" podID="55ed1a9f-f5a7-44fd-8b91-01d4e25f651a" containerID="edb1b18d79970d52edaf78c8f908b9d6ee819cebd4cd6db1cc8dcd50875d3bea" exitCode=0 Oct 30 08:53:12.017067 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:12.016655 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9" event={"ID":"55ed1a9f-f5a7-44fd-8b91-01d4e25f651a","Type":"ContainerDied","Data":"edb1b18d79970d52edaf78c8f908b9d6ee819cebd4cd6db1cc8dcd50875d3bea"} Oct 30 08:53:12.017067 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:12.016999 5028 scope.go:122] "RemoveContainer" containerID="edb1b18d79970d52edaf78c8f908b9d6ee819cebd4cd6db1cc8dcd50875d3bea" Oct 30 08:53:12.019910 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:12.019885 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vbv2z" event={"ID":"e5ddc593-a1bb-4f35-be9e-77b6f9486945","Type":"ContainerStarted","Data":"942f375478a202b30b793816634788b4c5889b360d47833cdc9ea73fb01ea4aa"} Oct 30 08:53:12.231611 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:12.231485 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gn6v4" Oct 30 08:53:12.819889 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:12.819863 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" Oct 30 08:53:12.820030 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:12.820007 5028 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 08:53:12.824620 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:12.824600 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-6jb9v" Oct 30 08:53:13.025506 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:13.025473 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h4gr9" event={"ID":"55ed1a9f-f5a7-44fd-8b91-01d4e25f651a","Type":"ContainerStarted","Data":"209478ad0c8b60d29a1eeae50150b49679112ec8168f67286465ae2ca101b283"} Oct 30 08:53:13.027376 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:13.027350 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vbv2z" event={"ID":"e5ddc593-a1bb-4f35-be9e-77b6f9486945","Type":"ContainerStarted","Data":"60ffd80b683a913efe85a47adc070f495288fe0465eadd666843f4fc4860a900"} Oct 30 08:53:13.027484 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:13.027395 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vbv2z" event={"ID":"e5ddc593-a1bb-4f35-be9e-77b6f9486945","Type":"ContainerStarted","Data":"fdaef86294f09fd92d7f9a1e4ca9f4e05a7740958c1873f261e72bf102930840"} Oct 30 08:53:13.027537 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:13.027482 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vbv2z" Oct 30 08:53:14.710898 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:14.710857 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8c3809a-d264-4139-8805-9b25c0f50f6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:14.713281 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:14.713259 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8c3809a-d264-4139-8805-9b25c0f50f6a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wphsz\" (UID: \"f8c3809a-d264-4139-8805-9b25c0f50f6a\") " pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:14.732339 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:14.732314 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wphsz" Oct 30 08:53:14.885820 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:14.885795 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:53:15.030365 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:15.030312 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wphsz"] Oct 30 08:53:15.036463 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:15.036443 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8c3809a_d264_4139_8805_9b25c0f50f6a.slice/crio-882a2689c52c31cc074c60775b526d3c4f6f6a4e5c2b6223ddffa1c95c467a4f WatchSource:0}: Error finding container 882a2689c52c31cc074c60775b526d3c4f6f6a4e5c2b6223ddffa1c95c467a4f: Status 404 returned error can't find the container with id 882a2689c52c31cc074c60775b526d3c4f6f6a4e5c2b6223ddffa1c95c467a4f Oct 30 08:53:15.794522 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:15.794501 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:53:16.040180 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:16.040111 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wphsz" event={"ID":"f8c3809a-d264-4139-8805-9b25c0f50f6a","Type":"ContainerStarted","Data":"a55f8bd3b5364bb4302ddad8ae33ea558297f0cd3c56190ab568dcabe6474c0a"} Oct 30 08:53:16.040180 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:16.040161 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wphsz" event={"ID":"f8c3809a-d264-4139-8805-9b25c0f50f6a","Type":"ContainerStarted","Data":"ad91cc4916ee99cff1f5e0875509ee5284999db6755785e2cbaf097b015d71b1"} Oct 30 08:53:16.040365 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:16.040182 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wphsz" event={"ID":"f8c3809a-d264-4139-8805-9b25c0f50f6a","Type":"ContainerStarted","Data":"882a2689c52c31cc074c60775b526d3c4f6f6a4e5c2b6223ddffa1c95c467a4f"} Oct 30 08:53:16.976567 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:16.976544 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wzfpw" Oct 30 08:53:17.046317 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:17.046295 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wphsz" event={"ID":"f8c3809a-d264-4139-8805-9b25c0f50f6a","Type":"ContainerStarted","Data":"7a9dffbf0e1dda89485617d1d24365c0e751887db7c2584e7b9e54467c7c6fd7"} Oct 30 08:53:20.366280 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:20.366244 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c5bffb4d-x885p"] Oct 30 08:53:23.033696 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:23.033664 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vbv2z" Oct 30 08:53:25.799756 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:25.799723 5028 patch_prober.go:29] interesting pod/image-registry-b77f4b5fc-fdtlw container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Oct 30 08:53:25.800297 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:25.799789 5028 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" podUID="cd1a7b7e-e1dd-4361-9091-b2983dff06da" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 08:53:27.612037 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:27.611982 5028 patch_prober.go:29] interesting pod/image-registry-b77f4b5fc-fdtlw container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Oct 30 08:53:27.612572 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:27.612058 5028 prober.go:122] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" podUID="cd1a7b7e-e1dd-4361-9091-b2983dff06da" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 08:53:28.644634 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.644604 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7n5wn"] Oct 30 08:53:28.651455 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.651424 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7n5wn" Oct 30 08:53:28.712016 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.711991 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Oct 30 08:53:28.712140 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.712018 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2whhd\"" Oct 30 08:53:28.712140 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.712017 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Oct 30 08:53:28.713491 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.713470 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ec5cfee8-15c1-4ed9-a140-8297f697c4ad-node-exporter-wtmp\") pod \"node-exporter-7n5wn\" (UID: \"ec5cfee8-15c1-4ed9-a140-8297f697c4ad\") " pod="openshift-monitoring/node-exporter-7n5wn" Oct 30 08:53:28.713596 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.713500 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smtql\" (UniqueName: \"kubernetes.io/projected/ec5cfee8-15c1-4ed9-a140-8297f697c4ad-kube-api-access-smtql\") pod \"node-exporter-7n5wn\" (UID: \"ec5cfee8-15c1-4ed9-a140-8297f697c4ad\") " pod="openshift-monitoring/node-exporter-7n5wn" Oct 30 08:53:28.713596 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.713518 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ec5cfee8-15c1-4ed9-a140-8297f697c4ad-node-exporter-textfile\") pod \"node-exporter-7n5wn\" (UID: \"ec5cfee8-15c1-4ed9-a140-8297f697c4ad\") " pod="openshift-monitoring/node-exporter-7n5wn" Oct 30 08:53:28.713596 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.713542 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ec5cfee8-15c1-4ed9-a140-8297f697c4ad-root\") pod \"node-exporter-7n5wn\" (UID: \"ec5cfee8-15c1-4ed9-a140-8297f697c4ad\") " pod="openshift-monitoring/node-exporter-7n5wn" Oct 30 08:53:28.713754 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.713680 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec5cfee8-15c1-4ed9-a140-8297f697c4ad-sys\") pod \"node-exporter-7n5wn\" (UID: \"ec5cfee8-15c1-4ed9-a140-8297f697c4ad\") " pod="openshift-monitoring/node-exporter-7n5wn" Oct 30 08:53:28.713754 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.713713 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec5cfee8-15c1-4ed9-a140-8297f697c4ad-metrics-client-ca\") pod \"node-exporter-7n5wn\" (UID: \"ec5cfee8-15c1-4ed9-a140-8297f697c4ad\") " pod="openshift-monitoring/node-exporter-7n5wn" Oct 30 08:53:28.713825 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.713784 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ec5cfee8-15c1-4ed9-a140-8297f697c4ad-node-exporter-accelerators-collector-config\") pod \"node-exporter-7n5wn\" (UID: \"ec5cfee8-15c1-4ed9-a140-8297f697c4ad\") " pod="openshift-monitoring/node-exporter-7n5wn" Oct 30 08:53:28.713874 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.713821 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ec5cfee8-15c1-4ed9-a140-8297f697c4ad-node-exporter-tls\") pod \"node-exporter-7n5wn\" (UID: \"ec5cfee8-15c1-4ed9-a140-8297f697c4ad\") " pod="openshift-monitoring/node-exporter-7n5wn" Oct 30 08:53:28.713874 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.713841 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec5cfee8-15c1-4ed9-a140-8297f697c4ad-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7n5wn\" (UID: \"ec5cfee8-15c1-4ed9-a140-8297f697c4ad\") " pod="openshift-monitoring/node-exporter-7n5wn" Oct 30 08:53:28.760325 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.760303 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Oct 30 08:53:28.760408 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.760360 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Oct 30 08:53:28.814426 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.814406 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec5cfee8-15c1-4ed9-a140-8297f697c4ad-sys\") pod \"node-exporter-7n5wn\" (UID: \"ec5cfee8-15c1-4ed9-a140-8297f697c4ad\") " pod="openshift-monitoring/node-exporter-7n5wn" Oct 30 08:53:28.814521 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.814430 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec5cfee8-15c1-4ed9-a140-8297f697c4ad-metrics-client-ca\") pod \"node-exporter-7n5wn\" (UID: \"ec5cfee8-15c1-4ed9-a140-8297f697c4ad\") " pod="openshift-monitoring/node-exporter-7n5wn" Oct 30 08:53:28.814521 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.814453 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ec5cfee8-15c1-4ed9-a140-8297f697c4ad-node-exporter-accelerators-collector-config\") pod \"node-exporter-7n5wn\" (UID: \"ec5cfee8-15c1-4ed9-a140-8297f697c4ad\") " pod="openshift-monitoring/node-exporter-7n5wn" Oct 30 08:53:28.814521 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.814475 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ec5cfee8-15c1-4ed9-a140-8297f697c4ad-node-exporter-tls\") pod \"node-exporter-7n5wn\" (UID: \"ec5cfee8-15c1-4ed9-a140-8297f697c4ad\") " pod="openshift-monitoring/node-exporter-7n5wn" Oct 30 08:53:28.814521 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.814493 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec5cfee8-15c1-4ed9-a140-8297f697c4ad-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7n5wn\" (UID: \"ec5cfee8-15c1-4ed9-a140-8297f697c4ad\") " pod="openshift-monitoring/node-exporter-7n5wn" Oct 30 08:53:28.814737 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.814520 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec5cfee8-15c1-4ed9-a140-8297f697c4ad-sys\") pod \"node-exporter-7n5wn\" (UID: \"ec5cfee8-15c1-4ed9-a140-8297f697c4ad\") " pod="openshift-monitoring/node-exporter-7n5wn" Oct 30 08:53:28.814737 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.814527 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ec5cfee8-15c1-4ed9-a140-8297f697c4ad-node-exporter-wtmp\") pod \"node-exporter-7n5wn\" (UID: \"ec5cfee8-15c1-4ed9-a140-8297f697c4ad\") " pod="openshift-monitoring/node-exporter-7n5wn" Oct 30 08:53:28.814737 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.814588 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smtql\" (UniqueName: \"kubernetes.io/projected/ec5cfee8-15c1-4ed9-a140-8297f697c4ad-kube-api-access-smtql\") pod \"node-exporter-7n5wn\" (UID: \"ec5cfee8-15c1-4ed9-a140-8297f697c4ad\") " pod="openshift-monitoring/node-exporter-7n5wn" Oct 30 08:53:28.814737 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.814623 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ec5cfee8-15c1-4ed9-a140-8297f697c4ad-node-exporter-textfile\") pod \"node-exporter-7n5wn\" (UID: \"ec5cfee8-15c1-4ed9-a140-8297f697c4ad\") " pod="openshift-monitoring/node-exporter-7n5wn" Oct 30 08:53:28.814737 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.814641 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ec5cfee8-15c1-4ed9-a140-8297f697c4ad-node-exporter-wtmp\") pod \"node-exporter-7n5wn\" (UID: \"ec5cfee8-15c1-4ed9-a140-8297f697c4ad\") " pod="openshift-monitoring/node-exporter-7n5wn" Oct 30 08:53:28.814737 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.814667 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ec5cfee8-15c1-4ed9-a140-8297f697c4ad-root\") pod \"node-exporter-7n5wn\" (UID: \"ec5cfee8-15c1-4ed9-a140-8297f697c4ad\") " pod="openshift-monitoring/node-exporter-7n5wn" Oct 30 08:53:28.814976 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.814737 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ec5cfee8-15c1-4ed9-a140-8297f697c4ad-root\") pod \"node-exporter-7n5wn\" (UID: \"ec5cfee8-15c1-4ed9-a140-8297f697c4ad\") " pod="openshift-monitoring/node-exporter-7n5wn" Oct 30 08:53:28.814976 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.814937 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ec5cfee8-15c1-4ed9-a140-8297f697c4ad-node-exporter-textfile\") pod \"node-exporter-7n5wn\" (UID: \"ec5cfee8-15c1-4ed9-a140-8297f697c4ad\") " pod="openshift-monitoring/node-exporter-7n5wn" Oct 30 08:53:28.815085 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.815039 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec5cfee8-15c1-4ed9-a140-8297f697c4ad-metrics-client-ca\") pod \"node-exporter-7n5wn\" (UID: \"ec5cfee8-15c1-4ed9-a140-8297f697c4ad\") " pod="openshift-monitoring/node-exporter-7n5wn" Oct 30 08:53:28.815085 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.815078 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ec5cfee8-15c1-4ed9-a140-8297f697c4ad-node-exporter-accelerators-collector-config\") pod \"node-exporter-7n5wn\" (UID: \"ec5cfee8-15c1-4ed9-a140-8297f697c4ad\") " pod="openshift-monitoring/node-exporter-7n5wn" Oct 30 08:53:28.816880 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.816859 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec5cfee8-15c1-4ed9-a140-8297f697c4ad-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7n5wn\" (UID: \"ec5cfee8-15c1-4ed9-a140-8297f697c4ad\") " pod="openshift-monitoring/node-exporter-7n5wn" Oct 30 08:53:28.817050 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.817031 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ec5cfee8-15c1-4ed9-a140-8297f697c4ad-node-exporter-tls\") pod \"node-exporter-7n5wn\" (UID: \"ec5cfee8-15c1-4ed9-a140-8297f697c4ad\") " pod="openshift-monitoring/node-exporter-7n5wn" Oct 30 08:53:28.837243 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.837224 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smtql\" (UniqueName: \"kubernetes.io/projected/ec5cfee8-15c1-4ed9-a140-8297f697c4ad-kube-api-access-smtql\") pod \"node-exporter-7n5wn\" (UID: \"ec5cfee8-15c1-4ed9-a140-8297f697c4ad\") " pod="openshift-monitoring/node-exporter-7n5wn" Oct 30 08:53:28.970924 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:28.970871 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7n5wn" Oct 30 08:53:29.002230 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:53:29.002189 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec5cfee8_15c1_4ed9_a140_8297f697c4ad.slice/crio-b5d055c7d3f6f49435913b90d98d44f266cd4c3ac5b97bda571df6de02d930e2 WatchSource:0}: Error finding container b5d055c7d3f6f49435913b90d98d44f266cd4c3ac5b97bda571df6de02d930e2: Status 404 returned error can't find the container with id b5d055c7d3f6f49435913b90d98d44f266cd4c3ac5b97bda571df6de02d930e2 Oct 30 08:53:29.094624 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:29.094597 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7n5wn" event={"ID":"ec5cfee8-15c1-4ed9-a140-8297f697c4ad","Type":"ContainerStarted","Data":"b5d055c7d3f6f49435913b90d98d44f266cd4c3ac5b97bda571df6de02d930e2"} Oct 30 08:53:30.371866 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:30.371842 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:53:31.103275 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:31.103240 5028 generic.go:356] "Generic (PLEG): container finished" podID="ec5cfee8-15c1-4ed9-a140-8297f697c4ad" containerID="90ccdd869ff92ac59bcca6265a3ca093427389f0b436bfa7fa01add8b429195c" exitCode=0 Oct 30 08:53:31.103436 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:31.103309 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7n5wn" event={"ID":"ec5cfee8-15c1-4ed9-a140-8297f697c4ad","Type":"ContainerDied","Data":"90ccdd869ff92ac59bcca6265a3ca093427389f0b436bfa7fa01add8b429195c"} Oct 30 08:53:32.109860 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:32.109823 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7n5wn" event={"ID":"ec5cfee8-15c1-4ed9-a140-8297f697c4ad","Type":"ContainerStarted","Data":"b495030c53159ee48a4cc038852df8d353059783ab33e5baf2620e38c3ec68bd"} Oct 30 08:53:32.110247 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:32.109885 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7n5wn" event={"ID":"ec5cfee8-15c1-4ed9-a140-8297f697c4ad","Type":"ContainerStarted","Data":"b6af7d363a5208fd775b696bc2d396240cc3d3b00d5fb053436e49eb2fcb033f"} Oct 30 08:53:32.180126 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:32.180066 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7n5wn" podStartSLOduration=2.747469632 podStartE2EDuration="4.180053828s" totalImagesPullingTime="1.352449012s" totalInitContainerRuntime="80.135184ms" isStatefulPod=true podCreationTimestamp="2026-10-30 08:53:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:53:32.167571661 +0000 UTC m=+26.383684020" watchObservedRunningTime="2026-10-30 08:53:32.180053828 +0000 UTC m=+26.396166186" Oct 30 08:53:35.801896 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:35.801867 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:53:42.234844 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:42.234811 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gn6v4" Oct 30 08:53:42.741851 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:53:42.741813 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 08:53:44.016595 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:44.016566 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b77f4b5fc-fdtlw"] Oct 30 08:53:45.389178 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:45.389137 5028 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" podUID="9e5c0d3f-6e6c-44d8-b50d-cecacd28474d" containerName="registry" containerID="cri-o://112f9c12384833aae1b8f9239557bb23699d7ce48d8e268580aa17cb00f2e405" gracePeriod=30 Oct 30 08:53:45.637029 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:45.637004 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:53:45.733862 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:45.733797 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-ca-trust-extracted\") pod \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " Oct 30 08:53:45.733862 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:45.733839 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-tls\" (UniqueName: \"kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-tls\") pod \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " Oct 30 08:53:45.734055 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:45.733866 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-kube-api-access-hzbp9\" (UniqueName: \"kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-kube-api-access-hzbp9\") pod \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " Oct 30 08:53:45.734055 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:45.733891 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-bound-sa-token\") pod \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " Oct 30 08:53:45.734055 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:45.733928 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-trusted-ca\") pod \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " Oct 30 08:53:45.734055 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:45.733965 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-certificates\") pod \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " Oct 30 08:53:45.734055 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:45.734001 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-image-registry-private-configuration\") pod \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " Oct 30 08:53:45.734055 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:45.734032 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-installation-pull-secrets\") pod \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\" (UID: \"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d\") " Oct 30 08:53:45.734547 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:45.734479 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-trusted-ca" pod "9e5c0d3f-6e6c-44d8-b50d-cecacd28474d" (UID: "9e5c0d3f-6e6c-44d8-b50d-cecacd28474d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 08:53:45.735151 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:45.735117 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-certificates" pod "9e5c0d3f-6e6c-44d8-b50d-cecacd28474d" (UID: "9e5c0d3f-6e6c-44d8-b50d-cecacd28474d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 08:53:45.736753 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:45.736728 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-tls" pod "9e5c0d3f-6e6c-44d8-b50d-cecacd28474d" (UID: "9e5c0d3f-6e6c-44d8-b50d-cecacd28474d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 08:53:45.736870 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:45.736723 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-bound-sa-token" pod "9e5c0d3f-6e6c-44d8-b50d-cecacd28474d" (UID: "9e5c0d3f-6e6c-44d8-b50d-cecacd28474d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 08:53:45.736870 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:45.736757 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-installation-pull-secrets" pod "9e5c0d3f-6e6c-44d8-b50d-cecacd28474d" (UID: "9e5c0d3f-6e6c-44d8-b50d-cecacd28474d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 08:53:45.736998 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:45.736918 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-kube-api-access-hzbp9" pod "9e5c0d3f-6e6c-44d8-b50d-cecacd28474d" (UID: "9e5c0d3f-6e6c-44d8-b50d-cecacd28474d"). InnerVolumeSpecName "kube-api-access-hzbp9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 08:53:45.736998 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:45.736935 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-image-registry-private-configuration" pod "9e5c0d3f-6e6c-44d8-b50d-cecacd28474d" (UID: "9e5c0d3f-6e6c-44d8-b50d-cecacd28474d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 08:53:45.741182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:45.741152 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-ca-trust-extracted" pod "9e5c0d3f-6e6c-44d8-b50d-cecacd28474d" (UID: "9e5c0d3f-6e6c-44d8-b50d-cecacd28474d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 08:53:45.835174 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:45.835153 5028 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-trusted-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:53:45.835174 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:45.835174 5028 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-certificates\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:53:45.835312 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:45.835186 5028 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-image-registry-private-configuration\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:53:45.835312 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:45.835196 5028 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-installation-pull-secrets\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:53:45.835312 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:45.835225 5028 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-ca-trust-extracted\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:53:45.835312 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:45.835234 5028 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-registry-tls\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:53:45.835312 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:45.835244 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzbp9\" (UniqueName: \"kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-kube-api-access-hzbp9\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:53:45.835312 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:45.835252 5028 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d-bound-sa-token\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:53:46.167796 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:46.167767 5028 generic.go:356] "Generic (PLEG): container finished" podID="9e5c0d3f-6e6c-44d8-b50d-cecacd28474d" containerID="112f9c12384833aae1b8f9239557bb23699d7ce48d8e268580aa17cb00f2e405" exitCode=0 Oct 30 08:53:46.167948 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:46.167801 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" event={"ID":"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d","Type":"ContainerDied","Data":"112f9c12384833aae1b8f9239557bb23699d7ce48d8e268580aa17cb00f2e405"} Oct 30 08:53:46.167948 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:46.167817 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" Oct 30 08:53:46.167948 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:46.167837 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c5bffb4d-x885p" event={"ID":"9e5c0d3f-6e6c-44d8-b50d-cecacd28474d","Type":"ContainerDied","Data":"9dc2547001f7c4319c0976628dbf1b5d3dcec462bc1139124da15cad4ff1cb33"} Oct 30 08:53:46.167948 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:46.167859 5028 scope.go:122] "RemoveContainer" containerID="112f9c12384833aae1b8f9239557bb23699d7ce48d8e268580aa17cb00f2e405" Oct 30 08:53:46.176936 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:46.176919 5028 scope.go:122] "RemoveContainer" containerID="112f9c12384833aae1b8f9239557bb23699d7ce48d8e268580aa17cb00f2e405" Oct 30 08:53:46.177218 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:53:46.177184 5028 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"112f9c12384833aae1b8f9239557bb23699d7ce48d8e268580aa17cb00f2e405\": container with ID starting with 112f9c12384833aae1b8f9239557bb23699d7ce48d8e268580aa17cb00f2e405 not found: ID does not exist" containerID="112f9c12384833aae1b8f9239557bb23699d7ce48d8e268580aa17cb00f2e405" Oct 30 08:53:46.177282 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:46.177228 5028 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"112f9c12384833aae1b8f9239557bb23699d7ce48d8e268580aa17cb00f2e405"} err="failed to get container status \"112f9c12384833aae1b8f9239557bb23699d7ce48d8e268580aa17cb00f2e405\": rpc error: code = NotFound desc = could not find container \"112f9c12384833aae1b8f9239557bb23699d7ce48d8e268580aa17cb00f2e405\": container with ID starting with 112f9c12384833aae1b8f9239557bb23699d7ce48d8e268580aa17cb00f2e405 not found: ID does not exist" Oct 30 08:53:46.229970 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:46.229933 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c5bffb4d-x885p"] Oct 30 08:53:46.241941 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:46.241918 5028 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7c5bffb4d-x885p"] Oct 30 08:53:47.912576 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:53:47.912495 5028 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9e5c0d3f-6e6c-44d8-b50d-cecacd28474d" path="/var/lib/kubelet/pods/9e5c0d3f-6e6c-44d8-b50d-cecacd28474d/volumes" Oct 30 08:54:09.037964 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:09.037892 5028 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" podUID="cd1a7b7e-e1dd-4361-9091-b2983dff06da" containerName="registry" containerID="cri-o://c8042f309a7ffecf99284f109e0aeba51fce60db2e1ed3d67489c312652e5f39" gracePeriod=30 Oct 30 08:54:09.261945 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:09.261910 5028 generic.go:356] "Generic (PLEG): container finished" podID="cd1a7b7e-e1dd-4361-9091-b2983dff06da" containerID="c8042f309a7ffecf99284f109e0aeba51fce60db2e1ed3d67489c312652e5f39" exitCode=0 Oct 30 08:54:09.262089 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:09.261952 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" event={"ID":"cd1a7b7e-e1dd-4361-9091-b2983dff06da","Type":"ContainerDied","Data":"c8042f309a7ffecf99284f109e0aeba51fce60db2e1ed3d67489c312652e5f39"} Oct 30 08:54:09.279654 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:09.279630 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:54:09.403546 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:09.403518 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cd1a7b7e-e1dd-4361-9091-b2983dff06da-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cd1a7b7e-e1dd-4361-9091-b2983dff06da-ca-trust-extracted\") pod \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " Oct 30 08:54:09.403669 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:09.403573 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-tls\" (UniqueName: \"kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-tls\") pod \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " Oct 30 08:54:09.403669 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:09.403600 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cd1a7b7e-e1dd-4361-9091-b2983dff06da-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cd1a7b7e-e1dd-4361-9091-b2983dff06da-trusted-ca\") pod \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " Oct 30 08:54:09.403669 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:09.403621 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-certificates\") pod \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " Oct 30 08:54:09.403669 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:09.403645 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cd1a7b7e-e1dd-4361-9091-b2983dff06da-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cd1a7b7e-e1dd-4361-9091-b2983dff06da-installation-pull-secrets\") pod \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " Oct 30 08:54:09.403669 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:09.403664 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-bound-sa-token\") pod \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " Oct 30 08:54:09.403991 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:09.403720 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cd1a7b7e-e1dd-4361-9091-b2983dff06da-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cd1a7b7e-e1dd-4361-9091-b2983dff06da-image-registry-private-configuration\") pod \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " Oct 30 08:54:09.403991 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:09.403760 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-kube-api-access-nh9pf\" (UniqueName: \"kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-kube-api-access-nh9pf\") pod \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\" (UID: \"cd1a7b7e-e1dd-4361-9091-b2983dff06da\") " Oct 30 08:54:09.404095 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:09.404031 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-certificates" pod "cd1a7b7e-e1dd-4361-9091-b2983dff06da" (UID: "cd1a7b7e-e1dd-4361-9091-b2983dff06da"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 08:54:09.404095 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:09.404065 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd1a7b7e-e1dd-4361-9091-b2983dff06da-trusted-ca" pod "cd1a7b7e-e1dd-4361-9091-b2983dff06da" (UID: "cd1a7b7e-e1dd-4361-9091-b2983dff06da"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 08:54:09.406265 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:09.406239 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-kube-api-access-nh9pf" pod "cd1a7b7e-e1dd-4361-9091-b2983dff06da" (UID: "cd1a7b7e-e1dd-4361-9091-b2983dff06da"). InnerVolumeSpecName "kube-api-access-nh9pf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 08:54:09.406404 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:09.406380 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-bound-sa-token" pod "cd1a7b7e-e1dd-4361-9091-b2983dff06da" (UID: "cd1a7b7e-e1dd-4361-9091-b2983dff06da"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 08:54:09.406466 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:09.406398 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd1a7b7e-e1dd-4361-9091-b2983dff06da-image-registry-private-configuration" pod "cd1a7b7e-e1dd-4361-9091-b2983dff06da" (UID: "cd1a7b7e-e1dd-4361-9091-b2983dff06da"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 08:54:09.406520 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:09.406466 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-tls" pod "cd1a7b7e-e1dd-4361-9091-b2983dff06da" (UID: "cd1a7b7e-e1dd-4361-9091-b2983dff06da"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 08:54:09.406598 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:09.406581 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd1a7b7e-e1dd-4361-9091-b2983dff06da-installation-pull-secrets" pod "cd1a7b7e-e1dd-4361-9091-b2983dff06da" (UID: "cd1a7b7e-e1dd-4361-9091-b2983dff06da"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 08:54:09.410137 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:09.410111 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd1a7b7e-e1dd-4361-9091-b2983dff06da-ca-trust-extracted" pod "cd1a7b7e-e1dd-4361-9091-b2983dff06da" (UID: "cd1a7b7e-e1dd-4361-9091-b2983dff06da"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 08:54:09.504654 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:09.504633 5028 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cd1a7b7e-e1dd-4361-9091-b2983dff06da-image-registry-private-configuration\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:54:09.504748 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:09.504657 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nh9pf\" (UniqueName: \"kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-kube-api-access-nh9pf\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:54:09.504748 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:09.504667 5028 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cd1a7b7e-e1dd-4361-9091-b2983dff06da-ca-trust-extracted\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:54:09.504748 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:09.504685 5028 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-tls\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:54:09.504748 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:09.504694 5028 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cd1a7b7e-e1dd-4361-9091-b2983dff06da-trusted-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:54:09.504748 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:09.504702 5028 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cd1a7b7e-e1dd-4361-9091-b2983dff06da-registry-certificates\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:54:09.504748 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:09.504711 5028 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cd1a7b7e-e1dd-4361-9091-b2983dff06da-installation-pull-secrets\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:54:09.504748 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:09.504719 5028 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd1a7b7e-e1dd-4361-9091-b2983dff06da-bound-sa-token\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:54:10.267186 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:10.267109 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" event={"ID":"cd1a7b7e-e1dd-4361-9091-b2983dff06da","Type":"ContainerDied","Data":"dd57350e5c0fc27ee2262762904af138c63e2402628a66e3b68dfafcdac6b44e"} Oct 30 08:54:10.267580 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:10.267131 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b77f4b5fc-fdtlw" Oct 30 08:54:10.267580 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:10.267200 5028 scope.go:122] "RemoveContainer" containerID="c8042f309a7ffecf99284f109e0aeba51fce60db2e1ed3d67489c312652e5f39" Oct 30 08:54:10.330395 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:10.330374 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b77f4b5fc-fdtlw"] Oct 30 08:54:10.342219 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:10.342185 5028 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-b77f4b5fc-fdtlw"] Oct 30 08:54:11.272728 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:11.272697 5028 generic.go:356] "Generic (PLEG): container finished" podID="c3e38a1c-cf20-4170-a71e-5fdc414e2343" containerID="3957c36c3a1558e16f31ace2ad9ff350445252a88f3de4e6b518c057cb9e8eac" exitCode=0 Oct 30 08:54:11.273119 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:11.272770 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-cdnwr" event={"ID":"c3e38a1c-cf20-4170-a71e-5fdc414e2343","Type":"ContainerDied","Data":"3957c36c3a1558e16f31ace2ad9ff350445252a88f3de4e6b518c057cb9e8eac"} Oct 30 08:54:11.273119 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:11.273081 5028 scope.go:122] "RemoveContainer" containerID="3957c36c3a1558e16f31ace2ad9ff350445252a88f3de4e6b518c057cb9e8eac" Oct 30 08:54:11.908765 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:11.908737 5028 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cd1a7b7e-e1dd-4361-9091-b2983dff06da" path="/var/lib/kubelet/pods/cd1a7b7e-e1dd-4361-9091-b2983dff06da/volumes" Oct 30 08:54:12.279049 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:12.278979 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-cdnwr" event={"ID":"c3e38a1c-cf20-4170-a71e-5fdc414e2343","Type":"ContainerStarted","Data":"678f63612c4feef2e6e27e2b42fb708b7e953dc90586bebe7e1b8b6eef4a940d"} Oct 30 08:54:12.741557 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:54:12.741523 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 08:54:24.329644 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:24.329566 5028 generic.go:356] "Generic (PLEG): container finished" podID="fc5de6fe-b01e-4773-acc5-e04e5af9e11a" containerID="0d12810b0a62f9593aa21aa026b7979cb8112636a024cf1ed8156da4e532983e" exitCode=0 Oct 30 08:54:24.329644 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:24.329620 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-948ql-pgchp" event={"ID":"fc5de6fe-b01e-4773-acc5-e04e5af9e11a","Type":"ContainerDied","Data":"0d12810b0a62f9593aa21aa026b7979cb8112636a024cf1ed8156da4e532983e"} Oct 30 08:54:25.462857 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:25.462835 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-948ql-pgchp" Oct 30 08:54:25.524243 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:25.524219 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-service-ca-bundle\") pod \"fc5de6fe-b01e-4773-acc5-e04e5af9e11a\" (UID: \"fc5de6fe-b01e-4773-acc5-e04e5af9e11a\") " Oct 30 08:54:25.524570 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:25.524297 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-kube-api-access-6mq2k\" (UniqueName: \"kubernetes.io/projected/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-kube-api-access-6mq2k\") pod \"fc5de6fe-b01e-4773-acc5-e04e5af9e11a\" (UID: \"fc5de6fe-b01e-4773-acc5-e04e5af9e11a\") " Oct 30 08:54:25.524570 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:25.524363 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-trusted-ca-bundle\") pod \"fc5de6fe-b01e-4773-acc5-e04e5af9e11a\" (UID: \"fc5de6fe-b01e-4773-acc5-e04e5af9e11a\") " Oct 30 08:54:25.524570 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:25.524413 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-archives-path\") pod \"fc5de6fe-b01e-4773-acc5-e04e5af9e11a\" (UID: \"fc5de6fe-b01e-4773-acc5-e04e5af9e11a\") " Oct 30 08:54:25.524570 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:25.524507 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-service-ca-bundle" pod "fc5de6fe-b01e-4773-acc5-e04e5af9e11a" (UID: "fc5de6fe-b01e-4773-acc5-e04e5af9e11a"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 08:54:25.524740 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:25.524690 5028 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-service-ca-bundle\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:54:25.524740 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:25.524705 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-trusted-ca-bundle" pod "fc5de6fe-b01e-4773-acc5-e04e5af9e11a" (UID: "fc5de6fe-b01e-4773-acc5-e04e5af9e11a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 08:54:25.524803 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:25.524753 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-archives-path" pod "fc5de6fe-b01e-4773-acc5-e04e5af9e11a" (UID: "fc5de6fe-b01e-4773-acc5-e04e5af9e11a"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 08:54:25.526429 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:25.526403 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-kube-api-access-6mq2k" pod "fc5de6fe-b01e-4773-acc5-e04e5af9e11a" (UID: "fc5de6fe-b01e-4773-acc5-e04e5af9e11a"). InnerVolumeSpecName "kube-api-access-6mq2k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 08:54:25.625379 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:25.625328 5028 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-archives-path\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:54:25.625379 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:25.625351 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mq2k\" (UniqueName: \"kubernetes.io/projected/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-kube-api-access-6mq2k\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:54:25.625379 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:25.625365 5028 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc5de6fe-b01e-4773-acc5-e04e5af9e11a-trusted-ca-bundle\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:54:26.338421 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:26.338389 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-948ql-pgchp" event={"ID":"fc5de6fe-b01e-4773-acc5-e04e5af9e11a","Type":"ContainerDied","Data":"ab9b5428b175e275b196cbd5eba6bf78a9f024864a577e072f21f12f280eb063"} Oct 30 08:54:26.338568 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:26.338433 5028 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab9b5428b175e275b196cbd5eba6bf78a9f024864a577e072f21f12f280eb063" Oct 30 08:54:26.338568 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:26.338402 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-948ql-pgchp" Oct 30 08:54:35.374363 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:35.374314 5028 generic.go:356] "Generic (PLEG): container finished" podID="80da5ad0-0b1d-40da-82b8-97202a58ee9f" containerID="9bf71404274abe588d79708b640ee8776f3a492cdfa836901403448ba8f39503" exitCode=0 Oct 30 08:54:35.374731 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:35.374388 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-46mmb" event={"ID":"80da5ad0-0b1d-40da-82b8-97202a58ee9f","Type":"ContainerDied","Data":"9bf71404274abe588d79708b640ee8776f3a492cdfa836901403448ba8f39503"} Oct 30 08:54:35.374731 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:35.374713 5028 scope.go:122] "RemoveContainer" containerID="9bf71404274abe588d79708b640ee8776f3a492cdfa836901403448ba8f39503" Oct 30 08:54:36.067595 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:36.067560 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-b9qhc-4phk2"] Oct 30 08:54:36.067859 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:36.067848 5028 cpu_manager.go:414] "containerMap: removing container" podUID="9e5c0d3f-6e6c-44d8-b50d-cecacd28474d" containerName="registry" Oct 30 08:54:36.067902 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:36.067860 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9e5c0d3f-6e6c-44d8-b50d-cecacd28474d" containerName="registry" Oct 30 08:54:36.067902 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:36.067871 5028 cpu_manager.go:414] "containerMap: removing container" podUID="fc5de6fe-b01e-4773-acc5-e04e5af9e11a" containerName="insights-gathering" Oct 30 08:54:36.067902 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:36.067876 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fc5de6fe-b01e-4773-acc5-e04e5af9e11a" containerName="insights-gathering" Oct 30 08:54:36.067902 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:36.067889 5028 cpu_manager.go:414] "containerMap: removing container" podUID="cd1a7b7e-e1dd-4361-9091-b2983dff06da" containerName="registry" Oct 30 08:54:36.067902 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:36.067893 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cd1a7b7e-e1dd-4361-9091-b2983dff06da" containerName="registry" Oct 30 08:54:36.068047 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:36.067945 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="9e5c0d3f-6e6c-44d8-b50d-cecacd28474d" containerName="registry" Oct 30 08:54:36.068047 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:36.067952 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="fc5de6fe-b01e-4773-acc5-e04e5af9e11a" containerName="insights-gathering" Oct 30 08:54:36.068047 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:36.067960 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="cd1a7b7e-e1dd-4361-9091-b2983dff06da" containerName="registry" Oct 30 08:54:36.070728 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:36.070710 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-b9qhc-4phk2" Oct 30 08:54:36.088586 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:36.088562 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-b9qhc-4phk2"] Oct 30 08:54:36.099126 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:36.099109 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-z8lm4\"" Oct 30 08:54:36.199047 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:36.199018 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2jr2\" (UniqueName: \"kubernetes.io/projected/2d182e6f-51a8-4e86-854d-78bfe19c1a83-kube-api-access-d2jr2\") pod \"periodic-gathering-b9qhc-4phk2\" (UID: \"2d182e6f-51a8-4e86-854d-78bfe19c1a83\") " pod="openshift-insights/periodic-gathering-b9qhc-4phk2" Oct 30 08:54:36.199163 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:36.199060 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/2d182e6f-51a8-4e86-854d-78bfe19c1a83-archives-path\") pod \"periodic-gathering-b9qhc-4phk2\" (UID: \"2d182e6f-51a8-4e86-854d-78bfe19c1a83\") " pod="openshift-insights/periodic-gathering-b9qhc-4phk2" Oct 30 08:54:36.199163 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:36.199082 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d182e6f-51a8-4e86-854d-78bfe19c1a83-trusted-ca-bundle\") pod \"periodic-gathering-b9qhc-4phk2\" (UID: \"2d182e6f-51a8-4e86-854d-78bfe19c1a83\") " pod="openshift-insights/periodic-gathering-b9qhc-4phk2" Oct 30 08:54:36.199281 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:36.199226 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d182e6f-51a8-4e86-854d-78bfe19c1a83-service-ca-bundle\") pod \"periodic-gathering-b9qhc-4phk2\" (UID: \"2d182e6f-51a8-4e86-854d-78bfe19c1a83\") " pod="openshift-insights/periodic-gathering-b9qhc-4phk2" Oct 30 08:54:36.300162 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:36.300131 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2jr2\" (UniqueName: \"kubernetes.io/projected/2d182e6f-51a8-4e86-854d-78bfe19c1a83-kube-api-access-d2jr2\") pod \"periodic-gathering-b9qhc-4phk2\" (UID: \"2d182e6f-51a8-4e86-854d-78bfe19c1a83\") " pod="openshift-insights/periodic-gathering-b9qhc-4phk2" Oct 30 08:54:36.300318 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:36.300170 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/2d182e6f-51a8-4e86-854d-78bfe19c1a83-archives-path\") pod \"periodic-gathering-b9qhc-4phk2\" (UID: \"2d182e6f-51a8-4e86-854d-78bfe19c1a83\") " pod="openshift-insights/periodic-gathering-b9qhc-4phk2" Oct 30 08:54:36.300318 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:36.300195 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d182e6f-51a8-4e86-854d-78bfe19c1a83-trusted-ca-bundle\") pod \"periodic-gathering-b9qhc-4phk2\" (UID: \"2d182e6f-51a8-4e86-854d-78bfe19c1a83\") " pod="openshift-insights/periodic-gathering-b9qhc-4phk2" Oct 30 08:54:36.300428 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:36.300334 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d182e6f-51a8-4e86-854d-78bfe19c1a83-service-ca-bundle\") pod \"periodic-gathering-b9qhc-4phk2\" (UID: \"2d182e6f-51a8-4e86-854d-78bfe19c1a83\") " pod="openshift-insights/periodic-gathering-b9qhc-4phk2" Oct 30 08:54:36.300591 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:36.300573 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/2d182e6f-51a8-4e86-854d-78bfe19c1a83-archives-path\") pod \"periodic-gathering-b9qhc-4phk2\" (UID: \"2d182e6f-51a8-4e86-854d-78bfe19c1a83\") " pod="openshift-insights/periodic-gathering-b9qhc-4phk2" Oct 30 08:54:36.300884 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:36.300868 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d182e6f-51a8-4e86-854d-78bfe19c1a83-service-ca-bundle\") pod \"periodic-gathering-b9qhc-4phk2\" (UID: \"2d182e6f-51a8-4e86-854d-78bfe19c1a83\") " pod="openshift-insights/periodic-gathering-b9qhc-4phk2" Oct 30 08:54:36.300922 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:36.300899 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d182e6f-51a8-4e86-854d-78bfe19c1a83-trusted-ca-bundle\") pod \"periodic-gathering-b9qhc-4phk2\" (UID: \"2d182e6f-51a8-4e86-854d-78bfe19c1a83\") " pod="openshift-insights/periodic-gathering-b9qhc-4phk2" Oct 30 08:54:36.323387 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:36.323337 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2jr2\" (UniqueName: \"kubernetes.io/projected/2d182e6f-51a8-4e86-854d-78bfe19c1a83-kube-api-access-d2jr2\") pod \"periodic-gathering-b9qhc-4phk2\" (UID: \"2d182e6f-51a8-4e86-854d-78bfe19c1a83\") " pod="openshift-insights/periodic-gathering-b9qhc-4phk2" Oct 30 08:54:36.380711 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:36.380687 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-46mmb" event={"ID":"80da5ad0-0b1d-40da-82b8-97202a58ee9f","Type":"ContainerStarted","Data":"6fe8e0dcc5777b693b44aacd6a8e54b4b5791908b82fda6f2412993dea654cfd"} Oct 30 08:54:36.382059 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:36.382043 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-b9qhc-4phk2" Oct 30 08:54:36.677392 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:36.677355 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-b9qhc-4phk2"] Oct 30 08:54:36.682108 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:54:36.682080 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d182e6f_51a8_4e86_854d_78bfe19c1a83.slice/crio-8524eca79e1b82bc4c5812b9c89a85b92575e39b4ef82d85d16f99c946f16b70 WatchSource:0}: Error finding container 8524eca79e1b82bc4c5812b9c89a85b92575e39b4ef82d85d16f99c946f16b70: Status 404 returned error can't find the container with id 8524eca79e1b82bc4c5812b9c89a85b92575e39b4ef82d85d16f99c946f16b70 Oct 30 08:54:37.386224 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:37.386171 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-b9qhc-4phk2" event={"ID":"2d182e6f-51a8-4e86-854d-78bfe19c1a83","Type":"ContainerStarted","Data":"32012a05a3992076bcae92d7ce111db899403c5c9041a301fb6929e314a9eca0"} Oct 30 08:54:37.386605 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:37.386242 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-b9qhc-4phk2" event={"ID":"2d182e6f-51a8-4e86-854d-78bfe19c1a83","Type":"ContainerStarted","Data":"8524eca79e1b82bc4c5812b9c89a85b92575e39b4ef82d85d16f99c946f16b70"} Oct 30 08:54:37.425605 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:54:37.425558 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-b9qhc-4phk2" podStartSLOduration=1.425543222 podStartE2EDuration="1.425543222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:54:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:54:37.424563656 +0000 UTC m=+91.640676013" watchObservedRunningTime="2026-10-30 08:54:37.425543222 +0000 UTC m=+91.641655574" Oct 30 08:54:42.743574 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:54:42.743532 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 08:55:12.742261 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:55:12.742222 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 08:55:42.744398 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:55:42.744310 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 08:56:01.728566 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:56:01.728532 5028 generic.go:356] "Generic (PLEG): container finished" podID="2d182e6f-51a8-4e86-854d-78bfe19c1a83" containerID="32012a05a3992076bcae92d7ce111db899403c5c9041a301fb6929e314a9eca0" exitCode=0 Oct 30 08:56:01.728983 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:56:01.728603 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-b9qhc-4phk2" event={"ID":"2d182e6f-51a8-4e86-854d-78bfe19c1a83","Type":"ContainerDied","Data":"32012a05a3992076bcae92d7ce111db899403c5c9041a301fb6929e314a9eca0"} Oct 30 08:56:02.857229 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:56:02.857189 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-b9qhc-4phk2" Oct 30 08:56:02.897601 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:56:02.897569 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2d182e6f-51a8-4e86-854d-78bfe19c1a83-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d182e6f-51a8-4e86-854d-78bfe19c1a83-trusted-ca-bundle\") pod \"2d182e6f-51a8-4e86-854d-78bfe19c1a83\" (UID: \"2d182e6f-51a8-4e86-854d-78bfe19c1a83\") " Oct 30 08:56:02.897728 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:56:02.897630 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d182e6f-51a8-4e86-854d-78bfe19c1a83-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/2d182e6f-51a8-4e86-854d-78bfe19c1a83-archives-path\") pod \"2d182e6f-51a8-4e86-854d-78bfe19c1a83\" (UID: \"2d182e6f-51a8-4e86-854d-78bfe19c1a83\") " Oct 30 08:56:02.897728 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:56:02.897658 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2d182e6f-51a8-4e86-854d-78bfe19c1a83-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d182e6f-51a8-4e86-854d-78bfe19c1a83-service-ca-bundle\") pod \"2d182e6f-51a8-4e86-854d-78bfe19c1a83\" (UID: \"2d182e6f-51a8-4e86-854d-78bfe19c1a83\") " Oct 30 08:56:02.897728 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:56:02.897718 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d182e6f-51a8-4e86-854d-78bfe19c1a83-kube-api-access-d2jr2\" (UniqueName: \"kubernetes.io/projected/2d182e6f-51a8-4e86-854d-78bfe19c1a83-kube-api-access-d2jr2\") pod \"2d182e6f-51a8-4e86-854d-78bfe19c1a83\" (UID: \"2d182e6f-51a8-4e86-854d-78bfe19c1a83\") " Oct 30 08:56:02.898047 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:56:02.898001 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d182e6f-51a8-4e86-854d-78bfe19c1a83-trusted-ca-bundle" pod "2d182e6f-51a8-4e86-854d-78bfe19c1a83" (UID: "2d182e6f-51a8-4e86-854d-78bfe19c1a83"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 08:56:02.898047 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:56:02.898043 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d182e6f-51a8-4e86-854d-78bfe19c1a83-service-ca-bundle" pod "2d182e6f-51a8-4e86-854d-78bfe19c1a83" (UID: "2d182e6f-51a8-4e86-854d-78bfe19c1a83"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 08:56:02.898244 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:56:02.898050 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d182e6f-51a8-4e86-854d-78bfe19c1a83-archives-path" pod "2d182e6f-51a8-4e86-854d-78bfe19c1a83" (UID: "2d182e6f-51a8-4e86-854d-78bfe19c1a83"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 08:56:02.900411 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:56:02.900381 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d182e6f-51a8-4e86-854d-78bfe19c1a83-kube-api-access-d2jr2" pod "2d182e6f-51a8-4e86-854d-78bfe19c1a83" (UID: "2d182e6f-51a8-4e86-854d-78bfe19c1a83"). InnerVolumeSpecName "kube-api-access-d2jr2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 08:56:02.999261 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:56:02.999169 5028 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d182e6f-51a8-4e86-854d-78bfe19c1a83-trusted-ca-bundle\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:56:02.999261 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:56:02.999221 5028 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/2d182e6f-51a8-4e86-854d-78bfe19c1a83-archives-path\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:56:02.999261 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:56:02.999231 5028 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d182e6f-51a8-4e86-854d-78bfe19c1a83-service-ca-bundle\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:56:02.999261 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:56:02.999239 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2jr2\" (UniqueName: \"kubernetes.io/projected/2d182e6f-51a8-4e86-854d-78bfe19c1a83-kube-api-access-d2jr2\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:56:03.737606 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:56:03.737578 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-b9qhc-4phk2" Oct 30 08:56:03.737857 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:56:03.737571 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-b9qhc-4phk2" event={"ID":"2d182e6f-51a8-4e86-854d-78bfe19c1a83","Type":"ContainerDied","Data":"8524eca79e1b82bc4c5812b9c89a85b92575e39b4ef82d85d16f99c946f16b70"} Oct 30 08:56:03.737857 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:56:03.737696 5028 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8524eca79e1b82bc4c5812b9c89a85b92575e39b4ef82d85d16f99c946f16b70" Oct 30 08:56:12.740787 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:56:12.740750 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 08:56:42.743499 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:56:42.743460 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 08:57:12.741673 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:57:12.741638 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 08:57:26.831993 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:26.831954 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak6qsd"] Oct 30 08:57:26.834585 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:26.832310 5028 cpu_manager.go:414] "containerMap: removing container" podUID="2d182e6f-51a8-4e86-854d-78bfe19c1a83" containerName="insights-gathering" Oct 30 08:57:26.834585 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:26.832325 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d182e6f-51a8-4e86-854d-78bfe19c1a83" containerName="insights-gathering" Oct 30 08:57:26.834585 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:26.832460 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d182e6f-51a8-4e86-854d-78bfe19c1a83" containerName="insights-gathering" Oct 30 08:57:26.835638 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:26.835622 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak6qsd" Oct 30 08:57:26.849628 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:26.849609 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-scl56\"" Oct 30 08:57:26.861544 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:26.861518 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Oct 30 08:57:26.861673 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:26.861508 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Oct 30 08:57:26.862864 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:26.862844 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak6qsd"] Oct 30 08:57:26.930586 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:26.930567 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c4fwsv"] Oct 30 08:57:26.933826 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:26.933811 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c4fwsv" Oct 30 08:57:26.953351 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:26.953323 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-dztkg\"" Oct 30 08:57:26.954831 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:26.954809 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c4fwsv"] Oct 30 08:57:26.973078 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:26.973053 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgfcp\" (UniqueName: \"kubernetes.io/projected/ba34d7cd-ade7-49b7-bcfc-1caabccd9683-kube-api-access-xgfcp\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak6qsd\" (UID: \"ba34d7cd-ade7-49b7-bcfc-1caabccd9683\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak6qsd" Oct 30 08:57:26.973169 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:26.973088 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba34d7cd-ade7-49b7-bcfc-1caabccd9683-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak6qsd\" (UID: \"ba34d7cd-ade7-49b7-bcfc-1caabccd9683\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak6qsd" Oct 30 08:57:26.973169 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:26.973113 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba34d7cd-ade7-49b7-bcfc-1caabccd9683-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak6qsd\" (UID: \"ba34d7cd-ade7-49b7-bcfc-1caabccd9683\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak6qsd" Oct 30 08:57:27.030841 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.030820 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7frghl"] Oct 30 08:57:27.034141 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.034126 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7frghl" Oct 30 08:57:27.051082 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.051062 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-tn2ns\"" Oct 30 08:57:27.052293 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.052277 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7frghl"] Oct 30 08:57:27.074167 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.074139 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgfcp\" (UniqueName: \"kubernetes.io/projected/ba34d7cd-ade7-49b7-bcfc-1caabccd9683-kube-api-access-xgfcp\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak6qsd\" (UID: \"ba34d7cd-ade7-49b7-bcfc-1caabccd9683\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak6qsd" Oct 30 08:57:27.074283 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.074176 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be6df281-507f-43be-a1cf-e5677ed85bbd-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c4fwsv\" (UID: \"be6df281-507f-43be-a1cf-e5677ed85bbd\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c4fwsv" Oct 30 08:57:27.074283 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.074242 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba34d7cd-ade7-49b7-bcfc-1caabccd9683-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak6qsd\" (UID: \"ba34d7cd-ade7-49b7-bcfc-1caabccd9683\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak6qsd" Oct 30 08:57:27.074283 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.074272 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba34d7cd-ade7-49b7-bcfc-1caabccd9683-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak6qsd\" (UID: \"ba34d7cd-ade7-49b7-bcfc-1caabccd9683\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak6qsd" Oct 30 08:57:27.074429 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.074358 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftqkr\" (UniqueName: \"kubernetes.io/projected/be6df281-507f-43be-a1cf-e5677ed85bbd-kube-api-access-ftqkr\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c4fwsv\" (UID: \"be6df281-507f-43be-a1cf-e5677ed85bbd\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c4fwsv" Oct 30 08:57:27.074429 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.074385 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be6df281-507f-43be-a1cf-e5677ed85bbd-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c4fwsv\" (UID: \"be6df281-507f-43be-a1cf-e5677ed85bbd\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c4fwsv" Oct 30 08:57:27.074728 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.074707 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba34d7cd-ade7-49b7-bcfc-1caabccd9683-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak6qsd\" (UID: \"ba34d7cd-ade7-49b7-bcfc-1caabccd9683\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak6qsd" Oct 30 08:57:27.074768 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.074721 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba34d7cd-ade7-49b7-bcfc-1caabccd9683-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak6qsd\" (UID: \"ba34d7cd-ade7-49b7-bcfc-1caabccd9683\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak6qsd" Oct 30 08:57:27.097089 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.097063 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgfcp\" (UniqueName: \"kubernetes.io/projected/ba34d7cd-ade7-49b7-bcfc-1caabccd9683-kube-api-access-xgfcp\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak6qsd\" (UID: \"ba34d7cd-ade7-49b7-bcfc-1caabccd9683\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak6qsd" Oct 30 08:57:27.134589 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.134566 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnrcf"] Oct 30 08:57:27.137996 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.137980 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnrcf" Oct 30 08:57:27.151781 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.151762 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak6qsd" Oct 30 08:57:27.152270 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.152254 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-rpndh\"" Oct 30 08:57:27.157534 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.157515 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnrcf"] Oct 30 08:57:27.175057 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.175031 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f632f217-80ef-43f7-a879-c5dd6d4a9fa0-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7frghl\" (UID: \"f632f217-80ef-43f7-a879-c5dd6d4a9fa0\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7frghl" Oct 30 08:57:27.175143 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.175068 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftqkr\" (UniqueName: \"kubernetes.io/projected/be6df281-507f-43be-a1cf-e5677ed85bbd-kube-api-access-ftqkr\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c4fwsv\" (UID: \"be6df281-507f-43be-a1cf-e5677ed85bbd\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c4fwsv" Oct 30 08:57:27.175143 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.175094 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be6df281-507f-43be-a1cf-e5677ed85bbd-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c4fwsv\" (UID: \"be6df281-507f-43be-a1cf-e5677ed85bbd\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c4fwsv" Oct 30 08:57:27.175143 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.175139 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be6df281-507f-43be-a1cf-e5677ed85bbd-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c4fwsv\" (UID: \"be6df281-507f-43be-a1cf-e5677ed85bbd\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c4fwsv" Oct 30 08:57:27.175275 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.175169 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f632f217-80ef-43f7-a879-c5dd6d4a9fa0-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7frghl\" (UID: \"f632f217-80ef-43f7-a879-c5dd6d4a9fa0\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7frghl" Oct 30 08:57:27.175275 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.175225 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmtrj\" (UniqueName: \"kubernetes.io/projected/f632f217-80ef-43f7-a879-c5dd6d4a9fa0-kube-api-access-lmtrj\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7frghl\" (UID: \"f632f217-80ef-43f7-a879-c5dd6d4a9fa0\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7frghl" Oct 30 08:57:27.175568 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.175545 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be6df281-507f-43be-a1cf-e5677ed85bbd-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c4fwsv\" (UID: \"be6df281-507f-43be-a1cf-e5677ed85bbd\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c4fwsv" Oct 30 08:57:27.175789 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.175628 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be6df281-507f-43be-a1cf-e5677ed85bbd-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c4fwsv\" (UID: \"be6df281-507f-43be-a1cf-e5677ed85bbd\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c4fwsv" Oct 30 08:57:27.198019 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.197992 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftqkr\" (UniqueName: \"kubernetes.io/projected/be6df281-507f-43be-a1cf-e5677ed85bbd-kube-api-access-ftqkr\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c4fwsv\" (UID: \"be6df281-507f-43be-a1cf-e5677ed85bbd\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c4fwsv" Oct 30 08:57:27.248512 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.248488 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c4fwsv" Oct 30 08:57:27.272820 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.272794 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71hrzxs"] Oct 30 08:57:27.276418 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.276392 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f632f217-80ef-43f7-a879-c5dd6d4a9fa0-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7frghl\" (UID: \"f632f217-80ef-43f7-a879-c5dd6d4a9fa0\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7frghl" Oct 30 08:57:27.276520 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.276429 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71hrzxs" Oct 30 08:57:27.276520 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.276442 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/244e1aae-3d5f-42e6-87d6-008807036a2a-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnrcf\" (UID: \"244e1aae-3d5f-42e6-87d6-008807036a2a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnrcf" Oct 30 08:57:27.276520 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.276461 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c5jj\" (UniqueName: \"kubernetes.io/projected/244e1aae-3d5f-42e6-87d6-008807036a2a-kube-api-access-5c5jj\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnrcf\" (UID: \"244e1aae-3d5f-42e6-87d6-008807036a2a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnrcf" Oct 30 08:57:27.276520 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.276504 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f632f217-80ef-43f7-a879-c5dd6d4a9fa0-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7frghl\" (UID: \"f632f217-80ef-43f7-a879-c5dd6d4a9fa0\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7frghl" Oct 30 08:57:27.276730 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.276597 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/244e1aae-3d5f-42e6-87d6-008807036a2a-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnrcf\" (UID: \"244e1aae-3d5f-42e6-87d6-008807036a2a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnrcf" Oct 30 08:57:27.276730 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.276649 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmtrj\" (UniqueName: \"kubernetes.io/projected/f632f217-80ef-43f7-a879-c5dd6d4a9fa0-kube-api-access-lmtrj\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7frghl\" (UID: \"f632f217-80ef-43f7-a879-c5dd6d4a9fa0\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7frghl" Oct 30 08:57:27.276834 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.276823 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f632f217-80ef-43f7-a879-c5dd6d4a9fa0-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7frghl\" (UID: \"f632f217-80ef-43f7-a879-c5dd6d4a9fa0\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7frghl" Oct 30 08:57:27.276884 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.276841 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f632f217-80ef-43f7-a879-c5dd6d4a9fa0-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7frghl\" (UID: \"f632f217-80ef-43f7-a879-c5dd6d4a9fa0\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7frghl" Oct 30 08:57:27.293727 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.293687 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e644421527c169d876fdb59235c927986d6bd2-9d2815fc-dockercfg-9bsnj\"" Oct 30 08:57:27.298748 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.298198 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71hrzxs"] Oct 30 08:57:27.305727 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.302605 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmtrj\" (UniqueName: \"kubernetes.io/projected/f632f217-80ef-43f7-a879-c5dd6d4a9fa0-kube-api-access-lmtrj\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7frghl\" (UID: \"f632f217-80ef-43f7-a879-c5dd6d4a9fa0\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7frghl" Oct 30 08:57:27.349362 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.349316 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7frghl" Oct 30 08:57:27.377164 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.377137 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnpxz\" (UniqueName: \"kubernetes.io/projected/37e7e745-50fa-4704-bbd2-c4624a3f4c84-kube-api-access-lnpxz\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71hrzxs\" (UID: \"37e7e745-50fa-4704-bbd2-c4624a3f4c84\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71hrzxs" Oct 30 08:57:27.377513 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.377173 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/244e1aae-3d5f-42e6-87d6-008807036a2a-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnrcf\" (UID: \"244e1aae-3d5f-42e6-87d6-008807036a2a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnrcf" Oct 30 08:57:27.377513 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.377198 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37e7e745-50fa-4704-bbd2-c4624a3f4c84-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71hrzxs\" (UID: \"37e7e745-50fa-4704-bbd2-c4624a3f4c84\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71hrzxs" Oct 30 08:57:27.377513 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.377351 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37e7e745-50fa-4704-bbd2-c4624a3f4c84-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71hrzxs\" (UID: \"37e7e745-50fa-4704-bbd2-c4624a3f4c84\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71hrzxs" Oct 30 08:57:27.377513 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.377378 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/244e1aae-3d5f-42e6-87d6-008807036a2a-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnrcf\" (UID: \"244e1aae-3d5f-42e6-87d6-008807036a2a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnrcf" Oct 30 08:57:27.377513 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.377393 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c5jj\" (UniqueName: \"kubernetes.io/projected/244e1aae-3d5f-42e6-87d6-008807036a2a-kube-api-access-5c5jj\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnrcf\" (UID: \"244e1aae-3d5f-42e6-87d6-008807036a2a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnrcf" Oct 30 08:57:27.377795 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.377573 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/244e1aae-3d5f-42e6-87d6-008807036a2a-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnrcf\" (UID: \"244e1aae-3d5f-42e6-87d6-008807036a2a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnrcf" Oct 30 08:57:27.377795 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.377628 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/244e1aae-3d5f-42e6-87d6-008807036a2a-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnrcf\" (UID: \"244e1aae-3d5f-42e6-87d6-008807036a2a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnrcf" Oct 30 08:57:27.402016 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.401958 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c5jj\" (UniqueName: \"kubernetes.io/projected/244e1aae-3d5f-42e6-87d6-008807036a2a-kube-api-access-5c5jj\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnrcf\" (UID: \"244e1aae-3d5f-42e6-87d6-008807036a2a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnrcf" Oct 30 08:57:27.452248 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.452224 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak6qsd"] Oct 30 08:57:27.453038 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.453011 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnrcf" Oct 30 08:57:27.456517 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:57:27.456492 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba34d7cd_ade7_49b7_bcfc_1caabccd9683.slice/crio-6331e243606a81e757fda00d0b5d4ad388d0b846af8a1b306f77e24e32e70084 WatchSource:0}: Error finding container 6331e243606a81e757fda00d0b5d4ad388d0b846af8a1b306f77e24e32e70084: Status 404 returned error can't find the container with id 6331e243606a81e757fda00d0b5d4ad388d0b846af8a1b306f77e24e32e70084 Oct 30 08:57:27.478321 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.478295 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37e7e745-50fa-4704-bbd2-c4624a3f4c84-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71hrzxs\" (UID: \"37e7e745-50fa-4704-bbd2-c4624a3f4c84\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71hrzxs" Oct 30 08:57:27.478436 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.478350 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnpxz\" (UniqueName: \"kubernetes.io/projected/37e7e745-50fa-4704-bbd2-c4624a3f4c84-kube-api-access-lnpxz\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71hrzxs\" (UID: \"37e7e745-50fa-4704-bbd2-c4624a3f4c84\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71hrzxs" Oct 30 08:57:27.478436 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.478378 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37e7e745-50fa-4704-bbd2-c4624a3f4c84-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71hrzxs\" (UID: \"37e7e745-50fa-4704-bbd2-c4624a3f4c84\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71hrzxs" Oct 30 08:57:27.478631 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.478611 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37e7e745-50fa-4704-bbd2-c4624a3f4c84-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71hrzxs\" (UID: \"37e7e745-50fa-4704-bbd2-c4624a3f4c84\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71hrzxs" Oct 30 08:57:27.478697 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.478676 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37e7e745-50fa-4704-bbd2-c4624a3f4c84-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71hrzxs\" (UID: \"37e7e745-50fa-4704-bbd2-c4624a3f4c84\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71hrzxs" Oct 30 08:57:27.503373 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.502224 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnpxz\" (UniqueName: \"kubernetes.io/projected/37e7e745-50fa-4704-bbd2-c4624a3f4c84-kube-api-access-lnpxz\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71hrzxs\" (UID: \"37e7e745-50fa-4704-bbd2-c4624a3f4c84\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71hrzxs" Oct 30 08:57:27.546430 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.546392 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c4fwsv"] Oct 30 08:57:27.550453 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:57:27.550427 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe6df281_507f_43be_a1cf_e5677ed85bbd.slice/crio-eda9c0c7df4e01754050791bea8601ef12bcc456da18f7c167a3b832a319db63 WatchSource:0}: Error finding container eda9c0c7df4e01754050791bea8601ef12bcc456da18f7c167a3b832a319db63: Status 404 returned error can't find the container with id eda9c0c7df4e01754050791bea8601ef12bcc456da18f7c167a3b832a319db63 Oct 30 08:57:27.593026 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.593006 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71hrzxs" Oct 30 08:57:27.645043 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.645005 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7frghl"] Oct 30 08:57:27.652818 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:57:27.652790 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf632f217_80ef_43f7_a879_c5dd6d4a9fa0.slice/crio-cdd64028d09c56434ea5211fa79535c184f50a718b80622befb297b27d29c51c WatchSource:0}: Error finding container cdd64028d09c56434ea5211fa79535c184f50a718b80622befb297b27d29c51c: Status 404 returned error can't find the container with id cdd64028d09c56434ea5211fa79535c184f50a718b80622befb297b27d29c51c Oct 30 08:57:27.753898 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.753869 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnrcf"] Oct 30 08:57:27.757658 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:57:27.757631 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod244e1aae_3d5f_42e6_87d6_008807036a2a.slice/crio-8c440d0ad4e8118c24d9e82cea6fcee28a7717af07eea5552d6831b1b8a8983f WatchSource:0}: Error finding container 8c440d0ad4e8118c24d9e82cea6fcee28a7717af07eea5552d6831b1b8a8983f: Status 404 returned error can't find the container with id 8c440d0ad4e8118c24d9e82cea6fcee28a7717af07eea5552d6831b1b8a8983f Oct 30 08:57:27.889393 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:27.889335 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71hrzxs"] Oct 30 08:57:27.893715 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:57:27.893689 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37e7e745_50fa_4704_bbd2_c4624a3f4c84.slice/crio-a8d8b0c975097048da9a3fe9e33e0a3de3de8621eb47dd478ccff55240ec4f51 WatchSource:0}: Error finding container a8d8b0c975097048da9a3fe9e33e0a3de3de8621eb47dd478ccff55240ec4f51: Status 404 returned error can't find the container with id a8d8b0c975097048da9a3fe9e33e0a3de3de8621eb47dd478ccff55240ec4f51 Oct 30 08:57:28.067335 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:28.067253 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7frghl" event={"ID":"f632f217-80ef-43f7-a879-c5dd6d4a9fa0","Type":"ContainerStarted","Data":"cdd64028d09c56434ea5211fa79535c184f50a718b80622befb297b27d29c51c"} Oct 30 08:57:28.069833 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:28.069799 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c4fwsv" event={"ID":"be6df281-507f-43be-a1cf-e5677ed85bbd","Type":"ContainerStarted","Data":"eda9c0c7df4e01754050791bea8601ef12bcc456da18f7c167a3b832a319db63"} Oct 30 08:57:28.071646 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:28.071619 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak6qsd" event={"ID":"ba34d7cd-ade7-49b7-bcfc-1caabccd9683","Type":"ContainerStarted","Data":"6331e243606a81e757fda00d0b5d4ad388d0b846af8a1b306f77e24e32e70084"} Oct 30 08:57:28.073551 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:28.073505 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71hrzxs" event={"ID":"37e7e745-50fa-4704-bbd2-c4624a3f4c84","Type":"ContainerStarted","Data":"a8d8b0c975097048da9a3fe9e33e0a3de3de8621eb47dd478ccff55240ec4f51"} Oct 30 08:57:28.075198 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:28.075171 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnrcf" event={"ID":"244e1aae-3d5f-42e6-87d6-008807036a2a","Type":"ContainerStarted","Data":"8c440d0ad4e8118c24d9e82cea6fcee28a7717af07eea5552d6831b1b8a8983f"} Oct 30 08:57:29.336862 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:29.334155 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnnhf5"] Oct 30 08:57:29.343032 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:29.342848 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnnhf5" Oct 30 08:57:29.359328 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:29.358800 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnnhf5"] Oct 30 08:57:29.368951 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:29.368929 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-k9z79\"" Oct 30 08:57:29.393542 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:29.393452 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7014e1f-cca5-4c4c-84a2-03c26d2846d6-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnnhf5\" (UID: \"d7014e1f-cca5-4c4c-84a2-03c26d2846d6\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnnhf5" Oct 30 08:57:29.393542 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:29.393505 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49pws\" (UniqueName: \"kubernetes.io/projected/d7014e1f-cca5-4c4c-84a2-03c26d2846d6-kube-api-access-49pws\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnnhf5\" (UID: \"d7014e1f-cca5-4c4c-84a2-03c26d2846d6\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnnhf5" Oct 30 08:57:29.393718 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:29.393628 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7014e1f-cca5-4c4c-84a2-03c26d2846d6-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnnhf5\" (UID: \"d7014e1f-cca5-4c4c-84a2-03c26d2846d6\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnnhf5" Oct 30 08:57:29.494541 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:29.494504 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7014e1f-cca5-4c4c-84a2-03c26d2846d6-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnnhf5\" (UID: \"d7014e1f-cca5-4c4c-84a2-03c26d2846d6\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnnhf5" Oct 30 08:57:29.494695 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:29.494561 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49pws\" (UniqueName: \"kubernetes.io/projected/d7014e1f-cca5-4c4c-84a2-03c26d2846d6-kube-api-access-49pws\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnnhf5\" (UID: \"d7014e1f-cca5-4c4c-84a2-03c26d2846d6\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnnhf5" Oct 30 08:57:29.494695 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:29.494613 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7014e1f-cca5-4c4c-84a2-03c26d2846d6-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnnhf5\" (UID: \"d7014e1f-cca5-4c4c-84a2-03c26d2846d6\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnnhf5" Oct 30 08:57:29.495019 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:29.494998 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7014e1f-cca5-4c4c-84a2-03c26d2846d6-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnnhf5\" (UID: \"d7014e1f-cca5-4c4c-84a2-03c26d2846d6\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnnhf5" Oct 30 08:57:29.495293 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:29.495274 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7014e1f-cca5-4c4c-84a2-03c26d2846d6-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnnhf5\" (UID: \"d7014e1f-cca5-4c4c-84a2-03c26d2846d6\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnnhf5" Oct 30 08:57:29.521971 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:29.521930 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49pws\" (UniqueName: \"kubernetes.io/projected/d7014e1f-cca5-4c4c-84a2-03c26d2846d6-kube-api-access-49pws\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnnhf5\" (UID: \"d7014e1f-cca5-4c4c-84a2-03c26d2846d6\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnnhf5" Oct 30 08:57:29.674740 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:29.674656 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnnhf5" Oct 30 08:57:29.998144 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:29.997972 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnnhf5"] Oct 30 08:57:30.010090 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:57:30.009385 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7014e1f_cca5_4c4c_84a2_03c26d2846d6.slice/crio-552c5347690e19985e720b51080067563d8fab182be7130a57d9cd79eea33f1a WatchSource:0}: Error finding container 552c5347690e19985e720b51080067563d8fab182be7130a57d9cd79eea33f1a: Status 404 returned error can't find the container with id 552c5347690e19985e720b51080067563d8fab182be7130a57d9cd79eea33f1a Oct 30 08:57:30.095897 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.095828 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnnhf5" event={"ID":"d7014e1f-cca5-4c4c-84a2-03c26d2846d6","Type":"ContainerStarted","Data":"552c5347690e19985e720b51080067563d8fab182be7130a57d9cd79eea33f1a"} Oct 30 08:57:30.366157 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.366118 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv"] Oct 30 08:57:30.372218 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.371396 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:30.389170 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.389083 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-6vw6v\"" Oct 30 08:57:30.408988 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.407101 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Oct 30 08:57:30.408988 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.408925 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv"] Oct 30 08:57:30.410072 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.409497 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c855b64-13be-4e63-8f3f-531056c34afc-workload-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-wkmvv\" (UID: \"9c855b64-13be-4e63-8f3f-531056c34afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:30.410072 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.409541 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c855b64-13be-4e63-8f3f-531056c34afc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fcb75c45f-wkmvv\" (UID: \"9c855b64-13be-4e63-8f3f-531056c34afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:30.410072 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.409637 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c855b64-13be-4e63-8f3f-531056c34afc-credential-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-wkmvv\" (UID: \"9c855b64-13be-4e63-8f3f-531056c34afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:30.410072 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.409688 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcj8j\" (UniqueName: \"kubernetes.io/projected/9c855b64-13be-4e63-8f3f-531056c34afc-kube-api-access-dcj8j\") pod \"maas-default-gateway-openshift-default-fcb75c45f-wkmvv\" (UID: \"9c855b64-13be-4e63-8f3f-531056c34afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:30.410072 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.409759 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c855b64-13be-4e63-8f3f-531056c34afc-istio-token\") pod \"maas-default-gateway-openshift-default-fcb75c45f-wkmvv\" (UID: \"9c855b64-13be-4e63-8f3f-531056c34afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:30.410072 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.409795 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c855b64-13be-4e63-8f3f-531056c34afc-workload-certs\") pod \"maas-default-gateway-openshift-default-fcb75c45f-wkmvv\" (UID: \"9c855b64-13be-4e63-8f3f-531056c34afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:30.410072 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.409820 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c855b64-13be-4e63-8f3f-531056c34afc-istio-envoy\") pod \"maas-default-gateway-openshift-default-fcb75c45f-wkmvv\" (UID: \"9c855b64-13be-4e63-8f3f-531056c34afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:30.410072 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.409843 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c855b64-13be-4e63-8f3f-531056c34afc-istio-data\") pod \"maas-default-gateway-openshift-default-fcb75c45f-wkmvv\" (UID: \"9c855b64-13be-4e63-8f3f-531056c34afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:30.410072 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.409881 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c855b64-13be-4e63-8f3f-531056c34afc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fcb75c45f-wkmvv\" (UID: \"9c855b64-13be-4e63-8f3f-531056c34afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:30.507271 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.507235 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc"] Oct 30 08:57:30.511777 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.510704 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c855b64-13be-4e63-8f3f-531056c34afc-credential-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-wkmvv\" (UID: \"9c855b64-13be-4e63-8f3f-531056c34afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:30.511777 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.510748 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcj8j\" (UniqueName: \"kubernetes.io/projected/9c855b64-13be-4e63-8f3f-531056c34afc-kube-api-access-dcj8j\") pod \"maas-default-gateway-openshift-default-fcb75c45f-wkmvv\" (UID: \"9c855b64-13be-4e63-8f3f-531056c34afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:30.511777 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.510792 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c855b64-13be-4e63-8f3f-531056c34afc-istio-token\") pod \"maas-default-gateway-openshift-default-fcb75c45f-wkmvv\" (UID: \"9c855b64-13be-4e63-8f3f-531056c34afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:30.511777 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.510825 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c855b64-13be-4e63-8f3f-531056c34afc-workload-certs\") pod \"maas-default-gateway-openshift-default-fcb75c45f-wkmvv\" (UID: \"9c855b64-13be-4e63-8f3f-531056c34afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:30.511777 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.510850 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c855b64-13be-4e63-8f3f-531056c34afc-istio-envoy\") pod \"maas-default-gateway-openshift-default-fcb75c45f-wkmvv\" (UID: \"9c855b64-13be-4e63-8f3f-531056c34afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:30.511777 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.510876 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c855b64-13be-4e63-8f3f-531056c34afc-istio-data\") pod \"maas-default-gateway-openshift-default-fcb75c45f-wkmvv\" (UID: \"9c855b64-13be-4e63-8f3f-531056c34afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:30.511777 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.510912 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c855b64-13be-4e63-8f3f-531056c34afc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fcb75c45f-wkmvv\" (UID: \"9c855b64-13be-4e63-8f3f-531056c34afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:30.511777 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.510961 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c855b64-13be-4e63-8f3f-531056c34afc-workload-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-wkmvv\" (UID: \"9c855b64-13be-4e63-8f3f-531056c34afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:30.511777 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.510993 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c855b64-13be-4e63-8f3f-531056c34afc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fcb75c45f-wkmvv\" (UID: \"9c855b64-13be-4e63-8f3f-531056c34afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:30.511777 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.511083 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:30.511777 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.511162 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c855b64-13be-4e63-8f3f-531056c34afc-credential-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-wkmvv\" (UID: \"9c855b64-13be-4e63-8f3f-531056c34afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:30.511777 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.511707 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c855b64-13be-4e63-8f3f-531056c34afc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fcb75c45f-wkmvv\" (UID: \"9c855b64-13be-4e63-8f3f-531056c34afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:30.512396 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.511860 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c855b64-13be-4e63-8f3f-531056c34afc-istio-data\") pod \"maas-default-gateway-openshift-default-fcb75c45f-wkmvv\" (UID: \"9c855b64-13be-4e63-8f3f-531056c34afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:30.512396 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.512312 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c855b64-13be-4e63-8f3f-531056c34afc-workload-certs\") pod \"maas-default-gateway-openshift-default-fcb75c45f-wkmvv\" (UID: \"9c855b64-13be-4e63-8f3f-531056c34afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:30.512507 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.512423 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c855b64-13be-4e63-8f3f-531056c34afc-workload-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-wkmvv\" (UID: \"9c855b64-13be-4e63-8f3f-531056c34afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:30.523270 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.523242 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c855b64-13be-4e63-8f3f-531056c34afc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fcb75c45f-wkmvv\" (UID: \"9c855b64-13be-4e63-8f3f-531056c34afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:30.523693 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.523612 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c855b64-13be-4e63-8f3f-531056c34afc-istio-envoy\") pod \"maas-default-gateway-openshift-default-fcb75c45f-wkmvv\" (UID: \"9c855b64-13be-4e63-8f3f-531056c34afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:30.534356 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.534334 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc"] Oct 30 08:57:30.541405 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.541384 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c855b64-13be-4e63-8f3f-531056c34afc-istio-token\") pod \"maas-default-gateway-openshift-default-fcb75c45f-wkmvv\" (UID: \"9c855b64-13be-4e63-8f3f-531056c34afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:30.542007 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.541989 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcj8j\" (UniqueName: \"kubernetes.io/projected/9c855b64-13be-4e63-8f3f-531056c34afc-kube-api-access-dcj8j\") pod \"maas-default-gateway-openshift-default-fcb75c45f-wkmvv\" (UID: \"9c855b64-13be-4e63-8f3f-531056c34afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:30.548917 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.548844 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-x9vx9\"" Oct 30 08:57:30.611406 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.611379 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bafdeba-c0c2-48ef-9dbe-b189447b40bf-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc\" (UID: \"5bafdeba-c0c2-48ef-9dbe-b189447b40bf\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:30.611544 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.611416 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bafdeba-c0c2-48ef-9dbe-b189447b40bf-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc\" (UID: \"5bafdeba-c0c2-48ef-9dbe-b189447b40bf\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:30.611544 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.611457 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bafdeba-c0c2-48ef-9dbe-b189447b40bf-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc\" (UID: \"5bafdeba-c0c2-48ef-9dbe-b189447b40bf\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:30.611544 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.611481 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bafdeba-c0c2-48ef-9dbe-b189447b40bf-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc\" (UID: \"5bafdeba-c0c2-48ef-9dbe-b189447b40bf\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:30.611544 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.611506 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqt4t\" (UniqueName: \"kubernetes.io/projected/5bafdeba-c0c2-48ef-9dbe-b189447b40bf-kube-api-access-jqt4t\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc\" (UID: \"5bafdeba-c0c2-48ef-9dbe-b189447b40bf\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:30.611544 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.611535 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bafdeba-c0c2-48ef-9dbe-b189447b40bf-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc\" (UID: \"5bafdeba-c0c2-48ef-9dbe-b189447b40bf\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:30.611806 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.611567 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bafdeba-c0c2-48ef-9dbe-b189447b40bf-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc\" (UID: \"5bafdeba-c0c2-48ef-9dbe-b189447b40bf\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:30.611806 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.611644 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bafdeba-c0c2-48ef-9dbe-b189447b40bf-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc\" (UID: \"5bafdeba-c0c2-48ef-9dbe-b189447b40bf\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:30.611806 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.611679 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bafdeba-c0c2-48ef-9dbe-b189447b40bf-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc\" (UID: \"5bafdeba-c0c2-48ef-9dbe-b189447b40bf\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:30.691397 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.691333 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:30.712860 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.712831 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bafdeba-c0c2-48ef-9dbe-b189447b40bf-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc\" (UID: \"5bafdeba-c0c2-48ef-9dbe-b189447b40bf\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:30.712984 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.712879 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bafdeba-c0c2-48ef-9dbe-b189447b40bf-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc\" (UID: \"5bafdeba-c0c2-48ef-9dbe-b189447b40bf\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:30.712984 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.712940 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bafdeba-c0c2-48ef-9dbe-b189447b40bf-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc\" (UID: \"5bafdeba-c0c2-48ef-9dbe-b189447b40bf\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:30.712984 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.712970 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bafdeba-c0c2-48ef-9dbe-b189447b40bf-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc\" (UID: \"5bafdeba-c0c2-48ef-9dbe-b189447b40bf\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:30.713150 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.713002 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bafdeba-c0c2-48ef-9dbe-b189447b40bf-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc\" (UID: \"5bafdeba-c0c2-48ef-9dbe-b189447b40bf\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:30.713150 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.713030 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bafdeba-c0c2-48ef-9dbe-b189447b40bf-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc\" (UID: \"5bafdeba-c0c2-48ef-9dbe-b189447b40bf\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:30.713150 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.713072 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bafdeba-c0c2-48ef-9dbe-b189447b40bf-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc\" (UID: \"5bafdeba-c0c2-48ef-9dbe-b189447b40bf\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:30.713150 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.713098 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bafdeba-c0c2-48ef-9dbe-b189447b40bf-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc\" (UID: \"5bafdeba-c0c2-48ef-9dbe-b189447b40bf\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:30.713150 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.713123 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqt4t\" (UniqueName: \"kubernetes.io/projected/5bafdeba-c0c2-48ef-9dbe-b189447b40bf-kube-api-access-jqt4t\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc\" (UID: \"5bafdeba-c0c2-48ef-9dbe-b189447b40bf\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:30.714263 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.714242 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bafdeba-c0c2-48ef-9dbe-b189447b40bf-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc\" (UID: \"5bafdeba-c0c2-48ef-9dbe-b189447b40bf\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:30.714982 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.714963 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bafdeba-c0c2-48ef-9dbe-b189447b40bf-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc\" (UID: \"5bafdeba-c0c2-48ef-9dbe-b189447b40bf\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:30.715246 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.715219 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bafdeba-c0c2-48ef-9dbe-b189447b40bf-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc\" (UID: \"5bafdeba-c0c2-48ef-9dbe-b189447b40bf\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:30.715734 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.715709 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bafdeba-c0c2-48ef-9dbe-b189447b40bf-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc\" (UID: \"5bafdeba-c0c2-48ef-9dbe-b189447b40bf\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:30.716013 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.715992 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bafdeba-c0c2-48ef-9dbe-b189447b40bf-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc\" (UID: \"5bafdeba-c0c2-48ef-9dbe-b189447b40bf\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:30.724304 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.723793 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bafdeba-c0c2-48ef-9dbe-b189447b40bf-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc\" (UID: \"5bafdeba-c0c2-48ef-9dbe-b189447b40bf\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:30.724304 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.724268 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bafdeba-c0c2-48ef-9dbe-b189447b40bf-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc\" (UID: \"5bafdeba-c0c2-48ef-9dbe-b189447b40bf\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:30.740065 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.740028 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bafdeba-c0c2-48ef-9dbe-b189447b40bf-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc\" (UID: \"5bafdeba-c0c2-48ef-9dbe-b189447b40bf\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:30.741016 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.740994 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqt4t\" (UniqueName: \"kubernetes.io/projected/5bafdeba-c0c2-48ef-9dbe-b189447b40bf-kube-api-access-jqt4t\") pod \"openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc\" (UID: \"5bafdeba-c0c2-48ef-9dbe-b189447b40bf\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:30.873342 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:30.873297 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:31.057317 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:31.057227 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv"] Oct 30 08:57:31.061980 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:57:31.061943 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c855b64_13be_4e63_8f3f_531056c34afc.slice/crio-214512b575a8931dbcd29669e00f9fa64ac5abf289c63f2280d49c1fdf064002 WatchSource:0}: Error finding container 214512b575a8931dbcd29669e00f9fa64ac5abf289c63f2280d49c1fdf064002: Status 404 returned error can't find the container with id 214512b575a8931dbcd29669e00f9fa64ac5abf289c63f2280d49c1fdf064002 Oct 30 08:57:31.116771 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:31.116735 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" event={"ID":"9c855b64-13be-4e63-8f3f-531056c34afc","Type":"ContainerStarted","Data":"214512b575a8931dbcd29669e00f9fa64ac5abf289c63f2280d49c1fdf064002"} Oct 30 08:57:31.244419 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:31.244300 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc"] Oct 30 08:57:31.253883 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:57:31.253851 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bafdeba_c0c2_48ef_9dbe_b189447b40bf.slice/crio-b2e03246011223c85fd320ac205cea92d18493bf0ed1155bf98094961a04a3c4 WatchSource:0}: Error finding container b2e03246011223c85fd320ac205cea92d18493bf0ed1155bf98094961a04a3c4: Status 404 returned error can't find the container with id b2e03246011223c85fd320ac205cea92d18493bf0ed1155bf98094961a04a3c4 Oct 30 08:57:31.482808 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:31.482778 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644f5gw6"] Oct 30 08:57:31.489184 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:31.488345 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644f5gw6" Oct 30 08:57:31.503255 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:31.503231 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c4959aeb960c8e20c88ac2de924a35b8221494-145dcd5a-dockercfg-n4n67\"" Oct 30 08:57:31.511163 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:31.511055 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644f5gw6"] Oct 30 08:57:31.519554 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:31.519531 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91b836e7-3ec9-4926-be10-52ef8fc8f541-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644f5gw6\" (UID: \"91b836e7-3ec9-4926-be10-52ef8fc8f541\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644f5gw6" Oct 30 08:57:31.519657 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:31.519567 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkkjj\" (UniqueName: \"kubernetes.io/projected/91b836e7-3ec9-4926-be10-52ef8fc8f541-kube-api-access-kkkjj\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644f5gw6\" (UID: \"91b836e7-3ec9-4926-be10-52ef8fc8f541\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644f5gw6" Oct 30 08:57:31.519657 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:31.519593 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91b836e7-3ec9-4926-be10-52ef8fc8f541-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644f5gw6\" (UID: \"91b836e7-3ec9-4926-be10-52ef8fc8f541\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644f5gw6" Oct 30 08:57:31.622319 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:31.621052 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91b836e7-3ec9-4926-be10-52ef8fc8f541-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644f5gw6\" (UID: \"91b836e7-3ec9-4926-be10-52ef8fc8f541\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644f5gw6" Oct 30 08:57:31.622319 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:31.621119 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkkjj\" (UniqueName: \"kubernetes.io/projected/91b836e7-3ec9-4926-be10-52ef8fc8f541-kube-api-access-kkkjj\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644f5gw6\" (UID: \"91b836e7-3ec9-4926-be10-52ef8fc8f541\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644f5gw6" Oct 30 08:57:31.622319 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:31.621154 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91b836e7-3ec9-4926-be10-52ef8fc8f541-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644f5gw6\" (UID: \"91b836e7-3ec9-4926-be10-52ef8fc8f541\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644f5gw6" Oct 30 08:57:31.622319 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:31.621711 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91b836e7-3ec9-4926-be10-52ef8fc8f541-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644f5gw6\" (UID: \"91b836e7-3ec9-4926-be10-52ef8fc8f541\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644f5gw6" Oct 30 08:57:31.622319 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:31.621970 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91b836e7-3ec9-4926-be10-52ef8fc8f541-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644f5gw6\" (UID: \"91b836e7-3ec9-4926-be10-52ef8fc8f541\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644f5gw6" Oct 30 08:57:31.652716 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:31.652655 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkkjj\" (UniqueName: \"kubernetes.io/projected/91b836e7-3ec9-4926-be10-52ef8fc8f541-kube-api-access-kkkjj\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644f5gw6\" (UID: \"91b836e7-3ec9-4926-be10-52ef8fc8f541\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644f5gw6" Oct 30 08:57:31.809937 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:31.809686 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644f5gw6" Oct 30 08:57:32.144503 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:32.144461 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" event={"ID":"5bafdeba-c0c2-48ef-9dbe-b189447b40bf","Type":"ContainerStarted","Data":"b2e03246011223c85fd320ac205cea92d18493bf0ed1155bf98094961a04a3c4"} Oct 30 08:57:32.171915 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:32.171883 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644f5gw6"] Oct 30 08:57:33.184281 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:33.184232 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644f5gw6" event={"ID":"91b836e7-3ec9-4926-be10-52ef8fc8f541","Type":"ContainerStarted","Data":"d6e0ced545da50b2ccb210caad2851f18a18ecbbc2619d6162ea653fe1e47d45"} Oct 30 08:57:34.499730 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:34.499698 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dbzqj"] Oct 30 08:57:34.504987 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:34.504963 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dbzqj" Oct 30 08:57:34.526834 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:34.523361 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dbzqj"] Oct 30 08:57:34.554761 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:34.554583 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv2h7\" (UniqueName: \"kubernetes.io/projected/e77df329-89f1-40ee-b862-83b6e562cd6b-kube-api-access-kv2h7\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dbzqj\" (UID: \"e77df329-89f1-40ee-b862-83b6e562cd6b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dbzqj" Oct 30 08:57:34.554761 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:34.554635 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e77df329-89f1-40ee-b862-83b6e562cd6b-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dbzqj\" (UID: \"e77df329-89f1-40ee-b862-83b6e562cd6b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dbzqj" Oct 30 08:57:34.554761 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:34.554662 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e77df329-89f1-40ee-b862-83b6e562cd6b-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dbzqj\" (UID: \"e77df329-89f1-40ee-b862-83b6e562cd6b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dbzqj" Oct 30 08:57:34.656170 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:34.656126 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv2h7\" (UniqueName: \"kubernetes.io/projected/e77df329-89f1-40ee-b862-83b6e562cd6b-kube-api-access-kv2h7\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dbzqj\" (UID: \"e77df329-89f1-40ee-b862-83b6e562cd6b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dbzqj" Oct 30 08:57:34.656357 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:34.656219 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e77df329-89f1-40ee-b862-83b6e562cd6b-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dbzqj\" (UID: \"e77df329-89f1-40ee-b862-83b6e562cd6b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dbzqj" Oct 30 08:57:34.656357 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:34.656267 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e77df329-89f1-40ee-b862-83b6e562cd6b-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dbzqj\" (UID: \"e77df329-89f1-40ee-b862-83b6e562cd6b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dbzqj" Oct 30 08:57:34.656703 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:34.656680 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e77df329-89f1-40ee-b862-83b6e562cd6b-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dbzqj\" (UID: \"e77df329-89f1-40ee-b862-83b6e562cd6b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dbzqj" Oct 30 08:57:34.657282 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:34.657257 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e77df329-89f1-40ee-b862-83b6e562cd6b-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dbzqj\" (UID: \"e77df329-89f1-40ee-b862-83b6e562cd6b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dbzqj" Oct 30 08:57:34.696915 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:34.696840 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv2h7\" (UniqueName: \"kubernetes.io/projected/e77df329-89f1-40ee-b862-83b6e562cd6b-kube-api-access-kv2h7\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dbzqj\" (UID: \"e77df329-89f1-40ee-b862-83b6e562cd6b\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dbzqj" Oct 30 08:57:34.833541 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:34.833243 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dbzqj" Oct 30 08:57:35.189724 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:35.189693 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dbzqj"] Oct 30 08:57:35.195864 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:57:35.195827 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode77df329_89f1_40ee_b862_83b6e562cd6b.slice/crio-66792ba7d93796c3c91a7e0386902ab22144f7a545c3cfc138de04e4f38db61a WatchSource:0}: Error finding container 66792ba7d93796c3c91a7e0386902ab22144f7a545c3cfc138de04e4f38db61a: Status 404 returned error can't find the container with id 66792ba7d93796c3c91a7e0386902ab22144f7a545c3cfc138de04e4f38db61a Oct 30 08:57:36.221587 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:36.221542 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dbzqj" event={"ID":"e77df329-89f1-40ee-b862-83b6e562cd6b","Type":"ContainerStarted","Data":"66792ba7d93796c3c91a7e0386902ab22144f7a545c3cfc138de04e4f38db61a"} Oct 30 08:57:39.460605 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:39.459784 5028 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 08:57:39.460605 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:39.459874 5028 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 08:57:39.460605 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:39.459935 5028 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 08:57:39.930672 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:39.930616 5028 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 08:57:39.930812 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:39.930715 5028 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 08:57:39.930812 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:39.930760 5028 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 08:57:40.268034 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:40.267902 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" event={"ID":"5bafdeba-c0c2-48ef-9dbe-b189447b40bf","Type":"ContainerStarted","Data":"fdd9624c5b76b51338790b528be77c7672020ef0f8197ff58f1ca45829eec6e5"} Oct 30 08:57:40.271846 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:40.271650 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" event={"ID":"9c855b64-13be-4e63-8f3f-531056c34afc","Type":"ContainerStarted","Data":"44c19a1253eeac61bf946dd2e33388a00c67dda252e15adcdabc0647dde998ad"} Oct 30 08:57:40.325107 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:40.325023 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" podStartSLOduration=1.6520825019999998 podStartE2EDuration="10.325004247s" totalImagesPullingTime="8.672921745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:57:40.323665747 +0000 UTC m=+274.539778129" watchObservedRunningTime="2026-10-30 08:57:40.325004247 +0000 UTC m=+274.541116606" Oct 30 08:57:40.694642 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:40.692911 5028 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:40.700082 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:40.700057 5028 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:40.745316 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:40.745262 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" podStartSLOduration=2.351307277 podStartE2EDuration="10.745245763s" totalImagesPullingTime="8.393938486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:57:40.36907868 +0000 UTC m=+274.585191063" watchObservedRunningTime="2026-10-30 08:57:40.745245763 +0000 UTC m=+274.961358122" Oct 30 08:57:40.874010 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:40.873968 5028 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:41.279899 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:41.279864 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:41.281219 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:41.281182 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 08:57:41.880040 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:41.880007 5028 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:42.287474 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:42.287320 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:42.289074 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:42.288812 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc" Oct 30 08:57:42.755849 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:57:42.755764 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 08:57:44.302363 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:44.302334 5028 generic.go:356] "Generic (PLEG): container finished" podID="244e1aae-3d5f-42e6-87d6-008807036a2a" containerID="65297c34face57aca6e13b9666b05eeb1fcb83ce37fbf1617f331e8af0749f5a" exitCode=0 Oct 30 08:57:44.302768 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:44.302464 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnrcf" event={"ID":"244e1aae-3d5f-42e6-87d6-008807036a2a","Type":"ContainerDied","Data":"65297c34face57aca6e13b9666b05eeb1fcb83ce37fbf1617f331e8af0749f5a"} Oct 30 08:57:44.304267 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:44.304241 5028 generic.go:356] "Generic (PLEG): container finished" podID="be6df281-507f-43be-a1cf-e5677ed85bbd" containerID="d358aa41a54f936edc2170be53483271d33aabbf652a4706dfcf382533c5f462" exitCode=0 Oct 30 08:57:44.304378 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:44.304272 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c4fwsv" event={"ID":"be6df281-507f-43be-a1cf-e5677ed85bbd","Type":"ContainerDied","Data":"d358aa41a54f936edc2170be53483271d33aabbf652a4706dfcf382533c5f462"} Oct 30 08:57:44.307546 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:44.307523 5028 generic.go:356] "Generic (PLEG): container finished" podID="91b836e7-3ec9-4926-be10-52ef8fc8f541" containerID="0885b47d8265e41c75e716372ba339824b9527ad93f3e91c9e79659bf9ff9401" exitCode=0 Oct 30 08:57:44.307707 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:44.307679 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644f5gw6" event={"ID":"91b836e7-3ec9-4926-be10-52ef8fc8f541","Type":"ContainerDied","Data":"0885b47d8265e41c75e716372ba339824b9527ad93f3e91c9e79659bf9ff9401"} Oct 30 08:57:44.309268 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:44.309239 5028 generic.go:356] "Generic (PLEG): container finished" podID="ba34d7cd-ade7-49b7-bcfc-1caabccd9683" containerID="2a812a8b6e69098d14f8a5a9ab982eb3018c21c3470f82e740bab9625ec38162" exitCode=0 Oct 30 08:57:44.309362 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:44.309268 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak6qsd" event={"ID":"ba34d7cd-ade7-49b7-bcfc-1caabccd9683","Type":"ContainerDied","Data":"2a812a8b6e69098d14f8a5a9ab982eb3018c21c3470f82e740bab9625ec38162"} Oct 30 08:57:45.315669 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:45.315608 5028 generic.go:356] "Generic (PLEG): container finished" podID="37e7e745-50fa-4704-bbd2-c4624a3f4c84" containerID="30c622577a8df3a0df72327c60966edcd1c7066482ca4fe9ec7db450bd9b5923" exitCode=0 Oct 30 08:57:45.316039 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:45.315695 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71hrzxs" event={"ID":"37e7e745-50fa-4704-bbd2-c4624a3f4c84","Type":"ContainerDied","Data":"30c622577a8df3a0df72327c60966edcd1c7066482ca4fe9ec7db450bd9b5923"} Oct 30 08:57:45.320266 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:45.320240 5028 generic.go:356] "Generic (PLEG): container finished" podID="e77df329-89f1-40ee-b862-83b6e562cd6b" containerID="64397a19efa036215c32485f9dbd547425c4854589258359997ea21a51488e7d" exitCode=0 Oct 30 08:57:45.320380 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:45.320343 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dbzqj" event={"ID":"e77df329-89f1-40ee-b862-83b6e562cd6b","Type":"ContainerDied","Data":"64397a19efa036215c32485f9dbd547425c4854589258359997ea21a51488e7d"} Oct 30 08:57:45.322208 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:45.322182 5028 generic.go:356] "Generic (PLEG): container finished" podID="f632f217-80ef-43f7-a879-c5dd6d4a9fa0" containerID="43309ed13e662718bfcd5991167a20106ad1a75658e44df0bba6c0ef9f5fedd8" exitCode=0 Oct 30 08:57:45.322323 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:45.322294 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7frghl" event={"ID":"f632f217-80ef-43f7-a879-c5dd6d4a9fa0","Type":"ContainerDied","Data":"43309ed13e662718bfcd5991167a20106ad1a75658e44df0bba6c0ef9f5fedd8"} Oct 30 08:57:45.324348 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:45.324323 5028 generic.go:356] "Generic (PLEG): container finished" podID="d7014e1f-cca5-4c4c-84a2-03c26d2846d6" containerID="de613d93fd20846369dd65802f75502bb4171648336c80bb2bdb0be311ede187" exitCode=0 Oct 30 08:57:45.324434 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:45.324405 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnnhf5" event={"ID":"d7014e1f-cca5-4c4c-84a2-03c26d2846d6","Type":"ContainerDied","Data":"de613d93fd20846369dd65802f75502bb4171648336c80bb2bdb0be311ede187"} Oct 30 08:57:46.332645 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:46.332562 5028 generic.go:356] "Generic (PLEG): container finished" podID="37e7e745-50fa-4704-bbd2-c4624a3f4c84" containerID="e4a261129f724b9ab2958dc421eca1470c7c27d6b41daf8ab8053fa8c454be4d" exitCode=0 Oct 30 08:57:46.333131 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:46.332655 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71hrzxs" event={"ID":"37e7e745-50fa-4704-bbd2-c4624a3f4c84","Type":"ContainerDied","Data":"e4a261129f724b9ab2958dc421eca1470c7c27d6b41daf8ab8053fa8c454be4d"} Oct 30 08:57:46.336901 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:46.336876 5028 generic.go:356] "Generic (PLEG): container finished" podID="244e1aae-3d5f-42e6-87d6-008807036a2a" containerID="4c0043c709db8c30c1b79b60b3340f0d6343cfd2efdf7de4a95b249e218711e3" exitCode=0 Oct 30 08:57:46.337011 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:46.336993 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnrcf" event={"ID":"244e1aae-3d5f-42e6-87d6-008807036a2a","Type":"ContainerDied","Data":"4c0043c709db8c30c1b79b60b3340f0d6343cfd2efdf7de4a95b249e218711e3"} Oct 30 08:57:47.355894 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:47.355812 5028 generic.go:356] "Generic (PLEG): container finished" podID="ba34d7cd-ade7-49b7-bcfc-1caabccd9683" containerID="839e9654788b99bd3de5316b9738e682716225844bbd1861432c31803ad77d6b" exitCode=0 Oct 30 08:57:47.356361 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:47.355935 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak6qsd" event={"ID":"ba34d7cd-ade7-49b7-bcfc-1caabccd9683","Type":"ContainerDied","Data":"839e9654788b99bd3de5316b9738e682716225844bbd1861432c31803ad77d6b"} Oct 30 08:57:47.361057 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:47.361020 5028 generic.go:356] "Generic (PLEG): container finished" podID="e77df329-89f1-40ee-b862-83b6e562cd6b" containerID="9c3e23f7b43b0e1dd55c69d7cf51d3ef83424f0fbbabe9d61eadfb1a3a81cdcd" exitCode=0 Oct 30 08:57:47.361236 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:47.361214 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dbzqj" event={"ID":"e77df329-89f1-40ee-b862-83b6e562cd6b","Type":"ContainerDied","Data":"9c3e23f7b43b0e1dd55c69d7cf51d3ef83424f0fbbabe9d61eadfb1a3a81cdcd"} Oct 30 08:57:47.365048 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:47.365023 5028 generic.go:356] "Generic (PLEG): container finished" podID="f632f217-80ef-43f7-a879-c5dd6d4a9fa0" containerID="ab81378d143e12622fe919570d738945370be95854c37ddc23c8e40388cf002f" exitCode=0 Oct 30 08:57:47.365152 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:47.365129 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7frghl" event={"ID":"f632f217-80ef-43f7-a879-c5dd6d4a9fa0","Type":"ContainerDied","Data":"ab81378d143e12622fe919570d738945370be95854c37ddc23c8e40388cf002f"} Oct 30 08:57:47.373433 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:47.373404 5028 generic.go:356] "Generic (PLEG): container finished" podID="be6df281-507f-43be-a1cf-e5677ed85bbd" containerID="b596a4ab179ee76fb5b5ec9eae9379d163ec7e399f58fe5152993b86232532e6" exitCode=0 Oct 30 08:57:47.373869 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:47.373843 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c4fwsv" event={"ID":"be6df281-507f-43be-a1cf-e5677ed85bbd","Type":"ContainerDied","Data":"b596a4ab179ee76fb5b5ec9eae9379d163ec7e399f58fe5152993b86232532e6"} Oct 30 08:57:47.376295 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:47.376271 5028 generic.go:356] "Generic (PLEG): container finished" podID="91b836e7-3ec9-4926-be10-52ef8fc8f541" containerID="2f1ec6d8b72c3c2829a1baf9e5e035238e10c0f644dc737e74d14993dd251ae3" exitCode=0 Oct 30 08:57:47.376397 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:47.376360 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644f5gw6" event={"ID":"91b836e7-3ec9-4926-be10-52ef8fc8f541","Type":"ContainerDied","Data":"2f1ec6d8b72c3c2829a1baf9e5e035238e10c0f644dc737e74d14993dd251ae3"} Oct 30 08:57:48.389633 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:48.389589 5028 generic.go:356] "Generic (PLEG): container finished" podID="d7014e1f-cca5-4c4c-84a2-03c26d2846d6" containerID="b5cadd84f5966bb8560856a9eb858fa1868e73f366ec0e2ad2a2779035c178c2" exitCode=0 Oct 30 08:57:48.390076 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:57:48.389675 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnnhf5" event={"ID":"d7014e1f-cca5-4c4c-84a2-03c26d2846d6","Type":"ContainerDied","Data":"b5cadd84f5966bb8560856a9eb858fa1868e73f366ec0e2ad2a2779035c178c2"} Oct 30 08:58:03.539432 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:03.538953 5028 generic.go:356] "Generic (PLEG): container finished" podID="37e7e745-50fa-4704-bbd2-c4624a3f4c84" containerID="c53b2a1169f09bd12a8eadb1f92aa4cab66bfb9a5074d0bb5a3585318e799c71" exitCode=0 Oct 30 08:58:03.539432 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:03.539035 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71hrzxs" event={"ID":"37e7e745-50fa-4704-bbd2-c4624a3f4c84","Type":"ContainerDied","Data":"c53b2a1169f09bd12a8eadb1f92aa4cab66bfb9a5074d0bb5a3585318e799c71"} Oct 30 08:58:03.542148 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:03.542117 5028 generic.go:356] "Generic (PLEG): container finished" podID="244e1aae-3d5f-42e6-87d6-008807036a2a" containerID="6da9bbcd8ee76c46d9e125326272e7f5bd48a5e9714f78e316018fa1d83cedcd" exitCode=0 Oct 30 08:58:03.542272 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:03.542169 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnrcf" event={"ID":"244e1aae-3d5f-42e6-87d6-008807036a2a","Type":"ContainerDied","Data":"6da9bbcd8ee76c46d9e125326272e7f5bd48a5e9714f78e316018fa1d83cedcd"} Oct 30 08:58:04.550579 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:04.550540 5028 generic.go:356] "Generic (PLEG): container finished" podID="ba34d7cd-ade7-49b7-bcfc-1caabccd9683" containerID="2e203821090dc6cc9f3df1753e315ee703e94548c35031e899d80a5a014e3b42" exitCode=0 Oct 30 08:58:04.550931 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:04.550627 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak6qsd" event={"ID":"ba34d7cd-ade7-49b7-bcfc-1caabccd9683","Type":"ContainerDied","Data":"2e203821090dc6cc9f3df1753e315ee703e94548c35031e899d80a5a014e3b42"} Oct 30 08:58:04.553086 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:04.553052 5028 generic.go:356] "Generic (PLEG): container finished" podID="e77df329-89f1-40ee-b862-83b6e562cd6b" containerID="b83094e6a7def732d110fb9b0431cd337eb1dbfa8c478e8953de203b1dbd4bfc" exitCode=0 Oct 30 08:58:04.553231 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:04.553106 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dbzqj" event={"ID":"e77df329-89f1-40ee-b862-83b6e562cd6b","Type":"ContainerDied","Data":"b83094e6a7def732d110fb9b0431cd337eb1dbfa8c478e8953de203b1dbd4bfc"} Oct 30 08:58:04.555519 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:04.555436 5028 generic.go:356] "Generic (PLEG): container finished" podID="f632f217-80ef-43f7-a879-c5dd6d4a9fa0" containerID="e41dc8acd156fe1b142786b88d108e597f1c47bf64c712e1f955f8e6e9da00f4" exitCode=0 Oct 30 08:58:04.555611 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:04.555521 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7frghl" event={"ID":"f632f217-80ef-43f7-a879-c5dd6d4a9fa0","Type":"ContainerDied","Data":"e41dc8acd156fe1b142786b88d108e597f1c47bf64c712e1f955f8e6e9da00f4"} Oct 30 08:58:04.557685 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:04.557665 5028 generic.go:356] "Generic (PLEG): container finished" podID="be6df281-507f-43be-a1cf-e5677ed85bbd" containerID="85a1f605d16bf60a7a0a8c08659904bc9a469928672245abdac57687f791b75c" exitCode=0 Oct 30 08:58:04.557781 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:04.557742 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c4fwsv" event={"ID":"be6df281-507f-43be-a1cf-e5677ed85bbd","Type":"ContainerDied","Data":"85a1f605d16bf60a7a0a8c08659904bc9a469928672245abdac57687f791b75c"} Oct 30 08:58:04.559786 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:04.559763 5028 generic.go:356] "Generic (PLEG): container finished" podID="91b836e7-3ec9-4926-be10-52ef8fc8f541" containerID="b223f3c4671ebb0d55120ae7ecb836079393c99440a9b0a3e6a09ecf55e31398" exitCode=0 Oct 30 08:58:04.559882 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:04.559831 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644f5gw6" event={"ID":"91b836e7-3ec9-4926-be10-52ef8fc8f541","Type":"ContainerDied","Data":"b223f3c4671ebb0d55120ae7ecb836079393c99440a9b0a3e6a09ecf55e31398"} Oct 30 08:58:04.688167 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:04.688147 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnrcf" Oct 30 08:58:04.731444 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:04.731423 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71hrzxs" Oct 30 08:58:04.769985 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:04.769959 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/244e1aae-3d5f-42e6-87d6-008807036a2a-bundle\" (UniqueName: \"kubernetes.io/empty-dir/244e1aae-3d5f-42e6-87d6-008807036a2a-bundle\") pod \"244e1aae-3d5f-42e6-87d6-008807036a2a\" (UID: \"244e1aae-3d5f-42e6-87d6-008807036a2a\") " Oct 30 08:58:04.770120 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:04.769999 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/244e1aae-3d5f-42e6-87d6-008807036a2a-kube-api-access-5c5jj\" (UniqueName: \"kubernetes.io/projected/244e1aae-3d5f-42e6-87d6-008807036a2a-kube-api-access-5c5jj\") pod \"244e1aae-3d5f-42e6-87d6-008807036a2a\" (UID: \"244e1aae-3d5f-42e6-87d6-008807036a2a\") " Oct 30 08:58:04.770120 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:04.770023 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/244e1aae-3d5f-42e6-87d6-008807036a2a-util\" (UniqueName: \"kubernetes.io/empty-dir/244e1aae-3d5f-42e6-87d6-008807036a2a-util\") pod \"244e1aae-3d5f-42e6-87d6-008807036a2a\" (UID: \"244e1aae-3d5f-42e6-87d6-008807036a2a\") " Oct 30 08:58:04.770120 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:04.770066 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37e7e745-50fa-4704-bbd2-c4624a3f4c84-util\" (UniqueName: \"kubernetes.io/empty-dir/37e7e745-50fa-4704-bbd2-c4624a3f4c84-util\") pod \"37e7e745-50fa-4704-bbd2-c4624a3f4c84\" (UID: \"37e7e745-50fa-4704-bbd2-c4624a3f4c84\") " Oct 30 08:58:04.770562 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:04.770525 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/244e1aae-3d5f-42e6-87d6-008807036a2a-bundle" pod "244e1aae-3d5f-42e6-87d6-008807036a2a" (UID: "244e1aae-3d5f-42e6-87d6-008807036a2a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 08:58:04.772200 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:04.772169 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/244e1aae-3d5f-42e6-87d6-008807036a2a-kube-api-access-5c5jj" pod "244e1aae-3d5f-42e6-87d6-008807036a2a" (UID: "244e1aae-3d5f-42e6-87d6-008807036a2a"). InnerVolumeSpecName "kube-api-access-5c5jj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 08:58:04.775142 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:04.775118 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/244e1aae-3d5f-42e6-87d6-008807036a2a-util" pod "244e1aae-3d5f-42e6-87d6-008807036a2a" (UID: "244e1aae-3d5f-42e6-87d6-008807036a2a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 08:58:04.775949 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:04.775925 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37e7e745-50fa-4704-bbd2-c4624a3f4c84-util" pod "37e7e745-50fa-4704-bbd2-c4624a3f4c84" (UID: "37e7e745-50fa-4704-bbd2-c4624a3f4c84"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 08:58:04.870639 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:04.870568 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/37e7e745-50fa-4704-bbd2-c4624a3f4c84-bundle\" (UniqueName: \"kubernetes.io/empty-dir/37e7e745-50fa-4704-bbd2-c4624a3f4c84-bundle\") pod \"37e7e745-50fa-4704-bbd2-c4624a3f4c84\" (UID: \"37e7e745-50fa-4704-bbd2-c4624a3f4c84\") " Oct 30 08:58:04.870639 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:04.870609 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/37e7e745-50fa-4704-bbd2-c4624a3f4c84-kube-api-access-lnpxz\" (UniqueName: \"kubernetes.io/projected/37e7e745-50fa-4704-bbd2-c4624a3f4c84-kube-api-access-lnpxz\") pod \"37e7e745-50fa-4704-bbd2-c4624a3f4c84\" (UID: \"37e7e745-50fa-4704-bbd2-c4624a3f4c84\") " Oct 30 08:58:04.870883 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:04.870867 5028 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37e7e745-50fa-4704-bbd2-c4624a3f4c84-util\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:58:04.870949 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:04.870888 5028 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/244e1aae-3d5f-42e6-87d6-008807036a2a-bundle\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:58:04.871009 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:04.870902 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5c5jj\" (UniqueName: \"kubernetes.io/projected/244e1aae-3d5f-42e6-87d6-008807036a2a-kube-api-access-5c5jj\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:58:04.871009 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:04.870975 5028 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/244e1aae-3d5f-42e6-87d6-008807036a2a-util\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:58:04.871079 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:04.871026 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37e7e745-50fa-4704-bbd2-c4624a3f4c84-bundle" pod "37e7e745-50fa-4704-bbd2-c4624a3f4c84" (UID: "37e7e745-50fa-4704-bbd2-c4624a3f4c84"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 08:58:04.872707 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:04.872671 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37e7e745-50fa-4704-bbd2-c4624a3f4c84-kube-api-access-lnpxz" pod "37e7e745-50fa-4704-bbd2-c4624a3f4c84" (UID: "37e7e745-50fa-4704-bbd2-c4624a3f4c84"). InnerVolumeSpecName "kube-api-access-lnpxz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 08:58:04.971349 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:04.971321 5028 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37e7e745-50fa-4704-bbd2-c4624a3f4c84-bundle\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:58:04.971349 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:04.971344 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnpxz\" (UniqueName: \"kubernetes.io/projected/37e7e745-50fa-4704-bbd2-c4624a3f4c84-kube-api-access-lnpxz\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:58:05.566174 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.566154 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71hrzxs" Oct 30 08:58:05.566522 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.566149 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71hrzxs" event={"ID":"37e7e745-50fa-4704-bbd2-c4624a3f4c84","Type":"ContainerDied","Data":"a8d8b0c975097048da9a3fe9e33e0a3de3de8621eb47dd478ccff55240ec4f51"} Oct 30 08:58:05.566522 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.566252 5028 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8d8b0c975097048da9a3fe9e33e0a3de3de8621eb47dd478ccff55240ec4f51" Oct 30 08:58:05.568256 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.568236 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnrcf" Oct 30 08:58:05.568385 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.568236 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6xnrcf" event={"ID":"244e1aae-3d5f-42e6-87d6-008807036a2a","Type":"ContainerDied","Data":"8c440d0ad4e8118c24d9e82cea6fcee28a7717af07eea5552d6831b1b8a8983f"} Oct 30 08:58:05.568385 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.568360 5028 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8c440d0ad4e8118c24d9e82cea6fcee28a7717af07eea5552d6831b1b8a8983f" Oct 30 08:58:05.570623 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.570597 5028 generic.go:356] "Generic (PLEG): container finished" podID="d7014e1f-cca5-4c4c-84a2-03c26d2846d6" containerID="b974a737968ce64064ae1b5915683bf412469056373569245a864a35c88ae9e7" exitCode=0 Oct 30 08:58:05.570720 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.570676 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnnhf5" event={"ID":"d7014e1f-cca5-4c4c-84a2-03c26d2846d6","Type":"ContainerDied","Data":"b974a737968ce64064ae1b5915683bf412469056373569245a864a35c88ae9e7"} Oct 30 08:58:05.728790 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.728765 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dbzqj" Oct 30 08:58:05.761396 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.761373 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644f5gw6" Oct 30 08:58:05.814091 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.805617 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c4fwsv" Oct 30 08:58:05.834409 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.834389 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7frghl" Oct 30 08:58:05.837443 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.837421 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak6qsd" Oct 30 08:58:05.876510 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.876486 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f632f217-80ef-43f7-a879-c5dd6d4a9fa0-bundle\" (UniqueName: \"kubernetes.io/empty-dir/f632f217-80ef-43f7-a879-c5dd6d4a9fa0-bundle\") pod \"f632f217-80ef-43f7-a879-c5dd6d4a9fa0\" (UID: \"f632f217-80ef-43f7-a879-c5dd6d4a9fa0\") " Oct 30 08:58:05.876637 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.876528 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ba34d7cd-ade7-49b7-bcfc-1caabccd9683-bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba34d7cd-ade7-49b7-bcfc-1caabccd9683-bundle\") pod \"ba34d7cd-ade7-49b7-bcfc-1caabccd9683\" (UID: \"ba34d7cd-ade7-49b7-bcfc-1caabccd9683\") " Oct 30 08:58:05.876637 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.876565 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/91b836e7-3ec9-4926-be10-52ef8fc8f541-bundle\" (UniqueName: \"kubernetes.io/empty-dir/91b836e7-3ec9-4926-be10-52ef8fc8f541-bundle\") pod \"91b836e7-3ec9-4926-be10-52ef8fc8f541\" (UID: \"91b836e7-3ec9-4926-be10-52ef8fc8f541\") " Oct 30 08:58:05.876637 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.876625 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ba34d7cd-ade7-49b7-bcfc-1caabccd9683-util\" (UniqueName: \"kubernetes.io/empty-dir/ba34d7cd-ade7-49b7-bcfc-1caabccd9683-util\") pod \"ba34d7cd-ade7-49b7-bcfc-1caabccd9683\" (UID: \"ba34d7cd-ade7-49b7-bcfc-1caabccd9683\") " Oct 30 08:58:05.876794 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.876661 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/be6df281-507f-43be-a1cf-e5677ed85bbd-kube-api-access-ftqkr\" (UniqueName: \"kubernetes.io/projected/be6df281-507f-43be-a1cf-e5677ed85bbd-kube-api-access-ftqkr\") pod \"be6df281-507f-43be-a1cf-e5677ed85bbd\" (UID: \"be6df281-507f-43be-a1cf-e5677ed85bbd\") " Oct 30 08:58:05.876794 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.876701 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f632f217-80ef-43f7-a879-c5dd6d4a9fa0-util\" (UniqueName: \"kubernetes.io/empty-dir/f632f217-80ef-43f7-a879-c5dd6d4a9fa0-util\") pod \"f632f217-80ef-43f7-a879-c5dd6d4a9fa0\" (UID: \"f632f217-80ef-43f7-a879-c5dd6d4a9fa0\") " Oct 30 08:58:05.876794 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.876731 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be6df281-507f-43be-a1cf-e5677ed85bbd-util\" (UniqueName: \"kubernetes.io/empty-dir/be6df281-507f-43be-a1cf-e5677ed85bbd-util\") pod \"be6df281-507f-43be-a1cf-e5677ed85bbd\" (UID: \"be6df281-507f-43be-a1cf-e5677ed85bbd\") " Oct 30 08:58:05.876794 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.876788 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/91b836e7-3ec9-4926-be10-52ef8fc8f541-util\" (UniqueName: \"kubernetes.io/empty-dir/91b836e7-3ec9-4926-be10-52ef8fc8f541-util\") pod \"91b836e7-3ec9-4926-be10-52ef8fc8f541\" (UID: \"91b836e7-3ec9-4926-be10-52ef8fc8f541\") " Oct 30 08:58:05.876987 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.876817 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e77df329-89f1-40ee-b862-83b6e562cd6b-bundle\" (UniqueName: \"kubernetes.io/empty-dir/e77df329-89f1-40ee-b862-83b6e562cd6b-bundle\") pod \"e77df329-89f1-40ee-b862-83b6e562cd6b\" (UID: \"e77df329-89f1-40ee-b862-83b6e562cd6b\") " Oct 30 08:58:05.876987 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.876853 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f632f217-80ef-43f7-a879-c5dd6d4a9fa0-kube-api-access-lmtrj\" (UniqueName: \"kubernetes.io/projected/f632f217-80ef-43f7-a879-c5dd6d4a9fa0-kube-api-access-lmtrj\") pod \"f632f217-80ef-43f7-a879-c5dd6d4a9fa0\" (UID: \"f632f217-80ef-43f7-a879-c5dd6d4a9fa0\") " Oct 30 08:58:05.876987 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.876886 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be6df281-507f-43be-a1cf-e5677ed85bbd-bundle\" (UniqueName: \"kubernetes.io/empty-dir/be6df281-507f-43be-a1cf-e5677ed85bbd-bundle\") pod \"be6df281-507f-43be-a1cf-e5677ed85bbd\" (UID: \"be6df281-507f-43be-a1cf-e5677ed85bbd\") " Oct 30 08:58:05.876987 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.876939 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/91b836e7-3ec9-4926-be10-52ef8fc8f541-kube-api-access-kkkjj\" (UniqueName: \"kubernetes.io/projected/91b836e7-3ec9-4926-be10-52ef8fc8f541-kube-api-access-kkkjj\") pod \"91b836e7-3ec9-4926-be10-52ef8fc8f541\" (UID: \"91b836e7-3ec9-4926-be10-52ef8fc8f541\") " Oct 30 08:58:05.876987 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.876975 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e77df329-89f1-40ee-b862-83b6e562cd6b-kube-api-access-kv2h7\" (UniqueName: \"kubernetes.io/projected/e77df329-89f1-40ee-b862-83b6e562cd6b-kube-api-access-kv2h7\") pod \"e77df329-89f1-40ee-b862-83b6e562cd6b\" (UID: \"e77df329-89f1-40ee-b862-83b6e562cd6b\") " Oct 30 08:58:05.877247 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.877033 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ba34d7cd-ade7-49b7-bcfc-1caabccd9683-kube-api-access-xgfcp\" (UniqueName: \"kubernetes.io/projected/ba34d7cd-ade7-49b7-bcfc-1caabccd9683-kube-api-access-xgfcp\") pod \"ba34d7cd-ade7-49b7-bcfc-1caabccd9683\" (UID: \"ba34d7cd-ade7-49b7-bcfc-1caabccd9683\") " Oct 30 08:58:05.877247 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.877066 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e77df329-89f1-40ee-b862-83b6e562cd6b-util\" (UniqueName: \"kubernetes.io/empty-dir/e77df329-89f1-40ee-b862-83b6e562cd6b-util\") pod \"e77df329-89f1-40ee-b862-83b6e562cd6b\" (UID: \"e77df329-89f1-40ee-b862-83b6e562cd6b\") " Oct 30 08:58:05.877247 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.877178 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91b836e7-3ec9-4926-be10-52ef8fc8f541-bundle" pod "91b836e7-3ec9-4926-be10-52ef8fc8f541" (UID: "91b836e7-3ec9-4926-be10-52ef8fc8f541"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 08:58:05.877409 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.877314 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f632f217-80ef-43f7-a879-c5dd6d4a9fa0-bundle" pod "f632f217-80ef-43f7-a879-c5dd6d4a9fa0" (UID: "f632f217-80ef-43f7-a879-c5dd6d4a9fa0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 08:58:05.877409 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.877365 5028 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91b836e7-3ec9-4926-be10-52ef8fc8f541-bundle\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:58:05.877652 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.877628 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e77df329-89f1-40ee-b862-83b6e562cd6b-bundle" pod "e77df329-89f1-40ee-b862-83b6e562cd6b" (UID: "e77df329-89f1-40ee-b862-83b6e562cd6b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 08:58:05.883787 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.878285 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be6df281-507f-43be-a1cf-e5677ed85bbd-bundle" pod "be6df281-507f-43be-a1cf-e5677ed85bbd" (UID: "be6df281-507f-43be-a1cf-e5677ed85bbd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 08:58:05.883787 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.879970 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e77df329-89f1-40ee-b862-83b6e562cd6b-kube-api-access-kv2h7" pod "e77df329-89f1-40ee-b862-83b6e562cd6b" (UID: "e77df329-89f1-40ee-b862-83b6e562cd6b"). InnerVolumeSpecName "kube-api-access-kv2h7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 08:58:05.883787 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.880926 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba34d7cd-ade7-49b7-bcfc-1caabccd9683-bundle" pod "ba34d7cd-ade7-49b7-bcfc-1caabccd9683" (UID: "ba34d7cd-ade7-49b7-bcfc-1caabccd9683"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 08:58:05.883787 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.880945 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91b836e7-3ec9-4926-be10-52ef8fc8f541-kube-api-access-kkkjj" pod "91b836e7-3ec9-4926-be10-52ef8fc8f541" (UID: "91b836e7-3ec9-4926-be10-52ef8fc8f541"). InnerVolumeSpecName "kube-api-access-kkkjj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 08:58:05.883787 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.881984 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be6df281-507f-43be-a1cf-e5677ed85bbd-kube-api-access-ftqkr" pod "be6df281-507f-43be-a1cf-e5677ed85bbd" (UID: "be6df281-507f-43be-a1cf-e5677ed85bbd"). InnerVolumeSpecName "kube-api-access-ftqkr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 08:58:05.883787 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.883534 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f632f217-80ef-43f7-a879-c5dd6d4a9fa0-kube-api-access-lmtrj" pod "f632f217-80ef-43f7-a879-c5dd6d4a9fa0" (UID: "f632f217-80ef-43f7-a879-c5dd6d4a9fa0"). InnerVolumeSpecName "kube-api-access-lmtrj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 08:58:05.883787 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.883742 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91b836e7-3ec9-4926-be10-52ef8fc8f541-util" pod "91b836e7-3ec9-4926-be10-52ef8fc8f541" (UID: "91b836e7-3ec9-4926-be10-52ef8fc8f541"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 08:58:05.884177 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.884134 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f632f217-80ef-43f7-a879-c5dd6d4a9fa0-util" pod "f632f217-80ef-43f7-a879-c5dd6d4a9fa0" (UID: "f632f217-80ef-43f7-a879-c5dd6d4a9fa0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 08:58:05.884324 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.884306 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba34d7cd-ade7-49b7-bcfc-1caabccd9683-kube-api-access-xgfcp" pod "ba34d7cd-ade7-49b7-bcfc-1caabccd9683" (UID: "ba34d7cd-ade7-49b7-bcfc-1caabccd9683"). InnerVolumeSpecName "kube-api-access-xgfcp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 08:58:05.885812 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.885778 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be6df281-507f-43be-a1cf-e5677ed85bbd-util" pod "be6df281-507f-43be-a1cf-e5677ed85bbd" (UID: "be6df281-507f-43be-a1cf-e5677ed85bbd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 08:58:05.887845 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.887826 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e77df329-89f1-40ee-b862-83b6e562cd6b-util" pod "e77df329-89f1-40ee-b862-83b6e562cd6b" (UID: "e77df329-89f1-40ee-b862-83b6e562cd6b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 08:58:05.889404 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.889381 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba34d7cd-ade7-49b7-bcfc-1caabccd9683-util" pod "ba34d7cd-ade7-49b7-bcfc-1caabccd9683" (UID: "ba34d7cd-ade7-49b7-bcfc-1caabccd9683"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 08:58:05.953472 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.953450 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6jb9v_0c1ebb77-bd76-4329-ac03-87f60b688431/console-operator/1.log" Oct 30 08:58:05.956688 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.956659 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6jb9v_0c1ebb77-bd76-4329-ac03-87f60b688431/console-operator/1.log" Oct 30 08:58:05.977841 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.977821 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgfcp\" (UniqueName: \"kubernetes.io/projected/ba34d7cd-ade7-49b7-bcfc-1caabccd9683-kube-api-access-xgfcp\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:58:05.977841 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.977841 5028 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e77df329-89f1-40ee-b862-83b6e562cd6b-util\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:58:05.977968 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.977851 5028 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f632f217-80ef-43f7-a879-c5dd6d4a9fa0-bundle\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:58:05.977968 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.977860 5028 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba34d7cd-ade7-49b7-bcfc-1caabccd9683-bundle\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:58:05.977968 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.977867 5028 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba34d7cd-ade7-49b7-bcfc-1caabccd9683-util\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:58:05.977968 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.977875 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftqkr\" (UniqueName: \"kubernetes.io/projected/be6df281-507f-43be-a1cf-e5677ed85bbd-kube-api-access-ftqkr\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:58:05.977968 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.977883 5028 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f632f217-80ef-43f7-a879-c5dd6d4a9fa0-util\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:58:05.977968 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.977891 5028 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be6df281-507f-43be-a1cf-e5677ed85bbd-util\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:58:05.977968 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.977898 5028 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91b836e7-3ec9-4926-be10-52ef8fc8f541-util\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:58:05.977968 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.977905 5028 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e77df329-89f1-40ee-b862-83b6e562cd6b-bundle\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:58:05.977968 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.977913 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmtrj\" (UniqueName: \"kubernetes.io/projected/f632f217-80ef-43f7-a879-c5dd6d4a9fa0-kube-api-access-lmtrj\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:58:05.977968 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.977920 5028 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be6df281-507f-43be-a1cf-e5677ed85bbd-bundle\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:58:05.977968 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.977929 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkkjj\" (UniqueName: \"kubernetes.io/projected/91b836e7-3ec9-4926-be10-52ef8fc8f541-kube-api-access-kkkjj\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:58:05.977968 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:05.977936 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kv2h7\" (UniqueName: \"kubernetes.io/projected/e77df329-89f1-40ee-b862-83b6e562cd6b-kube-api-access-kv2h7\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:58:06.577495 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:06.577474 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7frghl" Oct 30 08:58:06.577889 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:06.577468 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7frghl" event={"ID":"f632f217-80ef-43f7-a879-c5dd6d4a9fa0","Type":"ContainerDied","Data":"cdd64028d09c56434ea5211fa79535c184f50a718b80622befb297b27d29c51c"} Oct 30 08:58:06.577889 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:06.577598 5028 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cdd64028d09c56434ea5211fa79535c184f50a718b80622befb297b27d29c51c" Oct 30 08:58:06.579568 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:06.579538 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c4fwsv" event={"ID":"be6df281-507f-43be-a1cf-e5677ed85bbd","Type":"ContainerDied","Data":"eda9c0c7df4e01754050791bea8601ef12bcc456da18f7c167a3b832a319db63"} Oct 30 08:58:06.579568 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:06.579556 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c4fwsv" Oct 30 08:58:06.579744 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:06.579585 5028 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eda9c0c7df4e01754050791bea8601ef12bcc456da18f7c167a3b832a319db63" Oct 30 08:58:06.581904 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:06.581881 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644f5gw6" event={"ID":"91b836e7-3ec9-4926-be10-52ef8fc8f541","Type":"ContainerDied","Data":"d6e0ced545da50b2ccb210caad2851f18a18ecbbc2619d6162ea653fe1e47d45"} Oct 30 08:58:06.582013 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:06.581919 5028 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d6e0ced545da50b2ccb210caad2851f18a18ecbbc2619d6162ea653fe1e47d45" Oct 30 08:58:06.582013 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:06.581920 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644f5gw6" Oct 30 08:58:06.583975 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:06.583955 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak6qsd" Oct 30 08:58:06.584093 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:06.583986 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ak6qsd" event={"ID":"ba34d7cd-ade7-49b7-bcfc-1caabccd9683","Type":"ContainerDied","Data":"6331e243606a81e757fda00d0b5d4ad388d0b846af8a1b306f77e24e32e70084"} Oct 30 08:58:06.584093 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:06.584030 5028 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6331e243606a81e757fda00d0b5d4ad388d0b846af8a1b306f77e24e32e70084" Oct 30 08:58:06.586041 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:06.586025 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dbzqj" Oct 30 08:58:06.586131 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:06.586054 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dbzqj" event={"ID":"e77df329-89f1-40ee-b862-83b6e562cd6b","Type":"ContainerDied","Data":"66792ba7d93796c3c91a7e0386902ab22144f7a545c3cfc138de04e4f38db61a"} Oct 30 08:58:06.586131 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:06.586098 5028 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="66792ba7d93796c3c91a7e0386902ab22144f7a545c3cfc138de04e4f38db61a" Oct 30 08:58:06.714917 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:06.714894 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnnhf5" Oct 30 08:58:06.782135 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:06.782115 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d7014e1f-cca5-4c4c-84a2-03c26d2846d6-bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7014e1f-cca5-4c4c-84a2-03c26d2846d6-bundle\") pod \"d7014e1f-cca5-4c4c-84a2-03c26d2846d6\" (UID: \"d7014e1f-cca5-4c4c-84a2-03c26d2846d6\") " Oct 30 08:58:06.782267 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:06.782146 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d7014e1f-cca5-4c4c-84a2-03c26d2846d6-util\" (UniqueName: \"kubernetes.io/empty-dir/d7014e1f-cca5-4c4c-84a2-03c26d2846d6-util\") pod \"d7014e1f-cca5-4c4c-84a2-03c26d2846d6\" (UID: \"d7014e1f-cca5-4c4c-84a2-03c26d2846d6\") " Oct 30 08:58:06.782267 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:06.782170 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d7014e1f-cca5-4c4c-84a2-03c26d2846d6-kube-api-access-49pws\" (UniqueName: \"kubernetes.io/projected/d7014e1f-cca5-4c4c-84a2-03c26d2846d6-kube-api-access-49pws\") pod \"d7014e1f-cca5-4c4c-84a2-03c26d2846d6\" (UID: \"d7014e1f-cca5-4c4c-84a2-03c26d2846d6\") " Oct 30 08:58:06.782711 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:06.782686 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7014e1f-cca5-4c4c-84a2-03c26d2846d6-bundle" pod "d7014e1f-cca5-4c4c-84a2-03c26d2846d6" (UID: "d7014e1f-cca5-4c4c-84a2-03c26d2846d6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 08:58:06.784221 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:06.784189 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7014e1f-cca5-4c4c-84a2-03c26d2846d6-kube-api-access-49pws" pod "d7014e1f-cca5-4c4c-84a2-03c26d2846d6" (UID: "d7014e1f-cca5-4c4c-84a2-03c26d2846d6"). InnerVolumeSpecName "kube-api-access-49pws". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 08:58:06.787942 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:06.787917 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7014e1f-cca5-4c4c-84a2-03c26d2846d6-util" pod "d7014e1f-cca5-4c4c-84a2-03c26d2846d6" (UID: "d7014e1f-cca5-4c4c-84a2-03c26d2846d6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 08:58:06.882760 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:06.882738 5028 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7014e1f-cca5-4c4c-84a2-03c26d2846d6-bundle\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:58:06.882760 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:06.882756 5028 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7014e1f-cca5-4c4c-84a2-03c26d2846d6-util\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:58:06.882881 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:06.882765 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49pws\" (UniqueName: \"kubernetes.io/projected/d7014e1f-cca5-4c4c-84a2-03c26d2846d6-kube-api-access-49pws\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:58:07.592662 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:07.592631 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnnhf5" Oct 30 08:58:07.592662 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:07.592647 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cnnhf5" event={"ID":"d7014e1f-cca5-4c4c-84a2-03c26d2846d6","Type":"ContainerDied","Data":"552c5347690e19985e720b51080067563d8fab182be7130a57d9cd79eea33f1a"} Oct 30 08:58:07.593165 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:07.592713 5028 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="552c5347690e19985e720b51080067563d8fab182be7130a57d9cd79eea33f1a" Oct 30 08:58:12.472299 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472265 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-6zbnf"] Oct 30 08:58:12.472749 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472648 5028 cpu_manager.go:414] "containerMap: removing container" podUID="e77df329-89f1-40ee-b862-83b6e562cd6b" containerName="pull" Oct 30 08:58:12.472749 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472663 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e77df329-89f1-40ee-b862-83b6e562cd6b" containerName="pull" Oct 30 08:58:12.472749 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472691 5028 cpu_manager.go:414] "containerMap: removing container" podUID="91b836e7-3ec9-4926-be10-52ef8fc8f541" containerName="util" Oct 30 08:58:12.472749 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472699 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="91b836e7-3ec9-4926-be10-52ef8fc8f541" containerName="util" Oct 30 08:58:12.472749 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472710 5028 cpu_manager.go:414] "containerMap: removing container" podUID="244e1aae-3d5f-42e6-87d6-008807036a2a" containerName="util" Oct 30 08:58:12.472749 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472717 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="244e1aae-3d5f-42e6-87d6-008807036a2a" containerName="util" Oct 30 08:58:12.472749 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472729 5028 cpu_manager.go:414] "containerMap: removing container" podUID="f632f217-80ef-43f7-a879-c5dd6d4a9fa0" containerName="util" Oct 30 08:58:12.472749 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472736 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f632f217-80ef-43f7-a879-c5dd6d4a9fa0" containerName="util" Oct 30 08:58:12.472749 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472745 5028 cpu_manager.go:414] "containerMap: removing container" podUID="244e1aae-3d5f-42e6-87d6-008807036a2a" containerName="pull" Oct 30 08:58:12.472749 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472753 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="244e1aae-3d5f-42e6-87d6-008807036a2a" containerName="pull" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472764 5028 cpu_manager.go:414] "containerMap: removing container" podUID="37e7e745-50fa-4704-bbd2-c4624a3f4c84" containerName="pull" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472771 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="37e7e745-50fa-4704-bbd2-c4624a3f4c84" containerName="pull" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472783 5028 cpu_manager.go:414] "containerMap: removing container" podUID="be6df281-507f-43be-a1cf-e5677ed85bbd" containerName="util" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472790 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="be6df281-507f-43be-a1cf-e5677ed85bbd" containerName="util" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472800 5028 cpu_manager.go:414] "containerMap: removing container" podUID="37e7e745-50fa-4704-bbd2-c4624a3f4c84" containerName="extract" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472805 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="37e7e745-50fa-4704-bbd2-c4624a3f4c84" containerName="extract" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472812 5028 cpu_manager.go:414] "containerMap: removing container" podUID="e77df329-89f1-40ee-b862-83b6e562cd6b" containerName="extract" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472816 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e77df329-89f1-40ee-b862-83b6e562cd6b" containerName="extract" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472822 5028 cpu_manager.go:414] "containerMap: removing container" podUID="ba34d7cd-ade7-49b7-bcfc-1caabccd9683" containerName="extract" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472826 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ba34d7cd-ade7-49b7-bcfc-1caabccd9683" containerName="extract" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472835 5028 cpu_manager.go:414] "containerMap: removing container" podUID="d7014e1f-cca5-4c4c-84a2-03c26d2846d6" containerName="util" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472839 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d7014e1f-cca5-4c4c-84a2-03c26d2846d6" containerName="util" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472845 5028 cpu_manager.go:414] "containerMap: removing container" podUID="244e1aae-3d5f-42e6-87d6-008807036a2a" containerName="extract" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472849 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="244e1aae-3d5f-42e6-87d6-008807036a2a" containerName="extract" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472857 5028 cpu_manager.go:414] "containerMap: removing container" podUID="f632f217-80ef-43f7-a879-c5dd6d4a9fa0" containerName="extract" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472861 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f632f217-80ef-43f7-a879-c5dd6d4a9fa0" containerName="extract" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472870 5028 cpu_manager.go:414] "containerMap: removing container" podUID="91b836e7-3ec9-4926-be10-52ef8fc8f541" containerName="extract" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472874 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="91b836e7-3ec9-4926-be10-52ef8fc8f541" containerName="extract" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472881 5028 cpu_manager.go:414] "containerMap: removing container" podUID="91b836e7-3ec9-4926-be10-52ef8fc8f541" containerName="pull" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472885 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="91b836e7-3ec9-4926-be10-52ef8fc8f541" containerName="pull" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472891 5028 cpu_manager.go:414] "containerMap: removing container" podUID="be6df281-507f-43be-a1cf-e5677ed85bbd" containerName="pull" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472897 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="be6df281-507f-43be-a1cf-e5677ed85bbd" containerName="pull" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472903 5028 cpu_manager.go:414] "containerMap: removing container" podUID="be6df281-507f-43be-a1cf-e5677ed85bbd" containerName="extract" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472908 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="be6df281-507f-43be-a1cf-e5677ed85bbd" containerName="extract" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472914 5028 cpu_manager.go:414] "containerMap: removing container" podUID="f632f217-80ef-43f7-a879-c5dd6d4a9fa0" containerName="pull" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472918 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f632f217-80ef-43f7-a879-c5dd6d4a9fa0" containerName="pull" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472924 5028 cpu_manager.go:414] "containerMap: removing container" podUID="d7014e1f-cca5-4c4c-84a2-03c26d2846d6" containerName="pull" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472927 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d7014e1f-cca5-4c4c-84a2-03c26d2846d6" containerName="pull" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472936 5028 cpu_manager.go:414] "containerMap: removing container" podUID="ba34d7cd-ade7-49b7-bcfc-1caabccd9683" containerName="util" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472940 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ba34d7cd-ade7-49b7-bcfc-1caabccd9683" containerName="util" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472950 5028 cpu_manager.go:414] "containerMap: removing container" podUID="37e7e745-50fa-4704-bbd2-c4624a3f4c84" containerName="util" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472957 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="37e7e745-50fa-4704-bbd2-c4624a3f4c84" containerName="util" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472968 5028 cpu_manager.go:414] "containerMap: removing container" podUID="e77df329-89f1-40ee-b862-83b6e562cd6b" containerName="util" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472973 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e77df329-89f1-40ee-b862-83b6e562cd6b" containerName="util" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472979 5028 cpu_manager.go:414] "containerMap: removing container" podUID="d7014e1f-cca5-4c4c-84a2-03c26d2846d6" containerName="extract" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472984 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d7014e1f-cca5-4c4c-84a2-03c26d2846d6" containerName="extract" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472990 5028 cpu_manager.go:414] "containerMap: removing container" podUID="ba34d7cd-ade7-49b7-bcfc-1caabccd9683" containerName="pull" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.472994 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ba34d7cd-ade7-49b7-bcfc-1caabccd9683" containerName="pull" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.473064 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="244e1aae-3d5f-42e6-87d6-008807036a2a" containerName="extract" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.473072 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="f632f217-80ef-43f7-a879-c5dd6d4a9fa0" containerName="extract" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.473079 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="91b836e7-3ec9-4926-be10-52ef8fc8f541" containerName="extract" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.473085 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="be6df281-507f-43be-a1cf-e5677ed85bbd" containerName="extract" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.473093 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="d7014e1f-cca5-4c4c-84a2-03c26d2846d6" containerName="extract" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.473100 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="37e7e745-50fa-4704-bbd2-c4624a3f4c84" containerName="extract" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.473106 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="e77df329-89f1-40ee-b862-83b6e562cd6b" containerName="extract" Oct 30 08:58:12.473172 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.473110 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="ba34d7cd-ade7-49b7-bcfc-1caabccd9683" containerName="extract" Oct 30 08:58:12.476041 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.476025 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-6zbnf" Oct 30 08:58:12.504743 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.504717 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Oct 30 08:58:12.504743 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.504726 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-2wjx7\"" Oct 30 08:58:12.504905 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.504759 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Oct 30 08:58:12.504905 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.504812 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Oct 30 08:58:12.506483 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.506467 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-6zbnf"] Oct 30 08:58:12.524377 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.524353 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vnhd\" (UniqueName: \"kubernetes.io/projected/e5747093-4ff8-4a2f-915a-31271e9ccf1f-kube-api-access-9vnhd\") pod \"dns-operator-controller-manager-8557cbdb84-6zbnf\" (UID: \"e5747093-4ff8-4a2f-915a-31271e9ccf1f\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-6zbnf" Oct 30 08:58:12.624984 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.624954 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vnhd\" (UniqueName: \"kubernetes.io/projected/e5747093-4ff8-4a2f-915a-31271e9ccf1f-kube-api-access-9vnhd\") pod \"dns-operator-controller-manager-8557cbdb84-6zbnf\" (UID: \"e5747093-4ff8-4a2f-915a-31271e9ccf1f\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-6zbnf" Oct 30 08:58:12.647851 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.647822 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vnhd\" (UniqueName: \"kubernetes.io/projected/e5747093-4ff8-4a2f-915a-31271e9ccf1f-kube-api-access-9vnhd\") pod \"dns-operator-controller-manager-8557cbdb84-6zbnf\" (UID: \"e5747093-4ff8-4a2f-915a-31271e9ccf1f\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-6zbnf" Oct 30 08:58:12.741532 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:58:12.741468 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 08:58:12.787716 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:12.787692 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-6zbnf" Oct 30 08:58:13.087269 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:13.087237 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-6zbnf"] Oct 30 08:58:13.091542 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:58:13.091517 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5747093_4ff8_4a2f_915a_31271e9ccf1f.slice/crio-8aa8a45c9940c7fc98643828447b8951a74797e2b0b79a49185a5be41ae8ca52 WatchSource:0}: Error finding container 8aa8a45c9940c7fc98643828447b8951a74797e2b0b79a49185a5be41ae8ca52: Status 404 returned error can't find the container with id 8aa8a45c9940c7fc98643828447b8951a74797e2b0b79a49185a5be41ae8ca52 Oct 30 08:58:13.094178 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:13.094157 5028 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 08:58:13.621943 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:13.621901 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-6zbnf" event={"ID":"e5747093-4ff8-4a2f-915a-31271e9ccf1f","Type":"ContainerStarted","Data":"8aa8a45c9940c7fc98643828447b8951a74797e2b0b79a49185a5be41ae8ca52"} Oct 30 08:58:17.285044 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.285015 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5645d865fb-5hlm6"] Oct 30 08:58:17.288612 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.288596 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5645d865fb-5hlm6" Oct 30 08:58:17.321776 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.321747 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Oct 30 08:58:17.321971 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.321932 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Oct 30 08:58:17.321971 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.321943 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Oct 30 08:58:17.321971 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.321946 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-6qkhc\"" Oct 30 08:58:17.322156 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.321980 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Oct 30 08:58:17.322156 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.321992 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Oct 30 08:58:17.324671 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.324645 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5645d865fb-5hlm6"] Oct 30 08:58:17.364396 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.364372 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6178d593-a79b-4e9d-b7fa-1488b989556a-tmp\") pod \"opendatahub-operator-controller-manager-5645d865fb-5hlm6\" (UID: \"6178d593-a79b-4e9d-b7fa-1488b989556a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5645d865fb-5hlm6" Oct 30 08:58:17.364499 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.364402 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n28l2\" (UniqueName: \"kubernetes.io/projected/6178d593-a79b-4e9d-b7fa-1488b989556a-kube-api-access-n28l2\") pod \"opendatahub-operator-controller-manager-5645d865fb-5hlm6\" (UID: \"6178d593-a79b-4e9d-b7fa-1488b989556a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5645d865fb-5hlm6" Oct 30 08:58:17.364499 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.364423 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6178d593-a79b-4e9d-b7fa-1488b989556a-webhook-cert\") pod \"opendatahub-operator-controller-manager-5645d865fb-5hlm6\" (UID: \"6178d593-a79b-4e9d-b7fa-1488b989556a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5645d865fb-5hlm6" Oct 30 08:58:17.364595 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.364492 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6178d593-a79b-4e9d-b7fa-1488b989556a-manifests\") pod \"opendatahub-operator-controller-manager-5645d865fb-5hlm6\" (UID: \"6178d593-a79b-4e9d-b7fa-1488b989556a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5645d865fb-5hlm6" Oct 30 08:58:17.364595 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.364582 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6178d593-a79b-4e9d-b7fa-1488b989556a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5645d865fb-5hlm6\" (UID: \"6178d593-a79b-4e9d-b7fa-1488b989556a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5645d865fb-5hlm6" Oct 30 08:58:17.364680 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.364653 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6178d593-a79b-4e9d-b7fa-1488b989556a-metrics-cert\") pod \"opendatahub-operator-controller-manager-5645d865fb-5hlm6\" (UID: \"6178d593-a79b-4e9d-b7fa-1488b989556a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5645d865fb-5hlm6" Oct 30 08:58:17.465878 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.465800 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6178d593-a79b-4e9d-b7fa-1488b989556a-tmp\") pod \"opendatahub-operator-controller-manager-5645d865fb-5hlm6\" (UID: \"6178d593-a79b-4e9d-b7fa-1488b989556a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5645d865fb-5hlm6" Oct 30 08:58:17.465878 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.465834 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n28l2\" (UniqueName: \"kubernetes.io/projected/6178d593-a79b-4e9d-b7fa-1488b989556a-kube-api-access-n28l2\") pod \"opendatahub-operator-controller-manager-5645d865fb-5hlm6\" (UID: \"6178d593-a79b-4e9d-b7fa-1488b989556a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5645d865fb-5hlm6" Oct 30 08:58:17.465878 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.465856 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6178d593-a79b-4e9d-b7fa-1488b989556a-webhook-cert\") pod \"opendatahub-operator-controller-manager-5645d865fb-5hlm6\" (UID: \"6178d593-a79b-4e9d-b7fa-1488b989556a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5645d865fb-5hlm6" Oct 30 08:58:17.466052 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.465917 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6178d593-a79b-4e9d-b7fa-1488b989556a-manifests\") pod \"opendatahub-operator-controller-manager-5645d865fb-5hlm6\" (UID: \"6178d593-a79b-4e9d-b7fa-1488b989556a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5645d865fb-5hlm6" Oct 30 08:58:17.466052 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.465962 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6178d593-a79b-4e9d-b7fa-1488b989556a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5645d865fb-5hlm6\" (UID: \"6178d593-a79b-4e9d-b7fa-1488b989556a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5645d865fb-5hlm6" Oct 30 08:58:17.466052 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.465986 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6178d593-a79b-4e9d-b7fa-1488b989556a-metrics-cert\") pod \"opendatahub-operator-controller-manager-5645d865fb-5hlm6\" (UID: \"6178d593-a79b-4e9d-b7fa-1488b989556a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5645d865fb-5hlm6" Oct 30 08:58:17.466357 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.466340 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6178d593-a79b-4e9d-b7fa-1488b989556a-manifests\") pod \"opendatahub-operator-controller-manager-5645d865fb-5hlm6\" (UID: \"6178d593-a79b-4e9d-b7fa-1488b989556a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5645d865fb-5hlm6" Oct 30 08:58:17.468373 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.468348 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6178d593-a79b-4e9d-b7fa-1488b989556a-tmp\") pod \"opendatahub-operator-controller-manager-5645d865fb-5hlm6\" (UID: \"6178d593-a79b-4e9d-b7fa-1488b989556a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5645d865fb-5hlm6" Oct 30 08:58:17.468373 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.468363 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6178d593-a79b-4e9d-b7fa-1488b989556a-webhook-cert\") pod \"opendatahub-operator-controller-manager-5645d865fb-5hlm6\" (UID: \"6178d593-a79b-4e9d-b7fa-1488b989556a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5645d865fb-5hlm6" Oct 30 08:58:17.468530 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.468392 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6178d593-a79b-4e9d-b7fa-1488b989556a-metrics-cert\") pod \"opendatahub-operator-controller-manager-5645d865fb-5hlm6\" (UID: \"6178d593-a79b-4e9d-b7fa-1488b989556a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5645d865fb-5hlm6" Oct 30 08:58:17.468530 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.468485 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6178d593-a79b-4e9d-b7fa-1488b989556a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5645d865fb-5hlm6\" (UID: \"6178d593-a79b-4e9d-b7fa-1488b989556a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5645d865fb-5hlm6" Oct 30 08:58:17.488655 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.488634 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n28l2\" (UniqueName: \"kubernetes.io/projected/6178d593-a79b-4e9d-b7fa-1488b989556a-kube-api-access-n28l2\") pod \"opendatahub-operator-controller-manager-5645d865fb-5hlm6\" (UID: \"6178d593-a79b-4e9d-b7fa-1488b989556a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5645d865fb-5hlm6" Oct 30 08:58:17.602823 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.602790 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5645d865fb-5hlm6" Oct 30 08:58:17.646851 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.646819 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-6zbnf" event={"ID":"e5747093-4ff8-4a2f-915a-31271e9ccf1f","Type":"ContainerStarted","Data":"ae748dfcdb6d14dba23365841ec47a49368214c28377c080d99d6a15ca57ed4d"} Oct 30 08:58:17.647006 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.646920 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-6zbnf" Oct 30 08:58:17.688065 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.688018 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-6zbnf" podStartSLOduration=1.606824509 podStartE2EDuration="5.688004519s" totalImagesPullingTime="4.08118001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:58:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:58:17.687337535 +0000 UTC m=+311.903449890" watchObservedRunningTime="2026-10-30 08:58:17.688004519 +0000 UTC m=+311.904116877" Oct 30 08:58:17.980817 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:58:17.980786 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6178d593_a79b_4e9d_b7fa_1488b989556a.slice/crio-ce92691deba49e51276b5e517899d02f85f02128220fc2fe8fe025cc755b521a WatchSource:0}: Error finding container ce92691deba49e51276b5e517899d02f85f02128220fc2fe8fe025cc755b521a: Status 404 returned error can't find the container with id ce92691deba49e51276b5e517899d02f85f02128220fc2fe8fe025cc755b521a Oct 30 08:58:17.985284 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:17.985263 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5645d865fb-5hlm6"] Oct 30 08:58:18.655191 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:18.655129 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5645d865fb-5hlm6" event={"ID":"6178d593-a79b-4e9d-b7fa-1488b989556a","Type":"ContainerStarted","Data":"ce92691deba49e51276b5e517899d02f85f02128220fc2fe8fe025cc755b521a"} Oct 30 08:58:19.942956 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:19.942929 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-f2nbm"] Oct 30 08:58:19.946567 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:19.946547 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-f2nbm" Oct 30 08:58:19.961848 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:19.961817 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-f2nbm"] Oct 30 08:58:19.971431 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:19.971396 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5ldgt\"" Oct 30 08:58:19.985797 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:19.985771 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a241e842-e733-49a0-9821-6000d281d1a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-f2nbm\" (UID: \"a241e842-e733-49a0-9821-6000d281d1a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-f2nbm" Oct 30 08:58:19.985922 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:19.985898 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx9m6\" (UniqueName: \"kubernetes.io/projected/a241e842-e733-49a0-9821-6000d281d1a2-kube-api-access-sx9m6\") pod \"kuadrant-operator-controller-manager-cf8469d7b-f2nbm\" (UID: \"a241e842-e733-49a0-9821-6000d281d1a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-f2nbm" Oct 30 08:58:20.086400 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:20.086363 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a241e842-e733-49a0-9821-6000d281d1a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-f2nbm\" (UID: \"a241e842-e733-49a0-9821-6000d281d1a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-f2nbm" Oct 30 08:58:20.086556 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:20.086428 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx9m6\" (UniqueName: \"kubernetes.io/projected/a241e842-e733-49a0-9821-6000d281d1a2-kube-api-access-sx9m6\") pod \"kuadrant-operator-controller-manager-cf8469d7b-f2nbm\" (UID: \"a241e842-e733-49a0-9821-6000d281d1a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-f2nbm" Oct 30 08:58:20.086781 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:20.086758 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a241e842-e733-49a0-9821-6000d281d1a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-f2nbm\" (UID: \"a241e842-e733-49a0-9821-6000d281d1a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-f2nbm" Oct 30 08:58:20.116661 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:20.116629 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx9m6\" (UniqueName: \"kubernetes.io/projected/a241e842-e733-49a0-9821-6000d281d1a2-kube-api-access-sx9m6\") pod \"kuadrant-operator-controller-manager-cf8469d7b-f2nbm\" (UID: \"a241e842-e733-49a0-9821-6000d281d1a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-f2nbm" Oct 30 08:58:20.260601 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:20.260525 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-f2nbm" Oct 30 08:58:20.622786 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:20.622744 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-f2nbm"] Oct 30 08:58:20.626239 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:58:20.626185 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda241e842_e733_49a0_9821_6000d281d1a2.slice/crio-533dc6d2931588e528ace78d3c0e598cb5e6b0e5b11f96a66d53b240ad9d72c7 WatchSource:0}: Error finding container 533dc6d2931588e528ace78d3c0e598cb5e6b0e5b11f96a66d53b240ad9d72c7: Status 404 returned error can't find the container with id 533dc6d2931588e528ace78d3c0e598cb5e6b0e5b11f96a66d53b240ad9d72c7 Oct 30 08:58:20.666433 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:20.666396 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-f2nbm" event={"ID":"a241e842-e733-49a0-9821-6000d281d1a2","Type":"ContainerStarted","Data":"533dc6d2931588e528ace78d3c0e598cb5e6b0e5b11f96a66d53b240ad9d72c7"} Oct 30 08:58:21.673995 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:21.673953 5028 generic.go:356] "Generic (PLEG): container finished" podID="6178d593-a79b-4e9d-b7fa-1488b989556a" containerID="c255783855163d75e99a44053a60cce5d7ffd8989144e5b307abeb5ea646b197" exitCode=0 Oct 30 08:58:21.674505 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:21.674030 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5645d865fb-5hlm6" event={"ID":"6178d593-a79b-4e9d-b7fa-1488b989556a","Type":"ContainerDied","Data":"c255783855163d75e99a44053a60cce5d7ffd8989144e5b307abeb5ea646b197"} Oct 30 08:58:22.682911 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:22.682869 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5645d865fb-5hlm6" event={"ID":"6178d593-a79b-4e9d-b7fa-1488b989556a","Type":"ContainerStarted","Data":"5520f4983e28ed060ea14941ae37070daeb5b3c6d9630cf768a70820d28d33ae"} Oct 30 08:58:22.683612 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:22.683595 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5645d865fb-5hlm6" Oct 30 08:58:22.774721 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:22.774669 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5645d865fb-5hlm6" podStartSLOduration=2.19835274 podStartE2EDuration="5.774654355s" totalImagesPullingTime="3.082345405s" totalInitContainerRuntime="493.95621ms" isStatefulPod=false podCreationTimestamp="2026-10-30 08:58:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:58:22.761832932 +0000 UTC m=+316.977945292" watchObservedRunningTime="2026-10-30 08:58:22.774654355 +0000 UTC m=+316.990766713" Oct 30 08:58:24.696569 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:24.696479 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-f2nbm" event={"ID":"a241e842-e733-49a0-9821-6000d281d1a2","Type":"ContainerStarted","Data":"e4f414578e47dd3ff845b736a56de577ae384db5349003344ce7b009c1a1f145"} Oct 30 08:58:24.767562 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:24.767513 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-f2nbm" podStartSLOduration=1.96509102 podStartE2EDuration="5.767499204s" totalImagesPullingTime="3.802408184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:58:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:58:24.75408628 +0000 UTC m=+318.970198650" watchObservedRunningTime="2026-10-30 08:58:24.767499204 +0000 UTC m=+318.983611562" Oct 30 08:58:25.701624 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:25.701586 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-f2nbm" Oct 30 08:58:28.658135 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:28.658101 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-6zbnf" Oct 30 08:58:29.063872 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:29.063788 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-jffhs"] Oct 30 08:58:29.070082 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:29.070060 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-jffhs" Oct 30 08:58:29.089835 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:29.089812 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-86f7g\"" Oct 30 08:58:29.092277 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:29.092252 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-jffhs"] Oct 30 08:58:29.164631 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:29.164603 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27tzp\" (UniqueName: \"kubernetes.io/projected/0a33a4c8-c195-44cb-b10c-7fc71f7428e6-kube-api-access-27tzp\") pod \"authorino-operator-7b7bb4bc77-jffhs\" (UID: \"0a33a4c8-c195-44cb-b10c-7fc71f7428e6\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-jffhs" Oct 30 08:58:29.265623 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:29.265598 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27tzp\" (UniqueName: \"kubernetes.io/projected/0a33a4c8-c195-44cb-b10c-7fc71f7428e6-kube-api-access-27tzp\") pod \"authorino-operator-7b7bb4bc77-jffhs\" (UID: \"0a33a4c8-c195-44cb-b10c-7fc71f7428e6\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-jffhs" Oct 30 08:58:29.291989 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:29.291963 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27tzp\" (UniqueName: \"kubernetes.io/projected/0a33a4c8-c195-44cb-b10c-7fc71f7428e6-kube-api-access-27tzp\") pod \"authorino-operator-7b7bb4bc77-jffhs\" (UID: \"0a33a4c8-c195-44cb-b10c-7fc71f7428e6\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-jffhs" Oct 30 08:58:29.382904 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:29.382880 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-jffhs" Oct 30 08:58:29.694116 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:29.694036 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-jffhs"] Oct 30 08:58:29.698067 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:58:29.698038 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a33a4c8_c195_44cb_b10c_7fc71f7428e6.slice/crio-3a5d30cfd201f9ea370be94f2bd29b06d7dd06d4b1d09cc96363126b7121ab80 WatchSource:0}: Error finding container 3a5d30cfd201f9ea370be94f2bd29b06d7dd06d4b1d09cc96363126b7121ab80: Status 404 returned error can't find the container with id 3a5d30cfd201f9ea370be94f2bd29b06d7dd06d4b1d09cc96363126b7121ab80 Oct 30 08:58:29.721637 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:29.721602 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-jffhs" event={"ID":"0a33a4c8-c195-44cb-b10c-7fc71f7428e6","Type":"ContainerStarted","Data":"3a5d30cfd201f9ea370be94f2bd29b06d7dd06d4b1d09cc96363126b7121ab80"} Oct 30 08:58:31.734630 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:31.734599 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-jffhs" event={"ID":"0a33a4c8-c195-44cb-b10c-7fc71f7428e6","Type":"ContainerStarted","Data":"ec2fc43f42f2304c25daa07ab72c8527f23ab293ce0deeee469c18e8c38f497b"} Oct 30 08:58:31.735020 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:31.734717 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-jffhs" Oct 30 08:58:31.776673 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:31.776631 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-7b7bb4bc77-jffhs" podStartSLOduration=1.367949586 podStartE2EDuration="2.776619689s" totalImagesPullingTime="1.408670103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:58:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:58:31.775250477 +0000 UTC m=+325.991362835" watchObservedRunningTime="2026-10-30 08:58:31.776619689 +0000 UTC m=+325.992732047" Oct 30 08:58:34.699010 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:34.698983 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5645d865fb-5hlm6" Oct 30 08:58:36.709862 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:36.709831 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-f2nbm" Oct 30 08:58:37.716494 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:37.716465 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7ns9n"] Oct 30 08:58:37.720263 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:37.720242 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7ns9n" Oct 30 08:58:37.733960 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:37.733933 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7ns9n"] Oct 30 08:58:37.832296 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:37.832270 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d04c24e1-b59c-412c-af1f-58b220325b38-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-7ns9n\" (UID: \"d04c24e1-b59c-412c-af1f-58b220325b38\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7ns9n" Oct 30 08:58:37.832395 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:37.832312 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jrmq\" (UniqueName: \"kubernetes.io/projected/d04c24e1-b59c-412c-af1f-58b220325b38-kube-api-access-7jrmq\") pod \"kuadrant-operator-controller-manager-678d87766f-7ns9n\" (UID: \"d04c24e1-b59c-412c-af1f-58b220325b38\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7ns9n" Oct 30 08:58:37.933124 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:37.933101 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d04c24e1-b59c-412c-af1f-58b220325b38-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-7ns9n\" (UID: \"d04c24e1-b59c-412c-af1f-58b220325b38\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7ns9n" Oct 30 08:58:37.933254 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:37.933142 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jrmq\" (UniqueName: \"kubernetes.io/projected/d04c24e1-b59c-412c-af1f-58b220325b38-kube-api-access-7jrmq\") pod \"kuadrant-operator-controller-manager-678d87766f-7ns9n\" (UID: \"d04c24e1-b59c-412c-af1f-58b220325b38\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7ns9n" Oct 30 08:58:37.933481 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:37.933462 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d04c24e1-b59c-412c-af1f-58b220325b38-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-7ns9n\" (UID: \"d04c24e1-b59c-412c-af1f-58b220325b38\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7ns9n" Oct 30 08:58:37.958790 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:37.958769 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jrmq\" (UniqueName: \"kubernetes.io/projected/d04c24e1-b59c-412c-af1f-58b220325b38-kube-api-access-7jrmq\") pod \"kuadrant-operator-controller-manager-678d87766f-7ns9n\" (UID: \"d04c24e1-b59c-412c-af1f-58b220325b38\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7ns9n" Oct 30 08:58:38.033178 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:38.033115 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7ns9n" Oct 30 08:58:38.414914 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:38.414879 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7ns9n"] Oct 30 08:58:38.418829 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:58:38.418803 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd04c24e1_b59c_412c_af1f_58b220325b38.slice/crio-113d1f369a30eb14d9a5d04aaa7e827b6982c07d1021910fdff67446fe1f8372 WatchSource:0}: Error finding container 113d1f369a30eb14d9a5d04aaa7e827b6982c07d1021910fdff67446fe1f8372: Status 404 returned error can't find the container with id 113d1f369a30eb14d9a5d04aaa7e827b6982c07d1021910fdff67446fe1f8372 Oct 30 08:58:38.775126 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:38.773168 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7ns9n" event={"ID":"d04c24e1-b59c-412c-af1f-58b220325b38","Type":"ContainerStarted","Data":"56f7d58afeca38521d896beb7dc43e9b16fbc5a8960e16348d350e6ae23a3c24"} Oct 30 08:58:38.775126 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:38.773296 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7ns9n" event={"ID":"d04c24e1-b59c-412c-af1f-58b220325b38","Type":"ContainerStarted","Data":"113d1f369a30eb14d9a5d04aaa7e827b6982c07d1021910fdff67446fe1f8372"} Oct 30 08:58:38.775126 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:38.773507 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7ns9n" Oct 30 08:58:38.835841 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:38.835792 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7ns9n" podStartSLOduration=1.83578113 podStartE2EDuration="1.83578113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:58:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:58:38.833984324 +0000 UTC m=+333.050096683" watchObservedRunningTime="2026-10-30 08:58:38.83578113 +0000 UTC m=+333.051893485" Oct 30 08:58:42.741582 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:58:42.741547 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 08:58:42.742339 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:42.742319 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-jffhs" Oct 30 08:58:48.213395 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.213366 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f"] Oct 30 08:58:48.221634 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.221610 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:48.243230 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.243191 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f"] Oct 30 08:58:48.313043 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.313020 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-972f2\"" Oct 30 08:58:48.314312 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.314288 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9494399d-55d2-48ce-a8fa-4ffd9d1e9307-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-cm45f\" (UID: \"9494399d-55d2-48ce-a8fa-4ffd9d1e9307\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:48.314436 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.314411 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9494399d-55d2-48ce-a8fa-4ffd9d1e9307-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-cm45f\" (UID: \"9494399d-55d2-48ce-a8fa-4ffd9d1e9307\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:48.314527 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.314504 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cbm6\" (UniqueName: \"kubernetes.io/projected/9494399d-55d2-48ce-a8fa-4ffd9d1e9307-kube-api-access-2cbm6\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-cm45f\" (UID: \"9494399d-55d2-48ce-a8fa-4ffd9d1e9307\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:48.314724 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.314701 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9494399d-55d2-48ce-a8fa-4ffd9d1e9307-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-cm45f\" (UID: \"9494399d-55d2-48ce-a8fa-4ffd9d1e9307\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:48.314812 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.314746 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9494399d-55d2-48ce-a8fa-4ffd9d1e9307-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-cm45f\" (UID: \"9494399d-55d2-48ce-a8fa-4ffd9d1e9307\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:48.314812 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.314777 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9494399d-55d2-48ce-a8fa-4ffd9d1e9307-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-cm45f\" (UID: \"9494399d-55d2-48ce-a8fa-4ffd9d1e9307\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:48.314890 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.314808 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9494399d-55d2-48ce-a8fa-4ffd9d1e9307-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-cm45f\" (UID: \"9494399d-55d2-48ce-a8fa-4ffd9d1e9307\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:48.314890 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.314835 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9494399d-55d2-48ce-a8fa-4ffd9d1e9307-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-cm45f\" (UID: \"9494399d-55d2-48ce-a8fa-4ffd9d1e9307\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:48.314890 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.314860 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9494399d-55d2-48ce-a8fa-4ffd9d1e9307-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-cm45f\" (UID: \"9494399d-55d2-48ce-a8fa-4ffd9d1e9307\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:48.416174 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.416140 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9494399d-55d2-48ce-a8fa-4ffd9d1e9307-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-cm45f\" (UID: \"9494399d-55d2-48ce-a8fa-4ffd9d1e9307\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:48.416365 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.416238 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9494399d-55d2-48ce-a8fa-4ffd9d1e9307-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-cm45f\" (UID: \"9494399d-55d2-48ce-a8fa-4ffd9d1e9307\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:48.416365 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.416286 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cbm6\" (UniqueName: \"kubernetes.io/projected/9494399d-55d2-48ce-a8fa-4ffd9d1e9307-kube-api-access-2cbm6\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-cm45f\" (UID: \"9494399d-55d2-48ce-a8fa-4ffd9d1e9307\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:48.416365 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.416316 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9494399d-55d2-48ce-a8fa-4ffd9d1e9307-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-cm45f\" (UID: \"9494399d-55d2-48ce-a8fa-4ffd9d1e9307\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:48.416365 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.416344 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9494399d-55d2-48ce-a8fa-4ffd9d1e9307-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-cm45f\" (UID: \"9494399d-55d2-48ce-a8fa-4ffd9d1e9307\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:48.416593 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.416367 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9494399d-55d2-48ce-a8fa-4ffd9d1e9307-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-cm45f\" (UID: \"9494399d-55d2-48ce-a8fa-4ffd9d1e9307\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:48.416593 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.416401 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9494399d-55d2-48ce-a8fa-4ffd9d1e9307-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-cm45f\" (UID: \"9494399d-55d2-48ce-a8fa-4ffd9d1e9307\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:48.416593 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.416428 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9494399d-55d2-48ce-a8fa-4ffd9d1e9307-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-cm45f\" (UID: \"9494399d-55d2-48ce-a8fa-4ffd9d1e9307\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:48.416593 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.416454 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9494399d-55d2-48ce-a8fa-4ffd9d1e9307-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-cm45f\" (UID: \"9494399d-55d2-48ce-a8fa-4ffd9d1e9307\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:48.417034 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.417010 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9494399d-55d2-48ce-a8fa-4ffd9d1e9307-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-cm45f\" (UID: \"9494399d-55d2-48ce-a8fa-4ffd9d1e9307\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:48.417162 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.417026 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9494399d-55d2-48ce-a8fa-4ffd9d1e9307-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-cm45f\" (UID: \"9494399d-55d2-48ce-a8fa-4ffd9d1e9307\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:48.417162 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.417110 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9494399d-55d2-48ce-a8fa-4ffd9d1e9307-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-cm45f\" (UID: \"9494399d-55d2-48ce-a8fa-4ffd9d1e9307\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:48.417314 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.417226 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9494399d-55d2-48ce-a8fa-4ffd9d1e9307-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-cm45f\" (UID: \"9494399d-55d2-48ce-a8fa-4ffd9d1e9307\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:48.417505 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.417484 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9494399d-55d2-48ce-a8fa-4ffd9d1e9307-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-cm45f\" (UID: \"9494399d-55d2-48ce-a8fa-4ffd9d1e9307\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:48.418754 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.418699 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9494399d-55d2-48ce-a8fa-4ffd9d1e9307-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-cm45f\" (UID: \"9494399d-55d2-48ce-a8fa-4ffd9d1e9307\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:48.419425 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.419399 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9494399d-55d2-48ce-a8fa-4ffd9d1e9307-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-cm45f\" (UID: \"9494399d-55d2-48ce-a8fa-4ffd9d1e9307\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:48.439094 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.439068 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9494399d-55d2-48ce-a8fa-4ffd9d1e9307-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-cm45f\" (UID: \"9494399d-55d2-48ce-a8fa-4ffd9d1e9307\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:48.439259 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.439242 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cbm6\" (UniqueName: \"kubernetes.io/projected/9494399d-55d2-48ce-a8fa-4ffd9d1e9307-kube-api-access-2cbm6\") pod \"data-science-gateway-data-science-gateway-class-7c689579c-cm45f\" (UID: \"9494399d-55d2-48ce-a8fa-4ffd9d1e9307\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:48.536159 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.536074 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:48.695453 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.695424 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-qzdj4"] Oct 30 08:58:48.699012 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.698986 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-qzdj4" Oct 30 08:58:48.714541 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.714519 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Oct 30 08:58:48.714854 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.714771 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pmls4\"" Oct 30 08:58:48.717035 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.717013 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-qzdj4"] Oct 30 08:58:48.820346 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.820273 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/62dee2e1-ac98-4656-8c39-5267300c0e54-config-file\") pod \"limitador-limitador-74dfcfb894-qzdj4\" (UID: \"62dee2e1-ac98-4656-8c39-5267300c0e54\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-qzdj4" Oct 30 08:58:48.820346 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.820312 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc4v4\" (UniqueName: \"kubernetes.io/projected/62dee2e1-ac98-4656-8c39-5267300c0e54-kube-api-access-nc4v4\") pod \"limitador-limitador-74dfcfb894-qzdj4\" (UID: \"62dee2e1-ac98-4656-8c39-5267300c0e54\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-qzdj4" Oct 30 08:58:48.829342 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.829316 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-qzdj4"] Oct 30 08:58:48.855317 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.855275 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f"] Oct 30 08:58:48.858945 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:58:48.858916 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9494399d_55d2_48ce_a8fa_4ffd9d1e9307.slice/crio-0acabe73d3d889f8aaaf65e63d6d6a11d36bf872d74ca049b82e3727084d0ce8 WatchSource:0}: Error finding container 0acabe73d3d889f8aaaf65e63d6d6a11d36bf872d74ca049b82e3727084d0ce8: Status 404 returned error can't find the container with id 0acabe73d3d889f8aaaf65e63d6d6a11d36bf872d74ca049b82e3727084d0ce8 Oct 30 08:58:48.861139 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.861110 5028 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 08:58:48.861193 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.861174 5028 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 08:58:48.861272 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.861225 5028 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 08:58:48.921139 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.921119 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/62dee2e1-ac98-4656-8c39-5267300c0e54-config-file\") pod \"limitador-limitador-74dfcfb894-qzdj4\" (UID: \"62dee2e1-ac98-4656-8c39-5267300c0e54\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-qzdj4" Oct 30 08:58:48.921281 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.921161 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc4v4\" (UniqueName: \"kubernetes.io/projected/62dee2e1-ac98-4656-8c39-5267300c0e54-kube-api-access-nc4v4\") pod \"limitador-limitador-74dfcfb894-qzdj4\" (UID: \"62dee2e1-ac98-4656-8c39-5267300c0e54\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-qzdj4" Oct 30 08:58:48.921701 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.921677 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/62dee2e1-ac98-4656-8c39-5267300c0e54-config-file\") pod \"limitador-limitador-74dfcfb894-qzdj4\" (UID: \"62dee2e1-ac98-4656-8c39-5267300c0e54\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-qzdj4" Oct 30 08:58:48.944014 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:48.943986 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc4v4\" (UniqueName: \"kubernetes.io/projected/62dee2e1-ac98-4656-8c39-5267300c0e54-kube-api-access-nc4v4\") pod \"limitador-limitador-74dfcfb894-qzdj4\" (UID: \"62dee2e1-ac98-4656-8c39-5267300c0e54\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-qzdj4" Oct 30 08:58:49.011900 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:49.011872 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-qzdj4" Oct 30 08:58:49.311362 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:49.311327 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-qzdj4"] Oct 30 08:58:49.314130 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:58:49.314101 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62dee2e1_ac98_4656_8c39_5267300c0e54.slice/crio-01613d8caa4840adccb8570a4c6bbe6c3c9cadef8960c0f51ae1e6124af53fa9 WatchSource:0}: Error finding container 01613d8caa4840adccb8570a4c6bbe6c3c9cadef8960c0f51ae1e6124af53fa9: Status 404 returned error can't find the container with id 01613d8caa4840adccb8570a4c6bbe6c3c9cadef8960c0f51ae1e6124af53fa9 Oct 30 08:58:49.780684 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:49.780651 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-7ns9n" Oct 30 08:58:49.831845 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:49.831811 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-qzdj4" event={"ID":"62dee2e1-ac98-4656-8c39-5267300c0e54","Type":"ContainerStarted","Data":"01613d8caa4840adccb8570a4c6bbe6c3c9cadef8960c0f51ae1e6124af53fa9"} Oct 30 08:58:49.833281 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:49.833262 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" event={"ID":"9494399d-55d2-48ce-a8fa-4ffd9d1e9307","Type":"ContainerStarted","Data":"6473253c387fd3f67abfe468f2e0bdd04bf5b1de2954ab99b3719ed049f83fa9"} Oct 30 08:58:49.833351 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:49.833310 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" event={"ID":"9494399d-55d2-48ce-a8fa-4ffd9d1e9307","Type":"ContainerStarted","Data":"0acabe73d3d889f8aaaf65e63d6d6a11d36bf872d74ca049b82e3727084d0ce8"} Oct 30 08:58:49.877661 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:49.877631 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-f2nbm"] Oct 30 08:58:49.877886 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:49.877861 5028 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-f2nbm" podUID="a241e842-e733-49a0-9821-6000d281d1a2" containerName="manager" containerID="cri-o://e4f414578e47dd3ff845b736a56de577ae384db5349003344ce7b009c1a1f145" gracePeriod=10 Oct 30 08:58:49.887193 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:49.887141 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" podStartSLOduration=1.8871252539999999 podStartE2EDuration="1.887125254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:58:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:58:49.88610795 +0000 UTC m=+344.102220309" watchObservedRunningTime="2026-10-30 08:58:49.887125254 +0000 UTC m=+344.103237613" Oct 30 08:58:50.354097 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:50.354073 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-f2nbm" Oct 30 08:58:50.536740 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:50.536652 5028 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:50.536894 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:50.536774 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a241e842-e733-49a0-9821-6000d281d1a2-kube-api-access-sx9m6\" (UniqueName: \"kubernetes.io/projected/a241e842-e733-49a0-9821-6000d281d1a2-kube-api-access-sx9m6\") pod \"a241e842-e733-49a0-9821-6000d281d1a2\" (UID: \"a241e842-e733-49a0-9821-6000d281d1a2\") " Oct 30 08:58:50.536894 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:50.536824 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a241e842-e733-49a0-9821-6000d281d1a2-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a241e842-e733-49a0-9821-6000d281d1a2-extensions-socket-volume\") pod \"a241e842-e733-49a0-9821-6000d281d1a2\" (UID: \"a241e842-e733-49a0-9821-6000d281d1a2\") " Oct 30 08:58:50.537399 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:50.537372 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a241e842-e733-49a0-9821-6000d281d1a2-extensions-socket-volume" pod "a241e842-e733-49a0-9821-6000d281d1a2" (UID: "a241e842-e733-49a0-9821-6000d281d1a2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 08:58:50.539163 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:50.539138 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a241e842-e733-49a0-9821-6000d281d1a2-kube-api-access-sx9m6" pod "a241e842-e733-49a0-9821-6000d281d1a2" (UID: "a241e842-e733-49a0-9821-6000d281d1a2"). InnerVolumeSpecName "kube-api-access-sx9m6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 08:58:50.541759 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:50.541734 5028 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:50.637675 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:50.637649 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sx9m6\" (UniqueName: \"kubernetes.io/projected/a241e842-e733-49a0-9821-6000d281d1a2-kube-api-access-sx9m6\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:58:50.637675 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:50.637677 5028 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a241e842-e733-49a0-9821-6000d281d1a2-extensions-socket-volume\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:58:50.840438 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:50.840407 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-qzdj4" event={"ID":"62dee2e1-ac98-4656-8c39-5267300c0e54","Type":"ContainerStarted","Data":"03d1175f6e9209898873032cd5c01f1419d7f876cd34623edcc53386b323c9bf"} Oct 30 08:58:50.840605 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:50.840472 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-qzdj4" Oct 30 08:58:50.841912 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:50.841884 5028 generic.go:356] "Generic (PLEG): container finished" podID="a241e842-e733-49a0-9821-6000d281d1a2" containerID="e4f414578e47dd3ff845b736a56de577ae384db5349003344ce7b009c1a1f145" exitCode=0 Oct 30 08:58:50.842745 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:50.842729 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-f2nbm" Oct 30 08:58:50.845283 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:50.845258 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-f2nbm" event={"ID":"a241e842-e733-49a0-9821-6000d281d1a2","Type":"ContainerDied","Data":"e4f414578e47dd3ff845b736a56de577ae384db5349003344ce7b009c1a1f145"} Oct 30 08:58:50.845389 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:50.845319 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-f2nbm" event={"ID":"a241e842-e733-49a0-9821-6000d281d1a2","Type":"ContainerDied","Data":"533dc6d2931588e528ace78d3c0e598cb5e6b0e5b11f96a66d53b240ad9d72c7"} Oct 30 08:58:50.845389 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:50.845345 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:50.845389 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:50.845372 5028 scope.go:122] "RemoveContainer" containerID="e4f414578e47dd3ff845b736a56de577ae384db5349003344ce7b009c1a1f145" Oct 30 08:58:50.846084 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:50.846064 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7c689579c-cm45f" Oct 30 08:58:50.854756 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:50.854740 5028 scope.go:122] "RemoveContainer" containerID="e4f414578e47dd3ff845b736a56de577ae384db5349003344ce7b009c1a1f145" Oct 30 08:58:50.855021 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:58:50.854995 5028 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4f414578e47dd3ff845b736a56de577ae384db5349003344ce7b009c1a1f145\": container with ID starting with e4f414578e47dd3ff845b736a56de577ae384db5349003344ce7b009c1a1f145 not found: ID does not exist" containerID="e4f414578e47dd3ff845b736a56de577ae384db5349003344ce7b009c1a1f145" Oct 30 08:58:50.855106 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:50.855027 5028 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4f414578e47dd3ff845b736a56de577ae384db5349003344ce7b009c1a1f145"} err="failed to get container status \"e4f414578e47dd3ff845b736a56de577ae384db5349003344ce7b009c1a1f145\": rpc error: code = NotFound desc = could not find container \"e4f414578e47dd3ff845b736a56de577ae384db5349003344ce7b009c1a1f145\": container with ID starting with e4f414578e47dd3ff845b736a56de577ae384db5349003344ce7b009c1a1f145 not found: ID does not exist" Oct 30 08:58:50.891767 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:50.891720 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-qzdj4" podStartSLOduration=1.634043885 podStartE2EDuration="2.891705818s" totalImagesPullingTime="1.257661933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:58:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:58:50.889685588 +0000 UTC m=+345.105797948" watchObservedRunningTime="2026-10-30 08:58:50.891705818 +0000 UTC m=+345.107818177" Oct 30 08:58:50.991741 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:50.991712 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-f2nbm"] Oct 30 08:58:51.001901 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:51.001874 5028 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-f2nbm"] Oct 30 08:58:51.914285 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:51.914253 5028 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a241e842-e733-49a0-9821-6000d281d1a2" path="/var/lib/kubelet/pods/a241e842-e733-49a0-9821-6000d281d1a2/volumes" Oct 30 08:58:57.363776 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:57.363747 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-zksvh"] Oct 30 08:58:57.364145 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:57.364134 5028 cpu_manager.go:414] "containerMap: removing container" podUID="a241e842-e733-49a0-9821-6000d281d1a2" containerName="manager" Oct 30 08:58:57.364182 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:57.364146 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a241e842-e733-49a0-9821-6000d281d1a2" containerName="manager" Oct 30 08:58:57.364274 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:57.364261 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="a241e842-e733-49a0-9821-6000d281d1a2" containerName="manager" Oct 30 08:58:57.370945 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:57.370924 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zksvh" Oct 30 08:58:57.388961 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:57.388940 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-zksvh"] Oct 30 08:58:57.398181 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:57.398158 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Oct 30 08:58:57.398286 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:57.398242 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Oct 30 08:58:57.398359 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:57.398345 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-module-controller-manager-dockercfg-8k9xg\"" Oct 30 08:58:57.428360 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:57.422764 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"odh-trusted-ca-bundle\"" Oct 30 08:58:57.490745 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:57.490718 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97qn2\" (UniqueName: \"kubernetes.io/projected/e4569615-7d5a-4841-8684-514a391362c2-kube-api-access-97qn2\") pod \"kserve-module-controller-manager-7566cf5fc8-zksvh\" (UID: \"e4569615-7d5a-4841-8684-514a391362c2\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zksvh" Oct 30 08:58:57.490825 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:57.490759 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4569615-7d5a-4841-8684-514a391362c2-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-zksvh\" (UID: \"e4569615-7d5a-4841-8684-514a391362c2\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zksvh" Oct 30 08:58:57.490885 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:57.490864 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4569615-7d5a-4841-8684-514a391362c2-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-zksvh\" (UID: \"e4569615-7d5a-4841-8684-514a391362c2\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zksvh" Oct 30 08:58:57.490922 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:57.490911 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e4569615-7d5a-4841-8684-514a391362c2-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-zksvh\" (UID: \"e4569615-7d5a-4841-8684-514a391362c2\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zksvh" Oct 30 08:58:57.592273 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:57.592246 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4569615-7d5a-4841-8684-514a391362c2-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-zksvh\" (UID: \"e4569615-7d5a-4841-8684-514a391362c2\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zksvh" Oct 30 08:58:57.592376 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:57.592298 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e4569615-7d5a-4841-8684-514a391362c2-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-zksvh\" (UID: \"e4569615-7d5a-4841-8684-514a391362c2\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zksvh" Oct 30 08:58:57.592376 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:57.592345 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97qn2\" (UniqueName: \"kubernetes.io/projected/e4569615-7d5a-4841-8684-514a391362c2-kube-api-access-97qn2\") pod \"kserve-module-controller-manager-7566cf5fc8-zksvh\" (UID: \"e4569615-7d5a-4841-8684-514a391362c2\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zksvh" Oct 30 08:58:57.592489 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:57.592378 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4569615-7d5a-4841-8684-514a391362c2-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-zksvh\" (UID: \"e4569615-7d5a-4841-8684-514a391362c2\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zksvh" Oct 30 08:58:57.592750 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:57.592726 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e4569615-7d5a-4841-8684-514a391362c2-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-zksvh\" (UID: \"e4569615-7d5a-4841-8684-514a391362c2\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zksvh" Oct 30 08:58:57.592821 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:57.592771 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e4569615-7d5a-4841-8684-514a391362c2-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-zksvh\" (UID: \"e4569615-7d5a-4841-8684-514a391362c2\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zksvh" Oct 30 08:58:57.593081 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:57.593062 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4569615-7d5a-4841-8684-514a391362c2-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-zksvh\" (UID: \"e4569615-7d5a-4841-8684-514a391362c2\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zksvh" Oct 30 08:58:57.615453 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:57.615399 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97qn2\" (UniqueName: \"kubernetes.io/projected/e4569615-7d5a-4841-8684-514a391362c2-kube-api-access-97qn2\") pod \"kserve-module-controller-manager-7566cf5fc8-zksvh\" (UID: \"e4569615-7d5a-4841-8684-514a391362c2\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zksvh" Oct 30 08:58:57.683234 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:57.683194 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zksvh" Oct 30 08:58:57.994246 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:57.994147 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-zksvh"] Oct 30 08:58:57.998424 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:58:57.998397 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4569615_7d5a_4841_8684_514a391362c2.slice/crio-14953662d20c1f1f4f813515a744c957b053b6bbb637577b2079eaefae50545f WatchSource:0}: Error finding container 14953662d20c1f1f4f813515a744c957b053b6bbb637577b2079eaefae50545f: Status 404 returned error can't find the container with id 14953662d20c1f1f4f813515a744c957b053b6bbb637577b2079eaefae50545f Oct 30 08:58:58.885772 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:58:58.885707 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zksvh" event={"ID":"e4569615-7d5a-4841-8684-514a391362c2","Type":"ContainerStarted","Data":"14953662d20c1f1f4f813515a744c957b053b6bbb637577b2079eaefae50545f"} Oct 30 08:59:00.898102 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:00.898062 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zksvh" event={"ID":"e4569615-7d5a-4841-8684-514a391362c2","Type":"ContainerStarted","Data":"c4f80081c8605ff665999ac7d2e8d7c48a9a07bcf4c677c84066bf49613d89ce"} Oct 30 08:59:00.898584 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:00.898139 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zksvh" Oct 30 08:59:00.941270 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:00.941227 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zksvh" podStartSLOduration=1.65895979 podStartE2EDuration="3.94121397s" totalImagesPullingTime="2.28225418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:59:00.94009164 +0000 UTC m=+355.156203996" watchObservedRunningTime="2026-10-30 08:59:00.94121397 +0000 UTC m=+355.157326318" Oct 30 08:59:01.849511 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:01.849486 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-qzdj4" Oct 30 08:59:12.743449 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:59:12.743414 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 08:59:13.948995 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:13.948959 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-rt9vx"] Oct 30 08:59:13.954306 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:13.954285 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-rt9vx" Oct 30 08:59:13.969886 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:13.969863 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-rt9vx"] Oct 30 08:59:13.979435 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:13.979415 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5hwcx\"" Oct 30 08:59:14.018038 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:14.018012 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72zk2\" (UniqueName: \"kubernetes.io/projected/f8364a10-cf73-4e4c-8f3e-6fd45ca0a64f-kube-api-access-72zk2\") pod \"authorino-56c6c9ddd5-rt9vx\" (UID: \"f8364a10-cf73-4e4c-8f3e-6fd45ca0a64f\") " pod="kuadrant-system/authorino-56c6c9ddd5-rt9vx" Oct 30 08:59:14.119025 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:14.118997 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72zk2\" (UniqueName: \"kubernetes.io/projected/f8364a10-cf73-4e4c-8f3e-6fd45ca0a64f-kube-api-access-72zk2\") pod \"authorino-56c6c9ddd5-rt9vx\" (UID: \"f8364a10-cf73-4e4c-8f3e-6fd45ca0a64f\") " pod="kuadrant-system/authorino-56c6c9ddd5-rt9vx" Oct 30 08:59:14.141628 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:14.141602 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72zk2\" (UniqueName: \"kubernetes.io/projected/f8364a10-cf73-4e4c-8f3e-6fd45ca0a64f-kube-api-access-72zk2\") pod \"authorino-56c6c9ddd5-rt9vx\" (UID: \"f8364a10-cf73-4e4c-8f3e-6fd45ca0a64f\") " pod="kuadrant-system/authorino-56c6c9ddd5-rt9vx" Oct 30 08:59:14.273978 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:14.273919 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-rt9vx" Oct 30 08:59:14.573335 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:14.573257 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-rt9vx"] Oct 30 08:59:14.576821 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:59:14.576785 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8364a10_cf73_4e4c_8f3e_6fd45ca0a64f.slice/crio-854a1893aa7b1a2614f0de2757395b751bd9932c31af8ff786bd50cad044939e WatchSource:0}: Error finding container 854a1893aa7b1a2614f0de2757395b751bd9932c31af8ff786bd50cad044939e: Status 404 returned error can't find the container with id 854a1893aa7b1a2614f0de2757395b751bd9932c31af8ff786bd50cad044939e Oct 30 08:59:14.966972 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:14.966909 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-rt9vx" event={"ID":"f8364a10-cf73-4e4c-8f3e-6fd45ca0a64f","Type":"ContainerStarted","Data":"854a1893aa7b1a2614f0de2757395b751bd9932c31af8ff786bd50cad044939e"} Oct 30 08:59:16.979815 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:16.979780 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-rt9vx" event={"ID":"f8364a10-cf73-4e4c-8f3e-6fd45ca0a64f","Type":"ContainerStarted","Data":"f10808a23dcb81b58484ec18e8cbde72b998930cef5f323a743f58821d2d2a59"} Oct 30 08:59:17.018456 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:17.018399 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-rt9vx" podStartSLOduration=2.3490110299999998 podStartE2EDuration="4.018384491s" totalImagesPullingTime="1.669373461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:59:17.016648039 +0000 UTC m=+371.232760397" watchObservedRunningTime="2026-10-30 08:59:17.018384491 +0000 UTC m=+371.234496849" Oct 30 08:59:21.910929 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:21.910900 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-zksvh" Oct 30 08:59:25.232948 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:25.232914 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-qzdj4"] Oct 30 08:59:25.233408 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:25.233125 5028 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-qzdj4" podUID="62dee2e1-ac98-4656-8c39-5267300c0e54" containerName="limitador" containerID="cri-o://03d1175f6e9209898873032cd5c01f1419d7f876cd34623edcc53386b323c9bf" gracePeriod=30 Oct 30 08:59:25.781335 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:25.781312 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-qzdj4" Oct 30 08:59:25.815816 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:25.815762 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/62dee2e1-ac98-4656-8c39-5267300c0e54-config-file\" (UniqueName: \"kubernetes.io/configmap/62dee2e1-ac98-4656-8c39-5267300c0e54-config-file\") pod \"62dee2e1-ac98-4656-8c39-5267300c0e54\" (UID: \"62dee2e1-ac98-4656-8c39-5267300c0e54\") " Oct 30 08:59:25.815816 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:25.815797 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/62dee2e1-ac98-4656-8c39-5267300c0e54-kube-api-access-nc4v4\" (UniqueName: \"kubernetes.io/projected/62dee2e1-ac98-4656-8c39-5267300c0e54-kube-api-access-nc4v4\") pod \"62dee2e1-ac98-4656-8c39-5267300c0e54\" (UID: \"62dee2e1-ac98-4656-8c39-5267300c0e54\") " Oct 30 08:59:25.816104 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:25.816077 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62dee2e1-ac98-4656-8c39-5267300c0e54-config-file" pod "62dee2e1-ac98-4656-8c39-5267300c0e54" (UID: "62dee2e1-ac98-4656-8c39-5267300c0e54"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 08:59:25.817745 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:25.817720 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62dee2e1-ac98-4656-8c39-5267300c0e54-kube-api-access-nc4v4" pod "62dee2e1-ac98-4656-8c39-5267300c0e54" (UID: "62dee2e1-ac98-4656-8c39-5267300c0e54"). InnerVolumeSpecName "kube-api-access-nc4v4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 08:59:25.916902 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:25.916880 5028 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/62dee2e1-ac98-4656-8c39-5267300c0e54-config-file\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:59:25.916902 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:25.916903 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nc4v4\" (UniqueName: \"kubernetes.io/projected/62dee2e1-ac98-4656-8c39-5267300c0e54-kube-api-access-nc4v4\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:59:26.026386 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:26.026356 5028 generic.go:356] "Generic (PLEG): container finished" podID="62dee2e1-ac98-4656-8c39-5267300c0e54" containerID="03d1175f6e9209898873032cd5c01f1419d7f876cd34623edcc53386b323c9bf" exitCode=0 Oct 30 08:59:26.026546 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:26.026404 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-qzdj4" Oct 30 08:59:26.026546 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:26.026440 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-qzdj4" event={"ID":"62dee2e1-ac98-4656-8c39-5267300c0e54","Type":"ContainerDied","Data":"03d1175f6e9209898873032cd5c01f1419d7f876cd34623edcc53386b323c9bf"} Oct 30 08:59:26.026546 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:26.026495 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-qzdj4" event={"ID":"62dee2e1-ac98-4656-8c39-5267300c0e54","Type":"ContainerDied","Data":"01613d8caa4840adccb8570a4c6bbe6c3c9cadef8960c0f51ae1e6124af53fa9"} Oct 30 08:59:26.026546 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:26.026523 5028 scope.go:122] "RemoveContainer" containerID="03d1175f6e9209898873032cd5c01f1419d7f876cd34623edcc53386b323c9bf" Oct 30 08:59:26.035545 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:26.035518 5028 scope.go:122] "RemoveContainer" containerID="03d1175f6e9209898873032cd5c01f1419d7f876cd34623edcc53386b323c9bf" Oct 30 08:59:26.035806 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:59:26.035787 5028 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03d1175f6e9209898873032cd5c01f1419d7f876cd34623edcc53386b323c9bf\": container with ID starting with 03d1175f6e9209898873032cd5c01f1419d7f876cd34623edcc53386b323c9bf not found: ID does not exist" containerID="03d1175f6e9209898873032cd5c01f1419d7f876cd34623edcc53386b323c9bf" Oct 30 08:59:26.035869 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:26.035817 5028 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03d1175f6e9209898873032cd5c01f1419d7f876cd34623edcc53386b323c9bf"} err="failed to get container status \"03d1175f6e9209898873032cd5c01f1419d7f876cd34623edcc53386b323c9bf\": rpc error: code = NotFound desc = could not find container \"03d1175f6e9209898873032cd5c01f1419d7f876cd34623edcc53386b323c9bf\": container with ID starting with 03d1175f6e9209898873032cd5c01f1419d7f876cd34623edcc53386b323c9bf not found: ID does not exist" Oct 30 08:59:26.076201 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:26.076151 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-qzdj4"] Oct 30 08:59:26.082275 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:26.082257 5028 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-qzdj4"] Oct 30 08:59:27.910343 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:27.910304 5028 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="62dee2e1-ac98-4656-8c39-5267300c0e54" path="/var/lib/kubelet/pods/62dee2e1-ac98-4656-8c39-5267300c0e54/volumes" Oct 30 08:59:31.121663 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:31.121630 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-r2fh8"] Oct 30 08:59:31.122139 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:31.122018 5028 cpu_manager.go:414] "containerMap: removing container" podUID="62dee2e1-ac98-4656-8c39-5267300c0e54" containerName="limitador" Oct 30 08:59:31.122139 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:31.122029 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="62dee2e1-ac98-4656-8c39-5267300c0e54" containerName="limitador" Oct 30 08:59:31.122139 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:31.122100 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="62dee2e1-ac98-4656-8c39-5267300c0e54" containerName="limitador" Oct 30 08:59:31.126571 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:31.126550 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-r2fh8" Oct 30 08:59:31.142702 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:31.142679 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-r2fh8"] Oct 30 08:59:31.151835 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:31.151811 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 30 08:59:31.151935 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:31.151842 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 30 08:59:31.222307 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:31.222274 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Oct 30 08:59:31.222464 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:31.222313 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-n6gt2\"" Oct 30 08:59:31.258823 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:31.258803 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/16a56bac-f82e-4df6-9adb-5031d545c4a0-data\") pod \"postgres-7cdbf6dc44-r2fh8\" (UID: \"16a56bac-f82e-4df6-9adb-5031d545c4a0\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-r2fh8" Oct 30 08:59:31.258914 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:31.258834 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl26z\" (UniqueName: \"kubernetes.io/projected/16a56bac-f82e-4df6-9adb-5031d545c4a0-kube-api-access-vl26z\") pod \"postgres-7cdbf6dc44-r2fh8\" (UID: \"16a56bac-f82e-4df6-9adb-5031d545c4a0\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-r2fh8" Oct 30 08:59:31.359278 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:31.359243 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/16a56bac-f82e-4df6-9adb-5031d545c4a0-data\") pod \"postgres-7cdbf6dc44-r2fh8\" (UID: \"16a56bac-f82e-4df6-9adb-5031d545c4a0\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-r2fh8" Oct 30 08:59:31.359436 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:31.359286 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl26z\" (UniqueName: \"kubernetes.io/projected/16a56bac-f82e-4df6-9adb-5031d545c4a0-kube-api-access-vl26z\") pod \"postgres-7cdbf6dc44-r2fh8\" (UID: \"16a56bac-f82e-4df6-9adb-5031d545c4a0\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-r2fh8" Oct 30 08:59:31.359631 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:31.359601 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/16a56bac-f82e-4df6-9adb-5031d545c4a0-data\") pod \"postgres-7cdbf6dc44-r2fh8\" (UID: \"16a56bac-f82e-4df6-9adb-5031d545c4a0\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-r2fh8" Oct 30 08:59:31.382127 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:31.382071 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl26z\" (UniqueName: \"kubernetes.io/projected/16a56bac-f82e-4df6-9adb-5031d545c4a0-kube-api-access-vl26z\") pod \"postgres-7cdbf6dc44-r2fh8\" (UID: \"16a56bac-f82e-4df6-9adb-5031d545c4a0\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-r2fh8" Oct 30 08:59:31.439009 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:31.438983 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-r2fh8" Oct 30 08:59:31.738079 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:31.738005 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-r2fh8"] Oct 30 08:59:31.741588 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:59:31.741561 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16a56bac_f82e_4df6_9adb_5031d545c4a0.slice/crio-2c5b4e3bfc104a68214cd13407b67fc89f6cac87a888f7d60a8f4fa575b4fe29 WatchSource:0}: Error finding container 2c5b4e3bfc104a68214cd13407b67fc89f6cac87a888f7d60a8f4fa575b4fe29: Status 404 returned error can't find the container with id 2c5b4e3bfc104a68214cd13407b67fc89f6cac87a888f7d60a8f4fa575b4fe29 Oct 30 08:59:32.058039 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:32.057964 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-r2fh8" event={"ID":"16a56bac-f82e-4df6-9adb-5031d545c4a0","Type":"ContainerStarted","Data":"2c5b4e3bfc104a68214cd13407b67fc89f6cac87a888f7d60a8f4fa575b4fe29"} Oct 30 08:59:37.093140 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:37.093102 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-r2fh8" event={"ID":"16a56bac-f82e-4df6-9adb-5031d545c4a0","Type":"ContainerStarted","Data":"957c8f59ff076dd35c2372dc0a198bbffd2596982160804c5280d6a230b9a6ea"} Oct 30 08:59:37.093554 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:37.093182 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-r2fh8" Oct 30 08:59:37.132522 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:37.132477 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-r2fh8" podStartSLOduration=1.066196637 podStartE2EDuration="6.132462514s" totalImagesPullingTime="5.066265877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:59:37.131476799 +0000 UTC m=+391.347589178" watchObservedRunningTime="2026-10-30 08:59:37.132462514 +0000 UTC m=+391.348574871" Oct 30 08:59:42.741765 ip-10-0-140-65 kubenswrapper[5028]: E1030 08:59:42.741728 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 08:59:43.127039 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:43.127012 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-r2fh8" Oct 30 08:59:50.834341 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:50.834259 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esjkbs"] Oct 30 08:59:50.841085 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:50.841062 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esjkbs" Oct 30 08:59:50.856989 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:50.856964 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esjkbs"] Oct 30 08:59:50.865530 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:50.865506 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Oct 30 08:59:50.865681 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:50.865552 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Oct 30 08:59:50.865681 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:50.865598 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"84daa8c4ed0405edc11b3a6589e0458f830ec2-28b1df78-dockercfg-9bjl8\"" Oct 30 08:59:50.936933 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:50.936906 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/456502ad-3f40-4443-a130-4f7e6bc71b65-util\") pod \"84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esjkbs\" (UID: \"456502ad-3f40-4443-a130-4f7e6bc71b65\") " pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esjkbs" Oct 30 08:59:50.937087 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:50.937034 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk9vc\" (UniqueName: \"kubernetes.io/projected/456502ad-3f40-4443-a130-4f7e6bc71b65-kube-api-access-bk9vc\") pod \"84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esjkbs\" (UID: \"456502ad-3f40-4443-a130-4f7e6bc71b65\") " pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esjkbs" Oct 30 08:59:50.937087 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:50.937076 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/456502ad-3f40-4443-a130-4f7e6bc71b65-bundle\") pod \"84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esjkbs\" (UID: \"456502ad-3f40-4443-a130-4f7e6bc71b65\") " pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esjkbs" Oct 30 08:59:51.037834 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:51.037801 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk9vc\" (UniqueName: \"kubernetes.io/projected/456502ad-3f40-4443-a130-4f7e6bc71b65-kube-api-access-bk9vc\") pod \"84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esjkbs\" (UID: \"456502ad-3f40-4443-a130-4f7e6bc71b65\") " pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esjkbs" Oct 30 08:59:51.037973 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:51.037845 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/456502ad-3f40-4443-a130-4f7e6bc71b65-bundle\") pod \"84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esjkbs\" (UID: \"456502ad-3f40-4443-a130-4f7e6bc71b65\") " pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esjkbs" Oct 30 08:59:51.037973 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:51.037884 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/456502ad-3f40-4443-a130-4f7e6bc71b65-util\") pod \"84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esjkbs\" (UID: \"456502ad-3f40-4443-a130-4f7e6bc71b65\") " pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esjkbs" Oct 30 08:59:51.038309 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:51.038289 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/456502ad-3f40-4443-a130-4f7e6bc71b65-util\") pod \"84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esjkbs\" (UID: \"456502ad-3f40-4443-a130-4f7e6bc71b65\") " pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esjkbs" Oct 30 08:59:51.038394 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:51.038342 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/456502ad-3f40-4443-a130-4f7e6bc71b65-bundle\") pod \"84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esjkbs\" (UID: \"456502ad-3f40-4443-a130-4f7e6bc71b65\") " pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esjkbs" Oct 30 08:59:51.063362 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:51.063340 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk9vc\" (UniqueName: \"kubernetes.io/projected/456502ad-3f40-4443-a130-4f7e6bc71b65-kube-api-access-bk9vc\") pod \"84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esjkbs\" (UID: \"456502ad-3f40-4443-a130-4f7e6bc71b65\") " pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esjkbs" Oct 30 08:59:51.163191 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:51.163129 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esjkbs" Oct 30 08:59:51.469193 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:51.469122 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esjkbs"] Oct 30 08:59:51.472483 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:59:51.472456 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod456502ad_3f40_4443_a130_4f7e6bc71b65.slice/crio-086115617a108ab1a083ee104af880d122ca24174e7869a8bb4292384868b81c WatchSource:0}: Error finding container 086115617a108ab1a083ee104af880d122ca24174e7869a8bb4292384868b81c: Status 404 returned error can't find the container with id 086115617a108ab1a083ee104af880d122ca24174e7869a8bb4292384868b81c Oct 30 08:59:52.170231 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:52.169694 5028 generic.go:356] "Generic (PLEG): container finished" podID="456502ad-3f40-4443-a130-4f7e6bc71b65" containerID="56e717749712dae4027cca69c3a46a2ae9194b1a9227029ada1f582e5de8dd73" exitCode=0 Oct 30 08:59:52.170231 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:52.169853 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esjkbs" event={"ID":"456502ad-3f40-4443-a130-4f7e6bc71b65","Type":"ContainerDied","Data":"56e717749712dae4027cca69c3a46a2ae9194b1a9227029ada1f582e5de8dd73"} Oct 30 08:59:52.170231 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:52.169929 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esjkbs" event={"ID":"456502ad-3f40-4443-a130-4f7e6bc71b65","Type":"ContainerStarted","Data":"086115617a108ab1a083ee104af880d122ca24174e7869a8bb4292384868b81c"} Oct 30 08:59:52.895295 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:52.895269 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6"] Oct 30 08:59:52.899186 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:52.899166 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6" Oct 30 08:59:52.913650 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:52.913629 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Oct 30 08:59:52.913846 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:52.913617 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Oct 30 08:59:52.921624 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:52.921608 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Oct 30 08:59:52.921712 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:52.921676 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-4b54w\"" Oct 30 08:59:52.927441 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:52.927418 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6"] Oct 30 08:59:53.052289 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:53.052258 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17ab8d72-af0f-4eac-9f1a-1b407a38f0d0-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-cdrr6\" (UID: \"17ab8d72-af0f-4eac-9f1a-1b407a38f0d0\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6" Oct 30 08:59:53.052440 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:53.052293 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/17ab8d72-af0f-4eac-9f1a-1b407a38f0d0-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-cdrr6\" (UID: \"17ab8d72-af0f-4eac-9f1a-1b407a38f0d0\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6" Oct 30 08:59:53.052440 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:53.052314 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/17ab8d72-af0f-4eac-9f1a-1b407a38f0d0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-cdrr6\" (UID: \"17ab8d72-af0f-4eac-9f1a-1b407a38f0d0\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6" Oct 30 08:59:53.052509 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:53.052449 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/17ab8d72-af0f-4eac-9f1a-1b407a38f0d0-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-cdrr6\" (UID: \"17ab8d72-af0f-4eac-9f1a-1b407a38f0d0\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6" Oct 30 08:59:53.052509 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:53.052484 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/17ab8d72-af0f-4eac-9f1a-1b407a38f0d0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-cdrr6\" (UID: \"17ab8d72-af0f-4eac-9f1a-1b407a38f0d0\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6" Oct 30 08:59:53.052612 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:53.052591 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zg5r\" (UniqueName: \"kubernetes.io/projected/17ab8d72-af0f-4eac-9f1a-1b407a38f0d0-kube-api-access-9zg5r\") pod \"istiod-openshift-gateway-7ddd9cfdc8-cdrr6\" (UID: \"17ab8d72-af0f-4eac-9f1a-1b407a38f0d0\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6" Oct 30 08:59:53.052648 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:53.052635 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/17ab8d72-af0f-4eac-9f1a-1b407a38f0d0-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-cdrr6\" (UID: \"17ab8d72-af0f-4eac-9f1a-1b407a38f0d0\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6" Oct 30 08:59:53.153862 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:53.153772 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zg5r\" (UniqueName: \"kubernetes.io/projected/17ab8d72-af0f-4eac-9f1a-1b407a38f0d0-kube-api-access-9zg5r\") pod \"istiod-openshift-gateway-7ddd9cfdc8-cdrr6\" (UID: \"17ab8d72-af0f-4eac-9f1a-1b407a38f0d0\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6" Oct 30 08:59:53.153862 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:53.153825 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/17ab8d72-af0f-4eac-9f1a-1b407a38f0d0-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-cdrr6\" (UID: \"17ab8d72-af0f-4eac-9f1a-1b407a38f0d0\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6" Oct 30 08:59:53.154076 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:53.153886 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17ab8d72-af0f-4eac-9f1a-1b407a38f0d0-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-cdrr6\" (UID: \"17ab8d72-af0f-4eac-9f1a-1b407a38f0d0\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6" Oct 30 08:59:53.154076 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:53.153978 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/17ab8d72-af0f-4eac-9f1a-1b407a38f0d0-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-cdrr6\" (UID: \"17ab8d72-af0f-4eac-9f1a-1b407a38f0d0\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6" Oct 30 08:59:53.154076 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:53.154018 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/17ab8d72-af0f-4eac-9f1a-1b407a38f0d0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-cdrr6\" (UID: \"17ab8d72-af0f-4eac-9f1a-1b407a38f0d0\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6" Oct 30 08:59:53.154076 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:53.154055 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/17ab8d72-af0f-4eac-9f1a-1b407a38f0d0-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-cdrr6\" (UID: \"17ab8d72-af0f-4eac-9f1a-1b407a38f0d0\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6" Oct 30 08:59:53.154322 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:53.154095 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/17ab8d72-af0f-4eac-9f1a-1b407a38f0d0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-cdrr6\" (UID: \"17ab8d72-af0f-4eac-9f1a-1b407a38f0d0\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6" Oct 30 08:59:53.154890 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:53.154850 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/17ab8d72-af0f-4eac-9f1a-1b407a38f0d0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-cdrr6\" (UID: \"17ab8d72-af0f-4eac-9f1a-1b407a38f0d0\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6" Oct 30 08:59:53.156162 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:53.156129 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/17ab8d72-af0f-4eac-9f1a-1b407a38f0d0-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-cdrr6\" (UID: \"17ab8d72-af0f-4eac-9f1a-1b407a38f0d0\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6" Oct 30 08:59:53.156293 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:53.156140 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/17ab8d72-af0f-4eac-9f1a-1b407a38f0d0-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-cdrr6\" (UID: \"17ab8d72-af0f-4eac-9f1a-1b407a38f0d0\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6" Oct 30 08:59:53.156335 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:53.156295 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/17ab8d72-af0f-4eac-9f1a-1b407a38f0d0-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-cdrr6\" (UID: \"17ab8d72-af0f-4eac-9f1a-1b407a38f0d0\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6" Oct 30 08:59:53.156371 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:53.156360 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/17ab8d72-af0f-4eac-9f1a-1b407a38f0d0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-cdrr6\" (UID: \"17ab8d72-af0f-4eac-9f1a-1b407a38f0d0\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6" Oct 30 08:59:53.177077 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:53.177047 5028 generic.go:356] "Generic (PLEG): container finished" podID="456502ad-3f40-4443-a130-4f7e6bc71b65" containerID="41069fa36f6c7f84f0b5be644ed03ecff8776c346d769d66fd6924be69427752" exitCode=0 Oct 30 08:59:53.177417 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:53.177121 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esjkbs" event={"ID":"456502ad-3f40-4443-a130-4f7e6bc71b65","Type":"ContainerDied","Data":"41069fa36f6c7f84f0b5be644ed03ecff8776c346d769d66fd6924be69427752"} Oct 30 08:59:53.191600 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:53.191567 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zg5r\" (UniqueName: \"kubernetes.io/projected/17ab8d72-af0f-4eac-9f1a-1b407a38f0d0-kube-api-access-9zg5r\") pod \"istiod-openshift-gateway-7ddd9cfdc8-cdrr6\" (UID: \"17ab8d72-af0f-4eac-9f1a-1b407a38f0d0\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6" Oct 30 08:59:53.191788 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:53.191768 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17ab8d72-af0f-4eac-9f1a-1b407a38f0d0-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-cdrr6\" (UID: \"17ab8d72-af0f-4eac-9f1a-1b407a38f0d0\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6" Oct 30 08:59:53.240656 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:53.240636 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6" Oct 30 08:59:53.560995 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:53.560919 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6"] Oct 30 08:59:53.563630 ip-10-0-140-65 kubenswrapper[5028]: W1030 08:59:53.563586 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17ab8d72_af0f_4eac_9f1a_1b407a38f0d0.slice/crio-3967524d78110369815d28797205c4e0ffba7dd8053af3b672beed86bc55fb21 WatchSource:0}: Error finding container 3967524d78110369815d28797205c4e0ffba7dd8053af3b672beed86bc55fb21: Status 404 returned error can't find the container with id 3967524d78110369815d28797205c4e0ffba7dd8053af3b672beed86bc55fb21 Oct 30 08:59:54.185247 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:54.185193 5028 generic.go:356] "Generic (PLEG): container finished" podID="456502ad-3f40-4443-a130-4f7e6bc71b65" containerID="8ca3ad76d14543a4ad500399384a6b09b6cbb535b071fa3269fbfa57cb1a37f0" exitCode=0 Oct 30 08:59:54.185644 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:54.185276 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esjkbs" event={"ID":"456502ad-3f40-4443-a130-4f7e6bc71b65","Type":"ContainerDied","Data":"8ca3ad76d14543a4ad500399384a6b09b6cbb535b071fa3269fbfa57cb1a37f0"} Oct 30 08:59:54.186885 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:54.186852 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6" event={"ID":"17ab8d72-af0f-4eac-9f1a-1b407a38f0d0","Type":"ContainerStarted","Data":"3967524d78110369815d28797205c4e0ffba7dd8053af3b672beed86bc55fb21"} Oct 30 08:59:55.360134 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:55.360097 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esjkbs" Oct 30 08:59:55.476597 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:55.476526 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/456502ad-3f40-4443-a130-4f7e6bc71b65-kube-api-access-bk9vc\" (UniqueName: \"kubernetes.io/projected/456502ad-3f40-4443-a130-4f7e6bc71b65-kube-api-access-bk9vc\") pod \"456502ad-3f40-4443-a130-4f7e6bc71b65\" (UID: \"456502ad-3f40-4443-a130-4f7e6bc71b65\") " Oct 30 08:59:55.476755 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:55.476601 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/456502ad-3f40-4443-a130-4f7e6bc71b65-util\" (UniqueName: \"kubernetes.io/empty-dir/456502ad-3f40-4443-a130-4f7e6bc71b65-util\") pod \"456502ad-3f40-4443-a130-4f7e6bc71b65\" (UID: \"456502ad-3f40-4443-a130-4f7e6bc71b65\") " Oct 30 08:59:55.476755 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:55.476655 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/456502ad-3f40-4443-a130-4f7e6bc71b65-bundle\" (UniqueName: \"kubernetes.io/empty-dir/456502ad-3f40-4443-a130-4f7e6bc71b65-bundle\") pod \"456502ad-3f40-4443-a130-4f7e6bc71b65\" (UID: \"456502ad-3f40-4443-a130-4f7e6bc71b65\") " Oct 30 08:59:55.477392 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:55.477334 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/456502ad-3f40-4443-a130-4f7e6bc71b65-bundle" pod "456502ad-3f40-4443-a130-4f7e6bc71b65" (UID: "456502ad-3f40-4443-a130-4f7e6bc71b65"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 08:59:55.478980 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:55.478953 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/456502ad-3f40-4443-a130-4f7e6bc71b65-kube-api-access-bk9vc" pod "456502ad-3f40-4443-a130-4f7e6bc71b65" (UID: "456502ad-3f40-4443-a130-4f7e6bc71b65"). InnerVolumeSpecName "kube-api-access-bk9vc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 08:59:55.483454 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:55.483430 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/456502ad-3f40-4443-a130-4f7e6bc71b65-util" pod "456502ad-3f40-4443-a130-4f7e6bc71b65" (UID: "456502ad-3f40-4443-a130-4f7e6bc71b65"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 08:59:55.577543 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:55.577511 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bk9vc\" (UniqueName: \"kubernetes.io/projected/456502ad-3f40-4443-a130-4f7e6bc71b65-kube-api-access-bk9vc\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:59:55.577543 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:55.577543 5028 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/456502ad-3f40-4443-a130-4f7e6bc71b65-util\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:59:55.577711 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:55.577559 5028 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/456502ad-3f40-4443-a130-4f7e6bc71b65-bundle\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 08:59:56.202666 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:56.202595 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esjkbs" event={"ID":"456502ad-3f40-4443-a130-4f7e6bc71b65","Type":"ContainerDied","Data":"086115617a108ab1a083ee104af880d122ca24174e7869a8bb4292384868b81c"} Oct 30 08:59:56.202666 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:56.202621 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esjkbs" Oct 30 08:59:56.202666 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:56.202641 5028 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="086115617a108ab1a083ee104af880d122ca24174e7869a8bb4292384868b81c" Oct 30 08:59:56.250580 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:56.250552 5028 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 08:59:56.250708 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:56.250607 5028 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 08:59:57.209245 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:57.209198 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6" event={"ID":"17ab8d72-af0f-4eac-9f1a-1b407a38f0d0","Type":"ContainerStarted","Data":"38e7587a66f962c1bfe07efa0ca9a3738c23fc7d952a0b813b91547047ae15e3"} Oct 30 08:59:57.209623 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:57.209398 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6" Oct 30 08:59:57.211218 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:57.211181 5028 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-cdrr6 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 30 08:59:57.211350 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:57.211243 5028 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6" podUID="17ab8d72-af0f-4eac-9f1a-1b407a38f0d0" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 08:59:57.269514 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:57.269473 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6" podStartSLOduration=2.585363317 podStartE2EDuration="5.26946157s" totalImagesPullingTime="2.684098253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 08:59:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 08:59:57.268426658 +0000 UTC m=+411.484539035" watchObservedRunningTime="2026-10-30 08:59:57.26946157 +0000 UTC m=+411.485573929" Oct 30 08:59:58.215525 ip-10-0-140-65 kubenswrapper[5028]: I1030 08:59:58.215496 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-cdrr6" Oct 30 09:00:12.742578 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:00:12.742543 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 09:00:42.743582 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:00:42.743543 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 09:01:10.587086 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:10.587053 5028 generic.go:356] "Generic (PLEG): container finished" podID="9c855b64-13be-4e63-8f3f-531056c34afc" containerID="44c19a1253eeac61bf946dd2e33388a00c67dda252e15adcdabc0647dde998ad" exitCode=0 Oct 30 09:01:10.587609 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:10.587125 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" event={"ID":"9c855b64-13be-4e63-8f3f-531056c34afc","Type":"ContainerDied","Data":"44c19a1253eeac61bf946dd2e33388a00c67dda252e15adcdabc0647dde998ad"} Oct 30 09:01:10.587609 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:10.587443 5028 scope.go:122] "RemoveContainer" containerID="44c19a1253eeac61bf946dd2e33388a00c67dda252e15adcdabc0647dde998ad" Oct 30 09:01:10.588475 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:10.588443 5028 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 09:01:10.588632 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:10.588530 5028 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 09:01:10.588632 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:10.588584 5028 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 09:01:11.286229 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:11.284308 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 09:01:11.598903 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:11.598869 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" event={"ID":"9c855b64-13be-4e63-8f3f-531056c34afc","Type":"ContainerStarted","Data":"225886ee1de6ebc53f3ab01953b6354c0b2c61e4a629deb2fe82970769395963"} Oct 30 09:01:11.692830 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:11.692798 5028 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 09:01:11.694163 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:11.694131 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-wkmvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Oct 30 09:01:11.694298 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:11.694196 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" podUID="9c855b64-13be-4e63-8f3f-531056c34afc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Oct 30 09:01:12.692582 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:12.692542 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-wkmvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Oct 30 09:01:12.693180 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:12.693147 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" podUID="9c855b64-13be-4e63-8f3f-531056c34afc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Oct 30 09:01:12.741471 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:01:12.741442 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 09:01:13.693728 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:13.693685 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-wkmvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Oct 30 09:01:13.694167 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:13.693764 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" podUID="9c855b64-13be-4e63-8f3f-531056c34afc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Oct 30 09:01:14.692587 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:14.692545 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-wkmvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Oct 30 09:01:14.692913 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:14.692610 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" podUID="9c855b64-13be-4e63-8f3f-531056c34afc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Oct 30 09:01:15.692592 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:15.692556 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-wkmvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Oct 30 09:01:15.693091 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:15.692612 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" podUID="9c855b64-13be-4e63-8f3f-531056c34afc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Oct 30 09:01:16.697264 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:16.697231 5028 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 09:01:16.697724 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:16.697681 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 09:01:16.698527 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:16.698505 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-wkmvv" Oct 30 09:01:42.742470 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:01:42.742379 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 09:01:45.280019 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:45.279988 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-84fc496cbd-rttqw"] Oct 30 09:01:45.280471 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:45.280456 5028 cpu_manager.go:414] "containerMap: removing container" podUID="456502ad-3f40-4443-a130-4f7e6bc71b65" containerName="util" Oct 30 09:01:45.280471 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:45.280470 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="456502ad-3f40-4443-a130-4f7e6bc71b65" containerName="util" Oct 30 09:01:45.280565 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:45.280484 5028 cpu_manager.go:414] "containerMap: removing container" podUID="456502ad-3f40-4443-a130-4f7e6bc71b65" containerName="pull" Oct 30 09:01:45.280565 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:45.280489 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="456502ad-3f40-4443-a130-4f7e6bc71b65" containerName="pull" Oct 30 09:01:45.280565 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:45.280505 5028 cpu_manager.go:414] "containerMap: removing container" podUID="456502ad-3f40-4443-a130-4f7e6bc71b65" containerName="extract" Oct 30 09:01:45.280565 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:45.280510 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="456502ad-3f40-4443-a130-4f7e6bc71b65" containerName="extract" Oct 30 09:01:45.280704 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:45.280593 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="456502ad-3f40-4443-a130-4f7e6bc71b65" containerName="extract" Oct 30 09:01:45.283689 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:45.283662 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84fc496cbd-rttqw" Oct 30 09:01:45.300763 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:45.300743 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84fc496cbd-rttqw"] Oct 30 09:01:45.312651 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:45.312635 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Oct 30 09:01:45.369179 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:45.369152 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8trj\" (UniqueName: \"kubernetes.io/projected/dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7-kube-api-access-d8trj\") pod \"authorino-84fc496cbd-rttqw\" (UID: \"dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7\") " pod="kuadrant-system/authorino-84fc496cbd-rttqw" Oct 30 09:01:45.369315 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:45.369201 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7-tls-cert\") pod \"authorino-84fc496cbd-rttqw\" (UID: \"dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7\") " pod="kuadrant-system/authorino-84fc496cbd-rttqw" Oct 30 09:01:45.469731 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:45.469703 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7-tls-cert\") pod \"authorino-84fc496cbd-rttqw\" (UID: \"dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7\") " pod="kuadrant-system/authorino-84fc496cbd-rttqw" Oct 30 09:01:45.469826 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:45.469769 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8trj\" (UniqueName: \"kubernetes.io/projected/dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7-kube-api-access-d8trj\") pod \"authorino-84fc496cbd-rttqw\" (UID: \"dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7\") " pod="kuadrant-system/authorino-84fc496cbd-rttqw" Oct 30 09:01:45.472275 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:45.472242 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7-tls-cert\") pod \"authorino-84fc496cbd-rttqw\" (UID: \"dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7\") " pod="kuadrant-system/authorino-84fc496cbd-rttqw" Oct 30 09:01:45.492248 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:45.492198 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8trj\" (UniqueName: \"kubernetes.io/projected/dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7-kube-api-access-d8trj\") pod \"authorino-84fc496cbd-rttqw\" (UID: \"dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7\") " pod="kuadrant-system/authorino-84fc496cbd-rttqw" Oct 30 09:01:45.595286 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:45.595266 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84fc496cbd-rttqw" Oct 30 09:01:45.890701 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:45.890634 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84fc496cbd-rttqw"] Oct 30 09:01:45.894017 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:01:45.893991 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd6a9fbf_8104_4ae3_ad23_f91ed6b91fd7.slice/crio-5447a76304476e3877e9b1975ec3c37423735203b940b6e0f9ef1844388c8aa0 WatchSource:0}: Error finding container 5447a76304476e3877e9b1975ec3c37423735203b940b6e0f9ef1844388c8aa0: Status 404 returned error can't find the container with id 5447a76304476e3877e9b1975ec3c37423735203b940b6e0f9ef1844388c8aa0 Oct 30 09:01:46.781807 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:46.781728 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84fc496cbd-rttqw" event={"ID":"dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7","Type":"ContainerStarted","Data":"4e23852a7262ff7ec6d15166dcd8156a57af864903b90528f694d0c59b14d010"} Oct 30 09:01:46.781807 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:46.781772 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84fc496cbd-rttqw" event={"ID":"dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7","Type":"ContainerStarted","Data":"5447a76304476e3877e9b1975ec3c37423735203b940b6e0f9ef1844388c8aa0"} Oct 30 09:01:46.823291 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:46.823227 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-84fc496cbd-rttqw" podStartSLOduration=1.19983451 podStartE2EDuration="1.823199162s" totalImagesPullingTime="623.364652ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 09:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 09:01:46.820270128 +0000 UTC m=+521.036382506" watchObservedRunningTime="2026-10-30 09:01:46.823199162 +0000 UTC m=+521.039311548" Oct 30 09:01:46.854384 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:46.854343 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-rt9vx"] Oct 30 09:01:46.854617 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:46.854584 5028 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-rt9vx" podUID="f8364a10-cf73-4e4c-8f3e-6fd45ca0a64f" containerName="authorino" containerID="cri-o://f10808a23dcb81b58484ec18e8cbde72b998930cef5f323a743f58821d2d2a59" gracePeriod=30 Oct 30 09:01:47.117830 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:47.117805 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-rt9vx" Oct 30 09:01:47.184979 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:47.184943 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f8364a10-cf73-4e4c-8f3e-6fd45ca0a64f-kube-api-access-72zk2\" (UniqueName: \"kubernetes.io/projected/f8364a10-cf73-4e4c-8f3e-6fd45ca0a64f-kube-api-access-72zk2\") pod \"f8364a10-cf73-4e4c-8f3e-6fd45ca0a64f\" (UID: \"f8364a10-cf73-4e4c-8f3e-6fd45ca0a64f\") " Oct 30 09:01:47.187091 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:47.187063 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8364a10-cf73-4e4c-8f3e-6fd45ca0a64f-kube-api-access-72zk2" pod "f8364a10-cf73-4e4c-8f3e-6fd45ca0a64f" (UID: "f8364a10-cf73-4e4c-8f3e-6fd45ca0a64f"). InnerVolumeSpecName "kube-api-access-72zk2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 09:01:47.286742 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:47.286651 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72zk2\" (UniqueName: \"kubernetes.io/projected/f8364a10-cf73-4e4c-8f3e-6fd45ca0a64f-kube-api-access-72zk2\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:01:47.787682 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:47.787646 5028 generic.go:356] "Generic (PLEG): container finished" podID="f8364a10-cf73-4e4c-8f3e-6fd45ca0a64f" containerID="f10808a23dcb81b58484ec18e8cbde72b998930cef5f323a743f58821d2d2a59" exitCode=0 Oct 30 09:01:47.788155 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:47.787696 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-rt9vx" Oct 30 09:01:47.788155 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:47.787729 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-rt9vx" event={"ID":"f8364a10-cf73-4e4c-8f3e-6fd45ca0a64f","Type":"ContainerDied","Data":"f10808a23dcb81b58484ec18e8cbde72b998930cef5f323a743f58821d2d2a59"} Oct 30 09:01:47.788155 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:47.787773 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-rt9vx" event={"ID":"f8364a10-cf73-4e4c-8f3e-6fd45ca0a64f","Type":"ContainerDied","Data":"854a1893aa7b1a2614f0de2757395b751bd9932c31af8ff786bd50cad044939e"} Oct 30 09:01:47.788155 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:47.787790 5028 scope.go:122] "RemoveContainer" containerID="f10808a23dcb81b58484ec18e8cbde72b998930cef5f323a743f58821d2d2a59" Oct 30 09:01:47.797613 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:47.797597 5028 scope.go:122] "RemoveContainer" containerID="f10808a23dcb81b58484ec18e8cbde72b998930cef5f323a743f58821d2d2a59" Oct 30 09:01:47.797859 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:01:47.797842 5028 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f10808a23dcb81b58484ec18e8cbde72b998930cef5f323a743f58821d2d2a59\": container with ID starting with f10808a23dcb81b58484ec18e8cbde72b998930cef5f323a743f58821d2d2a59 not found: ID does not exist" containerID="f10808a23dcb81b58484ec18e8cbde72b998930cef5f323a743f58821d2d2a59" Oct 30 09:01:47.797935 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:47.797866 5028 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f10808a23dcb81b58484ec18e8cbde72b998930cef5f323a743f58821d2d2a59"} err="failed to get container status \"f10808a23dcb81b58484ec18e8cbde72b998930cef5f323a743f58821d2d2a59\": rpc error: code = NotFound desc = could not find container \"f10808a23dcb81b58484ec18e8cbde72b998930cef5f323a743f58821d2d2a59\": container with ID starting with f10808a23dcb81b58484ec18e8cbde72b998930cef5f323a743f58821d2d2a59 not found: ID does not exist" Oct 30 09:01:47.836759 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:47.836736 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-rt9vx"] Oct 30 09:01:47.843860 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:47.843833 5028 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-rt9vx"] Oct 30 09:01:47.909661 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:01:47.909635 5028 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f8364a10-cf73-4e4c-8f3e-6fd45ca0a64f" path="/var/lib/kubelet/pods/f8364a10-cf73-4e4c-8f3e-6fd45ca0a64f/volumes" Oct 30 09:02:12.741406 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:02:12.741367 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 09:02:21.032141 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:21.032100 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-84fc496cbd-rttqw"] Oct 30 09:02:21.032654 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:21.032334 5028 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-84fc496cbd-rttqw" podUID="dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7" containerName="authorino" containerID="cri-o://4e23852a7262ff7ec6d15166dcd8156a57af864903b90528f694d0c59b14d010" gracePeriod=30 Oct 30 09:02:21.276188 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:21.276162 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84fc496cbd-rttqw" Oct 30 09:02:21.457477 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:21.457452 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7-kube-api-access-d8trj\" (UniqueName: \"kubernetes.io/projected/dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7-kube-api-access-d8trj\") pod \"dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7\" (UID: \"dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7\") " Oct 30 09:02:21.457626 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:21.457527 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7-tls-cert\" (UniqueName: \"kubernetes.io/secret/dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7-tls-cert\") pod \"dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7\" (UID: \"dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7\") " Oct 30 09:02:21.459586 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:21.459562 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7-kube-api-access-d8trj" pod "dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7" (UID: "dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7"). InnerVolumeSpecName "kube-api-access-d8trj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 09:02:21.467635 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:21.467609 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7-tls-cert" pod "dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7" (UID: "dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 09:02:21.558225 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:21.558174 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8trj\" (UniqueName: \"kubernetes.io/projected/dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7-kube-api-access-d8trj\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:02:21.558316 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:21.558201 5028 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7-tls-cert\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:02:21.977166 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:21.977129 5028 generic.go:356] "Generic (PLEG): container finished" podID="dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7" containerID="4e23852a7262ff7ec6d15166dcd8156a57af864903b90528f694d0c59b14d010" exitCode=0 Oct 30 09:02:21.977339 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:21.977189 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84fc496cbd-rttqw" Oct 30 09:02:21.977339 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:21.977234 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84fc496cbd-rttqw" event={"ID":"dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7","Type":"ContainerDied","Data":"4e23852a7262ff7ec6d15166dcd8156a57af864903b90528f694d0c59b14d010"} Oct 30 09:02:21.977339 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:21.977289 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84fc496cbd-rttqw" event={"ID":"dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7","Type":"ContainerDied","Data":"5447a76304476e3877e9b1975ec3c37423735203b940b6e0f9ef1844388c8aa0"} Oct 30 09:02:21.977339 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:21.977313 5028 scope.go:122] "RemoveContainer" containerID="4e23852a7262ff7ec6d15166dcd8156a57af864903b90528f694d0c59b14d010" Oct 30 09:02:21.986239 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:21.986218 5028 scope.go:122] "RemoveContainer" containerID="4e23852a7262ff7ec6d15166dcd8156a57af864903b90528f694d0c59b14d010" Oct 30 09:02:21.986506 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:02:21.986485 5028 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e23852a7262ff7ec6d15166dcd8156a57af864903b90528f694d0c59b14d010\": container with ID starting with 4e23852a7262ff7ec6d15166dcd8156a57af864903b90528f694d0c59b14d010 not found: ID does not exist" containerID="4e23852a7262ff7ec6d15166dcd8156a57af864903b90528f694d0c59b14d010" Oct 30 09:02:21.986570 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:21.986517 5028 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e23852a7262ff7ec6d15166dcd8156a57af864903b90528f694d0c59b14d010"} err="failed to get container status \"4e23852a7262ff7ec6d15166dcd8156a57af864903b90528f694d0c59b14d010\": rpc error: code = NotFound desc = could not find container \"4e23852a7262ff7ec6d15166dcd8156a57af864903b90528f694d0c59b14d010\": container with ID starting with 4e23852a7262ff7ec6d15166dcd8156a57af864903b90528f694d0c59b14d010 not found: ID does not exist" Oct 30 09:02:22.027279 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:22.027258 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-84fc496cbd-rttqw"] Oct 30 09:02:22.031339 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:22.031322 5028 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-84fc496cbd-rttqw"] Oct 30 09:02:23.909563 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:23.909529 5028 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7" path="/var/lib/kubelet/pods/dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7/volumes" Oct 30 09:02:42.745273 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:02:42.745232 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 09:02:56.832984 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:56.832909 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-7d85675f98-66hcj"] Oct 30 09:02:56.833383 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:56.833294 5028 cpu_manager.go:414] "containerMap: removing container" podUID="f8364a10-cf73-4e4c-8f3e-6fd45ca0a64f" containerName="authorino" Oct 30 09:02:56.833383 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:56.833307 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f8364a10-cf73-4e4c-8f3e-6fd45ca0a64f" containerName="authorino" Oct 30 09:02:56.833383 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:56.833324 5028 cpu_manager.go:414] "containerMap: removing container" podUID="dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7" containerName="authorino" Oct 30 09:02:56.833383 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:56.833331 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7" containerName="authorino" Oct 30 09:02:56.833512 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:56.833397 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="f8364a10-cf73-4e4c-8f3e-6fd45ca0a64f" containerName="authorino" Oct 30 09:02:56.833512 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:56.833406 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="dd6a9fbf-8104-4ae3-ad23-f91ed6b91fd7" containerName="authorino" Oct 30 09:02:56.836746 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:56.836726 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-7d85675f98-66hcj" Oct 30 09:02:56.851584 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:56.851562 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\"" Oct 30 09:02:56.863269 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:56.863247 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-metrics-tls\"" Oct 30 09:02:56.863554 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:56.863512 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-9wszg\"" Oct 30 09:02:56.866367 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:56.866345 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-7d85675f98-66hcj"] Oct 30 09:02:56.925795 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:56.925772 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4nd8\" (UniqueName: \"kubernetes.io/projected/537d0fb0-0a3a-416b-a310-7e0cecef0ff7-kube-api-access-g4nd8\") pod \"ai-gateway-controller-7d85675f98-66hcj\" (UID: \"537d0fb0-0a3a-416b-a310-7e0cecef0ff7\") " pod="opendatahub/ai-gateway-controller-7d85675f98-66hcj" Oct 30 09:02:56.925929 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:56.925906 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/537d0fb0-0a3a-416b-a310-7e0cecef0ff7-metrics-certs\") pod \"ai-gateway-controller-7d85675f98-66hcj\" (UID: \"537d0fb0-0a3a-416b-a310-7e0cecef0ff7\") " pod="opendatahub/ai-gateway-controller-7d85675f98-66hcj" Oct 30 09:02:57.027324 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:57.027300 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/537d0fb0-0a3a-416b-a310-7e0cecef0ff7-metrics-certs\") pod \"ai-gateway-controller-7d85675f98-66hcj\" (UID: \"537d0fb0-0a3a-416b-a310-7e0cecef0ff7\") " pod="opendatahub/ai-gateway-controller-7d85675f98-66hcj" Oct 30 09:02:57.027446 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:57.027341 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4nd8\" (UniqueName: \"kubernetes.io/projected/537d0fb0-0a3a-416b-a310-7e0cecef0ff7-kube-api-access-g4nd8\") pod \"ai-gateway-controller-7d85675f98-66hcj\" (UID: \"537d0fb0-0a3a-416b-a310-7e0cecef0ff7\") " pod="opendatahub/ai-gateway-controller-7d85675f98-66hcj" Oct 30 09:02:57.029712 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:57.029685 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/537d0fb0-0a3a-416b-a310-7e0cecef0ff7-metrics-certs\") pod \"ai-gateway-controller-7d85675f98-66hcj\" (UID: \"537d0fb0-0a3a-416b-a310-7e0cecef0ff7\") " pod="opendatahub/ai-gateway-controller-7d85675f98-66hcj" Oct 30 09:02:57.050151 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:57.050126 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4nd8\" (UniqueName: \"kubernetes.io/projected/537d0fb0-0a3a-416b-a310-7e0cecef0ff7-kube-api-access-g4nd8\") pod \"ai-gateway-controller-7d85675f98-66hcj\" (UID: \"537d0fb0-0a3a-416b-a310-7e0cecef0ff7\") " pod="opendatahub/ai-gateway-controller-7d85675f98-66hcj" Oct 30 09:02:57.149843 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:57.149820 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-7d85675f98-66hcj" Oct 30 09:02:57.448371 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:57.448302 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-7d85675f98-66hcj"] Oct 30 09:02:57.451766 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:02:57.451735 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod537d0fb0_0a3a_416b_a310_7e0cecef0ff7.slice/crio-94843650ca31cdf80ed49bb8147a8c4ce2d987cdfa350090a2e0895e4b8e2785 WatchSource:0}: Error finding container 94843650ca31cdf80ed49bb8147a8c4ce2d987cdfa350090a2e0895e4b8e2785: Status 404 returned error can't find the container with id 94843650ca31cdf80ed49bb8147a8c4ce2d987cdfa350090a2e0895e4b8e2785 Oct 30 09:02:58.168773 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:02:58.168735 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-7d85675f98-66hcj" event={"ID":"537d0fb0-0a3a-416b-a310-7e0cecef0ff7","Type":"ContainerStarted","Data":"94843650ca31cdf80ed49bb8147a8c4ce2d987cdfa350090a2e0895e4b8e2785"} Oct 30 09:03:00.182751 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:00.182710 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-7d85675f98-66hcj" event={"ID":"537d0fb0-0a3a-416b-a310-7e0cecef0ff7","Type":"ContainerStarted","Data":"8bd009a912efa37ce5959135236b501df0f7e7104b951de0d628a8935586ad57"} Oct 30 09:03:00.183189 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:00.182834 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-7d85675f98-66hcj" Oct 30 09:03:00.224231 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:00.224177 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-7d85675f98-66hcj" podStartSLOduration=1.955361425 podStartE2EDuration="4.224164877s" totalImagesPullingTime="2.268803452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 09:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 09:03:00.222268569 +0000 UTC m=+594.438380927" watchObservedRunningTime="2026-10-30 09:03:00.224164877 +0000 UTC m=+594.440277234" Oct 30 09:03:01.951384 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:01.951353 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-j2vnb"] Oct 30 09:03:01.955268 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:01.955246 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5f78687d5b-j2vnb" Oct 30 09:03:01.973064 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:01.973038 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-j2vnb"] Oct 30 09:03:01.982402 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:01.982376 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Oct 30 09:03:01.982402 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:01.982382 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-qgnkb\"" Oct 30 09:03:02.018494 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:02.018469 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-w7gvc"] Oct 30 09:03:02.022051 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:02.022036 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-w7gvc" Oct 30 09:03:02.042792 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:02.042771 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-w7gvc"] Oct 30 09:03:02.074264 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:02.074227 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7da56025-b457-4cd5-9b72-9182d1420139-plugins-config-volume\") pod \"payload-processing-5f78687d5b-j2vnb\" (UID: \"7da56025-b457-4cd5-9b72-9182d1420139\") " pod="openshift-ingress/payload-processing-5f78687d5b-j2vnb" Oct 30 09:03:02.074264 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:02.074268 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjw5n\" (UniqueName: \"kubernetes.io/projected/7da56025-b457-4cd5-9b72-9182d1420139-kube-api-access-rjw5n\") pod \"payload-processing-5f78687d5b-j2vnb\" (UID: \"7da56025-b457-4cd5-9b72-9182d1420139\") " pod="openshift-ingress/payload-processing-5f78687d5b-j2vnb" Oct 30 09:03:02.074492 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:02.074300 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8568914d-177e-4c0a-ab3b-deb3f6f79c84-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-w7gvc\" (UID: \"8568914d-177e-4c0a-ab3b-deb3f6f79c84\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-w7gvc" Oct 30 09:03:02.074492 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:02.074420 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk688\" (UniqueName: \"kubernetes.io/projected/8568914d-177e-4c0a-ab3b-deb3f6f79c84-kube-api-access-bk688\") pod \"payload-pre-processing-7b98bb678c-w7gvc\" (UID: \"8568914d-177e-4c0a-ab3b-deb3f6f79c84\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-w7gvc" Oct 30 09:03:02.175681 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:02.175642 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk688\" (UniqueName: \"kubernetes.io/projected/8568914d-177e-4c0a-ab3b-deb3f6f79c84-kube-api-access-bk688\") pod \"payload-pre-processing-7b98bb678c-w7gvc\" (UID: \"8568914d-177e-4c0a-ab3b-deb3f6f79c84\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-w7gvc" Oct 30 09:03:02.175865 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:02.175759 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7da56025-b457-4cd5-9b72-9182d1420139-plugins-config-volume\") pod \"payload-processing-5f78687d5b-j2vnb\" (UID: \"7da56025-b457-4cd5-9b72-9182d1420139\") " pod="openshift-ingress/payload-processing-5f78687d5b-j2vnb" Oct 30 09:03:02.175865 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:02.175789 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjw5n\" (UniqueName: \"kubernetes.io/projected/7da56025-b457-4cd5-9b72-9182d1420139-kube-api-access-rjw5n\") pod \"payload-processing-5f78687d5b-j2vnb\" (UID: \"7da56025-b457-4cd5-9b72-9182d1420139\") " pod="openshift-ingress/payload-processing-5f78687d5b-j2vnb" Oct 30 09:03:02.175865 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:02.175820 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8568914d-177e-4c0a-ab3b-deb3f6f79c84-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-w7gvc\" (UID: \"8568914d-177e-4c0a-ab3b-deb3f6f79c84\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-w7gvc" Oct 30 09:03:02.176586 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:02.176561 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8568914d-177e-4c0a-ab3b-deb3f6f79c84-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-w7gvc\" (UID: \"8568914d-177e-4c0a-ab3b-deb3f6f79c84\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-w7gvc" Oct 30 09:03:02.176675 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:02.176563 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7da56025-b457-4cd5-9b72-9182d1420139-plugins-config-volume\") pod \"payload-processing-5f78687d5b-j2vnb\" (UID: \"7da56025-b457-4cd5-9b72-9182d1420139\") " pod="openshift-ingress/payload-processing-5f78687d5b-j2vnb" Oct 30 09:03:02.198705 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:02.198675 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjw5n\" (UniqueName: \"kubernetes.io/projected/7da56025-b457-4cd5-9b72-9182d1420139-kube-api-access-rjw5n\") pod \"payload-processing-5f78687d5b-j2vnb\" (UID: \"7da56025-b457-4cd5-9b72-9182d1420139\") " pod="openshift-ingress/payload-processing-5f78687d5b-j2vnb" Oct 30 09:03:02.198791 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:02.198677 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk688\" (UniqueName: \"kubernetes.io/projected/8568914d-177e-4c0a-ab3b-deb3f6f79c84-kube-api-access-bk688\") pod \"payload-pre-processing-7b98bb678c-w7gvc\" (UID: \"8568914d-177e-4c0a-ab3b-deb3f6f79c84\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-w7gvc" Oct 30 09:03:02.269345 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:02.269284 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5f78687d5b-j2vnb" Oct 30 09:03:02.334824 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:02.334589 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-w7gvc" Oct 30 09:03:02.568488 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:02.568466 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-j2vnb"] Oct 30 09:03:02.570922 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:03:02.570895 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7da56025_b457_4cd5_9b72_9182d1420139.slice/crio-8c70e25f8dd74a5352dd07b472216002e2e07dcf0aa9aa67f5c6172f837d346d WatchSource:0}: Error finding container 8c70e25f8dd74a5352dd07b472216002e2e07dcf0aa9aa67f5c6172f837d346d: Status 404 returned error can't find the container with id 8c70e25f8dd74a5352dd07b472216002e2e07dcf0aa9aa67f5c6172f837d346d Oct 30 09:03:02.644651 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:02.644632 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-w7gvc"] Oct 30 09:03:02.647071 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:03:02.647050 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8568914d_177e_4c0a_ab3b_deb3f6f79c84.slice/crio-631492be9a76cd629bebc26fbf7aeba90fe80d35d458326ae525cdcbfc69ebc6 WatchSource:0}: Error finding container 631492be9a76cd629bebc26fbf7aeba90fe80d35d458326ae525cdcbfc69ebc6: Status 404 returned error can't find the container with id 631492be9a76cd629bebc26fbf7aeba90fe80d35d458326ae525cdcbfc69ebc6 Oct 30 09:03:03.216591 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:03.216552 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5f78687d5b-j2vnb" event={"ID":"7da56025-b457-4cd5-9b72-9182d1420139","Type":"ContainerStarted","Data":"8c70e25f8dd74a5352dd07b472216002e2e07dcf0aa9aa67f5c6172f837d346d"} Oct 30 09:03:03.218759 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:03.218728 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-w7gvc" event={"ID":"8568914d-177e-4c0a-ab3b-deb3f6f79c84","Type":"ContainerStarted","Data":"631492be9a76cd629bebc26fbf7aeba90fe80d35d458326ae525cdcbfc69ebc6"} Oct 30 09:03:05.233266 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:05.233235 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-w7gvc" event={"ID":"8568914d-177e-4c0a-ab3b-deb3f6f79c84","Type":"ContainerStarted","Data":"c35f59fafadba51524d19a11486c928a9dfd76e0c3b75426e1c0ff0fd746ba7d"} Oct 30 09:03:05.233683 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:05.233416 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-w7gvc" Oct 30 09:03:05.234873 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:05.234853 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5f78687d5b-j2vnb" event={"ID":"7da56025-b457-4cd5-9b72-9182d1420139","Type":"ContainerStarted","Data":"ce72a193ebe329805f6f43c5e4dae37b9d5f6a824a1685e0dbc50753eb830382"} Oct 30 09:03:05.234994 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:05.234983 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5f78687d5b-j2vnb" Oct 30 09:03:05.274586 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:05.274540 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7b98bb678c-w7gvc" podStartSLOduration=2.028434016 podStartE2EDuration="4.274524217s" totalImagesPullingTime="2.246090201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 09:03:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 09:03:05.272165336 +0000 UTC m=+599.488277695" watchObservedRunningTime="2026-10-30 09:03:05.274524217 +0000 UTC m=+599.490636577" Oct 30 09:03:05.312986 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:05.312931 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5f78687d5b-j2vnb" podStartSLOduration=2.081070301 podStartE2EDuration="4.312918193s" totalImagesPullingTime="2.231847892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 09:03:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 09:03:05.311624617 +0000 UTC m=+599.527736976" watchObservedRunningTime="2026-10-30 09:03:05.312918193 +0000 UTC m=+599.529030544" Oct 30 09:03:05.992977 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:05.992946 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6jb9v_0c1ebb77-bd76-4329-ac03-87f60b688431/console-operator/1.log" Oct 30 09:03:06.000134 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:06.000111 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6jb9v_0c1ebb77-bd76-4329-ac03-87f60b688431/console-operator/1.log" Oct 30 09:03:11.191258 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:11.191229 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-7d85675f98-66hcj" Oct 30 09:03:11.482910 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:11.482839 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-bff4ccf6f-7hqqw"] Oct 30 09:03:11.487645 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:11.487623 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-bff4ccf6f-7hqqw" Oct 30 09:03:11.504938 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:11.504910 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-bff4ccf6f-7hqqw"] Oct 30 09:03:11.549091 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:11.549067 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b97d933-5570-4ce2-86dd-db6e1c8a3ed1-metrics-certs\") pod \"ai-gateway-controller-bff4ccf6f-7hqqw\" (UID: \"0b97d933-5570-4ce2-86dd-db6e1c8a3ed1\") " pod="opendatahub/ai-gateway-controller-bff4ccf6f-7hqqw" Oct 30 09:03:11.549251 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:11.549099 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94ctp\" (UniqueName: \"kubernetes.io/projected/0b97d933-5570-4ce2-86dd-db6e1c8a3ed1-kube-api-access-94ctp\") pod \"ai-gateway-controller-bff4ccf6f-7hqqw\" (UID: \"0b97d933-5570-4ce2-86dd-db6e1c8a3ed1\") " pod="opendatahub/ai-gateway-controller-bff4ccf6f-7hqqw" Oct 30 09:03:11.649787 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:11.649764 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b97d933-5570-4ce2-86dd-db6e1c8a3ed1-metrics-certs\") pod \"ai-gateway-controller-bff4ccf6f-7hqqw\" (UID: \"0b97d933-5570-4ce2-86dd-db6e1c8a3ed1\") " pod="opendatahub/ai-gateway-controller-bff4ccf6f-7hqqw" Oct 30 09:03:11.649908 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:11.649796 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94ctp\" (UniqueName: \"kubernetes.io/projected/0b97d933-5570-4ce2-86dd-db6e1c8a3ed1-kube-api-access-94ctp\") pod \"ai-gateway-controller-bff4ccf6f-7hqqw\" (UID: \"0b97d933-5570-4ce2-86dd-db6e1c8a3ed1\") " pod="opendatahub/ai-gateway-controller-bff4ccf6f-7hqqw" Oct 30 09:03:11.652283 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:11.652263 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b97d933-5570-4ce2-86dd-db6e1c8a3ed1-metrics-certs\") pod \"ai-gateway-controller-bff4ccf6f-7hqqw\" (UID: \"0b97d933-5570-4ce2-86dd-db6e1c8a3ed1\") " pod="opendatahub/ai-gateway-controller-bff4ccf6f-7hqqw" Oct 30 09:03:11.672557 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:11.672536 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94ctp\" (UniqueName: \"kubernetes.io/projected/0b97d933-5570-4ce2-86dd-db6e1c8a3ed1-kube-api-access-94ctp\") pod \"ai-gateway-controller-bff4ccf6f-7hqqw\" (UID: \"0b97d933-5570-4ce2-86dd-db6e1c8a3ed1\") " pod="opendatahub/ai-gateway-controller-bff4ccf6f-7hqqw" Oct 30 09:03:11.800423 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:11.800366 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-bff4ccf6f-7hqqw" Oct 30 09:03:12.102354 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:12.102327 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-bff4ccf6f-7hqqw"] Oct 30 09:03:12.104330 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:03:12.104303 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b97d933_5570_4ce2_86dd_db6e1c8a3ed1.slice/crio-62bae09612a9fb3357f92a2fea9a104c5082f07ac2b82ac0d0200f560ecde193 WatchSource:0}: Error finding container 62bae09612a9fb3357f92a2fea9a104c5082f07ac2b82ac0d0200f560ecde193: Status 404 returned error can't find the container with id 62bae09612a9fb3357f92a2fea9a104c5082f07ac2b82ac0d0200f560ecde193 Oct 30 09:03:12.278671 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:12.278638 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-bff4ccf6f-7hqqw" event={"ID":"0b97d933-5570-4ce2-86dd-db6e1c8a3ed1","Type":"ContainerStarted","Data":"62bae09612a9fb3357f92a2fea9a104c5082f07ac2b82ac0d0200f560ecde193"} Oct 30 09:03:12.741622 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:03:12.741538 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 09:03:13.285676 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:13.285638 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-bff4ccf6f-7hqqw" event={"ID":"0b97d933-5570-4ce2-86dd-db6e1c8a3ed1","Type":"ContainerStarted","Data":"b46dc15ebd9913566902c6e306d339004bf7310f5db84e97292bab4d047be8b1"} Oct 30 09:03:13.286061 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:13.285722 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-bff4ccf6f-7hqqw" Oct 30 09:03:13.325582 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:13.325537 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-bff4ccf6f-7hqqw" podStartSLOduration=2.035477457 podStartE2EDuration="2.325523557s" totalImagesPullingTime="290.0461ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 09:03:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 09:03:13.324694953 +0000 UTC m=+607.540807308" watchObservedRunningTime="2026-10-30 09:03:13.325523557 +0000 UTC m=+607.541635915" Oct 30 09:03:16.243163 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:16.243132 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-w7gvc" Oct 30 09:03:16.243679 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:16.243228 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5f78687d5b-j2vnb" Oct 30 09:03:24.294079 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:24.294047 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-bff4ccf6f-7hqqw" Oct 30 09:03:24.363150 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:24.363120 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-7d85675f98-66hcj"] Oct 30 09:03:24.363370 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:24.363347 5028 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/ai-gateway-controller-7d85675f98-66hcj" podUID="537d0fb0-0a3a-416b-a310-7e0cecef0ff7" containerName="manager" containerID="cri-o://8bd009a912efa37ce5959135236b501df0f7e7104b951de0d628a8935586ad57" gracePeriod=30 Oct 30 09:03:24.609413 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:24.609389 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-7d85675f98-66hcj" Oct 30 09:03:24.758839 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:24.758809 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/537d0fb0-0a3a-416b-a310-7e0cecef0ff7-metrics-certs\" (UniqueName: \"kubernetes.io/secret/537d0fb0-0a3a-416b-a310-7e0cecef0ff7-metrics-certs\") pod \"537d0fb0-0a3a-416b-a310-7e0cecef0ff7\" (UID: \"537d0fb0-0a3a-416b-a310-7e0cecef0ff7\") " Oct 30 09:03:24.759014 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:24.758935 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/537d0fb0-0a3a-416b-a310-7e0cecef0ff7-kube-api-access-g4nd8\" (UniqueName: \"kubernetes.io/projected/537d0fb0-0a3a-416b-a310-7e0cecef0ff7-kube-api-access-g4nd8\") pod \"537d0fb0-0a3a-416b-a310-7e0cecef0ff7\" (UID: \"537d0fb0-0a3a-416b-a310-7e0cecef0ff7\") " Oct 30 09:03:24.760993 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:24.760967 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/537d0fb0-0a3a-416b-a310-7e0cecef0ff7-kube-api-access-g4nd8" pod "537d0fb0-0a3a-416b-a310-7e0cecef0ff7" (UID: "537d0fb0-0a3a-416b-a310-7e0cecef0ff7"). InnerVolumeSpecName "kube-api-access-g4nd8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 09:03:24.761123 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:24.761101 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/537d0fb0-0a3a-416b-a310-7e0cecef0ff7-metrics-certs" pod "537d0fb0-0a3a-416b-a310-7e0cecef0ff7" (UID: "537d0fb0-0a3a-416b-a310-7e0cecef0ff7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 09:03:24.859642 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:24.859589 5028 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/537d0fb0-0a3a-416b-a310-7e0cecef0ff7-metrics-certs\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:03:24.859642 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:24.859609 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4nd8\" (UniqueName: \"kubernetes.io/projected/537d0fb0-0a3a-416b-a310-7e0cecef0ff7-kube-api-access-g4nd8\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:03:25.348185 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:25.348154 5028 generic.go:356] "Generic (PLEG): container finished" podID="537d0fb0-0a3a-416b-a310-7e0cecef0ff7" containerID="8bd009a912efa37ce5959135236b501df0f7e7104b951de0d628a8935586ad57" exitCode=0 Oct 30 09:03:25.348630 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:25.348195 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-7d85675f98-66hcj" Oct 30 09:03:25.348630 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:25.348236 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-7d85675f98-66hcj" event={"ID":"537d0fb0-0a3a-416b-a310-7e0cecef0ff7","Type":"ContainerDied","Data":"8bd009a912efa37ce5959135236b501df0f7e7104b951de0d628a8935586ad57"} Oct 30 09:03:25.348630 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:25.348285 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-7d85675f98-66hcj" event={"ID":"537d0fb0-0a3a-416b-a310-7e0cecef0ff7","Type":"ContainerDied","Data":"94843650ca31cdf80ed49bb8147a8c4ce2d987cdfa350090a2e0895e4b8e2785"} Oct 30 09:03:25.348630 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:25.348309 5028 scope.go:122] "RemoveContainer" containerID="8bd009a912efa37ce5959135236b501df0f7e7104b951de0d628a8935586ad57" Oct 30 09:03:25.357378 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:25.357362 5028 scope.go:122] "RemoveContainer" containerID="8bd009a912efa37ce5959135236b501df0f7e7104b951de0d628a8935586ad57" Oct 30 09:03:25.357635 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:03:25.357619 5028 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bd009a912efa37ce5959135236b501df0f7e7104b951de0d628a8935586ad57\": container with ID starting with 8bd009a912efa37ce5959135236b501df0f7e7104b951de0d628a8935586ad57 not found: ID does not exist" containerID="8bd009a912efa37ce5959135236b501df0f7e7104b951de0d628a8935586ad57" Oct 30 09:03:25.357685 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:25.357645 5028 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bd009a912efa37ce5959135236b501df0f7e7104b951de0d628a8935586ad57"} err="failed to get container status \"8bd009a912efa37ce5959135236b501df0f7e7104b951de0d628a8935586ad57\": rpc error: code = NotFound desc = could not find container \"8bd009a912efa37ce5959135236b501df0f7e7104b951de0d628a8935586ad57\": container with ID starting with 8bd009a912efa37ce5959135236b501df0f7e7104b951de0d628a8935586ad57 not found: ID does not exist" Oct 30 09:03:25.397912 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:25.397892 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-7d85675f98-66hcj"] Oct 30 09:03:25.409965 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:25.409945 5028 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/ai-gateway-controller-7d85675f98-66hcj"] Oct 30 09:03:25.910836 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:25.910810 5028 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="537d0fb0-0a3a-416b-a310-7e0cecef0ff7" path="/var/lib/kubelet/pods/537d0fb0-0a3a-416b-a310-7e0cecef0ff7/volumes" Oct 30 09:03:32.377713 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:32.377680 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj"] Oct 30 09:03:32.378260 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:32.378236 5028 cpu_manager.go:414] "containerMap: removing container" podUID="537d0fb0-0a3a-416b-a310-7e0cecef0ff7" containerName="manager" Oct 30 09:03:32.378260 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:32.378258 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="537d0fb0-0a3a-416b-a310-7e0cecef0ff7" containerName="manager" Oct 30 09:03:32.378468 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:32.378372 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="537d0fb0-0a3a-416b-a310-7e0cecef0ff7" containerName="manager" Oct 30 09:03:32.386376 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:32.386344 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj" Oct 30 09:03:32.414966 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:32.414934 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Oct 30 09:03:32.414966 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:32.414952 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ftxvk\"" Oct 30 09:03:32.414966 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:32.414938 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Oct 30 09:03:32.415160 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:32.414939 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Oct 30 09:03:32.417221 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:32.417184 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj"] Oct 30 09:03:32.517849 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:32.517827 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26bf54d7-59dc-4eca-a226-0957237ae034-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj\" (UID: \"26bf54d7-59dc-4eca-a226-0957237ae034\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj" Oct 30 09:03:32.517979 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:32.517866 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26bf54d7-59dc-4eca-a226-0957237ae034-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj\" (UID: \"26bf54d7-59dc-4eca-a226-0957237ae034\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj" Oct 30 09:03:32.517979 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:32.517884 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26bf54d7-59dc-4eca-a226-0957237ae034-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj\" (UID: \"26bf54d7-59dc-4eca-a226-0957237ae034\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj" Oct 30 09:03:32.518066 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:32.518011 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26bf54d7-59dc-4eca-a226-0957237ae034-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj\" (UID: \"26bf54d7-59dc-4eca-a226-0957237ae034\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj" Oct 30 09:03:32.518066 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:32.518039 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26bf54d7-59dc-4eca-a226-0957237ae034-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj\" (UID: \"26bf54d7-59dc-4eca-a226-0957237ae034\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj" Oct 30 09:03:32.518066 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:32.518057 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8pn6\" (UniqueName: \"kubernetes.io/projected/26bf54d7-59dc-4eca-a226-0957237ae034-kube-api-access-l8pn6\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj\" (UID: \"26bf54d7-59dc-4eca-a226-0957237ae034\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj" Oct 30 09:03:32.618853 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:32.618822 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26bf54d7-59dc-4eca-a226-0957237ae034-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj\" (UID: \"26bf54d7-59dc-4eca-a226-0957237ae034\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj" Oct 30 09:03:32.619035 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:32.618865 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26bf54d7-59dc-4eca-a226-0957237ae034-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj\" (UID: \"26bf54d7-59dc-4eca-a226-0957237ae034\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj" Oct 30 09:03:32.619035 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:32.618882 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8pn6\" (UniqueName: \"kubernetes.io/projected/26bf54d7-59dc-4eca-a226-0957237ae034-kube-api-access-l8pn6\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj\" (UID: \"26bf54d7-59dc-4eca-a226-0957237ae034\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj" Oct 30 09:03:32.619162 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:32.619031 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26bf54d7-59dc-4eca-a226-0957237ae034-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj\" (UID: \"26bf54d7-59dc-4eca-a226-0957237ae034\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj" Oct 30 09:03:32.619162 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:32.619126 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26bf54d7-59dc-4eca-a226-0957237ae034-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj\" (UID: \"26bf54d7-59dc-4eca-a226-0957237ae034\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj" Oct 30 09:03:32.619302 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:32.619159 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26bf54d7-59dc-4eca-a226-0957237ae034-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj\" (UID: \"26bf54d7-59dc-4eca-a226-0957237ae034\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj" Oct 30 09:03:32.619356 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:32.619328 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26bf54d7-59dc-4eca-a226-0957237ae034-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj\" (UID: \"26bf54d7-59dc-4eca-a226-0957237ae034\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj" Oct 30 09:03:32.619406 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:32.619394 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26bf54d7-59dc-4eca-a226-0957237ae034-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj\" (UID: \"26bf54d7-59dc-4eca-a226-0957237ae034\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj" Oct 30 09:03:32.619484 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:32.619464 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26bf54d7-59dc-4eca-a226-0957237ae034-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj\" (UID: \"26bf54d7-59dc-4eca-a226-0957237ae034\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj" Oct 30 09:03:32.621342 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:32.621313 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26bf54d7-59dc-4eca-a226-0957237ae034-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj\" (UID: \"26bf54d7-59dc-4eca-a226-0957237ae034\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj" Oct 30 09:03:32.621586 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:32.621569 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26bf54d7-59dc-4eca-a226-0957237ae034-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj\" (UID: \"26bf54d7-59dc-4eca-a226-0957237ae034\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj" Oct 30 09:03:32.641620 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:32.641564 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8pn6\" (UniqueName: \"kubernetes.io/projected/26bf54d7-59dc-4eca-a226-0957237ae034-kube-api-access-l8pn6\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj\" (UID: \"26bf54d7-59dc-4eca-a226-0957237ae034\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj" Oct 30 09:03:32.702373 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:32.702348 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj" Oct 30 09:03:33.006349 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:33.006266 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj"] Oct 30 09:03:33.009041 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:03:33.009001 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26bf54d7_59dc_4eca_a226_0957237ae034.slice/crio-790a48df50ecd97e41a1d686cb1cf4ddcee2711ec2f9564c855cebd60e92b2cf WatchSource:0}: Error finding container 790a48df50ecd97e41a1d686cb1cf4ddcee2711ec2f9564c855cebd60e92b2cf: Status 404 returned error can't find the container with id 790a48df50ecd97e41a1d686cb1cf4ddcee2711ec2f9564c855cebd60e92b2cf Oct 30 09:03:33.010455 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:33.010437 5028 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 09:03:33.396079 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:33.396043 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj" event={"ID":"26bf54d7-59dc-4eca-a226-0957237ae034","Type":"ContainerStarted","Data":"790a48df50ecd97e41a1d686cb1cf4ddcee2711ec2f9564c855cebd60e92b2cf"} Oct 30 09:03:34.404982 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:34.404947 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj" event={"ID":"26bf54d7-59dc-4eca-a226-0957237ae034","Type":"ContainerStarted","Data":"f973ea94aaf926bc937c12b3552a8178d66b8fb5de1564eef3be7a3c40949edf"} Oct 30 09:03:34.447370 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:34.447240 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj" podStartSLOduration=1.283165067 podStartE2EDuration="2.447223007s" totalImagesPullingTime="1.16405794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 09:03:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 09:03:34.445218244 +0000 UTC m=+628.661330619" watchObservedRunningTime="2026-10-30 09:03:34.447223007 +0000 UTC m=+628.663335364" Oct 30 09:03:34.702649 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:34.702578 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj" Oct 30 09:03:37.163303 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:37.163258 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-zcm66"] Oct 30 09:03:37.167116 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:37.167091 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-zcm66" Oct 30 09:03:37.183167 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:37.182521 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\"" Oct 30 09:03:37.197855 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:37.197827 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-zcm66"] Oct 30 09:03:37.260448 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:37.260419 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jch2m\" (UniqueName: \"kubernetes.io/projected/781b05d1-4d9b-46de-8fff-4d26569ca881-kube-api-access-jch2m\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-zcm66\" (UID: \"781b05d1-4d9b-46de-8fff-4d26569ca881\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-zcm66" Oct 30 09:03:37.260571 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:37.260460 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/781b05d1-4d9b-46de-8fff-4d26569ca881-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-zcm66\" (UID: \"781b05d1-4d9b-46de-8fff-4d26569ca881\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-zcm66" Oct 30 09:03:37.260571 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:37.260494 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/781b05d1-4d9b-46de-8fff-4d26569ca881-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-zcm66\" (UID: \"781b05d1-4d9b-46de-8fff-4d26569ca881\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-zcm66" Oct 30 09:03:37.260643 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:37.260578 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/781b05d1-4d9b-46de-8fff-4d26569ca881-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-zcm66\" (UID: \"781b05d1-4d9b-46de-8fff-4d26569ca881\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-zcm66" Oct 30 09:03:37.260643 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:37.260596 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/781b05d1-4d9b-46de-8fff-4d26569ca881-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-zcm66\" (UID: \"781b05d1-4d9b-46de-8fff-4d26569ca881\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-zcm66" Oct 30 09:03:37.260643 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:37.260633 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/781b05d1-4d9b-46de-8fff-4d26569ca881-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-zcm66\" (UID: \"781b05d1-4d9b-46de-8fff-4d26569ca881\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-zcm66" Oct 30 09:03:37.361372 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:37.361342 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/781b05d1-4d9b-46de-8fff-4d26569ca881-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-zcm66\" (UID: \"781b05d1-4d9b-46de-8fff-4d26569ca881\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-zcm66" Oct 30 09:03:37.361372 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:37.361376 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/781b05d1-4d9b-46de-8fff-4d26569ca881-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-zcm66\" (UID: \"781b05d1-4d9b-46de-8fff-4d26569ca881\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-zcm66" Oct 30 09:03:37.361589 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:37.361413 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/781b05d1-4d9b-46de-8fff-4d26569ca881-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-zcm66\" (UID: \"781b05d1-4d9b-46de-8fff-4d26569ca881\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-zcm66" Oct 30 09:03:37.361589 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:37.361453 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jch2m\" (UniqueName: \"kubernetes.io/projected/781b05d1-4d9b-46de-8fff-4d26569ca881-kube-api-access-jch2m\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-zcm66\" (UID: \"781b05d1-4d9b-46de-8fff-4d26569ca881\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-zcm66" Oct 30 09:03:37.361589 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:37.361478 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/781b05d1-4d9b-46de-8fff-4d26569ca881-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-zcm66\" (UID: \"781b05d1-4d9b-46de-8fff-4d26569ca881\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-zcm66" Oct 30 09:03:37.361746 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:37.361628 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/781b05d1-4d9b-46de-8fff-4d26569ca881-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-zcm66\" (UID: \"781b05d1-4d9b-46de-8fff-4d26569ca881\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-zcm66" Oct 30 09:03:37.361983 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:37.361964 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/781b05d1-4d9b-46de-8fff-4d26569ca881-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-zcm66\" (UID: \"781b05d1-4d9b-46de-8fff-4d26569ca881\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-zcm66" Oct 30 09:03:37.362064 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:37.362021 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/781b05d1-4d9b-46de-8fff-4d26569ca881-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-zcm66\" (UID: \"781b05d1-4d9b-46de-8fff-4d26569ca881\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-zcm66" Oct 30 09:03:37.362131 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:37.362093 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/781b05d1-4d9b-46de-8fff-4d26569ca881-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-zcm66\" (UID: \"781b05d1-4d9b-46de-8fff-4d26569ca881\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-zcm66" Oct 30 09:03:37.363864 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:37.363836 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/781b05d1-4d9b-46de-8fff-4d26569ca881-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-zcm66\" (UID: \"781b05d1-4d9b-46de-8fff-4d26569ca881\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-zcm66" Oct 30 09:03:37.364147 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:37.364125 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/781b05d1-4d9b-46de-8fff-4d26569ca881-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-zcm66\" (UID: \"781b05d1-4d9b-46de-8fff-4d26569ca881\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-zcm66" Oct 30 09:03:37.384170 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:37.384141 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jch2m\" (UniqueName: \"kubernetes.io/projected/781b05d1-4d9b-46de-8fff-4d26569ca881-kube-api-access-jch2m\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-zcm66\" (UID: \"781b05d1-4d9b-46de-8fff-4d26569ca881\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-zcm66" Oct 30 09:03:37.499057 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:37.498985 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-zcm66" Oct 30 09:03:37.797017 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:37.796807 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-zcm66"] Oct 30 09:03:37.799773 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:03:37.799747 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod781b05d1_4d9b_46de_8fff_4d26569ca881.slice/crio-8d4df3bdb6b3957cccfd972d4d48965441d5daa16c3e3d47686bb9819367a682 WatchSource:0}: Error finding container 8d4df3bdb6b3957cccfd972d4d48965441d5daa16c3e3d47686bb9819367a682: Status 404 returned error can't find the container with id 8d4df3bdb6b3957cccfd972d4d48965441d5daa16c3e3d47686bb9819367a682 Oct 30 09:03:38.429663 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:38.429620 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-zcm66" event={"ID":"781b05d1-4d9b-46de-8fff-4d26569ca881","Type":"ContainerStarted","Data":"1227a0eb0290f446546b95833fc6a7ccb02990378df5b26b833f47403bcf21df"} Oct 30 09:03:38.430082 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:38.429693 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-zcm66" event={"ID":"781b05d1-4d9b-46de-8fff-4d26569ca881","Type":"ContainerStarted","Data":"8d4df3bdb6b3957cccfd972d4d48965441d5daa16c3e3d47686bb9819367a682"} Oct 30 09:03:38.470617 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:38.470566 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-zcm66" podStartSLOduration=1.265493656 podStartE2EDuration="1.470553897s" totalImagesPullingTime="205.060241ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 09:03:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 09:03:38.470392193 +0000 UTC m=+632.686504572" watchObservedRunningTime="2026-10-30 09:03:38.470553897 +0000 UTC m=+632.686666254" Oct 30 09:03:38.499478 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:38.499453 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-zcm66" Oct 30 09:03:40.539960 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:40.539928 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh"] Oct 30 09:03:40.543340 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:40.543317 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh" Oct 30 09:03:40.596569 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:40.596530 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh"] Oct 30 09:03:40.604186 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:40.604162 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Oct 30 09:03:40.692874 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:40.692828 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e8ed68f-dab6-4e98-9005-919bde2da988-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh\" (UID: \"3e8ed68f-dab6-4e98-9005-919bde2da988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh" Oct 30 09:03:40.693246 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:40.693197 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e8ed68f-dab6-4e98-9005-919bde2da988-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh\" (UID: \"3e8ed68f-dab6-4e98-9005-919bde2da988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh" Oct 30 09:03:40.693456 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:40.693427 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e8ed68f-dab6-4e98-9005-919bde2da988-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh\" (UID: \"3e8ed68f-dab6-4e98-9005-919bde2da988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh" Oct 30 09:03:40.693592 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:40.693572 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2s7m\" (UniqueName: \"kubernetes.io/projected/3e8ed68f-dab6-4e98-9005-919bde2da988-kube-api-access-w2s7m\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh\" (UID: \"3e8ed68f-dab6-4e98-9005-919bde2da988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh" Oct 30 09:03:40.693750 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:40.693733 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e8ed68f-dab6-4e98-9005-919bde2da988-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh\" (UID: \"3e8ed68f-dab6-4e98-9005-919bde2da988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh" Oct 30 09:03:40.693869 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:40.693854 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e8ed68f-dab6-4e98-9005-919bde2da988-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh\" (UID: \"3e8ed68f-dab6-4e98-9005-919bde2da988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh" Oct 30 09:03:40.796340 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:40.795440 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e8ed68f-dab6-4e98-9005-919bde2da988-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh\" (UID: \"3e8ed68f-dab6-4e98-9005-919bde2da988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh" Oct 30 09:03:40.796340 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:40.795504 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e8ed68f-dab6-4e98-9005-919bde2da988-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh\" (UID: \"3e8ed68f-dab6-4e98-9005-919bde2da988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh" Oct 30 09:03:40.796340 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:40.795556 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e8ed68f-dab6-4e98-9005-919bde2da988-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh\" (UID: \"3e8ed68f-dab6-4e98-9005-919bde2da988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh" Oct 30 09:03:40.796340 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:40.795584 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2s7m\" (UniqueName: \"kubernetes.io/projected/3e8ed68f-dab6-4e98-9005-919bde2da988-kube-api-access-w2s7m\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh\" (UID: \"3e8ed68f-dab6-4e98-9005-919bde2da988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh" Oct 30 09:03:40.796340 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:40.795631 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e8ed68f-dab6-4e98-9005-919bde2da988-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh\" (UID: \"3e8ed68f-dab6-4e98-9005-919bde2da988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh" Oct 30 09:03:40.796340 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:40.795659 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e8ed68f-dab6-4e98-9005-919bde2da988-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh\" (UID: \"3e8ed68f-dab6-4e98-9005-919bde2da988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh" Oct 30 09:03:40.796340 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:40.795955 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e8ed68f-dab6-4e98-9005-919bde2da988-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh\" (UID: \"3e8ed68f-dab6-4e98-9005-919bde2da988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh" Oct 30 09:03:40.796340 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:40.795993 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e8ed68f-dab6-4e98-9005-919bde2da988-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh\" (UID: \"3e8ed68f-dab6-4e98-9005-919bde2da988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh" Oct 30 09:03:40.796340 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:40.796015 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e8ed68f-dab6-4e98-9005-919bde2da988-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh\" (UID: \"3e8ed68f-dab6-4e98-9005-919bde2da988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh" Oct 30 09:03:40.798892 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:40.798860 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e8ed68f-dab6-4e98-9005-919bde2da988-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh\" (UID: \"3e8ed68f-dab6-4e98-9005-919bde2da988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh" Oct 30 09:03:40.799107 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:40.799086 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e8ed68f-dab6-4e98-9005-919bde2da988-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh\" (UID: \"3e8ed68f-dab6-4e98-9005-919bde2da988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh" Oct 30 09:03:40.818764 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:40.818737 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2s7m\" (UniqueName: \"kubernetes.io/projected/3e8ed68f-dab6-4e98-9005-919bde2da988-kube-api-access-w2s7m\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh\" (UID: \"3e8ed68f-dab6-4e98-9005-919bde2da988\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh" Oct 30 09:03:40.862495 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:40.862469 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh" Oct 30 09:03:41.186028 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:41.185925 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh"] Oct 30 09:03:41.188833 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:03:41.188805 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e8ed68f_dab6_4e98_9005_919bde2da988.slice/crio-d6c908ea404ca10ec80a0cd4a541e8a14dcfb0f028b2f13ca47efa544856a0a6 WatchSource:0}: Error finding container d6c908ea404ca10ec80a0cd4a541e8a14dcfb0f028b2f13ca47efa544856a0a6: Status 404 returned error can't find the container with id d6c908ea404ca10ec80a0cd4a541e8a14dcfb0f028b2f13ca47efa544856a0a6 Oct 30 09:03:41.447252 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:41.447229 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh" event={"ID":"3e8ed68f-dab6-4e98-9005-919bde2da988","Type":"ContainerStarted","Data":"d6c908ea404ca10ec80a0cd4a541e8a14dcfb0f028b2f13ca47efa544856a0a6"} Oct 30 09:03:42.455652 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:42.455616 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh" event={"ID":"3e8ed68f-dab6-4e98-9005-919bde2da988","Type":"ContainerStarted","Data":"903a0e066241ce8afc6162ca290f1859b84cf5b62b65ddf1858e221f26919041"} Oct 30 09:03:42.500338 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:42.500287 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh" podStartSLOduration=2.282742874 podStartE2EDuration="2.500272862s" totalImagesPullingTime="217.529988ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 09:03:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 09:03:42.497557323 +0000 UTC m=+636.713669701" watchObservedRunningTime="2026-10-30 09:03:42.500272862 +0000 UTC m=+636.716385220" Oct 30 09:03:42.702920 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:42.702888 5028 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj" Oct 30 09:03:42.715179 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:42.715119 5028 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj" Oct 30 09:03:42.741935 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:03:42.741904 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 09:03:42.863409 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:42.863389 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh" Oct 30 09:03:43.475194 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:43.475165 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj" Oct 30 09:03:44.209180 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:44.209127 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75"] Oct 30 09:03:44.219500 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:44.219473 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75" Oct 30 09:03:44.235569 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:44.235059 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe0b4ce0-4aec-420c-8735-6ae70d6647ff-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75\" (UID: \"fe0b4ce0-4aec-420c-8735-6ae70d6647ff\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75" Oct 30 09:03:44.235569 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:44.235110 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rz64\" (UniqueName: \"kubernetes.io/projected/fe0b4ce0-4aec-420c-8735-6ae70d6647ff-kube-api-access-9rz64\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75\" (UID: \"fe0b4ce0-4aec-420c-8735-6ae70d6647ff\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75" Oct 30 09:03:44.235569 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:44.235140 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe0b4ce0-4aec-420c-8735-6ae70d6647ff-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75\" (UID: \"fe0b4ce0-4aec-420c-8735-6ae70d6647ff\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75" Oct 30 09:03:44.235569 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:44.235189 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe0b4ce0-4aec-420c-8735-6ae70d6647ff-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75\" (UID: \"fe0b4ce0-4aec-420c-8735-6ae70d6647ff\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75" Oct 30 09:03:44.235569 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:44.235237 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe0b4ce0-4aec-420c-8735-6ae70d6647ff-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75\" (UID: \"fe0b4ce0-4aec-420c-8735-6ae70d6647ff\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75" Oct 30 09:03:44.235569 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:44.235280 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe0b4ce0-4aec-420c-8735-6ae70d6647ff-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75\" (UID: \"fe0b4ce0-4aec-420c-8735-6ae70d6647ff\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75" Oct 30 09:03:44.237370 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:44.237345 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75"] Oct 30 09:03:44.245097 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:44.245081 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Oct 30 09:03:44.336236 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:44.336176 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe0b4ce0-4aec-420c-8735-6ae70d6647ff-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75\" (UID: \"fe0b4ce0-4aec-420c-8735-6ae70d6647ff\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75" Oct 30 09:03:44.336236 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:44.336231 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe0b4ce0-4aec-420c-8735-6ae70d6647ff-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75\" (UID: \"fe0b4ce0-4aec-420c-8735-6ae70d6647ff\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75" Oct 30 09:03:44.336440 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:44.336264 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rz64\" (UniqueName: \"kubernetes.io/projected/fe0b4ce0-4aec-420c-8735-6ae70d6647ff-kube-api-access-9rz64\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75\" (UID: \"fe0b4ce0-4aec-420c-8735-6ae70d6647ff\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75" Oct 30 09:03:44.336440 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:44.336287 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe0b4ce0-4aec-420c-8735-6ae70d6647ff-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75\" (UID: \"fe0b4ce0-4aec-420c-8735-6ae70d6647ff\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75" Oct 30 09:03:44.336440 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:44.336330 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe0b4ce0-4aec-420c-8735-6ae70d6647ff-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75\" (UID: \"fe0b4ce0-4aec-420c-8735-6ae70d6647ff\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75" Oct 30 09:03:44.336440 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:44.336357 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe0b4ce0-4aec-420c-8735-6ae70d6647ff-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75\" (UID: \"fe0b4ce0-4aec-420c-8735-6ae70d6647ff\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75" Oct 30 09:03:44.336659 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:44.336638 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe0b4ce0-4aec-420c-8735-6ae70d6647ff-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75\" (UID: \"fe0b4ce0-4aec-420c-8735-6ae70d6647ff\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75" Oct 30 09:03:44.336732 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:44.336708 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe0b4ce0-4aec-420c-8735-6ae70d6647ff-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75\" (UID: \"fe0b4ce0-4aec-420c-8735-6ae70d6647ff\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75" Oct 30 09:03:44.336806 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:44.336782 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe0b4ce0-4aec-420c-8735-6ae70d6647ff-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75\" (UID: \"fe0b4ce0-4aec-420c-8735-6ae70d6647ff\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75" Oct 30 09:03:44.338563 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:44.338544 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe0b4ce0-4aec-420c-8735-6ae70d6647ff-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75\" (UID: \"fe0b4ce0-4aec-420c-8735-6ae70d6647ff\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75" Oct 30 09:03:44.338740 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:44.338723 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe0b4ce0-4aec-420c-8735-6ae70d6647ff-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75\" (UID: \"fe0b4ce0-4aec-420c-8735-6ae70d6647ff\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75" Oct 30 09:03:44.358509 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:44.358483 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rz64\" (UniqueName: \"kubernetes.io/projected/fe0b4ce0-4aec-420c-8735-6ae70d6647ff-kube-api-access-9rz64\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75\" (UID: \"fe0b4ce0-4aec-420c-8735-6ae70d6647ff\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75" Oct 30 09:03:44.545485 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:44.545409 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75" Oct 30 09:03:44.858618 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:44.858595 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75"] Oct 30 09:03:44.861159 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:03:44.861130 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe0b4ce0_4aec_420c_8735_6ae70d6647ff.slice/crio-8e3039e169b7f28fc6bc6764a356d443fb50c8cd1352d73ba2995f68fe0e8eaf WatchSource:0}: Error finding container 8e3039e169b7f28fc6bc6764a356d443fb50c8cd1352d73ba2995f68fe0e8eaf: Status 404 returned error can't find the container with id 8e3039e169b7f28fc6bc6764a356d443fb50c8cd1352d73ba2995f68fe0e8eaf Oct 30 09:03:45.474995 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:45.474915 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75" event={"ID":"fe0b4ce0-4aec-420c-8735-6ae70d6647ff","Type":"ContainerStarted","Data":"22dde470936c2cff1571bed7f29ba4f0b759f158a7e0cf78280d688c6ab517ec"} Oct 30 09:03:45.474995 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:45.474976 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75" event={"ID":"fe0b4ce0-4aec-420c-8735-6ae70d6647ff","Type":"ContainerStarted","Data":"8e3039e169b7f28fc6bc6764a356d443fb50c8cd1352d73ba2995f68fe0e8eaf"} Oct 30 09:03:45.523228 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:45.518361 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75" podStartSLOduration=1.306336268 podStartE2EDuration="1.518343904s" totalImagesPullingTime="212.007636ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 09:03:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 09:03:45.516128129 +0000 UTC m=+639.732240488" watchObservedRunningTime="2026-10-30 09:03:45.518343904 +0000 UTC m=+639.734456263" Oct 30 09:03:45.546346 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:45.546319 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75" Oct 30 09:03:47.499315 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:47.499276 5028 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-zcm66" Oct 30 09:03:47.513551 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:47.513515 5028 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-zcm66" Oct 30 09:03:48.504794 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:48.504760 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-zcm66" Oct 30 09:03:50.862770 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:50.862736 5028 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh" Oct 30 09:03:50.876294 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:50.876270 5028 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh" Oct 30 09:03:51.531974 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:51.531945 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh" Oct 30 09:03:54.545923 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:54.545888 5028 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75" Oct 30 09:03:54.558377 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:54.558347 5028 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75" Oct 30 09:03:55.547845 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:03:55.547813 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75" Oct 30 09:04:12.744333 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:04:12.744291 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 09:04:16.544754 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:16.544720 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns"] Oct 30 09:04:16.550328 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:16.550308 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:16.570513 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:16.570482 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns"] Oct 30 09:04:16.611752 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:16.611723 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22314808-f2ad-49af-9cd2-f2f90f33b795-istio-envoy\") pod \"maas-default-gateway-openshift-default-fcb75c45f-dr8ns\" (UID: \"22314808-f2ad-49af-9cd2-f2f90f33b795\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:16.611867 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:16.611756 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22314808-f2ad-49af-9cd2-f2f90f33b795-istio-token\") pod \"maas-default-gateway-openshift-default-fcb75c45f-dr8ns\" (UID: \"22314808-f2ad-49af-9cd2-f2f90f33b795\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:16.611867 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:16.611844 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22314808-f2ad-49af-9cd2-f2f90f33b795-workload-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-dr8ns\" (UID: \"22314808-f2ad-49af-9cd2-f2f90f33b795\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:16.611938 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:16.611876 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22314808-f2ad-49af-9cd2-f2f90f33b795-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fcb75c45f-dr8ns\" (UID: \"22314808-f2ad-49af-9cd2-f2f90f33b795\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:16.611977 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:16.611946 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22314808-f2ad-49af-9cd2-f2f90f33b795-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fcb75c45f-dr8ns\" (UID: \"22314808-f2ad-49af-9cd2-f2f90f33b795\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:16.612013 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:16.611978 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22314808-f2ad-49af-9cd2-f2f90f33b795-credential-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-dr8ns\" (UID: \"22314808-f2ad-49af-9cd2-f2f90f33b795\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:16.612013 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:16.612009 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22314808-f2ad-49af-9cd2-f2f90f33b795-workload-certs\") pod \"maas-default-gateway-openshift-default-fcb75c45f-dr8ns\" (UID: \"22314808-f2ad-49af-9cd2-f2f90f33b795\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:16.612080 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:16.612028 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mxj5\" (UniqueName: \"kubernetes.io/projected/22314808-f2ad-49af-9cd2-f2f90f33b795-kube-api-access-4mxj5\") pod \"maas-default-gateway-openshift-default-fcb75c45f-dr8ns\" (UID: \"22314808-f2ad-49af-9cd2-f2f90f33b795\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:16.612147 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:16.612132 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22314808-f2ad-49af-9cd2-f2f90f33b795-istio-data\") pod \"maas-default-gateway-openshift-default-fcb75c45f-dr8ns\" (UID: \"22314808-f2ad-49af-9cd2-f2f90f33b795\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:16.712715 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:16.712677 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22314808-f2ad-49af-9cd2-f2f90f33b795-istio-data\") pod \"maas-default-gateway-openshift-default-fcb75c45f-dr8ns\" (UID: \"22314808-f2ad-49af-9cd2-f2f90f33b795\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:16.712836 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:16.712735 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22314808-f2ad-49af-9cd2-f2f90f33b795-istio-envoy\") pod \"maas-default-gateway-openshift-default-fcb75c45f-dr8ns\" (UID: \"22314808-f2ad-49af-9cd2-f2f90f33b795\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:16.712836 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:16.712752 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22314808-f2ad-49af-9cd2-f2f90f33b795-istio-token\") pod \"maas-default-gateway-openshift-default-fcb75c45f-dr8ns\" (UID: \"22314808-f2ad-49af-9cd2-f2f90f33b795\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:16.712836 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:16.712797 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22314808-f2ad-49af-9cd2-f2f90f33b795-workload-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-dr8ns\" (UID: \"22314808-f2ad-49af-9cd2-f2f90f33b795\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:16.712836 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:16.712812 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22314808-f2ad-49af-9cd2-f2f90f33b795-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fcb75c45f-dr8ns\" (UID: \"22314808-f2ad-49af-9cd2-f2f90f33b795\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:16.713044 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:16.712835 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22314808-f2ad-49af-9cd2-f2f90f33b795-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fcb75c45f-dr8ns\" (UID: \"22314808-f2ad-49af-9cd2-f2f90f33b795\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:16.713044 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:16.712865 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22314808-f2ad-49af-9cd2-f2f90f33b795-credential-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-dr8ns\" (UID: \"22314808-f2ad-49af-9cd2-f2f90f33b795\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:16.713044 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:16.712899 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22314808-f2ad-49af-9cd2-f2f90f33b795-workload-certs\") pod \"maas-default-gateway-openshift-default-fcb75c45f-dr8ns\" (UID: \"22314808-f2ad-49af-9cd2-f2f90f33b795\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:16.713044 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:16.712926 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mxj5\" (UniqueName: \"kubernetes.io/projected/22314808-f2ad-49af-9cd2-f2f90f33b795-kube-api-access-4mxj5\") pod \"maas-default-gateway-openshift-default-fcb75c45f-dr8ns\" (UID: \"22314808-f2ad-49af-9cd2-f2f90f33b795\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:16.713276 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:16.713094 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22314808-f2ad-49af-9cd2-f2f90f33b795-istio-data\") pod \"maas-default-gateway-openshift-default-fcb75c45f-dr8ns\" (UID: \"22314808-f2ad-49af-9cd2-f2f90f33b795\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:16.713378 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:16.713318 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22314808-f2ad-49af-9cd2-f2f90f33b795-credential-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-dr8ns\" (UID: \"22314808-f2ad-49af-9cd2-f2f90f33b795\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:16.713378 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:16.713349 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22314808-f2ad-49af-9cd2-f2f90f33b795-workload-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-dr8ns\" (UID: \"22314808-f2ad-49af-9cd2-f2f90f33b795\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:16.713523 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:16.713397 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22314808-f2ad-49af-9cd2-f2f90f33b795-workload-certs\") pod \"maas-default-gateway-openshift-default-fcb75c45f-dr8ns\" (UID: \"22314808-f2ad-49af-9cd2-f2f90f33b795\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:16.713577 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:16.713528 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22314808-f2ad-49af-9cd2-f2f90f33b795-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fcb75c45f-dr8ns\" (UID: \"22314808-f2ad-49af-9cd2-f2f90f33b795\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:16.714960 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:16.714939 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22314808-f2ad-49af-9cd2-f2f90f33b795-istio-envoy\") pod \"maas-default-gateway-openshift-default-fcb75c45f-dr8ns\" (UID: \"22314808-f2ad-49af-9cd2-f2f90f33b795\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:16.715345 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:16.715325 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22314808-f2ad-49af-9cd2-f2f90f33b795-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fcb75c45f-dr8ns\" (UID: \"22314808-f2ad-49af-9cd2-f2f90f33b795\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:16.735378 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:16.735358 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22314808-f2ad-49af-9cd2-f2f90f33b795-istio-token\") pod \"maas-default-gateway-openshift-default-fcb75c45f-dr8ns\" (UID: \"22314808-f2ad-49af-9cd2-f2f90f33b795\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:16.735841 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:16.735820 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mxj5\" (UniqueName: \"kubernetes.io/projected/22314808-f2ad-49af-9cd2-f2f90f33b795-kube-api-access-4mxj5\") pod \"maas-default-gateway-openshift-default-fcb75c45f-dr8ns\" (UID: \"22314808-f2ad-49af-9cd2-f2f90f33b795\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:16.867849 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:16.867828 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:17.195951 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:17.195884 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns"] Oct 30 09:04:17.198914 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:04:17.198887 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22314808_f2ad_49af_9cd2_f2f90f33b795.slice/crio-4d507e72762f2d60b49e212d7af2fa8ae7c7fd4d8661b6f9ca9d7afaeb50c60c WatchSource:0}: Error finding container 4d507e72762f2d60b49e212d7af2fa8ae7c7fd4d8661b6f9ca9d7afaeb50c60c: Status 404 returned error can't find the container with id 4d507e72762f2d60b49e212d7af2fa8ae7c7fd4d8661b6f9ca9d7afaeb50c60c Oct 30 09:04:17.200959 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:17.200929 5028 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 09:04:17.201058 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:17.200985 5028 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 09:04:17.201058 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:17.201013 5028 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 09:04:17.659086 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:17.659048 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" event={"ID":"22314808-f2ad-49af-9cd2-f2f90f33b795","Type":"ContainerStarted","Data":"1852558f52e7c762cfc6c662581ac3b30f156e6fce9247ece02d7ecb648ddbd7"} Oct 30 09:04:17.659538 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:17.659145 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" event={"ID":"22314808-f2ad-49af-9cd2-f2f90f33b795","Type":"ContainerStarted","Data":"4d507e72762f2d60b49e212d7af2fa8ae7c7fd4d8661b6f9ca9d7afaeb50c60c"} Oct 30 09:04:17.742691 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:17.742640 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" podStartSLOduration=1.7426260249999999 podStartE2EDuration="1.742626025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 09:04:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 09:04:17.741247587 +0000 UTC m=+671.957359944" watchObservedRunningTime="2026-10-30 09:04:17.742626025 +0000 UTC m=+671.958738383" Oct 30 09:04:17.888229 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:17.880296 5028 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:18.892230 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:18.890368 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-dr8ns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Oct 30 09:04:18.892230 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:18.890434 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" podUID="22314808-f2ad-49af-9cd2-f2f90f33b795" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Oct 30 09:04:19.889230 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:19.886556 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-dr8ns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Oct 30 09:04:19.889230 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:19.886628 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" podUID="22314808-f2ad-49af-9cd2-f2f90f33b795" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Oct 30 09:04:20.892334 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:20.892294 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-dr8ns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Oct 30 09:04:20.892808 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:20.892361 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" podUID="22314808-f2ad-49af-9cd2-f2f90f33b795" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Oct 30 09:04:21.892596 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:21.892553 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-dr8ns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Oct 30 09:04:21.893075 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:21.892634 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" podUID="22314808-f2ad-49af-9cd2-f2f90f33b795" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Oct 30 09:04:22.891352 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:22.891314 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-dr8ns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Oct 30 09:04:22.891706 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:22.891674 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" podUID="22314808-f2ad-49af-9cd2-f2f90f33b795" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Oct 30 09:04:23.868877 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:23.868839 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-dr8ns container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Oct 30 09:04:23.869291 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:23.868918 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" podUID="22314808-f2ad-49af-9cd2-f2f90f33b795" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Oct 30 09:04:25.376021 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:25.375981 5028 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:25.376491 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:25.376421 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:25.377122 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:25.377096 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" Oct 30 09:04:31.595063 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:31.595031 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn"] Oct 30 09:04:31.600794 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:31.600768 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:31.620555 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:31.620534 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn"] Oct 30 09:04:31.775850 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:31.775820 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37ad32b7-0a5f-4437-8855-cc6ddebec8e3-workload-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-p5khn\" (UID: \"37ad32b7-0a5f-4437-8855-cc6ddebec8e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:31.776013 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:31.775855 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37ad32b7-0a5f-4437-8855-cc6ddebec8e3-istio-data\") pod \"maas-default-gateway-openshift-default-fcb75c45f-p5khn\" (UID: \"37ad32b7-0a5f-4437-8855-cc6ddebec8e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:31.776013 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:31.775873 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37ad32b7-0a5f-4437-8855-cc6ddebec8e3-istio-token\") pod \"maas-default-gateway-openshift-default-fcb75c45f-p5khn\" (UID: \"37ad32b7-0a5f-4437-8855-cc6ddebec8e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:31.776013 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:31.775986 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37ad32b7-0a5f-4437-8855-cc6ddebec8e3-istio-envoy\") pod \"maas-default-gateway-openshift-default-fcb75c45f-p5khn\" (UID: \"37ad32b7-0a5f-4437-8855-cc6ddebec8e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:31.776013 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:31.776012 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37ad32b7-0a5f-4437-8855-cc6ddebec8e3-workload-certs\") pod \"maas-default-gateway-openshift-default-fcb75c45f-p5khn\" (UID: \"37ad32b7-0a5f-4437-8855-cc6ddebec8e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:31.776152 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:31.776027 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2hhj\" (UniqueName: \"kubernetes.io/projected/37ad32b7-0a5f-4437-8855-cc6ddebec8e3-kube-api-access-s2hhj\") pod \"maas-default-gateway-openshift-default-fcb75c45f-p5khn\" (UID: \"37ad32b7-0a5f-4437-8855-cc6ddebec8e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:31.776152 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:31.776095 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37ad32b7-0a5f-4437-8855-cc6ddebec8e3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fcb75c45f-p5khn\" (UID: \"37ad32b7-0a5f-4437-8855-cc6ddebec8e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:31.776152 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:31.776146 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37ad32b7-0a5f-4437-8855-cc6ddebec8e3-credential-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-p5khn\" (UID: \"37ad32b7-0a5f-4437-8855-cc6ddebec8e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:31.776297 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:31.776187 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37ad32b7-0a5f-4437-8855-cc6ddebec8e3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fcb75c45f-p5khn\" (UID: \"37ad32b7-0a5f-4437-8855-cc6ddebec8e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:31.877042 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:31.876969 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37ad32b7-0a5f-4437-8855-cc6ddebec8e3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fcb75c45f-p5khn\" (UID: \"37ad32b7-0a5f-4437-8855-cc6ddebec8e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:31.877042 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:31.877015 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37ad32b7-0a5f-4437-8855-cc6ddebec8e3-credential-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-p5khn\" (UID: \"37ad32b7-0a5f-4437-8855-cc6ddebec8e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:31.877248 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:31.877060 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37ad32b7-0a5f-4437-8855-cc6ddebec8e3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fcb75c45f-p5khn\" (UID: \"37ad32b7-0a5f-4437-8855-cc6ddebec8e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:31.877248 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:31.877095 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37ad32b7-0a5f-4437-8855-cc6ddebec8e3-workload-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-p5khn\" (UID: \"37ad32b7-0a5f-4437-8855-cc6ddebec8e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:31.877248 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:31.877124 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37ad32b7-0a5f-4437-8855-cc6ddebec8e3-istio-data\") pod \"maas-default-gateway-openshift-default-fcb75c45f-p5khn\" (UID: \"37ad32b7-0a5f-4437-8855-cc6ddebec8e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:31.877248 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:31.877147 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37ad32b7-0a5f-4437-8855-cc6ddebec8e3-istio-token\") pod \"maas-default-gateway-openshift-default-fcb75c45f-p5khn\" (UID: \"37ad32b7-0a5f-4437-8855-cc6ddebec8e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:31.877248 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:31.877197 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37ad32b7-0a5f-4437-8855-cc6ddebec8e3-istio-envoy\") pod \"maas-default-gateway-openshift-default-fcb75c45f-p5khn\" (UID: \"37ad32b7-0a5f-4437-8855-cc6ddebec8e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:31.877526 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:31.877300 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37ad32b7-0a5f-4437-8855-cc6ddebec8e3-workload-certs\") pod \"maas-default-gateway-openshift-default-fcb75c45f-p5khn\" (UID: \"37ad32b7-0a5f-4437-8855-cc6ddebec8e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:31.877526 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:31.877339 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2hhj\" (UniqueName: \"kubernetes.io/projected/37ad32b7-0a5f-4437-8855-cc6ddebec8e3-kube-api-access-s2hhj\") pod \"maas-default-gateway-openshift-default-fcb75c45f-p5khn\" (UID: \"37ad32b7-0a5f-4437-8855-cc6ddebec8e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:31.877526 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:31.877504 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37ad32b7-0a5f-4437-8855-cc6ddebec8e3-credential-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-p5khn\" (UID: \"37ad32b7-0a5f-4437-8855-cc6ddebec8e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:31.877680 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:31.877552 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37ad32b7-0a5f-4437-8855-cc6ddebec8e3-istio-data\") pod \"maas-default-gateway-openshift-default-fcb75c45f-p5khn\" (UID: \"37ad32b7-0a5f-4437-8855-cc6ddebec8e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:31.877680 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:31.877602 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37ad32b7-0a5f-4437-8855-cc6ddebec8e3-workload-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-p5khn\" (UID: \"37ad32b7-0a5f-4437-8855-cc6ddebec8e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:31.877838 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:31.877821 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37ad32b7-0a5f-4437-8855-cc6ddebec8e3-workload-certs\") pod \"maas-default-gateway-openshift-default-fcb75c45f-p5khn\" (UID: \"37ad32b7-0a5f-4437-8855-cc6ddebec8e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:31.877938 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:31.877923 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37ad32b7-0a5f-4437-8855-cc6ddebec8e3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fcb75c45f-p5khn\" (UID: \"37ad32b7-0a5f-4437-8855-cc6ddebec8e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:31.879776 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:31.879748 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37ad32b7-0a5f-4437-8855-cc6ddebec8e3-istio-envoy\") pod \"maas-default-gateway-openshift-default-fcb75c45f-p5khn\" (UID: \"37ad32b7-0a5f-4437-8855-cc6ddebec8e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:31.879882 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:31.879871 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37ad32b7-0a5f-4437-8855-cc6ddebec8e3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fcb75c45f-p5khn\" (UID: \"37ad32b7-0a5f-4437-8855-cc6ddebec8e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:31.899882 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:31.899857 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37ad32b7-0a5f-4437-8855-cc6ddebec8e3-istio-token\") pod \"maas-default-gateway-openshift-default-fcb75c45f-p5khn\" (UID: \"37ad32b7-0a5f-4437-8855-cc6ddebec8e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:31.900280 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:31.900257 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2hhj\" (UniqueName: \"kubernetes.io/projected/37ad32b7-0a5f-4437-8855-cc6ddebec8e3-kube-api-access-s2hhj\") pod \"maas-default-gateway-openshift-default-fcb75c45f-p5khn\" (UID: \"37ad32b7-0a5f-4437-8855-cc6ddebec8e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:31.914880 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:31.914863 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:32.232089 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:32.232062 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn"] Oct 30 09:04:32.234908 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:04:32.234883 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37ad32b7_0a5f_4437_8855_cc6ddebec8e3.slice/crio-e416cfc5f0e7afcbbe614bf26529e1d65574529d12ad131d5f270f675f59b6b8 WatchSource:0}: Error finding container e416cfc5f0e7afcbbe614bf26529e1d65574529d12ad131d5f270f675f59b6b8: Status 404 returned error can't find the container with id e416cfc5f0e7afcbbe614bf26529e1d65574529d12ad131d5f270f675f59b6b8 Oct 30 09:04:32.237088 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:32.237056 5028 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 09:04:32.237181 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:32.237123 5028 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 09:04:32.237181 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:32.237151 5028 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 09:04:32.763307 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:32.763268 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" event={"ID":"37ad32b7-0a5f-4437-8855-cc6ddebec8e3","Type":"ContainerStarted","Data":"a6a8c617a4e0795f770103395c4a1aa9bff5e76558a6c18b8c7cc53382d75123"} Oct 30 09:04:32.763728 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:32.763315 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" event={"ID":"37ad32b7-0a5f-4437-8855-cc6ddebec8e3","Type":"ContainerStarted","Data":"e416cfc5f0e7afcbbe614bf26529e1d65574529d12ad131d5f270f675f59b6b8"} Oct 30 09:04:32.829596 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:32.829545 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" podStartSLOduration=1.829527707 podStartE2EDuration="1.829527707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 09:04:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 09:04:32.826778572 +0000 UTC m=+687.042890929" watchObservedRunningTime="2026-10-30 09:04:32.829527707 +0000 UTC m=+687.045640064" Oct 30 09:04:32.915163 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:32.915129 5028 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:33.917608 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:33.917578 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-p5khn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Oct 30 09:04:33.917983 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:33.917625 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" podUID="37ad32b7-0a5f-4437-8855-cc6ddebec8e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Oct 30 09:04:34.916195 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:34.916159 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-p5khn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Oct 30 09:04:34.916394 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:34.916243 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" podUID="37ad32b7-0a5f-4437-8855-cc6ddebec8e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Oct 30 09:04:35.915368 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:35.915334 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-p5khn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Oct 30 09:04:35.915739 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:35.915400 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" podUID="37ad32b7-0a5f-4437-8855-cc6ddebec8e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Oct 30 09:04:36.915868 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:36.915836 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-p5khn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Oct 30 09:04:36.916305 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:36.915905 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" podUID="37ad32b7-0a5f-4437-8855-cc6ddebec8e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Oct 30 09:04:37.915465 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:37.915429 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-p5khn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Oct 30 09:04:37.915635 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:37.915497 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" podUID="37ad32b7-0a5f-4437-8855-cc6ddebec8e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Oct 30 09:04:38.915974 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:38.915933 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-p5khn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Oct 30 09:04:38.916394 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:38.916012 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" podUID="37ad32b7-0a5f-4437-8855-cc6ddebec8e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Oct 30 09:04:40.917401 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:40.917359 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-p5khn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 09:04:40.917895 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:40.917423 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" podUID="37ad32b7-0a5f-4437-8855-cc6ddebec8e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 09:04:41.972318 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:41.972283 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-p5khn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 09:04:41.972895 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:41.972864 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" podUID="37ad32b7-0a5f-4437-8855-cc6ddebec8e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 09:04:42.764366 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:04:42.764336 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 09:04:43.028280 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:43.019292 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-p5khn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 09:04:43.028280 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:43.019370 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" podUID="37ad32b7-0a5f-4437-8855-cc6ddebec8e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 09:04:43.640835 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:43.640805 5028 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:43.641588 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:43.641416 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:43.643254 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:43.643228 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" Oct 30 09:04:59.647396 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:59.647360 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8c66181f-9hrm9"] Oct 30 09:04:59.651270 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:59.651250 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8c66181f-9hrm9" Oct 30 09:04:59.679266 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:59.679239 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 09:04:59.679408 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:59.679301 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kdwkr\"" Oct 30 09:04:59.681916 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:59.681890 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8c66181f-9hrm9"] Oct 30 09:04:59.730199 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:59.730175 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eb526886-06ef-4f1d-bd1b-d3c81ff2e10f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8c66181f-9hrm9\" (UID: \"eb526886-06ef-4f1d-bd1b-d3c81ff2e10f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8c66181f-9hrm9" Oct 30 09:04:59.730330 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:59.730218 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m9gb\" (UniqueName: \"kubernetes.io/projected/eb526886-06ef-4f1d-bd1b-d3c81ff2e10f-kube-api-access-5m9gb\") pod \"maas-api-revoke-sub-8c66181f-9hrm9\" (UID: \"eb526886-06ef-4f1d-bd1b-d3c81ff2e10f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8c66181f-9hrm9" Oct 30 09:04:59.730330 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:59.730244 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eb526886-06ef-4f1d-bd1b-d3c81ff2e10f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8c66181f-9hrm9\" (UID: \"eb526886-06ef-4f1d-bd1b-d3c81ff2e10f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8c66181f-9hrm9" Oct 30 09:04:59.831101 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:59.831073 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eb526886-06ef-4f1d-bd1b-d3c81ff2e10f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8c66181f-9hrm9\" (UID: \"eb526886-06ef-4f1d-bd1b-d3c81ff2e10f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8c66181f-9hrm9" Oct 30 09:04:59.831271 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:59.831110 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m9gb\" (UniqueName: \"kubernetes.io/projected/eb526886-06ef-4f1d-bd1b-d3c81ff2e10f-kube-api-access-5m9gb\") pod \"maas-api-revoke-sub-8c66181f-9hrm9\" (UID: \"eb526886-06ef-4f1d-bd1b-d3c81ff2e10f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8c66181f-9hrm9" Oct 30 09:04:59.831271 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:59.831138 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eb526886-06ef-4f1d-bd1b-d3c81ff2e10f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8c66181f-9hrm9\" (UID: \"eb526886-06ef-4f1d-bd1b-d3c81ff2e10f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8c66181f-9hrm9" Oct 30 09:04:59.831756 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:59.831734 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eb526886-06ef-4f1d-bd1b-d3c81ff2e10f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8c66181f-9hrm9\" (UID: \"eb526886-06ef-4f1d-bd1b-d3c81ff2e10f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8c66181f-9hrm9" Oct 30 09:04:59.833424 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:59.833401 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eb526886-06ef-4f1d-bd1b-d3c81ff2e10f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8c66181f-9hrm9\" (UID: \"eb526886-06ef-4f1d-bd1b-d3c81ff2e10f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8c66181f-9hrm9" Oct 30 09:04:59.853888 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:59.853869 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m9gb\" (UniqueName: \"kubernetes.io/projected/eb526886-06ef-4f1d-bd1b-d3c81ff2e10f-kube-api-access-5m9gb\") pod \"maas-api-revoke-sub-8c66181f-9hrm9\" (UID: \"eb526886-06ef-4f1d-bd1b-d3c81ff2e10f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8c66181f-9hrm9" Oct 30 09:04:59.964586 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:04:59.964531 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8c66181f-9hrm9" Oct 30 09:05:00.262915 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:00.262892 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8c66181f-9hrm9"] Oct 30 09:05:00.266224 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:05:00.266185 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb526886_06ef_4f1d_bd1b_d3c81ff2e10f.slice/crio-606087eb40e73ee4e4142eb3e9518ade8d41cb916aeaf86333dfaafe69a7bbe0 WatchSource:0}: Error finding container 606087eb40e73ee4e4142eb3e9518ade8d41cb916aeaf86333dfaafe69a7bbe0: Status 404 returned error can't find the container with id 606087eb40e73ee4e4142eb3e9518ade8d41cb916aeaf86333dfaafe69a7bbe0 Oct 30 09:05:01.010812 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:01.010772 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8c66181f-9hrm9" event={"ID":"eb526886-06ef-4f1d-bd1b-d3c81ff2e10f","Type":"ContainerStarted","Data":"606087eb40e73ee4e4142eb3e9518ade8d41cb916aeaf86333dfaafe69a7bbe0"} Oct 30 09:05:01.692657 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:01.692622 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5"] Oct 30 09:05:01.702394 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:01.702369 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:01.721984 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:01.721958 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5"] Oct 30 09:05:01.749131 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:01.749101 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bffb6ff-3933-4688-ac60-835c70b0ce3c-workload-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9p2l5\" (UID: \"5bffb6ff-3933-4688-ac60-835c70b0ce3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:01.749275 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:01.749213 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bffb6ff-3933-4688-ac60-835c70b0ce3c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9p2l5\" (UID: \"5bffb6ff-3933-4688-ac60-835c70b0ce3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:01.749340 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:01.749312 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bffb6ff-3933-4688-ac60-835c70b0ce3c-credential-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9p2l5\" (UID: \"5bffb6ff-3933-4688-ac60-835c70b0ce3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:01.749384 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:01.749345 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bffb6ff-3933-4688-ac60-835c70b0ce3c-workload-certs\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9p2l5\" (UID: \"5bffb6ff-3933-4688-ac60-835c70b0ce3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:01.749384 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:01.749362 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bffb6ff-3933-4688-ac60-835c70b0ce3c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9p2l5\" (UID: \"5bffb6ff-3933-4688-ac60-835c70b0ce3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:01.749536 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:01.749517 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bffb6ff-3933-4688-ac60-835c70b0ce3c-istio-data\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9p2l5\" (UID: \"5bffb6ff-3933-4688-ac60-835c70b0ce3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:01.749598 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:01.749549 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnqtb\" (UniqueName: \"kubernetes.io/projected/5bffb6ff-3933-4688-ac60-835c70b0ce3c-kube-api-access-pnqtb\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9p2l5\" (UID: \"5bffb6ff-3933-4688-ac60-835c70b0ce3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:01.749634 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:01.749626 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bffb6ff-3933-4688-ac60-835c70b0ce3c-istio-envoy\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9p2l5\" (UID: \"5bffb6ff-3933-4688-ac60-835c70b0ce3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:01.749675 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:01.749656 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bffb6ff-3933-4688-ac60-835c70b0ce3c-istio-token\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9p2l5\" (UID: \"5bffb6ff-3933-4688-ac60-835c70b0ce3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:01.850485 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:01.850454 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bffb6ff-3933-4688-ac60-835c70b0ce3c-credential-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9p2l5\" (UID: \"5bffb6ff-3933-4688-ac60-835c70b0ce3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:01.850663 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:01.850505 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bffb6ff-3933-4688-ac60-835c70b0ce3c-workload-certs\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9p2l5\" (UID: \"5bffb6ff-3933-4688-ac60-835c70b0ce3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:01.850663 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:01.850531 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bffb6ff-3933-4688-ac60-835c70b0ce3c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9p2l5\" (UID: \"5bffb6ff-3933-4688-ac60-835c70b0ce3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:01.850663 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:01.850594 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bffb6ff-3933-4688-ac60-835c70b0ce3c-istio-data\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9p2l5\" (UID: \"5bffb6ff-3933-4688-ac60-835c70b0ce3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:01.850663 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:01.850618 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnqtb\" (UniqueName: \"kubernetes.io/projected/5bffb6ff-3933-4688-ac60-835c70b0ce3c-kube-api-access-pnqtb\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9p2l5\" (UID: \"5bffb6ff-3933-4688-ac60-835c70b0ce3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:01.850663 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:01.850661 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bffb6ff-3933-4688-ac60-835c70b0ce3c-istio-envoy\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9p2l5\" (UID: \"5bffb6ff-3933-4688-ac60-835c70b0ce3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:01.850926 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:01.850699 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bffb6ff-3933-4688-ac60-835c70b0ce3c-istio-token\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9p2l5\" (UID: \"5bffb6ff-3933-4688-ac60-835c70b0ce3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:01.850926 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:01.850741 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bffb6ff-3933-4688-ac60-835c70b0ce3c-workload-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9p2l5\" (UID: \"5bffb6ff-3933-4688-ac60-835c70b0ce3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:01.850926 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:01.850776 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bffb6ff-3933-4688-ac60-835c70b0ce3c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9p2l5\" (UID: \"5bffb6ff-3933-4688-ac60-835c70b0ce3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:01.850926 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:01.850865 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bffb6ff-3933-4688-ac60-835c70b0ce3c-credential-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9p2l5\" (UID: \"5bffb6ff-3933-4688-ac60-835c70b0ce3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:01.850926 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:01.850875 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bffb6ff-3933-4688-ac60-835c70b0ce3c-workload-certs\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9p2l5\" (UID: \"5bffb6ff-3933-4688-ac60-835c70b0ce3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:01.851183 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:01.851114 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bffb6ff-3933-4688-ac60-835c70b0ce3c-istio-data\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9p2l5\" (UID: \"5bffb6ff-3933-4688-ac60-835c70b0ce3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:01.851608 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:01.851566 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bffb6ff-3933-4688-ac60-835c70b0ce3c-workload-socket\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9p2l5\" (UID: \"5bffb6ff-3933-4688-ac60-835c70b0ce3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:01.851745 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:01.851727 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bffb6ff-3933-4688-ac60-835c70b0ce3c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9p2l5\" (UID: \"5bffb6ff-3933-4688-ac60-835c70b0ce3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:01.853714 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:01.853690 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bffb6ff-3933-4688-ac60-835c70b0ce3c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9p2l5\" (UID: \"5bffb6ff-3933-4688-ac60-835c70b0ce3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:01.858689 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:01.858653 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bffb6ff-3933-4688-ac60-835c70b0ce3c-istio-envoy\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9p2l5\" (UID: \"5bffb6ff-3933-4688-ac60-835c70b0ce3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:01.873760 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:01.873732 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bffb6ff-3933-4688-ac60-835c70b0ce3c-istio-token\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9p2l5\" (UID: \"5bffb6ff-3933-4688-ac60-835c70b0ce3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:01.873861 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:01.873799 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnqtb\" (UniqueName: \"kubernetes.io/projected/5bffb6ff-3933-4688-ac60-835c70b0ce3c-kube-api-access-pnqtb\") pod \"maas-default-gateway-openshift-default-fcb75c45f-9p2l5\" (UID: \"5bffb6ff-3933-4688-ac60-835c70b0ce3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:02.025690 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:02.025612 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:02.357040 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:02.357017 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5"] Oct 30 09:05:02.359559 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:05:02.359533 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bffb6ff_3933_4688_ac60_835c70b0ce3c.slice/crio-3d9b18589dedce0050484087dc528aa63fc3d2bee6226b56d43811d398971585 WatchSource:0}: Error finding container 3d9b18589dedce0050484087dc528aa63fc3d2bee6226b56d43811d398971585: Status 404 returned error can't find the container with id 3d9b18589dedce0050484087dc528aa63fc3d2bee6226b56d43811d398971585 Oct 30 09:05:02.361598 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:02.361572 5028 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 09:05:02.361676 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:02.361633 5028 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 09:05:02.361676 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:02.361661 5028 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 09:05:03.024736 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:03.024694 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" event={"ID":"5bffb6ff-3933-4688-ac60-835c70b0ce3c","Type":"ContainerStarted","Data":"6970335ddb77dc103c77dbd5eb36c2d1690c4f7d2c23ad7a66cd5888cfdfa6f6"} Oct 30 09:05:03.024935 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:03.024758 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" event={"ID":"5bffb6ff-3933-4688-ac60-835c70b0ce3c","Type":"ContainerStarted","Data":"3d9b18589dedce0050484087dc528aa63fc3d2bee6226b56d43811d398971585"} Oct 30 09:05:03.025819 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:03.025792 5028 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:03.026343 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:03.026317 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8c66181f-9hrm9" event={"ID":"eb526886-06ef-4f1d-bd1b-d3c81ff2e10f","Type":"ContainerStarted","Data":"44131507cda52ecd86ee71c10cd1fdb601d915ca81bd629555d16b4cefedc06f"} Oct 30 09:05:03.027039 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:03.027017 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-9p2l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Oct 30 09:05:03.027120 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:03.027059 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" podUID="5bffb6ff-3933-4688-ac60-835c70b0ce3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Oct 30 09:05:03.132644 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:03.132596 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8c66181f-9hrm9" podStartSLOduration=2.153658263 podStartE2EDuration="4.132583999s" totalImagesPullingTime="1.978925736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 09:04:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 09:05:03.131284099 +0000 UTC m=+717.347396460" watchObservedRunningTime="2026-10-30 09:05:03.132583999 +0000 UTC m=+717.348696358" Oct 30 09:05:03.132795 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:03.132758 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" podStartSLOduration=2.132751881 podStartE2EDuration="2.132751881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 09:05:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 09:05:03.092049356 +0000 UTC m=+717.308161789" watchObservedRunningTime="2026-10-30 09:05:03.132751881 +0000 UTC m=+717.348864242" Oct 30 09:05:04.026832 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:04.026797 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-9p2l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Oct 30 09:05:04.027263 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:04.026855 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" podUID="5bffb6ff-3933-4688-ac60-835c70b0ce3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Oct 30 09:05:04.033045 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:04.033020 5028 generic.go:356] "Generic (PLEG): container finished" podID="eb526886-06ef-4f1d-bd1b-d3c81ff2e10f" containerID="44131507cda52ecd86ee71c10cd1fdb601d915ca81bd629555d16b4cefedc06f" exitCode=0 Oct 30 09:05:04.033185 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:04.033092 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8c66181f-9hrm9" event={"ID":"eb526886-06ef-4f1d-bd1b-d3c81ff2e10f","Type":"ContainerDied","Data":"44131507cda52ecd86ee71c10cd1fdb601d915ca81bd629555d16b4cefedc06f"} Oct 30 09:05:05.026780 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:05.026743 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-9p2l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Oct 30 09:05:05.026955 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:05.026806 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" podUID="5bffb6ff-3933-4688-ac60-835c70b0ce3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Oct 30 09:05:05.217937 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:05.217913 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8c66181f-9hrm9" Oct 30 09:05:05.307253 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:05.307163 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/eb526886-06ef-4f1d-bd1b-d3c81ff2e10f-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eb526886-06ef-4f1d-bd1b-d3c81ff2e10f-maas-api-xks-ca\") pod \"eb526886-06ef-4f1d-bd1b-d3c81ff2e10f\" (UID: \"eb526886-06ef-4f1d-bd1b-d3c81ff2e10f\") " Oct 30 09:05:05.307405 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:05.307258 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/eb526886-06ef-4f1d-bd1b-d3c81ff2e10f-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eb526886-06ef-4f1d-bd1b-d3c81ff2e10f-maas-api-openshift-ca\") pod \"eb526886-06ef-4f1d-bd1b-d3c81ff2e10f\" (UID: \"eb526886-06ef-4f1d-bd1b-d3c81ff2e10f\") " Oct 30 09:05:05.307478 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:05.307420 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/eb526886-06ef-4f1d-bd1b-d3c81ff2e10f-kube-api-access-5m9gb\" (UniqueName: \"kubernetes.io/projected/eb526886-06ef-4f1d-bd1b-d3c81ff2e10f-kube-api-access-5m9gb\") pod \"eb526886-06ef-4f1d-bd1b-d3c81ff2e10f\" (UID: \"eb526886-06ef-4f1d-bd1b-d3c81ff2e10f\") " Oct 30 09:05:05.307668 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:05.307635 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb526886-06ef-4f1d-bd1b-d3c81ff2e10f-maas-api-openshift-ca" pod "eb526886-06ef-4f1d-bd1b-d3c81ff2e10f" (UID: "eb526886-06ef-4f1d-bd1b-d3c81ff2e10f"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 09:05:05.307802 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:05.307778 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eb526886-06ef-4f1d-bd1b-d3c81ff2e10f-maas-api-openshift-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:05:05.309402 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:05.309360 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb526886-06ef-4f1d-bd1b-d3c81ff2e10f-maas-api-xks-ca" pod "eb526886-06ef-4f1d-bd1b-d3c81ff2e10f" (UID: "eb526886-06ef-4f1d-bd1b-d3c81ff2e10f"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 09:05:05.309570 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:05.309548 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb526886-06ef-4f1d-bd1b-d3c81ff2e10f-kube-api-access-5m9gb" pod "eb526886-06ef-4f1d-bd1b-d3c81ff2e10f" (UID: "eb526886-06ef-4f1d-bd1b-d3c81ff2e10f"). InnerVolumeSpecName "kube-api-access-5m9gb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 09:05:05.408889 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:05.408861 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5m9gb\" (UniqueName: \"kubernetes.io/projected/eb526886-06ef-4f1d-bd1b-d3c81ff2e10f-kube-api-access-5m9gb\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:05:05.408889 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:05.408885 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eb526886-06ef-4f1d-bd1b-d3c81ff2e10f-maas-api-xks-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:05:06.026892 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:06.026860 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-9p2l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Oct 30 09:05:06.027056 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:06.026915 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" podUID="5bffb6ff-3933-4688-ac60-835c70b0ce3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Oct 30 09:05:06.044638 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:06.044610 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8c66181f-9hrm9" Oct 30 09:05:06.044752 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:06.044648 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8c66181f-9hrm9" event={"ID":"eb526886-06ef-4f1d-bd1b-d3c81ff2e10f","Type":"ContainerDied","Data":"606087eb40e73ee4e4142eb3e9518ade8d41cb916aeaf86333dfaafe69a7bbe0"} Oct 30 09:05:06.044752 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:06.044700 5028 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="606087eb40e73ee4e4142eb3e9518ade8d41cb916aeaf86333dfaafe69a7bbe0" Oct 30 09:05:07.026621 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:07.026588 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-9p2l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Oct 30 09:05:07.026808 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:07.026648 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" podUID="5bffb6ff-3933-4688-ac60-835c70b0ce3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Oct 30 09:05:08.026881 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:08.026849 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-9p2l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Oct 30 09:05:08.027263 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:08.026898 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" podUID="5bffb6ff-3933-4688-ac60-835c70b0ce3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Oct 30 09:05:09.026730 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:09.026689 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-9p2l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Oct 30 09:05:09.026917 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:09.026746 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" podUID="5bffb6ff-3933-4688-ac60-835c70b0ce3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Oct 30 09:05:10.026881 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:10.026842 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-9p2l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body= Oct 30 09:05:10.027031 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:10.026907 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" podUID="5bffb6ff-3933-4688-ac60-835c70b0ce3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" Oct 30 09:05:10.151024 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:10.150991 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e48ea3c5-qx9h2"] Oct 30 09:05:10.151710 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:10.151685 5028 cpu_manager.go:414] "containerMap: removing container" podUID="eb526886-06ef-4f1d-bd1b-d3c81ff2e10f" containerName="revoke-keys" Oct 30 09:05:10.151710 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:10.151709 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="eb526886-06ef-4f1d-bd1b-d3c81ff2e10f" containerName="revoke-keys" Oct 30 09:05:10.151885 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:10.151834 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="eb526886-06ef-4f1d-bd1b-d3c81ff2e10f" containerName="revoke-keys" Oct 30 09:05:10.156717 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:10.156694 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e48ea3c5-qx9h2" Oct 30 09:05:10.172809 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:10.172783 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e48ea3c5-qx9h2"] Oct 30 09:05:10.194605 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:10.194575 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kdwkr\"" Oct 30 09:05:10.194922 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:10.194886 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 09:05:10.251713 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:10.251690 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ee0da264-db9e-4b62-8b8f-fbdad0319de9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e48ea3c5-qx9h2\" (UID: \"ee0da264-db9e-4b62-8b8f-fbdad0319de9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e48ea3c5-qx9h2" Oct 30 09:05:10.251830 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:10.251740 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w75gh\" (UniqueName: \"kubernetes.io/projected/ee0da264-db9e-4b62-8b8f-fbdad0319de9-kube-api-access-w75gh\") pod \"maas-api-revoke-sub-e48ea3c5-qx9h2\" (UID: \"ee0da264-db9e-4b62-8b8f-fbdad0319de9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e48ea3c5-qx9h2" Oct 30 09:05:10.251830 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:10.251777 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ee0da264-db9e-4b62-8b8f-fbdad0319de9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e48ea3c5-qx9h2\" (UID: \"ee0da264-db9e-4b62-8b8f-fbdad0319de9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e48ea3c5-qx9h2" Oct 30 09:05:10.352360 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:10.352324 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ee0da264-db9e-4b62-8b8f-fbdad0319de9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e48ea3c5-qx9h2\" (UID: \"ee0da264-db9e-4b62-8b8f-fbdad0319de9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e48ea3c5-qx9h2" Oct 30 09:05:10.352503 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:10.352400 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w75gh\" (UniqueName: \"kubernetes.io/projected/ee0da264-db9e-4b62-8b8f-fbdad0319de9-kube-api-access-w75gh\") pod \"maas-api-revoke-sub-e48ea3c5-qx9h2\" (UID: \"ee0da264-db9e-4b62-8b8f-fbdad0319de9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e48ea3c5-qx9h2" Oct 30 09:05:10.352503 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:10.352440 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ee0da264-db9e-4b62-8b8f-fbdad0319de9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e48ea3c5-qx9h2\" (UID: \"ee0da264-db9e-4b62-8b8f-fbdad0319de9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e48ea3c5-qx9h2" Oct 30 09:05:10.353156 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:10.353133 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ee0da264-db9e-4b62-8b8f-fbdad0319de9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e48ea3c5-qx9h2\" (UID: \"ee0da264-db9e-4b62-8b8f-fbdad0319de9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e48ea3c5-qx9h2" Oct 30 09:05:10.355176 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:10.355158 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ee0da264-db9e-4b62-8b8f-fbdad0319de9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e48ea3c5-qx9h2\" (UID: \"ee0da264-db9e-4b62-8b8f-fbdad0319de9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e48ea3c5-qx9h2" Oct 30 09:05:10.375326 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:10.375297 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w75gh\" (UniqueName: \"kubernetes.io/projected/ee0da264-db9e-4b62-8b8f-fbdad0319de9-kube-api-access-w75gh\") pod \"maas-api-revoke-sub-e48ea3c5-qx9h2\" (UID: \"ee0da264-db9e-4b62-8b8f-fbdad0319de9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e48ea3c5-qx9h2" Oct 30 09:05:10.476816 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:10.476795 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e48ea3c5-qx9h2" Oct 30 09:05:10.792492 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:10.792399 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e48ea3c5-qx9h2"] Oct 30 09:05:10.797689 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:05:10.796800 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee0da264_db9e_4b62_8b8f_fbdad0319de9.slice/crio-7df3d6f29118a8dc2ff0621351742cda88e114f7cdf4d2a7cee5e7f0bd8b44ec WatchSource:0}: Error finding container 7df3d6f29118a8dc2ff0621351742cda88e114f7cdf4d2a7cee5e7f0bd8b44ec: Status 404 returned error can't find the container with id 7df3d6f29118a8dc2ff0621351742cda88e114f7cdf4d2a7cee5e7f0bd8b44ec Oct 30 09:05:11.078466 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:11.078427 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e48ea3c5-qx9h2" event={"ID":"ee0da264-db9e-4b62-8b8f-fbdad0319de9","Type":"ContainerStarted","Data":"7df3d6f29118a8dc2ff0621351742cda88e114f7cdf4d2a7cee5e7f0bd8b44ec"} Oct 30 09:05:11.215262 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:11.215236 5028 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:11.216314 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:11.216296 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:11.216959 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:11.216941 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-9p2l5" Oct 30 09:05:12.086384 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:12.086350 5028 generic.go:356] "Generic (PLEG): container finished" podID="ee0da264-db9e-4b62-8b8f-fbdad0319de9" containerID="588e7895f9a44111ab4c7c64b70d72c18026e9c15b8cac7d529ef1356e4b6e3d" exitCode=0 Oct 30 09:05:12.086864 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:12.086432 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e48ea3c5-qx9h2" event={"ID":"ee0da264-db9e-4b62-8b8f-fbdad0319de9","Type":"ContainerDied","Data":"588e7895f9a44111ab4c7c64b70d72c18026e9c15b8cac7d529ef1356e4b6e3d"} Oct 30 09:05:12.741851 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:05:12.741812 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 09:05:13.319289 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:13.319258 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e48ea3c5-qx9h2" Oct 30 09:05:13.416705 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:13.388819 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ee0da264-db9e-4b62-8b8f-fbdad0319de9-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ee0da264-db9e-4b62-8b8f-fbdad0319de9-maas-api-openshift-ca\") pod \"ee0da264-db9e-4b62-8b8f-fbdad0319de9\" (UID: \"ee0da264-db9e-4b62-8b8f-fbdad0319de9\") " Oct 30 09:05:13.416705 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:13.388893 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ee0da264-db9e-4b62-8b8f-fbdad0319de9-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ee0da264-db9e-4b62-8b8f-fbdad0319de9-maas-api-xks-ca\") pod \"ee0da264-db9e-4b62-8b8f-fbdad0319de9\" (UID: \"ee0da264-db9e-4b62-8b8f-fbdad0319de9\") " Oct 30 09:05:13.416705 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:13.388973 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ee0da264-db9e-4b62-8b8f-fbdad0319de9-kube-api-access-w75gh\" (UniqueName: \"kubernetes.io/projected/ee0da264-db9e-4b62-8b8f-fbdad0319de9-kube-api-access-w75gh\") pod \"ee0da264-db9e-4b62-8b8f-fbdad0319de9\" (UID: \"ee0da264-db9e-4b62-8b8f-fbdad0319de9\") " Oct 30 09:05:13.416705 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:13.389693 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee0da264-db9e-4b62-8b8f-fbdad0319de9-maas-api-openshift-ca" pod "ee0da264-db9e-4b62-8b8f-fbdad0319de9" (UID: "ee0da264-db9e-4b62-8b8f-fbdad0319de9"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 09:05:13.416705 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:13.392422 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee0da264-db9e-4b62-8b8f-fbdad0319de9-maas-api-xks-ca" pod "ee0da264-db9e-4b62-8b8f-fbdad0319de9" (UID: "ee0da264-db9e-4b62-8b8f-fbdad0319de9"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 09:05:13.416705 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:13.392541 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee0da264-db9e-4b62-8b8f-fbdad0319de9-kube-api-access-w75gh" pod "ee0da264-db9e-4b62-8b8f-fbdad0319de9" (UID: "ee0da264-db9e-4b62-8b8f-fbdad0319de9"). InnerVolumeSpecName "kube-api-access-w75gh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 09:05:13.490382 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:13.490347 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ee0da264-db9e-4b62-8b8f-fbdad0319de9-maas-api-openshift-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:05:13.490382 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:13.490383 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ee0da264-db9e-4b62-8b8f-fbdad0319de9-maas-api-xks-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:05:13.490659 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:13.490399 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w75gh\" (UniqueName: \"kubernetes.io/projected/ee0da264-db9e-4b62-8b8f-fbdad0319de9-kube-api-access-w75gh\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:05:14.133230 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:14.130501 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e48ea3c5-qx9h2" event={"ID":"ee0da264-db9e-4b62-8b8f-fbdad0319de9","Type":"ContainerDied","Data":"7df3d6f29118a8dc2ff0621351742cda88e114f7cdf4d2a7cee5e7f0bd8b44ec"} Oct 30 09:05:14.133230 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:14.130567 5028 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7df3d6f29118a8dc2ff0621351742cda88e114f7cdf4d2a7cee5e7f0bd8b44ec" Oct 30 09:05:14.133230 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:14.130642 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e48ea3c5-qx9h2" Oct 30 09:05:20.510709 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:20.510671 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-701d685b-klbj7"] Oct 30 09:05:20.595233 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:20.571523 5028 cpu_manager.go:414] "containerMap: removing container" podUID="ee0da264-db9e-4b62-8b8f-fbdad0319de9" containerName="revoke-keys" Oct 30 09:05:20.622283 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:20.622250 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ee0da264-db9e-4b62-8b8f-fbdad0319de9" containerName="revoke-keys" Oct 30 09:05:20.639608 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:20.622599 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="ee0da264-db9e-4b62-8b8f-fbdad0319de9" containerName="revoke-keys" Oct 30 09:05:20.641548 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:20.641421 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-701d685b-klbj7"] Oct 30 09:05:20.641725 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:20.641518 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-701d685b-klbj7" Oct 30 09:05:20.661306 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:20.661285 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 09:05:20.662843 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:20.662824 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kdwkr\"" Oct 30 09:05:20.798681 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:20.798571 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9gp5\" (UniqueName: \"kubernetes.io/projected/8750959f-3214-4001-9794-54686f35ef87-kube-api-access-t9gp5\") pod \"maas-api-revoke-sub-701d685b-klbj7\" (UID: \"8750959f-3214-4001-9794-54686f35ef87\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-701d685b-klbj7" Oct 30 09:05:20.798860 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:20.798736 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8750959f-3214-4001-9794-54686f35ef87-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-701d685b-klbj7\" (UID: \"8750959f-3214-4001-9794-54686f35ef87\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-701d685b-klbj7" Oct 30 09:05:20.798935 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:20.798887 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8750959f-3214-4001-9794-54686f35ef87-maas-api-xks-ca\") pod \"maas-api-revoke-sub-701d685b-klbj7\" (UID: \"8750959f-3214-4001-9794-54686f35ef87\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-701d685b-klbj7" Oct 30 09:05:20.899543 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:20.899510 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8750959f-3214-4001-9794-54686f35ef87-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-701d685b-klbj7\" (UID: \"8750959f-3214-4001-9794-54686f35ef87\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-701d685b-klbj7" Oct 30 09:05:20.899728 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:20.899584 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8750959f-3214-4001-9794-54686f35ef87-maas-api-xks-ca\") pod \"maas-api-revoke-sub-701d685b-klbj7\" (UID: \"8750959f-3214-4001-9794-54686f35ef87\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-701d685b-klbj7" Oct 30 09:05:20.899728 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:20.899691 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9gp5\" (UniqueName: \"kubernetes.io/projected/8750959f-3214-4001-9794-54686f35ef87-kube-api-access-t9gp5\") pod \"maas-api-revoke-sub-701d685b-klbj7\" (UID: \"8750959f-3214-4001-9794-54686f35ef87\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-701d685b-klbj7" Oct 30 09:05:20.900334 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:20.900312 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8750959f-3214-4001-9794-54686f35ef87-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-701d685b-klbj7\" (UID: \"8750959f-3214-4001-9794-54686f35ef87\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-701d685b-klbj7" Oct 30 09:05:20.902012 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:20.901987 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8750959f-3214-4001-9794-54686f35ef87-maas-api-xks-ca\") pod \"maas-api-revoke-sub-701d685b-klbj7\" (UID: \"8750959f-3214-4001-9794-54686f35ef87\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-701d685b-klbj7" Oct 30 09:05:20.922866 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:20.922841 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9gp5\" (UniqueName: \"kubernetes.io/projected/8750959f-3214-4001-9794-54686f35ef87-kube-api-access-t9gp5\") pod \"maas-api-revoke-sub-701d685b-klbj7\" (UID: \"8750959f-3214-4001-9794-54686f35ef87\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-701d685b-klbj7" Oct 30 09:05:20.977911 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:20.977885 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-701d685b-klbj7" Oct 30 09:05:21.276329 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:21.276189 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-701d685b-klbj7"] Oct 30 09:05:21.279182 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:05:21.279159 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8750959f_3214_4001_9794_54686f35ef87.slice/crio-741bf825700b5321de3451f4005d01de37690b3abf43a973d8ba1d00313db9a7 WatchSource:0}: Error finding container 741bf825700b5321de3451f4005d01de37690b3abf43a973d8ba1d00313db9a7: Status 404 returned error can't find the container with id 741bf825700b5321de3451f4005d01de37690b3abf43a973d8ba1d00313db9a7 Oct 30 09:05:22.256282 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:22.256244 5028 generic.go:356] "Generic (PLEG): container finished" podID="8750959f-3214-4001-9794-54686f35ef87" containerID="55e71fe5a1a05f0f542d31d862c6c06eeb90b9fa06cfbff1ba31e4b87032cba3" exitCode=0 Oct 30 09:05:22.256590 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:22.256320 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-701d685b-klbj7" event={"ID":"8750959f-3214-4001-9794-54686f35ef87","Type":"ContainerDied","Data":"55e71fe5a1a05f0f542d31d862c6c06eeb90b9fa06cfbff1ba31e4b87032cba3"} Oct 30 09:05:22.256590 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:22.256374 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-701d685b-klbj7" event={"ID":"8750959f-3214-4001-9794-54686f35ef87","Type":"ContainerStarted","Data":"741bf825700b5321de3451f4005d01de37690b3abf43a973d8ba1d00313db9a7"} Oct 30 09:05:23.395667 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:23.395639 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-701d685b-klbj7" Oct 30 09:05:23.522313 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:23.522224 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8750959f-3214-4001-9794-54686f35ef87-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8750959f-3214-4001-9794-54686f35ef87-maas-api-openshift-ca\") pod \"8750959f-3214-4001-9794-54686f35ef87\" (UID: \"8750959f-3214-4001-9794-54686f35ef87\") " Oct 30 09:05:23.522313 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:23.522308 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8750959f-3214-4001-9794-54686f35ef87-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8750959f-3214-4001-9794-54686f35ef87-maas-api-xks-ca\") pod \"8750959f-3214-4001-9794-54686f35ef87\" (UID: \"8750959f-3214-4001-9794-54686f35ef87\") " Oct 30 09:05:23.522537 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:23.522359 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8750959f-3214-4001-9794-54686f35ef87-kube-api-access-t9gp5\" (UniqueName: \"kubernetes.io/projected/8750959f-3214-4001-9794-54686f35ef87-kube-api-access-t9gp5\") pod \"8750959f-3214-4001-9794-54686f35ef87\" (UID: \"8750959f-3214-4001-9794-54686f35ef87\") " Oct 30 09:05:23.522594 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:23.522544 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8750959f-3214-4001-9794-54686f35ef87-maas-api-openshift-ca" pod "8750959f-3214-4001-9794-54686f35ef87" (UID: "8750959f-3214-4001-9794-54686f35ef87"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 09:05:23.522661 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:23.522645 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8750959f-3214-4001-9794-54686f35ef87-maas-api-openshift-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:05:23.524422 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:23.524390 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8750959f-3214-4001-9794-54686f35ef87-kube-api-access-t9gp5" pod "8750959f-3214-4001-9794-54686f35ef87" (UID: "8750959f-3214-4001-9794-54686f35ef87"). InnerVolumeSpecName "kube-api-access-t9gp5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 09:05:23.524544 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:23.524528 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8750959f-3214-4001-9794-54686f35ef87-maas-api-xks-ca" pod "8750959f-3214-4001-9794-54686f35ef87" (UID: "8750959f-3214-4001-9794-54686f35ef87"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 09:05:23.624122 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:23.624091 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8750959f-3214-4001-9794-54686f35ef87-maas-api-xks-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:05:23.624122 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:23.624115 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9gp5\" (UniqueName: \"kubernetes.io/projected/8750959f-3214-4001-9794-54686f35ef87-kube-api-access-t9gp5\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:05:24.269552 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:24.269471 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-701d685b-klbj7" event={"ID":"8750959f-3214-4001-9794-54686f35ef87","Type":"ContainerDied","Data":"741bf825700b5321de3451f4005d01de37690b3abf43a973d8ba1d00313db9a7"} Oct 30 09:05:24.269552 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:24.269521 5028 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="741bf825700b5321de3451f4005d01de37690b3abf43a973d8ba1d00313db9a7" Oct 30 09:05:24.269552 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:24.269518 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-701d685b-klbj7" Oct 30 09:05:30.874845 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:30.874812 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-086e34f9-5nb7n"] Oct 30 09:05:30.875362 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:30.875343 5028 cpu_manager.go:414] "containerMap: removing container" podUID="8750959f-3214-4001-9794-54686f35ef87" containerName="revoke-keys" Oct 30 09:05:30.875456 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:30.875363 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8750959f-3214-4001-9794-54686f35ef87" containerName="revoke-keys" Oct 30 09:05:30.875505 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:30.875472 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="8750959f-3214-4001-9794-54686f35ef87" containerName="revoke-keys" Oct 30 09:05:30.878912 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:30.878893 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-086e34f9-5nb7n" Oct 30 09:05:30.893917 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:30.893880 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 09:05:30.895757 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:30.895726 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-086e34f9-5nb7n"] Oct 30 09:05:30.903672 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:30.903649 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kdwkr\"" Oct 30 09:05:30.986564 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:30.986532 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcjjz\" (UniqueName: \"kubernetes.io/projected/a47adb2a-e7a4-44ac-9af3-4be5a3316b15-kube-api-access-fcjjz\") pod \"maas-api-revoke-sub-086e34f9-5nb7n\" (UID: \"a47adb2a-e7a4-44ac-9af3-4be5a3316b15\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-086e34f9-5nb7n" Oct 30 09:05:30.986703 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:30.986573 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a47adb2a-e7a4-44ac-9af3-4be5a3316b15-maas-api-xks-ca\") pod \"maas-api-revoke-sub-086e34f9-5nb7n\" (UID: \"a47adb2a-e7a4-44ac-9af3-4be5a3316b15\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-086e34f9-5nb7n" Oct 30 09:05:30.986763 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:30.986699 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a47adb2a-e7a4-44ac-9af3-4be5a3316b15-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-086e34f9-5nb7n\" (UID: \"a47adb2a-e7a4-44ac-9af3-4be5a3316b15\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-086e34f9-5nb7n" Oct 30 09:05:31.087659 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:31.087625 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcjjz\" (UniqueName: \"kubernetes.io/projected/a47adb2a-e7a4-44ac-9af3-4be5a3316b15-kube-api-access-fcjjz\") pod \"maas-api-revoke-sub-086e34f9-5nb7n\" (UID: \"a47adb2a-e7a4-44ac-9af3-4be5a3316b15\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-086e34f9-5nb7n" Oct 30 09:05:31.087824 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:31.087662 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a47adb2a-e7a4-44ac-9af3-4be5a3316b15-maas-api-xks-ca\") pod \"maas-api-revoke-sub-086e34f9-5nb7n\" (UID: \"a47adb2a-e7a4-44ac-9af3-4be5a3316b15\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-086e34f9-5nb7n" Oct 30 09:05:31.087824 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:31.087710 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a47adb2a-e7a4-44ac-9af3-4be5a3316b15-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-086e34f9-5nb7n\" (UID: \"a47adb2a-e7a4-44ac-9af3-4be5a3316b15\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-086e34f9-5nb7n" Oct 30 09:05:31.088609 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:31.088586 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a47adb2a-e7a4-44ac-9af3-4be5a3316b15-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-086e34f9-5nb7n\" (UID: \"a47adb2a-e7a4-44ac-9af3-4be5a3316b15\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-086e34f9-5nb7n" Oct 30 09:05:31.089932 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:31.089904 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a47adb2a-e7a4-44ac-9af3-4be5a3316b15-maas-api-xks-ca\") pod \"maas-api-revoke-sub-086e34f9-5nb7n\" (UID: \"a47adb2a-e7a4-44ac-9af3-4be5a3316b15\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-086e34f9-5nb7n" Oct 30 09:05:31.110389 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:31.110366 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcjjz\" (UniqueName: \"kubernetes.io/projected/a47adb2a-e7a4-44ac-9af3-4be5a3316b15-kube-api-access-fcjjz\") pod \"maas-api-revoke-sub-086e34f9-5nb7n\" (UID: \"a47adb2a-e7a4-44ac-9af3-4be5a3316b15\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-086e34f9-5nb7n" Oct 30 09:05:31.197867 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:31.197804 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-086e34f9-5nb7n" Oct 30 09:05:31.496008 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:31.495977 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-086e34f9-5nb7n"] Oct 30 09:05:31.498849 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:05:31.498816 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda47adb2a_e7a4_44ac_9af3_4be5a3316b15.slice/crio-44c0e0a17b04fe7d9ceff90f9e730e093001c4dd2c929b2fca32ad0f90f0a35d WatchSource:0}: Error finding container 44c0e0a17b04fe7d9ceff90f9e730e093001c4dd2c929b2fca32ad0f90f0a35d: Status 404 returned error can't find the container with id 44c0e0a17b04fe7d9ceff90f9e730e093001c4dd2c929b2fca32ad0f90f0a35d Oct 30 09:05:32.318099 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:32.318062 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-086e34f9-5nb7n" event={"ID":"a47adb2a-e7a4-44ac-9af3-4be5a3316b15","Type":"ContainerStarted","Data":"6c441589d9e9cf036c1bdda7a6e1c48f6fc7f9ff7b5c402cdff4263a4e9bd64b"} Oct 30 09:05:32.318504 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:32.318115 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-086e34f9-5nb7n" event={"ID":"a47adb2a-e7a4-44ac-9af3-4be5a3316b15","Type":"ContainerStarted","Data":"44c0e0a17b04fe7d9ceff90f9e730e093001c4dd2c929b2fca32ad0f90f0a35d"} Oct 30 09:05:32.358922 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:32.358875 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-086e34f9-5nb7n" podStartSLOduration=2.358862195 podStartE2EDuration="2.358862195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 09:05:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 09:05:32.357490666 +0000 UTC m=+746.573603024" watchObservedRunningTime="2026-10-30 09:05:32.358862195 +0000 UTC m=+746.574974553" Oct 30 09:05:33.329784 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:33.329544 5028 generic.go:356] "Generic (PLEG): container finished" podID="a47adb2a-e7a4-44ac-9af3-4be5a3316b15" containerID="6c441589d9e9cf036c1bdda7a6e1c48f6fc7f9ff7b5c402cdff4263a4e9bd64b" exitCode=0 Oct 30 09:05:33.329784 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:33.329719 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-086e34f9-5nb7n" event={"ID":"a47adb2a-e7a4-44ac-9af3-4be5a3316b15","Type":"ContainerDied","Data":"6c441589d9e9cf036c1bdda7a6e1c48f6fc7f9ff7b5c402cdff4263a4e9bd64b"} Oct 30 09:05:35.120225 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:35.116893 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-086e34f9-5nb7n" Oct 30 09:05:35.203229 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:35.166759 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a47adb2a-e7a4-44ac-9af3-4be5a3316b15-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a47adb2a-e7a4-44ac-9af3-4be5a3316b15-maas-api-openshift-ca\") pod \"a47adb2a-e7a4-44ac-9af3-4be5a3316b15\" (UID: \"a47adb2a-e7a4-44ac-9af3-4be5a3316b15\") " Oct 30 09:05:35.203229 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:35.166845 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a47adb2a-e7a4-44ac-9af3-4be5a3316b15-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a47adb2a-e7a4-44ac-9af3-4be5a3316b15-maas-api-xks-ca\") pod \"a47adb2a-e7a4-44ac-9af3-4be5a3316b15\" (UID: \"a47adb2a-e7a4-44ac-9af3-4be5a3316b15\") " Oct 30 09:05:35.203229 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:35.166952 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a47adb2a-e7a4-44ac-9af3-4be5a3316b15-kube-api-access-fcjjz\" (UniqueName: \"kubernetes.io/projected/a47adb2a-e7a4-44ac-9af3-4be5a3316b15-kube-api-access-fcjjz\") pod \"a47adb2a-e7a4-44ac-9af3-4be5a3316b15\" (UID: \"a47adb2a-e7a4-44ac-9af3-4be5a3316b15\") " Oct 30 09:05:35.265242 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:35.265182 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a47adb2a-e7a4-44ac-9af3-4be5a3316b15-maas-api-openshift-ca" pod "a47adb2a-e7a4-44ac-9af3-4be5a3316b15" (UID: "a47adb2a-e7a4-44ac-9af3-4be5a3316b15"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 09:05:35.268278 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:35.268243 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a47adb2a-e7a4-44ac-9af3-4be5a3316b15-maas-api-openshift-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:05:35.268530 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:35.268496 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a47adb2a-e7a4-44ac-9af3-4be5a3316b15-maas-api-xks-ca" pod "a47adb2a-e7a4-44ac-9af3-4be5a3316b15" (UID: "a47adb2a-e7a4-44ac-9af3-4be5a3316b15"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 09:05:35.283359 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:35.283317 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a47adb2a-e7a4-44ac-9af3-4be5a3316b15-kube-api-access-fcjjz" pod "a47adb2a-e7a4-44ac-9af3-4be5a3316b15" (UID: "a47adb2a-e7a4-44ac-9af3-4be5a3316b15"). InnerVolumeSpecName "kube-api-access-fcjjz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 09:05:35.398227 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:35.383077 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcjjz\" (UniqueName: \"kubernetes.io/projected/a47adb2a-e7a4-44ac-9af3-4be5a3316b15-kube-api-access-fcjjz\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:05:35.448324 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:35.448274 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a47adb2a-e7a4-44ac-9af3-4be5a3316b15-maas-api-xks-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:05:35.448512 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:35.419270 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-086e34f9-5nb7n" Oct 30 09:05:35.457221 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:35.419159 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-086e34f9-5nb7n" event={"ID":"a47adb2a-e7a4-44ac-9af3-4be5a3316b15","Type":"ContainerDied","Data":"44c0e0a17b04fe7d9ceff90f9e730e093001c4dd2c929b2fca32ad0f90f0a35d"} Oct 30 09:05:35.457221 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:35.456292 5028 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="44c0e0a17b04fe7d9ceff90f9e730e093001c4dd2c929b2fca32ad0f90f0a35d" Oct 30 09:05:41.254938 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:41.254906 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-1058f3ff-q48n2"] Oct 30 09:05:41.255578 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:41.255557 5028 cpu_manager.go:414] "containerMap: removing container" podUID="a47adb2a-e7a4-44ac-9af3-4be5a3316b15" containerName="revoke-keys" Oct 30 09:05:41.255674 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:41.255580 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a47adb2a-e7a4-44ac-9af3-4be5a3316b15" containerName="revoke-keys" Oct 30 09:05:41.255734 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:41.255704 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="a47adb2a-e7a4-44ac-9af3-4be5a3316b15" containerName="revoke-keys" Oct 30 09:05:41.259349 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:41.259325 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1058f3ff-q48n2" Oct 30 09:05:41.277009 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:41.276984 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-1058f3ff-q48n2"] Oct 30 09:05:41.284768 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:41.284748 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 09:05:41.284768 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:41.284740 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kdwkr\"" Oct 30 09:05:41.448510 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:41.448472 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ae20e5ce-54be-4899-97c3-3424924dfb62-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-1058f3ff-q48n2\" (UID: \"ae20e5ce-54be-4899-97c3-3424924dfb62\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1058f3ff-q48n2" Oct 30 09:05:41.448510 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:41.448514 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk4zw\" (UniqueName: \"kubernetes.io/projected/ae20e5ce-54be-4899-97c3-3424924dfb62-kube-api-access-zk4zw\") pod \"maas-api-revoke-sub-1058f3ff-q48n2\" (UID: \"ae20e5ce-54be-4899-97c3-3424924dfb62\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1058f3ff-q48n2" Oct 30 09:05:41.448767 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:41.448589 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ae20e5ce-54be-4899-97c3-3424924dfb62-maas-api-xks-ca\") pod \"maas-api-revoke-sub-1058f3ff-q48n2\" (UID: \"ae20e5ce-54be-4899-97c3-3424924dfb62\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1058f3ff-q48n2" Oct 30 09:05:41.550080 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:41.550002 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ae20e5ce-54be-4899-97c3-3424924dfb62-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-1058f3ff-q48n2\" (UID: \"ae20e5ce-54be-4899-97c3-3424924dfb62\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1058f3ff-q48n2" Oct 30 09:05:41.550080 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:41.550038 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk4zw\" (UniqueName: \"kubernetes.io/projected/ae20e5ce-54be-4899-97c3-3424924dfb62-kube-api-access-zk4zw\") pod \"maas-api-revoke-sub-1058f3ff-q48n2\" (UID: \"ae20e5ce-54be-4899-97c3-3424924dfb62\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1058f3ff-q48n2" Oct 30 09:05:41.550080 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:41.550077 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ae20e5ce-54be-4899-97c3-3424924dfb62-maas-api-xks-ca\") pod \"maas-api-revoke-sub-1058f3ff-q48n2\" (UID: \"ae20e5ce-54be-4899-97c3-3424924dfb62\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1058f3ff-q48n2" Oct 30 09:05:41.550661 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:41.550642 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ae20e5ce-54be-4899-97c3-3424924dfb62-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-1058f3ff-q48n2\" (UID: \"ae20e5ce-54be-4899-97c3-3424924dfb62\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1058f3ff-q48n2" Oct 30 09:05:41.552445 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:41.552426 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ae20e5ce-54be-4899-97c3-3424924dfb62-maas-api-xks-ca\") pod \"maas-api-revoke-sub-1058f3ff-q48n2\" (UID: \"ae20e5ce-54be-4899-97c3-3424924dfb62\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1058f3ff-q48n2" Oct 30 09:05:41.572616 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:41.572593 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk4zw\" (UniqueName: \"kubernetes.io/projected/ae20e5ce-54be-4899-97c3-3424924dfb62-kube-api-access-zk4zw\") pod \"maas-api-revoke-sub-1058f3ff-q48n2\" (UID: \"ae20e5ce-54be-4899-97c3-3424924dfb62\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1058f3ff-q48n2" Oct 30 09:05:41.872708 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:41.872669 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1058f3ff-q48n2" Oct 30 09:05:42.180047 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:42.179866 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-1058f3ff-q48n2"] Oct 30 09:05:42.182958 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:05:42.182922 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae20e5ce_54be_4899_97c3_3424924dfb62.slice/crio-7e7bd883606cf5c95ec82609310e3bd5a4520186fa9b3dc2042da209d9044b54 WatchSource:0}: Error finding container 7e7bd883606cf5c95ec82609310e3bd5a4520186fa9b3dc2042da209d9044b54: Status 404 returned error can't find the container with id 7e7bd883606cf5c95ec82609310e3bd5a4520186fa9b3dc2042da209d9044b54 Oct 30 09:05:42.460165 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:42.460099 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1058f3ff-q48n2" event={"ID":"ae20e5ce-54be-4899-97c3-3424924dfb62","Type":"ContainerStarted","Data":"7e7bd883606cf5c95ec82609310e3bd5a4520186fa9b3dc2042da209d9044b54"} Oct 30 09:05:42.742197 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:05:42.742122 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 09:05:43.473232 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:43.473072 5028 generic.go:356] "Generic (PLEG): container finished" podID="ae20e5ce-54be-4899-97c3-3424924dfb62" containerID="7609243a0717976ff954b49179fe65908cb7bceb023112448ce237bb385a4ef7" exitCode=0 Oct 30 09:05:43.473774 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:43.473577 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1058f3ff-q48n2" event={"ID":"ae20e5ce-54be-4899-97c3-3424924dfb62","Type":"ContainerDied","Data":"7609243a0717976ff954b49179fe65908cb7bceb023112448ce237bb385a4ef7"} Oct 30 09:05:45.370670 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:45.370642 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1058f3ff-q48n2" Oct 30 09:05:45.550284 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:45.536838 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ae20e5ce-54be-4899-97c3-3424924dfb62-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ae20e5ce-54be-4899-97c3-3424924dfb62-maas-api-xks-ca\") pod \"ae20e5ce-54be-4899-97c3-3424924dfb62\" (UID: \"ae20e5ce-54be-4899-97c3-3424924dfb62\") " Oct 30 09:05:45.609335 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:45.609293 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ae20e5ce-54be-4899-97c3-3424924dfb62-kube-api-access-zk4zw\" (UniqueName: \"kubernetes.io/projected/ae20e5ce-54be-4899-97c3-3424924dfb62-kube-api-access-zk4zw\") pod \"ae20e5ce-54be-4899-97c3-3424924dfb62\" (UID: \"ae20e5ce-54be-4899-97c3-3424924dfb62\") " Oct 30 09:05:45.610085 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:45.610061 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ae20e5ce-54be-4899-97c3-3424924dfb62-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ae20e5ce-54be-4899-97c3-3424924dfb62-maas-api-openshift-ca\") pod \"ae20e5ce-54be-4899-97c3-3424924dfb62\" (UID: \"ae20e5ce-54be-4899-97c3-3424924dfb62\") " Oct 30 09:05:45.626584 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:45.626541 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae20e5ce-54be-4899-97c3-3424924dfb62-maas-api-xks-ca" pod "ae20e5ce-54be-4899-97c3-3424924dfb62" (UID: "ae20e5ce-54be-4899-97c3-3424924dfb62"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 09:05:45.660229 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:45.637388 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae20e5ce-54be-4899-97c3-3424924dfb62-maas-api-openshift-ca" pod "ae20e5ce-54be-4899-97c3-3424924dfb62" (UID: "ae20e5ce-54be-4899-97c3-3424924dfb62"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 09:05:45.660229 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:45.650224 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae20e5ce-54be-4899-97c3-3424924dfb62-kube-api-access-zk4zw" pod "ae20e5ce-54be-4899-97c3-3424924dfb62" (UID: "ae20e5ce-54be-4899-97c3-3424924dfb62"). InnerVolumeSpecName "kube-api-access-zk4zw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 09:05:45.701223 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:45.686313 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1058f3ff-q48n2" event={"ID":"ae20e5ce-54be-4899-97c3-3424924dfb62","Type":"ContainerDied","Data":"7e7bd883606cf5c95ec82609310e3bd5a4520186fa9b3dc2042da209d9044b54"} Oct 30 09:05:45.701223 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:45.686371 5028 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e7bd883606cf5c95ec82609310e3bd5a4520186fa9b3dc2042da209d9044b54" Oct 30 09:05:45.701223 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:45.686444 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1058f3ff-q48n2" Oct 30 09:05:45.721831 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:45.721806 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ae20e5ce-54be-4899-97c3-3424924dfb62-maas-api-xks-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:05:45.722020 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:45.722002 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zk4zw\" (UniqueName: \"kubernetes.io/projected/ae20e5ce-54be-4899-97c3-3424924dfb62-kube-api-access-zk4zw\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:05:45.722134 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:45.722119 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ae20e5ce-54be-4899-97c3-3424924dfb62-maas-api-openshift-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:05:56.427286 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:56.426328 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-dr8ns container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 09:05:56.427286 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:05:56.426429 5028 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" podUID="22314808-f2ad-49af-9cd2-f2f90f33b795" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 09:06:05.928540 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:05.928508 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5"] Oct 30 09:06:05.929067 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:05.929040 5028 cpu_manager.go:414] "containerMap: removing container" podUID="ae20e5ce-54be-4899-97c3-3424924dfb62" containerName="revoke-keys" Oct 30 09:06:05.929067 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:05.929060 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ae20e5ce-54be-4899-97c3-3424924dfb62" containerName="revoke-keys" Oct 30 09:06:05.929253 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:05.929236 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="ae20e5ce-54be-4899-97c3-3424924dfb62" containerName="revoke-keys" Oct 30 09:06:05.933107 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:05.933082 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" Oct 30 09:06:05.954821 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:05.954791 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5"] Oct 30 09:06:05.961841 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:05.961792 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"grid-inv-4a3d3cdd-unmatched-kserve-self-signed-certs\"" Oct 30 09:06:06.010043 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:06.010020 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-tmp-dir\") pod \"grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5\" (UID: \"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6\") " pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" Oct 30 09:06:06.010219 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:06.010056 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-tls-certs\") pod \"grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5\" (UID: \"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6\") " pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" Oct 30 09:06:06.010219 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:06.010078 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-dshm\") pod \"grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5\" (UID: \"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6\") " pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" Oct 30 09:06:06.010319 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:06.010249 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql7nt\" (UniqueName: \"kubernetes.io/projected/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-kube-api-access-ql7nt\") pod \"grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5\" (UID: \"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6\") " pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" Oct 30 09:06:06.010319 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:06.010280 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-home\") pod \"grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5\" (UID: \"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6\") " pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" Oct 30 09:06:06.010424 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:06.010325 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-model-cache\") pod \"grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5\" (UID: \"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6\") " pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" Oct 30 09:06:06.111716 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:06.111690 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-model-cache\") pod \"grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5\" (UID: \"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6\") " pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" Oct 30 09:06:06.111877 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:06.111755 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-tmp-dir\") pod \"grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5\" (UID: \"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6\") " pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" Oct 30 09:06:06.111877 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:06.111789 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-tls-certs\") pod \"grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5\" (UID: \"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6\") " pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" Oct 30 09:06:06.111877 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:06.111809 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-dshm\") pod \"grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5\" (UID: \"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6\") " pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" Oct 30 09:06:06.112059 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:06.111902 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql7nt\" (UniqueName: \"kubernetes.io/projected/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-kube-api-access-ql7nt\") pod \"grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5\" (UID: \"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6\") " pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" Oct 30 09:06:06.112059 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:06.111928 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-home\") pod \"grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5\" (UID: \"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6\") " pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" Oct 30 09:06:06.112813 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:06.112127 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-model-cache\") pod \"grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5\" (UID: \"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6\") " pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" Oct 30 09:06:06.112813 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:06.112200 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-tmp-dir\") pod \"grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5\" (UID: \"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6\") " pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" Oct 30 09:06:06.112813 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:06.112539 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-home\") pod \"grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5\" (UID: \"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6\") " pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" Oct 30 09:06:06.129145 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:06.127633 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-dshm\") pod \"grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5\" (UID: \"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6\") " pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" Oct 30 09:06:06.136409 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:06.131784 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-tls-certs\") pod \"grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5\" (UID: \"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6\") " pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" Oct 30 09:06:06.158155 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:06.158087 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql7nt\" (UniqueName: \"kubernetes.io/projected/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-kube-api-access-ql7nt\") pod \"grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5\" (UID: \"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6\") " pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" Oct 30 09:06:06.255390 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:06.255302 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" Oct 30 09:06:06.561519 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:06.561392 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5"] Oct 30 09:06:06.938505 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:06.937883 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" event={"ID":"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6","Type":"ContainerStarted","Data":"08ef42acd15499b7fcd591a9d60988807585968e99961cda45d9c227312bc0ad"} Oct 30 09:06:06.938505 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:06.937935 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" event={"ID":"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6","Type":"ContainerStarted","Data":"c63cb66b172867578ba90c59e9f4281e6e81ebdf1a3546f36170b77a031a1ca7"} Oct 30 09:06:06.983353 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:06.983279 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" podStartSLOduration=1.983257212 podStartE2EDuration="1.983257212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 09:06:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 09:06:06.978334794 +0000 UTC m=+781.194447177" watchObservedRunningTime="2026-10-30 09:06:06.983257212 +0000 UTC m=+781.199369571" Oct 30 09:06:07.255967 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:07.255876 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" Oct 30 09:06:12.897688 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:06:12.897646 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 09:06:16.255495 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:16.255466 5028 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" Oct 30 09:06:16.269346 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:16.269321 5028 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" Oct 30 09:06:17.116509 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:17.116472 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" Oct 30 09:06:31.563865 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.563828 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p"] Oct 30 09:06:31.567700 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.567677 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:31.588517 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.588493 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p"] Oct 30 09:06:31.595503 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.595480 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-main-7bd398-openshift-default-dockercfg-5fldg\"" Oct 30 09:06:31.727946 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.727904 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-workload-certs\") pod \"e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:31.728141 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.727966 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-istio-data\") pod \"e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:31.728141 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.728053 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a11bacf-f72d-4610-983b-de7f28351813-istiod-ca-cert\") pod \"e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:31.728303 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.728243 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-credential-socket\") pod \"e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:31.728303 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.728286 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-workload-socket\") pod \"e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:31.728413 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.728392 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a11bacf-f72d-4610-983b-de7f28351813-istio-podinfo\") pod \"e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:31.728472 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.728431 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a11bacf-f72d-4610-983b-de7f28351813-istio-token\") pod \"e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:31.728528 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.728483 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxrvl\" (UniqueName: \"kubernetes.io/projected/5a11bacf-f72d-4610-983b-de7f28351813-kube-api-access-wxrvl\") pod \"e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:31.728587 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.728543 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-istio-envoy\") pod \"e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:31.829920 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.829831 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a11bacf-f72d-4610-983b-de7f28351813-istiod-ca-cert\") pod \"e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:31.829920 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.829871 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-credential-socket\") pod \"e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:31.829920 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.829895 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-workload-socket\") pod \"e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:31.830200 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.829953 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a11bacf-f72d-4610-983b-de7f28351813-istio-podinfo\") pod \"e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:31.830200 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.829983 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a11bacf-f72d-4610-983b-de7f28351813-istio-token\") pod \"e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:31.830200 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.830120 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxrvl\" (UniqueName: \"kubernetes.io/projected/5a11bacf-f72d-4610-983b-de7f28351813-kube-api-access-wxrvl\") pod \"e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:31.830200 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.830179 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-istio-envoy\") pod \"e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:31.830462 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.830273 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-workload-certs\") pod \"e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:31.830462 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.830310 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-istio-data\") pod \"e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:31.830462 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.830332 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-credential-socket\") pod \"e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:31.830462 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.830401 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-workload-socket\") pod \"e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:31.830680 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.830642 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-istio-data\") pod \"e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:31.830738 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.830702 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-workload-certs\") pod \"e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:31.830796 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.830773 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a11bacf-f72d-4610-983b-de7f28351813-istiod-ca-cert\") pod \"e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:31.832375 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.832355 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-istio-envoy\") pod \"e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:31.832543 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.832525 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a11bacf-f72d-4610-983b-de7f28351813-istio-podinfo\") pod \"e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:31.852781 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.852753 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a11bacf-f72d-4610-983b-de7f28351813-istio-token\") pod \"e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:31.852931 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.852915 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxrvl\" (UniqueName: \"kubernetes.io/projected/5a11bacf-f72d-4610-983b-de7f28351813-kube-api-access-wxrvl\") pod \"e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:31.885227 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:31.883464 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:32.214116 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:32.214077 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p"] Oct 30 09:06:32.219378 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:06:32.219349 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a11bacf_f72d_4610_983b_de7f28351813.slice/crio-bcf70f926e2db226730d45713f800fdfe001472c38aa941812564f820fb9ad1d WatchSource:0}: Error finding container bcf70f926e2db226730d45713f800fdfe001472c38aa941812564f820fb9ad1d: Status 404 returned error can't find the container with id bcf70f926e2db226730d45713f800fdfe001472c38aa941812564f820fb9ad1d Oct 30 09:06:32.221426 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:32.221370 5028 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 09:06:32.221509 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:32.221453 5028 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 09:06:32.221509 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:32.221481 5028 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 09:06:33.196141 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:33.196103 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" event={"ID":"5a11bacf-f72d-4610-983b-de7f28351813","Type":"ContainerStarted","Data":"9c2f77cd1f4d1da693cbb3c9777a6c3d92b90aaafdc9b25d065057d985f748a2"} Oct 30 09:06:33.196630 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:33.196160 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" event={"ID":"5a11bacf-f72d-4610-983b-de7f28351813","Type":"ContainerStarted","Data":"bcf70f926e2db226730d45713f800fdfe001472c38aa941812564f820fb9ad1d"} Oct 30 09:06:33.253678 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:33.253618 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" podStartSLOduration=2.253603828 podStartE2EDuration="2.253603828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 09:06:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 09:06:33.251736694 +0000 UTC m=+807.467849051" watchObservedRunningTime="2026-10-30 09:06:33.253603828 +0000 UTC m=+807.469716185" Oct 30 09:06:33.884121 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:33.884087 5028 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:33.890031 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:33.890005 5028 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:34.201845 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:34.201764 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:34.202584 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:34.202568 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:37.670365 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:37.670326 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-main-7bd398-58947ff495wtps7"] Oct 30 09:06:37.674654 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:37.674630 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-7bd398-58947ff495wtps7" Oct 30 09:06:37.692052 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:37.692030 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-main-7bd398-58947ff495wtps7"] Oct 30 09:06:37.700595 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:37.700572 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-main-7bd398\"" Oct 30 09:06:37.700712 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:37.700655 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-main-7bd398-dockercfg-zzc87\"" Oct 30 09:06:37.791089 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:37.791029 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-main-7bd398-5cf77c9b9d-mqb7f"] Oct 30 09:06:37.796559 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:37.796525 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5w9d\" (UniqueName: \"kubernetes.io/projected/e3a795d8-9441-4ec2-9aa6-57075cbd7d55-kube-api-access-m5w9d\") pod \"payload-pre-processing-e2e-shared-a-main-7bd398-58947ff495wtps7\" (UID: \"e3a795d8-9441-4ec2-9aa6-57075cbd7d55\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-7bd398-58947ff495wtps7" Oct 30 09:06:37.796735 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:37.796570 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3a795d8-9441-4ec2-9aa6-57075cbd7d55-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-main-7bd398-58947ff495wtps7\" (UID: \"e3a795d8-9441-4ec2-9aa6-57075cbd7d55\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-7bd398-58947ff495wtps7" Oct 30 09:06:37.800797 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:37.800771 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-main-7bd398-5cf77c9b9d-mqb7f" Oct 30 09:06:37.804453 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:37.804423 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-main-7bd398-5cf77c9b9d-mqb7f"] Oct 30 09:06:37.897670 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:37.897640 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1da2960-1274-4bd6-8a08-8c3930b5d39d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-main-7bd398-5cf77c9b9d-mqb7f\" (UID: \"a1da2960-1274-4bd6-8a08-8c3930b5d39d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-main-7bd398-5cf77c9b9d-mqb7f" Oct 30 09:06:37.897797 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:37.897683 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlcnf\" (UniqueName: \"kubernetes.io/projected/a1da2960-1274-4bd6-8a08-8c3930b5d39d-kube-api-access-wlcnf\") pod \"payload-processing-e2e-shared-a-main-7bd398-5cf77c9b9d-mqb7f\" (UID: \"a1da2960-1274-4bd6-8a08-8c3930b5d39d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-main-7bd398-5cf77c9b9d-mqb7f" Oct 30 09:06:37.897842 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:37.897802 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5w9d\" (UniqueName: \"kubernetes.io/projected/e3a795d8-9441-4ec2-9aa6-57075cbd7d55-kube-api-access-m5w9d\") pod \"payload-pre-processing-e2e-shared-a-main-7bd398-58947ff495wtps7\" (UID: \"e3a795d8-9441-4ec2-9aa6-57075cbd7d55\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-7bd398-58947ff495wtps7" Oct 30 09:06:37.897842 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:37.897824 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3a795d8-9441-4ec2-9aa6-57075cbd7d55-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-main-7bd398-58947ff495wtps7\" (UID: \"e3a795d8-9441-4ec2-9aa6-57075cbd7d55\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-7bd398-58947ff495wtps7" Oct 30 09:06:37.898486 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:37.898467 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3a795d8-9441-4ec2-9aa6-57075cbd7d55-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-main-7bd398-58947ff495wtps7\" (UID: \"e3a795d8-9441-4ec2-9aa6-57075cbd7d55\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-7bd398-58947ff495wtps7" Oct 30 09:06:37.920621 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:37.920556 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5w9d\" (UniqueName: \"kubernetes.io/projected/e3a795d8-9441-4ec2-9aa6-57075cbd7d55-kube-api-access-m5w9d\") pod \"payload-pre-processing-e2e-shared-a-main-7bd398-58947ff495wtps7\" (UID: \"e3a795d8-9441-4ec2-9aa6-57075cbd7d55\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-7bd398-58947ff495wtps7" Oct 30 09:06:37.989181 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:37.989158 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-7bd398-58947ff495wtps7" Oct 30 09:06:37.998559 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:37.998534 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1da2960-1274-4bd6-8a08-8c3930b5d39d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-main-7bd398-5cf77c9b9d-mqb7f\" (UID: \"a1da2960-1274-4bd6-8a08-8c3930b5d39d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-main-7bd398-5cf77c9b9d-mqb7f" Oct 30 09:06:37.998650 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:37.998577 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlcnf\" (UniqueName: \"kubernetes.io/projected/a1da2960-1274-4bd6-8a08-8c3930b5d39d-kube-api-access-wlcnf\") pod \"payload-processing-e2e-shared-a-main-7bd398-5cf77c9b9d-mqb7f\" (UID: \"a1da2960-1274-4bd6-8a08-8c3930b5d39d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-main-7bd398-5cf77c9b9d-mqb7f" Oct 30 09:06:37.999297 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:37.999280 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1da2960-1274-4bd6-8a08-8c3930b5d39d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-main-7bd398-5cf77c9b9d-mqb7f\" (UID: \"a1da2960-1274-4bd6-8a08-8c3930b5d39d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-main-7bd398-5cf77c9b9d-mqb7f" Oct 30 09:06:38.021273 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:38.021249 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlcnf\" (UniqueName: \"kubernetes.io/projected/a1da2960-1274-4bd6-8a08-8c3930b5d39d-kube-api-access-wlcnf\") pod \"payload-processing-e2e-shared-a-main-7bd398-5cf77c9b9d-mqb7f\" (UID: \"a1da2960-1274-4bd6-8a08-8c3930b5d39d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-main-7bd398-5cf77c9b9d-mqb7f" Oct 30 09:06:38.123466 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:38.123430 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-main-7bd398-5cf77c9b9d-mqb7f" Oct 30 09:06:38.299919 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:38.299899 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-main-7bd398-58947ff495wtps7"] Oct 30 09:06:38.302668 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:06:38.302642 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3a795d8_9441_4ec2_9aa6_57075cbd7d55.slice/crio-125645f25cba444448e87005a3ac86d40fb46d52631a907801e5d0bb13103093 WatchSource:0}: Error finding container 125645f25cba444448e87005a3ac86d40fb46d52631a907801e5d0bb13103093: Status 404 returned error can't find the container with id 125645f25cba444448e87005a3ac86d40fb46d52631a907801e5d0bb13103093 Oct 30 09:06:38.477156 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:38.476815 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-main-7bd398-5cf77c9b9d-mqb7f"] Oct 30 09:06:38.479737 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:06:38.479708 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1da2960_1274_4bd6_8a08_8c3930b5d39d.slice/crio-576cece91f165caad2aba9521c68793ea517dc0559386a9449d0996d1a76600b WatchSource:0}: Error finding container 576cece91f165caad2aba9521c68793ea517dc0559386a9449d0996d1a76600b: Status 404 returned error can't find the container with id 576cece91f165caad2aba9521c68793ea517dc0559386a9449d0996d1a76600b Oct 30 09:06:39.238254 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:39.238198 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-7bd398-58947ff495wtps7" event={"ID":"e3a795d8-9441-4ec2-9aa6-57075cbd7d55","Type":"ContainerStarted","Data":"93d8b9257e334524b2974fe498c7d7ef54f9adc27336c7f1e7c3f60fae6f6de2"} Oct 30 09:06:39.238670 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:39.238272 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-7bd398-58947ff495wtps7" Oct 30 09:06:39.238670 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:39.238296 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-7bd398-58947ff495wtps7" event={"ID":"e3a795d8-9441-4ec2-9aa6-57075cbd7d55","Type":"ContainerStarted","Data":"125645f25cba444448e87005a3ac86d40fb46d52631a907801e5d0bb13103093"} Oct 30 09:06:39.240011 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:39.239985 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-main-7bd398-5cf77c9b9d-mqb7f" event={"ID":"a1da2960-1274-4bd6-8a08-8c3930b5d39d","Type":"ContainerStarted","Data":"603478a083a2e9c6b0888dd2bfd53008242fb8ee5667706b0c0d30990713d35f"} Oct 30 09:06:39.240011 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:39.240023 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-main-7bd398-5cf77c9b9d-mqb7f" event={"ID":"a1da2960-1274-4bd6-8a08-8c3930b5d39d","Type":"ContainerStarted","Data":"576cece91f165caad2aba9521c68793ea517dc0559386a9449d0996d1a76600b"} Oct 30 09:06:39.240196 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:39.240118 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-main-7bd398-5cf77c9b9d-mqb7f" Oct 30 09:06:39.278629 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:39.278588 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-7bd398-58947ff495wtps7" podStartSLOduration=2.2785758720000002 podStartE2EDuration="2.278575872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 09:06:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 09:06:39.277126311 +0000 UTC m=+813.493238680" watchObservedRunningTime="2026-10-30 09:06:39.278575872 +0000 UTC m=+813.494688229" Oct 30 09:06:39.318611 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:39.318545 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-main-7bd398-5cf77c9b9d-mqb7f" podStartSLOduration=2.318532886 podStartE2EDuration="2.318532886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 09:06:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 09:06:39.3163843 +0000 UTC m=+813.532496678" watchObservedRunningTime="2026-10-30 09:06:39.318532886 +0000 UTC m=+813.534645244" Oct 30 09:06:42.742733 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:06:42.742695 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 09:06:50.243377 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:50.243337 5028 patch_prober.go:29] interesting pod/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 09:06:50.243773 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:50.243412 5028 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" podUID="5a11bacf-f72d-4610-983b-de7f28351813" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 09:06:50.249660 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:50.249636 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-main-7bd398-5cf77c9b9d-mqb7f" Oct 30 09:06:50.249798 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:50.249712 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-7bd398-58947ff495wtps7" Oct 30 09:06:52.350429 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:52.350399 5028 generic.go:356] "Generic (PLEG): container finished" podID="5a11bacf-f72d-4610-983b-de7f28351813" containerID="9c2f77cd1f4d1da693cbb3c9777a6c3d92b90aaafdc9b25d065057d985f748a2" exitCode=0 Oct 30 09:06:52.350854 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:52.350481 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" event={"ID":"5a11bacf-f72d-4610-983b-de7f28351813","Type":"ContainerDied","Data":"9c2f77cd1f4d1da693cbb3c9777a6c3d92b90aaafdc9b25d065057d985f748a2"} Oct 30 09:06:52.350854 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:52.350812 5028 scope.go:122] "RemoveContainer" containerID="9c2f77cd1f4d1da693cbb3c9777a6c3d92b90aaafdc9b25d065057d985f748a2" Oct 30 09:06:52.351891 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:52.351865 5028 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 09:06:52.351951 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:52.351939 5028 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 09:06:52.351987 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:52.351980 5028 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"} Oct 30 09:06:53.359148 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:53.359112 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" event={"ID":"5a11bacf-f72d-4610-983b-de7f28351813","Type":"ContainerStarted","Data":"86676b25443a7533ca12e6e6f1c2f13f42ec48b1cd0869677dd406b389951b75"} Oct 30 09:06:53.889589 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:53.889556 5028 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:53.889964 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:53.889868 5028 patch_prober.go:29] interesting pod/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Oct 30 09:06:53.890138 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:53.890115 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" podUID="5a11bacf-f72d-4610-983b-de7f28351813" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Oct 30 09:06:54.887228 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:54.886539 5028 patch_prober.go:29] interesting pod/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Oct 30 09:06:54.887228 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:54.886598 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" podUID="5a11bacf-f72d-4610-983b-de7f28351813" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Oct 30 09:06:55.887570 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:55.887532 5028 patch_prober.go:29] interesting pod/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Oct 30 09:06:55.888149 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:55.888118 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" podUID="5a11bacf-f72d-4610-983b-de7f28351813" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Oct 30 09:06:56.887665 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:56.887625 5028 patch_prober.go:29] interesting pod/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Oct 30 09:06:56.888294 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:56.888258 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" podUID="5a11bacf-f72d-4610-983b-de7f28351813" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Oct 30 09:06:56.926695 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:56.926666 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw"] Oct 30 09:06:56.930592 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:56.930576 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw" Oct 30 09:06:56.945163 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:56.945138 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-main-3f394b\"" Oct 30 09:06:56.948428 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:56.948407 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw"] Oct 30 09:06:56.948750 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:56.948727 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d59cfe97-15ab-496e-9917-e4501f8f7249-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw\" (UID: \"d59cfe97-15ab-496e-9917-e4501f8f7249\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw" Oct 30 09:06:56.948916 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:56.948895 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2466\" (UniqueName: \"kubernetes.io/projected/d59cfe97-15ab-496e-9917-e4501f8f7249-kube-api-access-m2466\") pod \"payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw\" (UID: \"d59cfe97-15ab-496e-9917-e4501f8f7249\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw" Oct 30 09:06:56.956529 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:56.956504 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-main-3f394b-dockercfg-zkbq4\"" Oct 30 09:06:57.019818 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:57.019751 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7"] Oct 30 09:06:57.029144 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:57.029064 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7" Oct 30 09:06:57.043089 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:57.039986 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7"] Oct 30 09:06:57.076473 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:57.049738 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t59zp\" (UniqueName: \"kubernetes.io/projected/8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b-kube-api-access-t59zp\") pod \"payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7\" (UID: \"8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7" Oct 30 09:06:57.076473 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:57.049808 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7\" (UID: \"8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7" Oct 30 09:06:57.076473 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:57.049831 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2466\" (UniqueName: \"kubernetes.io/projected/d59cfe97-15ab-496e-9917-e4501f8f7249-kube-api-access-m2466\") pod \"payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw\" (UID: \"d59cfe97-15ab-496e-9917-e4501f8f7249\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw" Oct 30 09:06:57.076473 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:57.049891 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d59cfe97-15ab-496e-9917-e4501f8f7249-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw\" (UID: \"d59cfe97-15ab-496e-9917-e4501f8f7249\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw" Oct 30 09:06:57.076473 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:57.050858 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d59cfe97-15ab-496e-9917-e4501f8f7249-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw\" (UID: \"d59cfe97-15ab-496e-9917-e4501f8f7249\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw" Oct 30 09:06:57.121185 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:57.121156 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2466\" (UniqueName: \"kubernetes.io/projected/d59cfe97-15ab-496e-9917-e4501f8f7249-kube-api-access-m2466\") pod \"payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw\" (UID: \"d59cfe97-15ab-496e-9917-e4501f8f7249\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw" Oct 30 09:06:57.150586 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:57.150514 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7\" (UID: \"8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7" Oct 30 09:06:57.150703 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:57.150625 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t59zp\" (UniqueName: \"kubernetes.io/projected/8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b-kube-api-access-t59zp\") pod \"payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7\" (UID: \"8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7" Oct 30 09:06:57.151299 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:57.151267 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7\" (UID: \"8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7" Oct 30 09:06:57.194468 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:57.194439 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t59zp\" (UniqueName: \"kubernetes.io/projected/8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b-kube-api-access-t59zp\") pod \"payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7\" (UID: \"8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7" Oct 30 09:06:57.245181 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:57.245157 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw" Oct 30 09:06:57.365359 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:57.365325 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7" Oct 30 09:06:57.624290 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:57.624249 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw"] Oct 30 09:06:57.707599 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:57.707576 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7"] Oct 30 09:06:57.711344 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:06:57.711318 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dd6f0f9_dbb1_4fa4_8ac4_3882456d270b.slice/crio-bc36fabe4ddfc2d44d98c3898408c488cd95484c0c280b0a975b72ce68b14325 WatchSource:0}: Error finding container bc36fabe4ddfc2d44d98c3898408c488cd95484c0c280b0a975b72ce68b14325: Status 404 returned error can't find the container with id bc36fabe4ddfc2d44d98c3898408c488cd95484c0c280b0a975b72ce68b14325 Oct 30 09:06:57.891234 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:57.889595 5028 patch_prober.go:29] interesting pod/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Oct 30 09:06:57.891234 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:57.889649 5028 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" podUID="5a11bacf-f72d-4610-983b-de7f28351813" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Oct 30 09:06:58.425743 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:58.425699 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7" event={"ID":"8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b","Type":"ContainerStarted","Data":"fd60ae10e33cb4246196db2dba7ac7cc517f8e7c1e6a4f50d5a918a061ace543"} Oct 30 09:06:58.425947 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:58.425764 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7" event={"ID":"8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b","Type":"ContainerStarted","Data":"bc36fabe4ddfc2d44d98c3898408c488cd95484c0c280b0a975b72ce68b14325"} Oct 30 09:06:58.425947 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:58.425825 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7" Oct 30 09:06:58.427855 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:58.427830 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw" event={"ID":"d59cfe97-15ab-496e-9917-e4501f8f7249","Type":"ContainerStarted","Data":"fffae8cacc76918c5e7f37e2482b84641a5de8a0c214b5ad68d60e6bf7ab7d1b"} Oct 30 09:06:58.427979 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:58.427877 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw" event={"ID":"d59cfe97-15ab-496e-9917-e4501f8f7249","Type":"ContainerStarted","Data":"6acfe9b2e1e5b9b1406415177a6505f7faf27d0749d2e392686f223e967db47b"} Oct 30 09:06:58.427979 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:58.427939 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw" Oct 30 09:06:58.467985 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:58.467934 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7" podStartSLOduration=2.467920028 podStartE2EDuration="2.467920028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 09:06:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 09:06:58.46548415 +0000 UTC m=+832.681596532" watchObservedRunningTime="2026-10-30 09:06:58.467920028 +0000 UTC m=+832.684032386" Oct 30 09:06:58.505635 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:58.505588 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw" podStartSLOduration=2.505575681 podStartE2EDuration="2.505575681s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 09:06:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 09:06:58.504419119 +0000 UTC m=+832.720531497" watchObservedRunningTime="2026-10-30 09:06:58.505575681 +0000 UTC m=+832.721688067" Oct 30 09:06:58.888257 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:58.888201 5028 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:58.888699 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:58.888672 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:06:58.889379 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:06:58.889364 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:07:09.447337 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:09.447306 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw" Oct 30 09:07:09.447881 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:09.447727 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7" Oct 30 09:07:12.742533 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:07:12.742500 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 09:07:42.742314 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:07:42.742232 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 09:07:51.680274 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:51.680229 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6f7b1f4f-nnhxg"] Oct 30 09:07:51.685286 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:51.685269 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f7b1f4f-nnhxg" Oct 30 09:07:51.701820 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:51.701798 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6f7b1f4f-nnhxg"] Oct 30 09:07:51.710003 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:51.709983 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 09:07:51.710123 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:51.710104 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kdwkr\"" Oct 30 09:07:51.815782 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:51.815751 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld97p\" (UniqueName: \"kubernetes.io/projected/6988c9dd-b724-42e2-9726-55dfac1befd8-kube-api-access-ld97p\") pod \"maas-api-revoke-sub-6f7b1f4f-nnhxg\" (UID: \"6988c9dd-b724-42e2-9726-55dfac1befd8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f7b1f4f-nnhxg" Oct 30 09:07:51.815944 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:51.815796 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6988c9dd-b724-42e2-9726-55dfac1befd8-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6f7b1f4f-nnhxg\" (UID: \"6988c9dd-b724-42e2-9726-55dfac1befd8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f7b1f4f-nnhxg" Oct 30 09:07:51.816007 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:51.815993 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6988c9dd-b724-42e2-9726-55dfac1befd8-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6f7b1f4f-nnhxg\" (UID: \"6988c9dd-b724-42e2-9726-55dfac1befd8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f7b1f4f-nnhxg" Oct 30 09:07:51.916717 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:51.916685 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6988c9dd-b724-42e2-9726-55dfac1befd8-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6f7b1f4f-nnhxg\" (UID: \"6988c9dd-b724-42e2-9726-55dfac1befd8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f7b1f4f-nnhxg" Oct 30 09:07:51.916890 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:51.916725 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld97p\" (UniqueName: \"kubernetes.io/projected/6988c9dd-b724-42e2-9726-55dfac1befd8-kube-api-access-ld97p\") pod \"maas-api-revoke-sub-6f7b1f4f-nnhxg\" (UID: \"6988c9dd-b724-42e2-9726-55dfac1befd8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f7b1f4f-nnhxg" Oct 30 09:07:51.916890 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:51.916762 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6988c9dd-b724-42e2-9726-55dfac1befd8-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6f7b1f4f-nnhxg\" (UID: \"6988c9dd-b724-42e2-9726-55dfac1befd8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f7b1f4f-nnhxg" Oct 30 09:07:51.917493 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:51.917473 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6988c9dd-b724-42e2-9726-55dfac1befd8-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6f7b1f4f-nnhxg\" (UID: \"6988c9dd-b724-42e2-9726-55dfac1befd8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f7b1f4f-nnhxg" Oct 30 09:07:51.918888 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:51.918864 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6988c9dd-b724-42e2-9726-55dfac1befd8-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6f7b1f4f-nnhxg\" (UID: \"6988c9dd-b724-42e2-9726-55dfac1befd8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f7b1f4f-nnhxg" Oct 30 09:07:51.939517 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:51.939466 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld97p\" (UniqueName: \"kubernetes.io/projected/6988c9dd-b724-42e2-9726-55dfac1befd8-kube-api-access-ld97p\") pod \"maas-api-revoke-sub-6f7b1f4f-nnhxg\" (UID: \"6988c9dd-b724-42e2-9726-55dfac1befd8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f7b1f4f-nnhxg" Oct 30 09:07:51.997986 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:51.997966 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f7b1f4f-nnhxg" Oct 30 09:07:52.301823 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:52.301789 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6f7b1f4f-nnhxg"] Oct 30 09:07:52.304516 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:07:52.304487 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6988c9dd_b724_42e2_9726_55dfac1befd8.slice/crio-8cb8acfb110f1fd7e1b51772c318d4c4e2a5cc501ffd8158612c53a51d4a65b7 WatchSource:0}: Error finding container 8cb8acfb110f1fd7e1b51772c318d4c4e2a5cc501ffd8158612c53a51d4a65b7: Status 404 returned error can't find the container with id 8cb8acfb110f1fd7e1b51772c318d4c4e2a5cc501ffd8158612c53a51d4a65b7 Oct 30 09:07:52.804317 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:52.804276 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f7b1f4f-nnhxg" event={"ID":"6988c9dd-b724-42e2-9726-55dfac1befd8","Type":"ContainerStarted","Data":"a5d110263177fcae6d1046468762bbc2828e892c57d108985a4150ca3a973c50"} Oct 30 09:07:52.804730 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:52.804375 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f7b1f4f-nnhxg" event={"ID":"6988c9dd-b724-42e2-9726-55dfac1befd8","Type":"ContainerStarted","Data":"8cb8acfb110f1fd7e1b51772c318d4c4e2a5cc501ffd8158612c53a51d4a65b7"} Oct 30 09:07:52.846417 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:52.846375 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f7b1f4f-nnhxg" podStartSLOduration=1.846361367 podStartE2EDuration="1.846361367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 09:07:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 09:07:52.843166364 +0000 UTC m=+887.059278722" watchObservedRunningTime="2026-10-30 09:07:52.846361367 +0000 UTC m=+887.062473745" Oct 30 09:07:53.812086 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:53.812053 5028 generic.go:356] "Generic (PLEG): container finished" podID="6988c9dd-b724-42e2-9726-55dfac1befd8" containerID="a5d110263177fcae6d1046468762bbc2828e892c57d108985a4150ca3a973c50" exitCode=0 Oct 30 09:07:53.812489 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:53.812086 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f7b1f4f-nnhxg" event={"ID":"6988c9dd-b724-42e2-9726-55dfac1befd8","Type":"ContainerDied","Data":"a5d110263177fcae6d1046468762bbc2828e892c57d108985a4150ca3a973c50"} Oct 30 09:07:54.959960 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:54.959936 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f7b1f4f-nnhxg" Oct 30 09:07:55.047571 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:55.047546 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6988c9dd-b724-42e2-9726-55dfac1befd8-kube-api-access-ld97p\" (UniqueName: \"kubernetes.io/projected/6988c9dd-b724-42e2-9726-55dfac1befd8-kube-api-access-ld97p\") pod \"6988c9dd-b724-42e2-9726-55dfac1befd8\" (UID: \"6988c9dd-b724-42e2-9726-55dfac1befd8\") " Oct 30 09:07:55.047695 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:55.047679 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6988c9dd-b724-42e2-9726-55dfac1befd8-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6988c9dd-b724-42e2-9726-55dfac1befd8-maas-api-openshift-ca\") pod \"6988c9dd-b724-42e2-9726-55dfac1befd8\" (UID: \"6988c9dd-b724-42e2-9726-55dfac1befd8\") " Oct 30 09:07:55.047736 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:55.047709 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6988c9dd-b724-42e2-9726-55dfac1befd8-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6988c9dd-b724-42e2-9726-55dfac1befd8-maas-api-xks-ca\") pod \"6988c9dd-b724-42e2-9726-55dfac1befd8\" (UID: \"6988c9dd-b724-42e2-9726-55dfac1befd8\") " Oct 30 09:07:55.048047 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:55.048021 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6988c9dd-b724-42e2-9726-55dfac1befd8-maas-api-openshift-ca" pod "6988c9dd-b724-42e2-9726-55dfac1befd8" (UID: "6988c9dd-b724-42e2-9726-55dfac1befd8"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 09:07:55.049661 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:55.049634 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6988c9dd-b724-42e2-9726-55dfac1befd8-kube-api-access-ld97p" pod "6988c9dd-b724-42e2-9726-55dfac1befd8" (UID: "6988c9dd-b724-42e2-9726-55dfac1befd8"). InnerVolumeSpecName "kube-api-access-ld97p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 09:07:55.049757 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:55.049635 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6988c9dd-b724-42e2-9726-55dfac1befd8-maas-api-xks-ca" pod "6988c9dd-b724-42e2-9726-55dfac1befd8" (UID: "6988c9dd-b724-42e2-9726-55dfac1befd8"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 09:07:55.149154 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:55.149126 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6988c9dd-b724-42e2-9726-55dfac1befd8-maas-api-openshift-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:07:55.149154 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:55.149156 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6988c9dd-b724-42e2-9726-55dfac1befd8-maas-api-xks-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:07:55.149353 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:55.149166 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ld97p\" (UniqueName: \"kubernetes.io/projected/6988c9dd-b724-42e2-9726-55dfac1befd8-kube-api-access-ld97p\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:07:55.825628 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:55.825596 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f7b1f4f-nnhxg" event={"ID":"6988c9dd-b724-42e2-9726-55dfac1befd8","Type":"ContainerDied","Data":"8cb8acfb110f1fd7e1b51772c318d4c4e2a5cc501ffd8158612c53a51d4a65b7"} Oct 30 09:07:55.825628 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:55.825624 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6f7b1f4f-nnhxg" Oct 30 09:07:55.825843 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:07:55.825645 5028 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8cb8acfb110f1fd7e1b51772c318d4c4e2a5cc501ffd8158612c53a51d4a65b7" Oct 30 09:08:04.318938 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:04.318904 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-13ccea3e-82p7w"] Oct 30 09:08:04.319413 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:04.319400 5028 cpu_manager.go:414] "containerMap: removing container" podUID="6988c9dd-b724-42e2-9726-55dfac1befd8" containerName="revoke-keys" Oct 30 09:08:04.319456 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:04.319414 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6988c9dd-b724-42e2-9726-55dfac1befd8" containerName="revoke-keys" Oct 30 09:08:04.319535 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:04.319526 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="6988c9dd-b724-42e2-9726-55dfac1befd8" containerName="revoke-keys" Oct 30 09:08:04.323021 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:04.323005 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-13ccea3e-82p7w" Oct 30 09:08:04.341181 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:04.341160 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-13ccea3e-82p7w"] Oct 30 09:08:04.348475 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:04.348450 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 09:08:04.348619 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:04.348598 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kdwkr\"" Oct 30 09:08:04.443648 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:04.443623 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf4mp\" (UniqueName: \"kubernetes.io/projected/93b4c66b-5f09-403b-a9cb-328c663c2013-kube-api-access-tf4mp\") pod \"maas-api-revoke-sub-13ccea3e-82p7w\" (UID: \"93b4c66b-5f09-403b-a9cb-328c663c2013\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-13ccea3e-82p7w" Oct 30 09:08:04.443776 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:04.443704 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/93b4c66b-5f09-403b-a9cb-328c663c2013-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-13ccea3e-82p7w\" (UID: \"93b4c66b-5f09-403b-a9cb-328c663c2013\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-13ccea3e-82p7w" Oct 30 09:08:04.443843 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:04.443824 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/93b4c66b-5f09-403b-a9cb-328c663c2013-maas-api-xks-ca\") pod \"maas-api-revoke-sub-13ccea3e-82p7w\" (UID: \"93b4c66b-5f09-403b-a9cb-328c663c2013\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-13ccea3e-82p7w" Oct 30 09:08:04.545255 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:04.545226 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/93b4c66b-5f09-403b-a9cb-328c663c2013-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-13ccea3e-82p7w\" (UID: \"93b4c66b-5f09-403b-a9cb-328c663c2013\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-13ccea3e-82p7w" Oct 30 09:08:04.545398 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:04.545337 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/93b4c66b-5f09-403b-a9cb-328c663c2013-maas-api-xks-ca\") pod \"maas-api-revoke-sub-13ccea3e-82p7w\" (UID: \"93b4c66b-5f09-403b-a9cb-328c663c2013\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-13ccea3e-82p7w" Oct 30 09:08:04.545398 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:04.545392 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf4mp\" (UniqueName: \"kubernetes.io/projected/93b4c66b-5f09-403b-a9cb-328c663c2013-kube-api-access-tf4mp\") pod \"maas-api-revoke-sub-13ccea3e-82p7w\" (UID: \"93b4c66b-5f09-403b-a9cb-328c663c2013\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-13ccea3e-82p7w" Oct 30 09:08:04.545970 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:04.545946 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/93b4c66b-5f09-403b-a9cb-328c663c2013-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-13ccea3e-82p7w\" (UID: \"93b4c66b-5f09-403b-a9cb-328c663c2013\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-13ccea3e-82p7w" Oct 30 09:08:04.547766 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:04.547736 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/93b4c66b-5f09-403b-a9cb-328c663c2013-maas-api-xks-ca\") pod \"maas-api-revoke-sub-13ccea3e-82p7w\" (UID: \"93b4c66b-5f09-403b-a9cb-328c663c2013\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-13ccea3e-82p7w" Oct 30 09:08:04.567915 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:04.567892 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf4mp\" (UniqueName: \"kubernetes.io/projected/93b4c66b-5f09-403b-a9cb-328c663c2013-kube-api-access-tf4mp\") pod \"maas-api-revoke-sub-13ccea3e-82p7w\" (UID: \"93b4c66b-5f09-403b-a9cb-328c663c2013\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-13ccea3e-82p7w" Oct 30 09:08:04.635966 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:04.635943 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-13ccea3e-82p7w" Oct 30 09:08:04.938053 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:04.938031 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-13ccea3e-82p7w"] Oct 30 09:08:04.940929 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:08:04.940898 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93b4c66b_5f09_403b_a9cb_328c663c2013.slice/crio-dd94f325ac5ac15a1a0d20cbcc6e5cdef8ef133f1ef30ca245269837b302f79f WatchSource:0}: Error finding container dd94f325ac5ac15a1a0d20cbcc6e5cdef8ef133f1ef30ca245269837b302f79f: Status 404 returned error can't find the container with id dd94f325ac5ac15a1a0d20cbcc6e5cdef8ef133f1ef30ca245269837b302f79f Oct 30 09:08:05.886695 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:05.886659 5028 generic.go:356] "Generic (PLEG): container finished" podID="93b4c66b-5f09-403b-a9cb-328c663c2013" containerID="42b6f8fd9854743dbf42e6c85dd916d545d854c3e26f6b38b8a2b57efe3b89db" exitCode=0 Oct 30 09:08:05.887069 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:05.886743 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-13ccea3e-82p7w" event={"ID":"93b4c66b-5f09-403b-a9cb-328c663c2013","Type":"ContainerDied","Data":"42b6f8fd9854743dbf42e6c85dd916d545d854c3e26f6b38b8a2b57efe3b89db"} Oct 30 09:08:05.887069 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:05.886806 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-13ccea3e-82p7w" event={"ID":"93b4c66b-5f09-403b-a9cb-328c663c2013","Type":"ContainerStarted","Data":"dd94f325ac5ac15a1a0d20cbcc6e5cdef8ef133f1ef30ca245269837b302f79f"} Oct 30 09:08:06.081109 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:06.081031 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6jb9v_0c1ebb77-bd76-4329-ac03-87f60b688431/console-operator/1.log" Oct 30 09:08:06.081675 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:06.081656 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6jb9v_0c1ebb77-bd76-4329-ac03-87f60b688431/console-operator/1.log" Oct 30 09:08:07.042028 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:07.042001 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-13ccea3e-82p7w" Oct 30 09:08:07.169179 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:07.169108 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/93b4c66b-5f09-403b-a9cb-328c663c2013-kube-api-access-tf4mp\" (UniqueName: \"kubernetes.io/projected/93b4c66b-5f09-403b-a9cb-328c663c2013-kube-api-access-tf4mp\") pod \"93b4c66b-5f09-403b-a9cb-328c663c2013\" (UID: \"93b4c66b-5f09-403b-a9cb-328c663c2013\") " Oct 30 09:08:07.169373 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:07.169194 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/93b4c66b-5f09-403b-a9cb-328c663c2013-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/93b4c66b-5f09-403b-a9cb-328c663c2013-maas-api-openshift-ca\") pod \"93b4c66b-5f09-403b-a9cb-328c663c2013\" (UID: \"93b4c66b-5f09-403b-a9cb-328c663c2013\") " Oct 30 09:08:07.169373 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:07.169296 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/93b4c66b-5f09-403b-a9cb-328c663c2013-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/93b4c66b-5f09-403b-a9cb-328c663c2013-maas-api-xks-ca\") pod \"93b4c66b-5f09-403b-a9cb-328c663c2013\" (UID: \"93b4c66b-5f09-403b-a9cb-328c663c2013\") " Oct 30 09:08:07.169571 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:07.169548 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93b4c66b-5f09-403b-a9cb-328c663c2013-maas-api-openshift-ca" pod "93b4c66b-5f09-403b-a9cb-328c663c2013" (UID: "93b4c66b-5f09-403b-a9cb-328c663c2013"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 09:08:07.169704 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:07.169686 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/93b4c66b-5f09-403b-a9cb-328c663c2013-maas-api-openshift-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:08:07.171307 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:07.171284 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93b4c66b-5f09-403b-a9cb-328c663c2013-kube-api-access-tf4mp" pod "93b4c66b-5f09-403b-a9cb-328c663c2013" (UID: "93b4c66b-5f09-403b-a9cb-328c663c2013"). InnerVolumeSpecName "kube-api-access-tf4mp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 09:08:07.171413 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:07.171383 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93b4c66b-5f09-403b-a9cb-328c663c2013-maas-api-xks-ca" pod "93b4c66b-5f09-403b-a9cb-328c663c2013" (UID: "93b4c66b-5f09-403b-a9cb-328c663c2013"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 09:08:07.270978 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:07.270950 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tf4mp\" (UniqueName: \"kubernetes.io/projected/93b4c66b-5f09-403b-a9cb-328c663c2013-kube-api-access-tf4mp\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:08:07.270978 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:07.270979 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/93b4c66b-5f09-403b-a9cb-328c663c2013-maas-api-xks-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:08:07.906633 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:07.906609 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-13ccea3e-82p7w" Oct 30 09:08:07.912058 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:07.912030 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-13ccea3e-82p7w" event={"ID":"93b4c66b-5f09-403b-a9cb-328c663c2013","Type":"ContainerDied","Data":"dd94f325ac5ac15a1a0d20cbcc6e5cdef8ef133f1ef30ca245269837b302f79f"} Oct 30 09:08:07.912177 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:07.912072 5028 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd94f325ac5ac15a1a0d20cbcc6e5cdef8ef133f1ef30ca245269837b302f79f" Oct 30 09:08:12.847512 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:08:12.847474 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 09:08:14.711728 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:14.711675 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-p5khn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 09:08:14.712416 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:14.712365 5028 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" podUID="37ad32b7-0a5f-4437-8855-cc6ddebec8e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 09:08:14.793253 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:14.791646 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d9ec3d8e-f98nd"] Oct 30 09:08:14.793253 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:14.792497 5028 cpu_manager.go:414] "containerMap: removing container" podUID="93b4c66b-5f09-403b-a9cb-328c663c2013" containerName="revoke-keys" Oct 30 09:08:14.793253 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:14.792525 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="93b4c66b-5f09-403b-a9cb-328c663c2013" containerName="revoke-keys" Oct 30 09:08:14.793253 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:14.792676 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="93b4c66b-5f09-403b-a9cb-328c663c2013" containerName="revoke-keys" Oct 30 09:08:14.813028 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:14.813000 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d9ec3d8e-f98nd"] Oct 30 09:08:14.813356 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:14.813334 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d9ec3d8e-f98nd" Oct 30 09:08:14.830002 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:14.829979 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 09:08:14.883292 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:14.879529 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kdwkr\"" Oct 30 09:08:14.939749 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:14.939710 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pz8d\" (UniqueName: \"kubernetes.io/projected/9061938d-3282-4801-9610-4bee14a71ee1-kube-api-access-8pz8d\") pod \"maas-api-revoke-sub-d9ec3d8e-f98nd\" (UID: \"9061938d-3282-4801-9610-4bee14a71ee1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d9ec3d8e-f98nd" Oct 30 09:08:14.940020 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:14.939997 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9061938d-3282-4801-9610-4bee14a71ee1-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d9ec3d8e-f98nd\" (UID: \"9061938d-3282-4801-9610-4bee14a71ee1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d9ec3d8e-f98nd" Oct 30 09:08:14.940193 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:14.940174 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9061938d-3282-4801-9610-4bee14a71ee1-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d9ec3d8e-f98nd\" (UID: \"9061938d-3282-4801-9610-4bee14a71ee1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d9ec3d8e-f98nd" Oct 30 09:08:15.043651 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:15.041696 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9061938d-3282-4801-9610-4bee14a71ee1-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d9ec3d8e-f98nd\" (UID: \"9061938d-3282-4801-9610-4bee14a71ee1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d9ec3d8e-f98nd" Oct 30 09:08:15.043651 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:15.041821 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pz8d\" (UniqueName: \"kubernetes.io/projected/9061938d-3282-4801-9610-4bee14a71ee1-kube-api-access-8pz8d\") pod \"maas-api-revoke-sub-d9ec3d8e-f98nd\" (UID: \"9061938d-3282-4801-9610-4bee14a71ee1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d9ec3d8e-f98nd" Oct 30 09:08:15.043651 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:15.041888 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9061938d-3282-4801-9610-4bee14a71ee1-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d9ec3d8e-f98nd\" (UID: \"9061938d-3282-4801-9610-4bee14a71ee1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d9ec3d8e-f98nd" Oct 30 09:08:15.043651 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:15.042763 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9061938d-3282-4801-9610-4bee14a71ee1-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d9ec3d8e-f98nd\" (UID: \"9061938d-3282-4801-9610-4bee14a71ee1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d9ec3d8e-f98nd" Oct 30 09:08:15.051780 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:15.051756 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9061938d-3282-4801-9610-4bee14a71ee1-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d9ec3d8e-f98nd\" (UID: \"9061938d-3282-4801-9610-4bee14a71ee1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d9ec3d8e-f98nd" Oct 30 09:08:15.066148 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:15.066114 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pz8d\" (UniqueName: \"kubernetes.io/projected/9061938d-3282-4801-9610-4bee14a71ee1-kube-api-access-8pz8d\") pod \"maas-api-revoke-sub-d9ec3d8e-f98nd\" (UID: \"9061938d-3282-4801-9610-4bee14a71ee1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d9ec3d8e-f98nd" Oct 30 09:08:15.234332 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:15.234300 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d9ec3d8e-f98nd" Oct 30 09:08:15.553481 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:15.553454 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d9ec3d8e-f98nd"] Oct 30 09:08:15.555758 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:08:15.555730 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9061938d_3282_4801_9610_4bee14a71ee1.slice/crio-5e32cb883dd69b05c178f8e5f85dfad97e1211c3c37316dbfb3694edc0309720 WatchSource:0}: Error finding container 5e32cb883dd69b05c178f8e5f85dfad97e1211c3c37316dbfb3694edc0309720: Status 404 returned error can't find the container with id 5e32cb883dd69b05c178f8e5f85dfad97e1211c3c37316dbfb3694edc0309720 Oct 30 09:08:16.036118 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:16.036077 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d9ec3d8e-f98nd" event={"ID":"9061938d-3282-4801-9610-4bee14a71ee1","Type":"ContainerStarted","Data":"984ac3da0cb840e31ce71d9314f26417f67186d20f6bd727d597bcfcb75042b8"} Oct 30 09:08:16.036535 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:16.036140 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d9ec3d8e-f98nd" event={"ID":"9061938d-3282-4801-9610-4bee14a71ee1","Type":"ContainerStarted","Data":"5e32cb883dd69b05c178f8e5f85dfad97e1211c3c37316dbfb3694edc0309720"} Oct 30 09:08:16.076309 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:16.076264 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d9ec3d8e-f98nd" podStartSLOduration=2.076250895 podStartE2EDuration="2.076250895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 09:08:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 09:08:16.075487548 +0000 UTC m=+910.291599916" watchObservedRunningTime="2026-10-30 09:08:16.076250895 +0000 UTC m=+910.292363253" Oct 30 09:08:17.045662 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:17.045626 5028 generic.go:356] "Generic (PLEG): container finished" podID="9061938d-3282-4801-9610-4bee14a71ee1" containerID="984ac3da0cb840e31ce71d9314f26417f67186d20f6bd727d597bcfcb75042b8" exitCode=0 Oct 30 09:08:17.046137 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:17.045701 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d9ec3d8e-f98nd" event={"ID":"9061938d-3282-4801-9610-4bee14a71ee1","Type":"ContainerDied","Data":"984ac3da0cb840e31ce71d9314f26417f67186d20f6bd727d597bcfcb75042b8"} Oct 30 09:08:18.253927 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:18.253897 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d9ec3d8e-f98nd" Oct 30 09:08:18.289741 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:18.289713 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9061938d-3282-4801-9610-4bee14a71ee1-kube-api-access-8pz8d\" (UniqueName: \"kubernetes.io/projected/9061938d-3282-4801-9610-4bee14a71ee1-kube-api-access-8pz8d\") pod \"9061938d-3282-4801-9610-4bee14a71ee1\" (UID: \"9061938d-3282-4801-9610-4bee14a71ee1\") " Oct 30 09:08:18.289890 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:18.289791 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9061938d-3282-4801-9610-4bee14a71ee1-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9061938d-3282-4801-9610-4bee14a71ee1-maas-api-openshift-ca\") pod \"9061938d-3282-4801-9610-4bee14a71ee1\" (UID: \"9061938d-3282-4801-9610-4bee14a71ee1\") " Oct 30 09:08:18.289966 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:18.289888 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9061938d-3282-4801-9610-4bee14a71ee1-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9061938d-3282-4801-9610-4bee14a71ee1-maas-api-xks-ca\") pod \"9061938d-3282-4801-9610-4bee14a71ee1\" (UID: \"9061938d-3282-4801-9610-4bee14a71ee1\") " Oct 30 09:08:18.290372 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:18.290338 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9061938d-3282-4801-9610-4bee14a71ee1-maas-api-openshift-ca" pod "9061938d-3282-4801-9610-4bee14a71ee1" (UID: "9061938d-3282-4801-9610-4bee14a71ee1"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 09:08:18.292451 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:18.292410 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9061938d-3282-4801-9610-4bee14a71ee1-kube-api-access-8pz8d" pod "9061938d-3282-4801-9610-4bee14a71ee1" (UID: "9061938d-3282-4801-9610-4bee14a71ee1"). InnerVolumeSpecName "kube-api-access-8pz8d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 09:08:18.293127 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:18.293097 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9061938d-3282-4801-9610-4bee14a71ee1-maas-api-xks-ca" pod "9061938d-3282-4801-9610-4bee14a71ee1" (UID: "9061938d-3282-4801-9610-4bee14a71ee1"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 09:08:18.391557 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:18.391508 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9061938d-3282-4801-9610-4bee14a71ee1-maas-api-xks-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:08:18.391557 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:18.391551 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pz8d\" (UniqueName: \"kubernetes.io/projected/9061938d-3282-4801-9610-4bee14a71ee1-kube-api-access-8pz8d\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:08:18.391843 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:18.391569 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9061938d-3282-4801-9610-4bee14a71ee1-maas-api-openshift-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:08:19.064560 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:19.064500 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d9ec3d8e-f98nd" event={"ID":"9061938d-3282-4801-9610-4bee14a71ee1","Type":"ContainerDied","Data":"5e32cb883dd69b05c178f8e5f85dfad97e1211c3c37316dbfb3694edc0309720"} Oct 30 09:08:19.064755 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:19.064575 5028 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e32cb883dd69b05c178f8e5f85dfad97e1211c3c37316dbfb3694edc0309720" Oct 30 09:08:19.064755 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:19.064646 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d9ec3d8e-f98nd" Oct 30 09:08:25.224754 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:25.222220 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5a042a34-tlp4m"] Oct 30 09:08:25.224754 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:25.222950 5028 cpu_manager.go:414] "containerMap: removing container" podUID="9061938d-3282-4801-9610-4bee14a71ee1" containerName="revoke-keys" Oct 30 09:08:25.224754 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:25.222970 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9061938d-3282-4801-9610-4bee14a71ee1" containerName="revoke-keys" Oct 30 09:08:25.224754 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:25.223113 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="9061938d-3282-4801-9610-4bee14a71ee1" containerName="revoke-keys" Oct 30 09:08:25.232118 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:25.227072 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a042a34-tlp4m" Oct 30 09:08:25.254498 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:25.247432 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 09:08:25.259411 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:25.259374 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kdwkr\"" Oct 30 09:08:25.264584 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:25.261741 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5a042a34-tlp4m"] Oct 30 09:08:25.424309 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:25.424266 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d6e9140c-8f7b-46af-9047-32c2b7cb3099-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5a042a34-tlp4m\" (UID: \"d6e9140c-8f7b-46af-9047-32c2b7cb3099\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a042a34-tlp4m" Oct 30 09:08:25.424678 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:25.424653 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d6e9140c-8f7b-46af-9047-32c2b7cb3099-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5a042a34-tlp4m\" (UID: \"d6e9140c-8f7b-46af-9047-32c2b7cb3099\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a042a34-tlp4m" Oct 30 09:08:25.429332 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:25.429308 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8r4z\" (UniqueName: \"kubernetes.io/projected/d6e9140c-8f7b-46af-9047-32c2b7cb3099-kube-api-access-l8r4z\") pod \"maas-api-revoke-sub-5a042a34-tlp4m\" (UID: \"d6e9140c-8f7b-46af-9047-32c2b7cb3099\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a042a34-tlp4m" Oct 30 09:08:25.532817 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:25.532744 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d6e9140c-8f7b-46af-9047-32c2b7cb3099-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5a042a34-tlp4m\" (UID: \"d6e9140c-8f7b-46af-9047-32c2b7cb3099\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a042a34-tlp4m" Oct 30 09:08:25.534385 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:25.534361 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d6e9140c-8f7b-46af-9047-32c2b7cb3099-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5a042a34-tlp4m\" (UID: \"d6e9140c-8f7b-46af-9047-32c2b7cb3099\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a042a34-tlp4m" Oct 30 09:08:25.534546 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:25.534528 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8r4z\" (UniqueName: \"kubernetes.io/projected/d6e9140c-8f7b-46af-9047-32c2b7cb3099-kube-api-access-l8r4z\") pod \"maas-api-revoke-sub-5a042a34-tlp4m\" (UID: \"d6e9140c-8f7b-46af-9047-32c2b7cb3099\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a042a34-tlp4m" Oct 30 09:08:25.556052 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:25.556030 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d6e9140c-8f7b-46af-9047-32c2b7cb3099-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5a042a34-tlp4m\" (UID: \"d6e9140c-8f7b-46af-9047-32c2b7cb3099\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a042a34-tlp4m" Oct 30 09:08:25.556787 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:25.556765 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d6e9140c-8f7b-46af-9047-32c2b7cb3099-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5a042a34-tlp4m\" (UID: \"d6e9140c-8f7b-46af-9047-32c2b7cb3099\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a042a34-tlp4m" Oct 30 09:08:25.587113 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:25.586832 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8r4z\" (UniqueName: \"kubernetes.io/projected/d6e9140c-8f7b-46af-9047-32c2b7cb3099-kube-api-access-l8r4z\") pod \"maas-api-revoke-sub-5a042a34-tlp4m\" (UID: \"d6e9140c-8f7b-46af-9047-32c2b7cb3099\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a042a34-tlp4m" Oct 30 09:08:25.694404 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:25.694377 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a042a34-tlp4m" Oct 30 09:08:26.442862 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:26.442324 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-dr8ns container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 09:08:26.442862 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:26.442404 5028 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-dr8ns" podUID="22314808-f2ad-49af-9cd2-f2f90f33b795" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 09:08:26.748484 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:26.748454 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5a042a34-tlp4m"] Oct 30 09:08:27.429139 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:27.429044 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a042a34-tlp4m" event={"ID":"d6e9140c-8f7b-46af-9047-32c2b7cb3099","Type":"ContainerStarted","Data":"c849b9d7ac7fd9335222534e363cfabcdf3d8179d6da7d36bd7cad887e1a5f2c"} Oct 30 09:08:27.429306 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:27.429134 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a042a34-tlp4m" event={"ID":"d6e9140c-8f7b-46af-9047-32c2b7cb3099","Type":"ContainerStarted","Data":"a81ea5f8961c338974f5724b01979fd424b5f29d9404d62c0a4c6d3a1d098566"} Oct 30 09:08:27.470549 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:27.470505 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a042a34-tlp4m" podStartSLOduration=2.470493672 podStartE2EDuration="2.470493672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 09:08:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 09:08:27.467982905 +0000 UTC m=+921.684095263" watchObservedRunningTime="2026-10-30 09:08:27.470493672 +0000 UTC m=+921.686606029" Oct 30 09:08:28.436687 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:28.436653 5028 generic.go:356] "Generic (PLEG): container finished" podID="d6e9140c-8f7b-46af-9047-32c2b7cb3099" containerID="c849b9d7ac7fd9335222534e363cfabcdf3d8179d6da7d36bd7cad887e1a5f2c" exitCode=0 Oct 30 09:08:28.436857 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:28.436743 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a042a34-tlp4m" event={"ID":"d6e9140c-8f7b-46af-9047-32c2b7cb3099","Type":"ContainerDied","Data":"c849b9d7ac7fd9335222534e363cfabcdf3d8179d6da7d36bd7cad887e1a5f2c"} Oct 30 09:08:29.592917 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:29.592893 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a042a34-tlp4m" Oct 30 09:08:29.716607 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:29.716545 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d6e9140c-8f7b-46af-9047-32c2b7cb3099-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d6e9140c-8f7b-46af-9047-32c2b7cb3099-maas-api-xks-ca\") pod \"d6e9140c-8f7b-46af-9047-32c2b7cb3099\" (UID: \"d6e9140c-8f7b-46af-9047-32c2b7cb3099\") " Oct 30 09:08:29.716607 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:29.716587 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d6e9140c-8f7b-46af-9047-32c2b7cb3099-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d6e9140c-8f7b-46af-9047-32c2b7cb3099-maas-api-openshift-ca\") pod \"d6e9140c-8f7b-46af-9047-32c2b7cb3099\" (UID: \"d6e9140c-8f7b-46af-9047-32c2b7cb3099\") " Oct 30 09:08:29.716765 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:29.716676 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d6e9140c-8f7b-46af-9047-32c2b7cb3099-kube-api-access-l8r4z\" (UniqueName: \"kubernetes.io/projected/d6e9140c-8f7b-46af-9047-32c2b7cb3099-kube-api-access-l8r4z\") pod \"d6e9140c-8f7b-46af-9047-32c2b7cb3099\" (UID: \"d6e9140c-8f7b-46af-9047-32c2b7cb3099\") " Oct 30 09:08:29.716944 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:29.716924 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6e9140c-8f7b-46af-9047-32c2b7cb3099-maas-api-openshift-ca" pod "d6e9140c-8f7b-46af-9047-32c2b7cb3099" (UID: "d6e9140c-8f7b-46af-9047-32c2b7cb3099"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 09:08:29.717038 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:29.717019 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d6e9140c-8f7b-46af-9047-32c2b7cb3099-maas-api-openshift-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:08:29.718638 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:29.718612 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6e9140c-8f7b-46af-9047-32c2b7cb3099-maas-api-xks-ca" pod "d6e9140c-8f7b-46af-9047-32c2b7cb3099" (UID: "d6e9140c-8f7b-46af-9047-32c2b7cb3099"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 09:08:29.718739 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:29.718672 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6e9140c-8f7b-46af-9047-32c2b7cb3099-kube-api-access-l8r4z" pod "d6e9140c-8f7b-46af-9047-32c2b7cb3099" (UID: "d6e9140c-8f7b-46af-9047-32c2b7cb3099"). InnerVolumeSpecName "kube-api-access-l8r4z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 09:08:29.818031 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:29.818005 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d6e9140c-8f7b-46af-9047-32c2b7cb3099-maas-api-xks-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:08:29.818031 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:29.818029 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8r4z\" (UniqueName: \"kubernetes.io/projected/d6e9140c-8f7b-46af-9047-32c2b7cb3099-kube-api-access-l8r4z\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:08:30.451993 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:30.451961 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a042a34-tlp4m" Oct 30 09:08:30.451993 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:30.451975 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5a042a34-tlp4m" event={"ID":"d6e9140c-8f7b-46af-9047-32c2b7cb3099","Type":"ContainerDied","Data":"a81ea5f8961c338974f5724b01979fd424b5f29d9404d62c0a4c6d3a1d098566"} Oct 30 09:08:30.452234 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:30.452023 5028 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a81ea5f8961c338974f5724b01979fd424b5f29d9404d62c0a4c6d3a1d098566" Oct 30 09:08:35.557037 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:35.557005 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3aa439f4-zzckf"] Oct 30 09:08:35.557535 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:35.557520 5028 cpu_manager.go:414] "containerMap: removing container" podUID="d6e9140c-8f7b-46af-9047-32c2b7cb3099" containerName="revoke-keys" Oct 30 09:08:35.557583 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:35.557537 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d6e9140c-8f7b-46af-9047-32c2b7cb3099" containerName="revoke-keys" Oct 30 09:08:35.557623 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:35.557614 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="d6e9140c-8f7b-46af-9047-32c2b7cb3099" containerName="revoke-keys" Oct 30 09:08:35.561072 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:35.561057 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3aa439f4-zzckf" Oct 30 09:08:35.579141 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:35.579113 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3aa439f4-zzckf"] Oct 30 09:08:35.586254 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:35.586226 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 09:08:35.586381 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:35.586300 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kdwkr\"" Oct 30 09:08:35.674759 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:35.674726 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7c7h\" (UniqueName: \"kubernetes.io/projected/7a833d49-fa71-4144-922b-d7242dad03b0-kube-api-access-d7c7h\") pod \"maas-api-revoke-sub-3aa439f4-zzckf\" (UID: \"7a833d49-fa71-4144-922b-d7242dad03b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3aa439f4-zzckf" Oct 30 09:08:35.675100 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:35.675080 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7a833d49-fa71-4144-922b-d7242dad03b0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3aa439f4-zzckf\" (UID: \"7a833d49-fa71-4144-922b-d7242dad03b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3aa439f4-zzckf" Oct 30 09:08:35.675274 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:35.675259 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7a833d49-fa71-4144-922b-d7242dad03b0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3aa439f4-zzckf\" (UID: \"7a833d49-fa71-4144-922b-d7242dad03b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3aa439f4-zzckf" Oct 30 09:08:35.775806 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:35.775775 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7a833d49-fa71-4144-922b-d7242dad03b0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3aa439f4-zzckf\" (UID: \"7a833d49-fa71-4144-922b-d7242dad03b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3aa439f4-zzckf" Oct 30 09:08:35.775942 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:35.775813 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7a833d49-fa71-4144-922b-d7242dad03b0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3aa439f4-zzckf\" (UID: \"7a833d49-fa71-4144-922b-d7242dad03b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3aa439f4-zzckf" Oct 30 09:08:35.775942 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:35.775843 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7c7h\" (UniqueName: \"kubernetes.io/projected/7a833d49-fa71-4144-922b-d7242dad03b0-kube-api-access-d7c7h\") pod \"maas-api-revoke-sub-3aa439f4-zzckf\" (UID: \"7a833d49-fa71-4144-922b-d7242dad03b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3aa439f4-zzckf" Oct 30 09:08:35.776620 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:35.776593 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7a833d49-fa71-4144-922b-d7242dad03b0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3aa439f4-zzckf\" (UID: \"7a833d49-fa71-4144-922b-d7242dad03b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3aa439f4-zzckf" Oct 30 09:08:35.778234 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:35.778197 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7a833d49-fa71-4144-922b-d7242dad03b0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3aa439f4-zzckf\" (UID: \"7a833d49-fa71-4144-922b-d7242dad03b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3aa439f4-zzckf" Oct 30 09:08:35.798673 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:35.798652 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7c7h\" (UniqueName: \"kubernetes.io/projected/7a833d49-fa71-4144-922b-d7242dad03b0-kube-api-access-d7c7h\") pod \"maas-api-revoke-sub-3aa439f4-zzckf\" (UID: \"7a833d49-fa71-4144-922b-d7242dad03b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3aa439f4-zzckf" Oct 30 09:08:35.875251 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:35.875218 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3aa439f4-zzckf" Oct 30 09:08:36.179497 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:36.179467 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3aa439f4-zzckf"] Oct 30 09:08:36.491652 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:36.491625 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3aa439f4-zzckf" event={"ID":"7a833d49-fa71-4144-922b-d7242dad03b0","Type":"ContainerStarted","Data":"75bd6cf9ffbfc98af14e5c87453e28b0c3310b769fc37029c8260e4e262267e7"} Oct 30 09:08:36.491769 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:36.491679 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3aa439f4-zzckf" event={"ID":"7a833d49-fa71-4144-922b-d7242dad03b0","Type":"ContainerStarted","Data":"cf88da6ce3f5e067348f7b9ecf0071502d8fffaad23b51c220ab44853883c50a"} Oct 30 09:08:36.532978 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:36.532935 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3aa439f4-zzckf" podStartSLOduration=1.5329206279999998 podStartE2EDuration="1.532920628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 09:08:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 09:08:36.530010479 +0000 UTC m=+930.746122837" watchObservedRunningTime="2026-10-30 09:08:36.532920628 +0000 UTC m=+930.749032985" Oct 30 09:08:37.500829 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:37.500740 5028 generic.go:356] "Generic (PLEG): container finished" podID="7a833d49-fa71-4144-922b-d7242dad03b0" containerID="75bd6cf9ffbfc98af14e5c87453e28b0c3310b769fc37029c8260e4e262267e7" exitCode=0 Oct 30 09:08:37.501195 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:37.500838 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3aa439f4-zzckf" event={"ID":"7a833d49-fa71-4144-922b-d7242dad03b0","Type":"ContainerDied","Data":"75bd6cf9ffbfc98af14e5c87453e28b0c3310b769fc37029c8260e4e262267e7"} Oct 30 09:08:38.744368 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:38.744330 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3aa439f4-zzckf" Oct 30 09:08:38.927240 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:38.922570 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7a833d49-fa71-4144-922b-d7242dad03b0-kube-api-access-d7c7h\" (UniqueName: \"kubernetes.io/projected/7a833d49-fa71-4144-922b-d7242dad03b0-kube-api-access-d7c7h\") pod \"7a833d49-fa71-4144-922b-d7242dad03b0\" (UID: \"7a833d49-fa71-4144-922b-d7242dad03b0\") " Oct 30 09:08:38.927240 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:38.922710 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7a833d49-fa71-4144-922b-d7242dad03b0-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7a833d49-fa71-4144-922b-d7242dad03b0-maas-api-xks-ca\") pod \"7a833d49-fa71-4144-922b-d7242dad03b0\" (UID: \"7a833d49-fa71-4144-922b-d7242dad03b0\") " Oct 30 09:08:38.927240 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:38.922769 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7a833d49-fa71-4144-922b-d7242dad03b0-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7a833d49-fa71-4144-922b-d7242dad03b0-maas-api-openshift-ca\") pod \"7a833d49-fa71-4144-922b-d7242dad03b0\" (UID: \"7a833d49-fa71-4144-922b-d7242dad03b0\") " Oct 30 09:08:38.927240 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:38.923466 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a833d49-fa71-4144-922b-d7242dad03b0-maas-api-openshift-ca" pod "7a833d49-fa71-4144-922b-d7242dad03b0" (UID: "7a833d49-fa71-4144-922b-d7242dad03b0"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 09:08:39.002607 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:38.981345 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a833d49-fa71-4144-922b-d7242dad03b0-kube-api-access-d7c7h" pod "7a833d49-fa71-4144-922b-d7242dad03b0" (UID: "7a833d49-fa71-4144-922b-d7242dad03b0"). InnerVolumeSpecName "kube-api-access-d7c7h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 09:08:39.002607 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:38.991387 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a833d49-fa71-4144-922b-d7242dad03b0-maas-api-xks-ca" pod "7a833d49-fa71-4144-922b-d7242dad03b0" (UID: "7a833d49-fa71-4144-922b-d7242dad03b0"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 09:08:39.033224 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:39.023884 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7c7h\" (UniqueName: \"kubernetes.io/projected/7a833d49-fa71-4144-922b-d7242dad03b0-kube-api-access-d7c7h\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:08:39.033537 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:39.033427 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7a833d49-fa71-4144-922b-d7242dad03b0-maas-api-xks-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:08:39.053308 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:39.037243 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7a833d49-fa71-4144-922b-d7242dad03b0-maas-api-openshift-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:08:39.578242 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:39.578051 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3aa439f4-zzckf" event={"ID":"7a833d49-fa71-4144-922b-d7242dad03b0","Type":"ContainerDied","Data":"cf88da6ce3f5e067348f7b9ecf0071502d8fffaad23b51c220ab44853883c50a"} Oct 30 09:08:39.578242 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:39.578114 5028 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf88da6ce3f5e067348f7b9ecf0071502d8fffaad23b51c220ab44853883c50a" Oct 30 09:08:39.578242 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:39.578189 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3aa439f4-zzckf" Oct 30 09:08:42.741994 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:08:42.741961 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 09:08:45.920280 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:45.920245 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-85723326-mxtsv"] Oct 30 09:08:45.921047 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:45.921028 5028 cpu_manager.go:414] "containerMap: removing container" podUID="7a833d49-fa71-4144-922b-d7242dad03b0" containerName="revoke-keys" Oct 30 09:08:45.921100 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:45.921050 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7a833d49-fa71-4144-922b-d7242dad03b0" containerName="revoke-keys" Oct 30 09:08:45.921232 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:45.921218 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="7a833d49-fa71-4144-922b-d7242dad03b0" containerName="revoke-keys" Oct 30 09:08:45.925250 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:45.925226 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85723326-mxtsv" Oct 30 09:08:45.939932 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:45.939898 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-85723326-mxtsv"] Oct 30 09:08:45.947454 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:45.947430 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kdwkr\"" Oct 30 09:08:45.947454 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:45.947430 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 09:08:45.998180 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:45.998147 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shlt7\" (UniqueName: \"kubernetes.io/projected/54670664-247d-4c0f-8052-79bd30be33c6-kube-api-access-shlt7\") pod \"maas-api-revoke-sub-85723326-mxtsv\" (UID: \"54670664-247d-4c0f-8052-79bd30be33c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85723326-mxtsv" Oct 30 09:08:45.998321 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:45.998232 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/54670664-247d-4c0f-8052-79bd30be33c6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-85723326-mxtsv\" (UID: \"54670664-247d-4c0f-8052-79bd30be33c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85723326-mxtsv" Oct 30 09:08:45.998372 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:45.998320 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/54670664-247d-4c0f-8052-79bd30be33c6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-85723326-mxtsv\" (UID: \"54670664-247d-4c0f-8052-79bd30be33c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85723326-mxtsv" Oct 30 09:08:46.099614 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:46.099579 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/54670664-247d-4c0f-8052-79bd30be33c6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-85723326-mxtsv\" (UID: \"54670664-247d-4c0f-8052-79bd30be33c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85723326-mxtsv" Oct 30 09:08:46.099782 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:46.099647 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/54670664-247d-4c0f-8052-79bd30be33c6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-85723326-mxtsv\" (UID: \"54670664-247d-4c0f-8052-79bd30be33c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85723326-mxtsv" Oct 30 09:08:46.099782 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:46.099758 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shlt7\" (UniqueName: \"kubernetes.io/projected/54670664-247d-4c0f-8052-79bd30be33c6-kube-api-access-shlt7\") pod \"maas-api-revoke-sub-85723326-mxtsv\" (UID: \"54670664-247d-4c0f-8052-79bd30be33c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85723326-mxtsv" Oct 30 09:08:46.100468 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:46.100434 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/54670664-247d-4c0f-8052-79bd30be33c6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-85723326-mxtsv\" (UID: \"54670664-247d-4c0f-8052-79bd30be33c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85723326-mxtsv" Oct 30 09:08:46.102542 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:46.102514 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/54670664-247d-4c0f-8052-79bd30be33c6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-85723326-mxtsv\" (UID: \"54670664-247d-4c0f-8052-79bd30be33c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85723326-mxtsv" Oct 30 09:08:46.122600 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:46.122572 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shlt7\" (UniqueName: \"kubernetes.io/projected/54670664-247d-4c0f-8052-79bd30be33c6-kube-api-access-shlt7\") pod \"maas-api-revoke-sub-85723326-mxtsv\" (UID: \"54670664-247d-4c0f-8052-79bd30be33c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85723326-mxtsv" Oct 30 09:08:46.240662 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:46.240598 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85723326-mxtsv" Oct 30 09:08:46.550251 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:46.543320 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-85723326-mxtsv"] Oct 30 09:08:46.551541 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:08:46.551505 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54670664_247d_4c0f_8052_79bd30be33c6.slice/crio-cd34b754cfc2c716ed886bd1b6e5efacef8d4f1ba0ebe4be4e511a4f3abbe682 WatchSource:0}: Error finding container cd34b754cfc2c716ed886bd1b6e5efacef8d4f1ba0ebe4be4e511a4f3abbe682: Status 404 returned error can't find the container with id cd34b754cfc2c716ed886bd1b6e5efacef8d4f1ba0ebe4be4e511a4f3abbe682 Oct 30 09:08:46.648694 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:46.648666 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85723326-mxtsv" event={"ID":"54670664-247d-4c0f-8052-79bd30be33c6","Type":"ContainerStarted","Data":"cd34b754cfc2c716ed886bd1b6e5efacef8d4f1ba0ebe4be4e511a4f3abbe682"} Oct 30 09:08:47.657542 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:47.657509 5028 generic.go:356] "Generic (PLEG): container finished" podID="54670664-247d-4c0f-8052-79bd30be33c6" containerID="a99b3706fb5f24ec8398931f8a1d1c104954c062d8bd9e47290a815e8e580f4d" exitCode=0 Oct 30 09:08:47.657903 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:47.657593 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85723326-mxtsv" event={"ID":"54670664-247d-4c0f-8052-79bd30be33c6","Type":"ContainerDied","Data":"a99b3706fb5f24ec8398931f8a1d1c104954c062d8bd9e47290a815e8e580f4d"} Oct 30 09:08:48.893695 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:48.893395 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85723326-mxtsv" Oct 30 09:08:48.932076 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:48.931266 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/54670664-247d-4c0f-8052-79bd30be33c6-kube-api-access-shlt7\" (UniqueName: \"kubernetes.io/projected/54670664-247d-4c0f-8052-79bd30be33c6-kube-api-access-shlt7\") pod \"54670664-247d-4c0f-8052-79bd30be33c6\" (UID: \"54670664-247d-4c0f-8052-79bd30be33c6\") " Oct 30 09:08:48.932076 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:48.931339 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/54670664-247d-4c0f-8052-79bd30be33c6-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/54670664-247d-4c0f-8052-79bd30be33c6-maas-api-xks-ca\") pod \"54670664-247d-4c0f-8052-79bd30be33c6\" (UID: \"54670664-247d-4c0f-8052-79bd30be33c6\") " Oct 30 09:08:48.940872 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:48.940842 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54670664-247d-4c0f-8052-79bd30be33c6-maas-api-xks-ca" pod "54670664-247d-4c0f-8052-79bd30be33c6" (UID: "54670664-247d-4c0f-8052-79bd30be33c6"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 09:08:48.947562 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:48.947523 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54670664-247d-4c0f-8052-79bd30be33c6-kube-api-access-shlt7" pod "54670664-247d-4c0f-8052-79bd30be33c6" (UID: "54670664-247d-4c0f-8052-79bd30be33c6"). InnerVolumeSpecName "kube-api-access-shlt7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 09:08:49.033091 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:49.032678 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/54670664-247d-4c0f-8052-79bd30be33c6-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/54670664-247d-4c0f-8052-79bd30be33c6-maas-api-openshift-ca\") pod \"54670664-247d-4c0f-8052-79bd30be33c6\" (UID: \"54670664-247d-4c0f-8052-79bd30be33c6\") " Oct 30 09:08:49.033091 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:49.033025 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/54670664-247d-4c0f-8052-79bd30be33c6-maas-api-xks-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:08:49.033091 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:49.033048 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shlt7\" (UniqueName: \"kubernetes.io/projected/54670664-247d-4c0f-8052-79bd30be33c6-kube-api-access-shlt7\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:08:49.033091 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:49.033064 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54670664-247d-4c0f-8052-79bd30be33c6-maas-api-openshift-ca" pod "54670664-247d-4c0f-8052-79bd30be33c6" (UID: "54670664-247d-4c0f-8052-79bd30be33c6"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 09:08:49.135227 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:49.135172 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/54670664-247d-4c0f-8052-79bd30be33c6-maas-api-openshift-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:08:49.732228 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:49.724242 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85723326-mxtsv" event={"ID":"54670664-247d-4c0f-8052-79bd30be33c6","Type":"ContainerDied","Data":"cd34b754cfc2c716ed886bd1b6e5efacef8d4f1ba0ebe4be4e511a4f3abbe682"} Oct 30 09:08:49.732228 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:49.724305 5028 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cd34b754cfc2c716ed886bd1b6e5efacef8d4f1ba0ebe4be4e511a4f3abbe682" Oct 30 09:08:49.732228 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:08:49.724380 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85723326-mxtsv" Oct 30 09:09:02.675843 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:02.675808 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5"] Oct 30 09:09:12.758756 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:09:12.758711 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 09:09:14.692227 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:14.691458 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-p5khn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 09:09:14.692227 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:14.691559 5028 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" podUID="37ad32b7-0a5f-4437-8855-cc6ddebec8e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 09:09:17.699745 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:17.699698 5028 kuberuntime_container.go:898] "Killing container with a grace period" pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" podUID="fbfc3fab-b56a-43f5-ad2c-58b35e6505a6" containerName="main" containerID="cri-o://08ef42acd15499b7fcd591a9d60988807585968e99961cda45d9c227312bc0ad" gracePeriod=45 Oct 30 09:09:17.974548 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:17.974520 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" Oct 30 09:09:18.095604 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:18.095578 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-tls-certs\" (UniqueName: \"kubernetes.io/secret/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-tls-certs\") pod \"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6\" (UID: \"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6\") " Oct 30 09:09:18.095743 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:18.095660 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-dshm\") pod \"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6\" (UID: \"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6\") " Oct 30 09:09:18.095743 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:18.095700 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-model-cache\") pod \"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6\" (UID: \"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6\") " Oct 30 09:09:18.095846 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:18.095758 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-tmp-dir\") pod \"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6\" (UID: \"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6\") " Oct 30 09:09:18.095846 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:18.095788 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-home\" (UniqueName: \"kubernetes.io/empty-dir/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-home\") pod \"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6\" (UID: \"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6\") " Oct 30 09:09:18.095846 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:18.095837 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-kube-api-access-ql7nt\" (UniqueName: \"kubernetes.io/projected/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-kube-api-access-ql7nt\") pod \"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6\" (UID: \"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6\") " Oct 30 09:09:18.096279 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:18.096040 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-home" pod "fbfc3fab-b56a-43f5-ad2c-58b35e6505a6" (UID: "fbfc3fab-b56a-43f5-ad2c-58b35e6505a6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 09:09:18.096279 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:18.096057 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-tmp-dir" pod "fbfc3fab-b56a-43f5-ad2c-58b35e6505a6" (UID: "fbfc3fab-b56a-43f5-ad2c-58b35e6505a6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 09:09:18.096279 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:18.096066 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-model-cache" pod "fbfc3fab-b56a-43f5-ad2c-58b35e6505a6" (UID: "fbfc3fab-b56a-43f5-ad2c-58b35e6505a6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 09:09:18.096279 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:18.096273 5028 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-model-cache\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:09:18.096521 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:18.096294 5028 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-tmp-dir\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:09:18.096521 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:18.096302 5028 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-home\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:09:18.097943 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:18.097920 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-dshm" pod "fbfc3fab-b56a-43f5-ad2c-58b35e6505a6" (UID: "fbfc3fab-b56a-43f5-ad2c-58b35e6505a6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 09:09:18.098041 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:18.097923 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-tls-certs" pod "fbfc3fab-b56a-43f5-ad2c-58b35e6505a6" (UID: "fbfc3fab-b56a-43f5-ad2c-58b35e6505a6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 09:09:18.098041 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:18.097981 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-kube-api-access-ql7nt" pod "fbfc3fab-b56a-43f5-ad2c-58b35e6505a6" (UID: "fbfc3fab-b56a-43f5-ad2c-58b35e6505a6"). InnerVolumeSpecName "kube-api-access-ql7nt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 09:09:18.197805 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:18.197775 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ql7nt\" (UniqueName: \"kubernetes.io/projected/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-kube-api-access-ql7nt\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:09:18.197962 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:18.197835 5028 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-tls-certs\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:09:18.197962 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:18.197848 5028 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6-dshm\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:09:18.224940 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:18.224860 5028 generic.go:356] "Generic (PLEG): container finished" podID="fbfc3fab-b56a-43f5-ad2c-58b35e6505a6" containerID="08ef42acd15499b7fcd591a9d60988807585968e99961cda45d9c227312bc0ad" exitCode=0 Oct 30 09:09:18.224940 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:18.224920 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" Oct 30 09:09:18.225115 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:18.224942 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" event={"ID":"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6","Type":"ContainerDied","Data":"08ef42acd15499b7fcd591a9d60988807585968e99961cda45d9c227312bc0ad"} Oct 30 09:09:18.225115 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:18.224978 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5" event={"ID":"fbfc3fab-b56a-43f5-ad2c-58b35e6505a6","Type":"ContainerDied","Data":"c63cb66b172867578ba90c59e9f4281e6e81ebdf1a3546f36170b77a031a1ca7"} Oct 30 09:09:18.225115 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:18.225004 5028 scope.go:122] "RemoveContainer" containerID="08ef42acd15499b7fcd591a9d60988807585968e99961cda45d9c227312bc0ad" Oct 30 09:09:18.250971 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:18.250949 5028 scope.go:122] "RemoveContainer" containerID="08ef42acd15499b7fcd591a9d60988807585968e99961cda45d9c227312bc0ad" Oct 30 09:09:18.251358 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:09:18.251337 5028 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08ef42acd15499b7fcd591a9d60988807585968e99961cda45d9c227312bc0ad\": container with ID starting with 08ef42acd15499b7fcd591a9d60988807585968e99961cda45d9c227312bc0ad not found: ID does not exist" containerID="08ef42acd15499b7fcd591a9d60988807585968e99961cda45d9c227312bc0ad" Oct 30 09:09:18.251444 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:18.251369 5028 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08ef42acd15499b7fcd591a9d60988807585968e99961cda45d9c227312bc0ad"} err="failed to get container status \"08ef42acd15499b7fcd591a9d60988807585968e99961cda45d9c227312bc0ad\": rpc error: code = NotFound desc = could not find container \"08ef42acd15499b7fcd591a9d60988807585968e99961cda45d9c227312bc0ad\": container with ID starting with 08ef42acd15499b7fcd591a9d60988807585968e99961cda45d9c227312bc0ad not found: ID does not exist" Oct 30 09:09:18.279776 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:18.279751 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5"] Oct 30 09:09:18.285286 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:18.285264 5028 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["llm/grid-inv-4a3d3cdd-unmatched-kserve-7b76bdcb76-ldks5"] Oct 30 09:09:19.946110 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:19.945666 5028 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fbfc3fab-b56a-43f5-ad2c-58b35e6505a6" path="/var/lib/kubelet/pods/fbfc3fab-b56a-43f5-ad2c-58b35e6505a6/volumes" Oct 30 09:09:42.741778 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:09:42.741743 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 09:09:58.607304 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:58.607268 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9ce2012a-8w5wx"] Oct 30 09:09:58.607738 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:58.607724 5028 cpu_manager.go:414] "containerMap: removing container" podUID="54670664-247d-4c0f-8052-79bd30be33c6" containerName="revoke-keys" Oct 30 09:09:58.607782 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:58.607739 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="54670664-247d-4c0f-8052-79bd30be33c6" containerName="revoke-keys" Oct 30 09:09:58.607782 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:58.607759 5028 cpu_manager.go:414] "containerMap: removing container" podUID="fbfc3fab-b56a-43f5-ad2c-58b35e6505a6" containerName="main" Oct 30 09:09:58.607782 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:58.607765 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fbfc3fab-b56a-43f5-ad2c-58b35e6505a6" containerName="main" Oct 30 09:09:58.607880 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:58.607871 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="54670664-247d-4c0f-8052-79bd30be33c6" containerName="revoke-keys" Oct 30 09:09:58.607914 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:58.607884 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="fbfc3fab-b56a-43f5-ad2c-58b35e6505a6" containerName="main" Oct 30 09:09:58.611515 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:58.611497 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9ce2012a-8w5wx" Oct 30 09:09:58.627459 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:58.627437 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9ce2012a-8w5wx"] Oct 30 09:09:58.635352 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:58.635331 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 09:09:58.635462 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:58.635391 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kdwkr\"" Oct 30 09:09:58.715653 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:58.715628 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxks2\" (UniqueName: \"kubernetes.io/projected/0d1796bd-de03-434c-954f-593c37bec768-kube-api-access-bxks2\") pod \"maas-api-revoke-sub-9ce2012a-8w5wx\" (UID: \"0d1796bd-de03-434c-954f-593c37bec768\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9ce2012a-8w5wx" Oct 30 09:09:58.715761 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:58.715690 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0d1796bd-de03-434c-954f-593c37bec768-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9ce2012a-8w5wx\" (UID: \"0d1796bd-de03-434c-954f-593c37bec768\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9ce2012a-8w5wx" Oct 30 09:09:58.715802 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:58.715779 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0d1796bd-de03-434c-954f-593c37bec768-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9ce2012a-8w5wx\" (UID: \"0d1796bd-de03-434c-954f-593c37bec768\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9ce2012a-8w5wx" Oct 30 09:09:58.816554 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:58.816528 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxks2\" (UniqueName: \"kubernetes.io/projected/0d1796bd-de03-434c-954f-593c37bec768-kube-api-access-bxks2\") pod \"maas-api-revoke-sub-9ce2012a-8w5wx\" (UID: \"0d1796bd-de03-434c-954f-593c37bec768\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9ce2012a-8w5wx" Oct 30 09:09:58.816658 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:58.816593 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0d1796bd-de03-434c-954f-593c37bec768-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9ce2012a-8w5wx\" (UID: \"0d1796bd-de03-434c-954f-593c37bec768\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9ce2012a-8w5wx" Oct 30 09:09:58.816658 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:58.816634 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0d1796bd-de03-434c-954f-593c37bec768-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9ce2012a-8w5wx\" (UID: \"0d1796bd-de03-434c-954f-593c37bec768\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9ce2012a-8w5wx" Oct 30 09:09:58.817248 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:58.817229 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0d1796bd-de03-434c-954f-593c37bec768-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9ce2012a-8w5wx\" (UID: \"0d1796bd-de03-434c-954f-593c37bec768\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9ce2012a-8w5wx" Oct 30 09:09:58.819043 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:58.819017 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0d1796bd-de03-434c-954f-593c37bec768-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9ce2012a-8w5wx\" (UID: \"0d1796bd-de03-434c-954f-593c37bec768\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9ce2012a-8w5wx" Oct 30 09:09:58.839112 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:58.839092 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxks2\" (UniqueName: \"kubernetes.io/projected/0d1796bd-de03-434c-954f-593c37bec768-kube-api-access-bxks2\") pod \"maas-api-revoke-sub-9ce2012a-8w5wx\" (UID: \"0d1796bd-de03-434c-954f-593c37bec768\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9ce2012a-8w5wx" Oct 30 09:09:58.924443 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:58.924393 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9ce2012a-8w5wx" Oct 30 09:09:59.237222 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:59.237165 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9ce2012a-8w5wx"] Oct 30 09:09:59.239847 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:09:59.239820 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d1796bd_de03_434c_954f_593c37bec768.slice/crio-84f72f31a8366e9a273586205a6f154ed9d1a793b8203c2cea0dc0e6cd6f41c7 WatchSource:0}: Error finding container 84f72f31a8366e9a273586205a6f154ed9d1a793b8203c2cea0dc0e6cd6f41c7: Status 404 returned error can't find the container with id 84f72f31a8366e9a273586205a6f154ed9d1a793b8203c2cea0dc0e6cd6f41c7 Oct 30 09:09:59.576188 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:09:59.576163 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9ce2012a-8w5wx" event={"ID":"0d1796bd-de03-434c-954f-593c37bec768","Type":"ContainerStarted","Data":"84f72f31a8366e9a273586205a6f154ed9d1a793b8203c2cea0dc0e6cd6f41c7"} Oct 30 09:10:00.584217 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:00.584177 5028 generic.go:356] "Generic (PLEG): container finished" podID="0d1796bd-de03-434c-954f-593c37bec768" containerID="2eeb2f579f1f08b45b568658f5d66d900fa93f69b3b7065994fdd76b47cbc16a" exitCode=0 Oct 30 09:10:00.584574 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:00.584300 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9ce2012a-8w5wx" event={"ID":"0d1796bd-de03-434c-954f-593c37bec768","Type":"ContainerDied","Data":"2eeb2f579f1f08b45b568658f5d66d900fa93f69b3b7065994fdd76b47cbc16a"} Oct 30 09:10:01.729652 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:01.729628 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9ce2012a-8w5wx" Oct 30 09:10:01.847019 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:01.846939 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0d1796bd-de03-434c-954f-593c37bec768-kube-api-access-bxks2\" (UniqueName: \"kubernetes.io/projected/0d1796bd-de03-434c-954f-593c37bec768-kube-api-access-bxks2\") pod \"0d1796bd-de03-434c-954f-593c37bec768\" (UID: \"0d1796bd-de03-434c-954f-593c37bec768\") " Oct 30 09:10:01.847185 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:01.847034 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0d1796bd-de03-434c-954f-593c37bec768-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0d1796bd-de03-434c-954f-593c37bec768-maas-api-xks-ca\") pod \"0d1796bd-de03-434c-954f-593c37bec768\" (UID: \"0d1796bd-de03-434c-954f-593c37bec768\") " Oct 30 09:10:01.847288 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:01.847256 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0d1796bd-de03-434c-954f-593c37bec768-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0d1796bd-de03-434c-954f-593c37bec768-maas-api-openshift-ca\") pod \"0d1796bd-de03-434c-954f-593c37bec768\" (UID: \"0d1796bd-de03-434c-954f-593c37bec768\") " Oct 30 09:10:01.847646 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:01.847607 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d1796bd-de03-434c-954f-593c37bec768-maas-api-openshift-ca" pod "0d1796bd-de03-434c-954f-593c37bec768" (UID: "0d1796bd-de03-434c-954f-593c37bec768"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 09:10:01.849075 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:01.849047 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d1796bd-de03-434c-954f-593c37bec768-kube-api-access-bxks2" pod "0d1796bd-de03-434c-954f-593c37bec768" (UID: "0d1796bd-de03-434c-954f-593c37bec768"). InnerVolumeSpecName "kube-api-access-bxks2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 09:10:01.849272 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:01.849248 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d1796bd-de03-434c-954f-593c37bec768-maas-api-xks-ca" pod "0d1796bd-de03-434c-954f-593c37bec768" (UID: "0d1796bd-de03-434c-954f-593c37bec768"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 09:10:01.948959 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:01.948936 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0d1796bd-de03-434c-954f-593c37bec768-maas-api-openshift-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:10:01.949049 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:01.948961 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxks2\" (UniqueName: \"kubernetes.io/projected/0d1796bd-de03-434c-954f-593c37bec768-kube-api-access-bxks2\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:10:01.949049 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:01.948975 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0d1796bd-de03-434c-954f-593c37bec768-maas-api-xks-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:10:02.597413 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:02.597380 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9ce2012a-8w5wx" event={"ID":"0d1796bd-de03-434c-954f-593c37bec768","Type":"ContainerDied","Data":"84f72f31a8366e9a273586205a6f154ed9d1a793b8203c2cea0dc0e6cd6f41c7"} Oct 30 09:10:02.597413 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:02.597397 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9ce2012a-8w5wx" Oct 30 09:10:02.597612 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:02.597435 5028 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84f72f31a8366e9a273586205a6f154ed9d1a793b8203c2cea0dc0e6cd6f41c7" Oct 30 09:10:06.037639 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:06.037610 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8c66181f-9hrm9"] Oct 30 09:10:06.049171 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:06.049148 5028 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8c66181f-9hrm9"] Oct 30 09:10:07.911457 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:07.911425 5028 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="eb526886-06ef-4f1d-bd1b-d3c81ff2e10f" path="/var/lib/kubelet/pods/eb526886-06ef-4f1d-bd1b-d3c81ff2e10f/volumes" Oct 30 09:10:09.074013 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:09.073981 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4f576c80-667fz"] Oct 30 09:10:09.074463 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:09.074450 5028 cpu_manager.go:414] "containerMap: removing container" podUID="0d1796bd-de03-434c-954f-593c37bec768" containerName="revoke-keys" Oct 30 09:10:09.074512 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:09.074464 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0d1796bd-de03-434c-954f-593c37bec768" containerName="revoke-keys" Oct 30 09:10:09.074565 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:09.074557 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="0d1796bd-de03-434c-954f-593c37bec768" containerName="revoke-keys" Oct 30 09:10:09.079234 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:09.079214 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4f576c80-667fz" Oct 30 09:10:09.104639 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:09.104609 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 09:10:09.104794 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:09.104749 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kdwkr\"" Oct 30 09:10:09.113510 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:09.113474 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4f576c80-667fz"] Oct 30 09:10:09.119654 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:09.119626 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/15cb4b30-540d-4e7d-a2ec-e0944cefb1c6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4f576c80-667fz\" (UID: \"15cb4b30-540d-4e7d-a2ec-e0944cefb1c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4f576c80-667fz" Oct 30 09:10:09.119782 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:09.119707 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdj44\" (UniqueName: \"kubernetes.io/projected/15cb4b30-540d-4e7d-a2ec-e0944cefb1c6-kube-api-access-qdj44\") pod \"maas-api-revoke-sub-4f576c80-667fz\" (UID: \"15cb4b30-540d-4e7d-a2ec-e0944cefb1c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4f576c80-667fz" Oct 30 09:10:09.119846 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:09.119782 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/15cb4b30-540d-4e7d-a2ec-e0944cefb1c6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4f576c80-667fz\" (UID: \"15cb4b30-540d-4e7d-a2ec-e0944cefb1c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4f576c80-667fz" Oct 30 09:10:09.220539 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:09.220498 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdj44\" (UniqueName: \"kubernetes.io/projected/15cb4b30-540d-4e7d-a2ec-e0944cefb1c6-kube-api-access-qdj44\") pod \"maas-api-revoke-sub-4f576c80-667fz\" (UID: \"15cb4b30-540d-4e7d-a2ec-e0944cefb1c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4f576c80-667fz" Oct 30 09:10:09.220688 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:09.220602 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/15cb4b30-540d-4e7d-a2ec-e0944cefb1c6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4f576c80-667fz\" (UID: \"15cb4b30-540d-4e7d-a2ec-e0944cefb1c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4f576c80-667fz" Oct 30 09:10:09.220688 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:09.220677 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/15cb4b30-540d-4e7d-a2ec-e0944cefb1c6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4f576c80-667fz\" (UID: \"15cb4b30-540d-4e7d-a2ec-e0944cefb1c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4f576c80-667fz" Oct 30 09:10:09.221549 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:09.221524 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/15cb4b30-540d-4e7d-a2ec-e0944cefb1c6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4f576c80-667fz\" (UID: \"15cb4b30-540d-4e7d-a2ec-e0944cefb1c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4f576c80-667fz" Oct 30 09:10:09.223184 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:09.223154 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/15cb4b30-540d-4e7d-a2ec-e0944cefb1c6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4f576c80-667fz\" (UID: \"15cb4b30-540d-4e7d-a2ec-e0944cefb1c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4f576c80-667fz" Oct 30 09:10:09.243394 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:09.243367 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdj44\" (UniqueName: \"kubernetes.io/projected/15cb4b30-540d-4e7d-a2ec-e0944cefb1c6-kube-api-access-qdj44\") pod \"maas-api-revoke-sub-4f576c80-667fz\" (UID: \"15cb4b30-540d-4e7d-a2ec-e0944cefb1c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4f576c80-667fz" Oct 30 09:10:09.392752 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:09.392729 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4f576c80-667fz" Oct 30 09:10:09.693320 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:09.693294 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4f576c80-667fz"] Oct 30 09:10:09.695774 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:10:09.695748 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15cb4b30_540d_4e7d_a2ec_e0944cefb1c6.slice/crio-41d0ce797aa5e68f7d4b456581e25c412d64be73dd6230a79c808c4b180fec5d WatchSource:0}: Error finding container 41d0ce797aa5e68f7d4b456581e25c412d64be73dd6230a79c808c4b180fec5d: Status 404 returned error can't find the container with id 41d0ce797aa5e68f7d4b456581e25c412d64be73dd6230a79c808c4b180fec5d Oct 30 09:10:10.651612 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:10.651579 5028 generic.go:356] "Generic (PLEG): container finished" podID="15cb4b30-540d-4e7d-a2ec-e0944cefb1c6" containerID="10c717227ace59169372d901cda91ace28c358c58bd5c8879667f0f1b5a7b028" exitCode=0 Oct 30 09:10:10.651937 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:10.651628 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4f576c80-667fz" event={"ID":"15cb4b30-540d-4e7d-a2ec-e0944cefb1c6","Type":"ContainerDied","Data":"10c717227ace59169372d901cda91ace28c358c58bd5c8879667f0f1b5a7b028"} Oct 30 09:10:10.651937 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:10.651680 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4f576c80-667fz" event={"ID":"15cb4b30-540d-4e7d-a2ec-e0944cefb1c6","Type":"ContainerStarted","Data":"41d0ce797aa5e68f7d4b456581e25c412d64be73dd6230a79c808c4b180fec5d"} Oct 30 09:10:11.827186 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:11.827165 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4f576c80-667fz" Oct 30 09:10:11.840234 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:11.840194 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/15cb4b30-540d-4e7d-a2ec-e0944cefb1c6-kube-api-access-qdj44\" (UniqueName: \"kubernetes.io/projected/15cb4b30-540d-4e7d-a2ec-e0944cefb1c6-kube-api-access-qdj44\") pod \"15cb4b30-540d-4e7d-a2ec-e0944cefb1c6\" (UID: \"15cb4b30-540d-4e7d-a2ec-e0944cefb1c6\") " Oct 30 09:10:11.840393 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:11.840260 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/15cb4b30-540d-4e7d-a2ec-e0944cefb1c6-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/15cb4b30-540d-4e7d-a2ec-e0944cefb1c6-maas-api-xks-ca\") pod \"15cb4b30-540d-4e7d-a2ec-e0944cefb1c6\" (UID: \"15cb4b30-540d-4e7d-a2ec-e0944cefb1c6\") " Oct 30 09:10:11.840393 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:11.840349 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/15cb4b30-540d-4e7d-a2ec-e0944cefb1c6-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/15cb4b30-540d-4e7d-a2ec-e0944cefb1c6-maas-api-openshift-ca\") pod \"15cb4b30-540d-4e7d-a2ec-e0944cefb1c6\" (UID: \"15cb4b30-540d-4e7d-a2ec-e0944cefb1c6\") " Oct 30 09:10:11.840853 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:11.840826 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15cb4b30-540d-4e7d-a2ec-e0944cefb1c6-maas-api-openshift-ca" pod "15cb4b30-540d-4e7d-a2ec-e0944cefb1c6" (UID: "15cb4b30-540d-4e7d-a2ec-e0944cefb1c6"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 09:10:11.842621 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:11.842599 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15cb4b30-540d-4e7d-a2ec-e0944cefb1c6-kube-api-access-qdj44" pod "15cb4b30-540d-4e7d-a2ec-e0944cefb1c6" (UID: "15cb4b30-540d-4e7d-a2ec-e0944cefb1c6"). InnerVolumeSpecName "kube-api-access-qdj44". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 09:10:11.842840 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:11.842815 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15cb4b30-540d-4e7d-a2ec-e0944cefb1c6-maas-api-xks-ca" pod "15cb4b30-540d-4e7d-a2ec-e0944cefb1c6" (UID: "15cb4b30-540d-4e7d-a2ec-e0944cefb1c6"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 09:10:11.941378 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:11.941354 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdj44\" (UniqueName: \"kubernetes.io/projected/15cb4b30-540d-4e7d-a2ec-e0944cefb1c6-kube-api-access-qdj44\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:10:11.941378 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:11.941378 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/15cb4b30-540d-4e7d-a2ec-e0944cefb1c6-maas-api-xks-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:10:11.941530 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:11.941391 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/15cb4b30-540d-4e7d-a2ec-e0944cefb1c6-maas-api-openshift-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:10:12.671869 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:12.671829 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4f576c80-667fz" event={"ID":"15cb4b30-540d-4e7d-a2ec-e0944cefb1c6","Type":"ContainerDied","Data":"41d0ce797aa5e68f7d4b456581e25c412d64be73dd6230a79c808c4b180fec5d"} Oct 30 09:10:12.672067 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:12.671909 5028 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="41d0ce797aa5e68f7d4b456581e25c412d64be73dd6230a79c808c4b180fec5d" Oct 30 09:10:12.672179 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:12.672158 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4f576c80-667fz" Oct 30 09:10:12.755914 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:10:12.755877 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 09:10:14.040881 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:14.040840 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e48ea3c5-qx9h2"] Oct 30 09:10:14.060387 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:14.060355 5028 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e48ea3c5-qx9h2"] Oct 30 09:10:14.713232 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:14.701334 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-p5khn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 09:10:14.713232 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:14.701448 5028 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" podUID="37ad32b7-0a5f-4437-8855-cc6ddebec8e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 09:10:15.958229 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:15.957541 5028 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ee0da264-db9e-4b62-8b8f-fbdad0319de9" path="/var/lib/kubelet/pods/ee0da264-db9e-4b62-8b8f-fbdad0319de9/volumes" Oct 30 09:10:19.435279 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:19.435134 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c61f1c2e-sxw7v"] Oct 30 09:10:19.436231 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:19.435918 5028 cpu_manager.go:414] "containerMap: removing container" podUID="15cb4b30-540d-4e7d-a2ec-e0944cefb1c6" containerName="revoke-keys" Oct 30 09:10:19.436231 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:19.435942 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="15cb4b30-540d-4e7d-a2ec-e0944cefb1c6" containerName="revoke-keys" Oct 30 09:10:19.436231 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:19.436075 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="15cb4b30-540d-4e7d-a2ec-e0944cefb1c6" containerName="revoke-keys" Oct 30 09:10:19.498258 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:19.457575 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c61f1c2e-sxw7v" Oct 30 09:10:19.498258 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:19.481373 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c61f1c2e-sxw7v"] Oct 30 09:10:19.528352 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:19.522670 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 09:10:19.528352 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:19.522813 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kdwkr\"" Oct 30 09:10:19.598466 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:19.586322 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/08b2e049-adfc-4347-909b-d5c6bd08748a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c61f1c2e-sxw7v\" (UID: \"08b2e049-adfc-4347-909b-d5c6bd08748a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c61f1c2e-sxw7v" Oct 30 09:10:19.598466 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:19.586377 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjhxz\" (UniqueName: \"kubernetes.io/projected/08b2e049-adfc-4347-909b-d5c6bd08748a-kube-api-access-zjhxz\") pod \"maas-api-revoke-sub-c61f1c2e-sxw7v\" (UID: \"08b2e049-adfc-4347-909b-d5c6bd08748a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c61f1c2e-sxw7v" Oct 30 09:10:19.598466 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:19.586424 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/08b2e049-adfc-4347-909b-d5c6bd08748a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c61f1c2e-sxw7v\" (UID: \"08b2e049-adfc-4347-909b-d5c6bd08748a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c61f1c2e-sxw7v" Oct 30 09:10:19.688986 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:19.688897 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/08b2e049-adfc-4347-909b-d5c6bd08748a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c61f1c2e-sxw7v\" (UID: \"08b2e049-adfc-4347-909b-d5c6bd08748a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c61f1c2e-sxw7v" Oct 30 09:10:19.700315 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:19.700285 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjhxz\" (UniqueName: \"kubernetes.io/projected/08b2e049-adfc-4347-909b-d5c6bd08748a-kube-api-access-zjhxz\") pod \"maas-api-revoke-sub-c61f1c2e-sxw7v\" (UID: \"08b2e049-adfc-4347-909b-d5c6bd08748a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c61f1c2e-sxw7v" Oct 30 09:10:19.700835 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:19.700815 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/08b2e049-adfc-4347-909b-d5c6bd08748a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c61f1c2e-sxw7v\" (UID: \"08b2e049-adfc-4347-909b-d5c6bd08748a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c61f1c2e-sxw7v" Oct 30 09:10:19.701562 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:19.689954 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/08b2e049-adfc-4347-909b-d5c6bd08748a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c61f1c2e-sxw7v\" (UID: \"08b2e049-adfc-4347-909b-d5c6bd08748a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c61f1c2e-sxw7v" Oct 30 09:10:19.718922 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:19.718900 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/08b2e049-adfc-4347-909b-d5c6bd08748a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c61f1c2e-sxw7v\" (UID: \"08b2e049-adfc-4347-909b-d5c6bd08748a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c61f1c2e-sxw7v" Oct 30 09:10:19.742549 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:19.734810 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjhxz\" (UniqueName: \"kubernetes.io/projected/08b2e049-adfc-4347-909b-d5c6bd08748a-kube-api-access-zjhxz\") pod \"maas-api-revoke-sub-c61f1c2e-sxw7v\" (UID: \"08b2e049-adfc-4347-909b-d5c6bd08748a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c61f1c2e-sxw7v" Oct 30 09:10:19.865778 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:19.865751 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c61f1c2e-sxw7v" Oct 30 09:10:20.177634 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:20.177607 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c61f1c2e-sxw7v"] Oct 30 09:10:20.179844 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:10:20.179812 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08b2e049_adfc_4347_909b_d5c6bd08748a.slice/crio-aaf39d4ec8efd1b78c8afd7135c4f615c01dd1b278e2bd0fecc6cc2aeaaa6e64 WatchSource:0}: Error finding container aaf39d4ec8efd1b78c8afd7135c4f615c01dd1b278e2bd0fecc6cc2aeaaa6e64: Status 404 returned error can't find the container with id aaf39d4ec8efd1b78c8afd7135c4f615c01dd1b278e2bd0fecc6cc2aeaaa6e64 Oct 30 09:10:20.865461 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:20.865426 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c61f1c2e-sxw7v" event={"ID":"08b2e049-adfc-4347-909b-d5c6bd08748a","Type":"ContainerStarted","Data":"31ecca28a984aa4de24a4db5b086f9d740bff817cfc0af962d1b21eeeac773f6"} Oct 30 09:10:20.865818 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:20.865488 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c61f1c2e-sxw7v" event={"ID":"08b2e049-adfc-4347-909b-d5c6bd08748a","Type":"ContainerStarted","Data":"aaf39d4ec8efd1b78c8afd7135c4f615c01dd1b278e2bd0fecc6cc2aeaaa6e64"} Oct 30 09:10:20.909416 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:20.909367 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c61f1c2e-sxw7v" podStartSLOduration=1.90935553 podStartE2EDuration="1.90935553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 09:10:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 09:10:20.906673609 +0000 UTC m=+1035.122785968" watchObservedRunningTime="2026-10-30 09:10:20.90935553 +0000 UTC m=+1035.125467887" Oct 30 09:10:21.873988 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:21.873952 5028 generic.go:356] "Generic (PLEG): container finished" podID="08b2e049-adfc-4347-909b-d5c6bd08748a" containerID="31ecca28a984aa4de24a4db5b086f9d740bff817cfc0af962d1b21eeeac773f6" exitCode=0 Oct 30 09:10:21.874393 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:21.874043 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c61f1c2e-sxw7v" event={"ID":"08b2e049-adfc-4347-909b-d5c6bd08748a","Type":"ContainerDied","Data":"31ecca28a984aa4de24a4db5b086f9d740bff817cfc0af962d1b21eeeac773f6"} Oct 30 09:10:23.019929 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:23.019904 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c61f1c2e-sxw7v" Oct 30 09:10:23.132579 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:23.132501 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/08b2e049-adfc-4347-909b-d5c6bd08748a-kube-api-access-zjhxz\" (UniqueName: \"kubernetes.io/projected/08b2e049-adfc-4347-909b-d5c6bd08748a-kube-api-access-zjhxz\") pod \"08b2e049-adfc-4347-909b-d5c6bd08748a\" (UID: \"08b2e049-adfc-4347-909b-d5c6bd08748a\") " Oct 30 09:10:23.132725 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:23.132633 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/08b2e049-adfc-4347-909b-d5c6bd08748a-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/08b2e049-adfc-4347-909b-d5c6bd08748a-maas-api-openshift-ca\") pod \"08b2e049-adfc-4347-909b-d5c6bd08748a\" (UID: \"08b2e049-adfc-4347-909b-d5c6bd08748a\") " Oct 30 09:10:23.132725 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:23.132663 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/08b2e049-adfc-4347-909b-d5c6bd08748a-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/08b2e049-adfc-4347-909b-d5c6bd08748a-maas-api-xks-ca\") pod \"08b2e049-adfc-4347-909b-d5c6bd08748a\" (UID: \"08b2e049-adfc-4347-909b-d5c6bd08748a\") " Oct 30 09:10:23.132966 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:23.132936 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08b2e049-adfc-4347-909b-d5c6bd08748a-maas-api-openshift-ca" pod "08b2e049-adfc-4347-909b-d5c6bd08748a" (UID: "08b2e049-adfc-4347-909b-d5c6bd08748a"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 09:10:23.134490 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:23.134464 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08b2e049-adfc-4347-909b-d5c6bd08748a-kube-api-access-zjhxz" pod "08b2e049-adfc-4347-909b-d5c6bd08748a" (UID: "08b2e049-adfc-4347-909b-d5c6bd08748a"). InnerVolumeSpecName "kube-api-access-zjhxz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 09:10:23.134640 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:23.134612 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08b2e049-adfc-4347-909b-d5c6bd08748a-maas-api-xks-ca" pod "08b2e049-adfc-4347-909b-d5c6bd08748a" (UID: "08b2e049-adfc-4347-909b-d5c6bd08748a"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 09:10:23.234117 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:23.234093 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/08b2e049-adfc-4347-909b-d5c6bd08748a-maas-api-openshift-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:10:23.234117 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:23.234117 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/08b2e049-adfc-4347-909b-d5c6bd08748a-maas-api-xks-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:10:23.234326 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:23.234127 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjhxz\" (UniqueName: \"kubernetes.io/projected/08b2e049-adfc-4347-909b-d5c6bd08748a-kube-api-access-zjhxz\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:10:23.894183 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:23.894152 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c61f1c2e-sxw7v" Oct 30 09:10:23.894183 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:23.894167 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c61f1c2e-sxw7v" event={"ID":"08b2e049-adfc-4347-909b-d5c6bd08748a","Type":"ContainerDied","Data":"aaf39d4ec8efd1b78c8afd7135c4f615c01dd1b278e2bd0fecc6cc2aeaaa6e64"} Oct 30 09:10:23.894457 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:23.894246 5028 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aaf39d4ec8efd1b78c8afd7135c4f615c01dd1b278e2bd0fecc6cc2aeaaa6e64" Oct 30 09:10:24.028021 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:24.027992 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-701d685b-klbj7"] Oct 30 09:10:24.031230 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:24.031186 5028 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-701d685b-klbj7"] Oct 30 09:10:25.911184 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:25.911155 5028 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8750959f-3214-4001-9794-54686f35ef87" path="/var/lib/kubelet/pods/8750959f-3214-4001-9794-54686f35ef87/volumes" Oct 30 09:10:29.799423 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:29.799392 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b4648053-lzs45"] Oct 30 09:10:29.799900 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:29.799886 5028 cpu_manager.go:414] "containerMap: removing container" podUID="08b2e049-adfc-4347-909b-d5c6bd08748a" containerName="revoke-keys" Oct 30 09:10:29.799955 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:29.799901 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="08b2e049-adfc-4347-909b-d5c6bd08748a" containerName="revoke-keys" Oct 30 09:10:29.800005 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:29.799996 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="08b2e049-adfc-4347-909b-d5c6bd08748a" containerName="revoke-keys" Oct 30 09:10:29.803394 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:29.803376 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4648053-lzs45" Oct 30 09:10:29.817711 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:29.817666 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 09:10:29.818305 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:29.817867 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kdwkr\"" Oct 30 09:10:29.820433 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:29.820412 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b4648053-lzs45"] Oct 30 09:10:29.888660 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:29.888633 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqcwq\" (UniqueName: \"kubernetes.io/projected/54c4b613-1d77-447e-b3e2-e7d09739bf0d-kube-api-access-rqcwq\") pod \"maas-api-revoke-sub-b4648053-lzs45\" (UID: \"54c4b613-1d77-447e-b3e2-e7d09739bf0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4648053-lzs45" Oct 30 09:10:29.888803 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:29.888785 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/54c4b613-1d77-447e-b3e2-e7d09739bf0d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b4648053-lzs45\" (UID: \"54c4b613-1d77-447e-b3e2-e7d09739bf0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4648053-lzs45" Oct 30 09:10:29.888848 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:29.888818 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/54c4b613-1d77-447e-b3e2-e7d09739bf0d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b4648053-lzs45\" (UID: \"54c4b613-1d77-447e-b3e2-e7d09739bf0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4648053-lzs45" Oct 30 09:10:29.990085 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:29.990051 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/54c4b613-1d77-447e-b3e2-e7d09739bf0d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b4648053-lzs45\" (UID: \"54c4b613-1d77-447e-b3e2-e7d09739bf0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4648053-lzs45" Oct 30 09:10:29.990085 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:29.990088 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/54c4b613-1d77-447e-b3e2-e7d09739bf0d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b4648053-lzs45\" (UID: \"54c4b613-1d77-447e-b3e2-e7d09739bf0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4648053-lzs45" Oct 30 09:10:29.990365 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:29.990136 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqcwq\" (UniqueName: \"kubernetes.io/projected/54c4b613-1d77-447e-b3e2-e7d09739bf0d-kube-api-access-rqcwq\") pod \"maas-api-revoke-sub-b4648053-lzs45\" (UID: \"54c4b613-1d77-447e-b3e2-e7d09739bf0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4648053-lzs45" Oct 30 09:10:29.990952 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:29.990927 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/54c4b613-1d77-447e-b3e2-e7d09739bf0d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b4648053-lzs45\" (UID: \"54c4b613-1d77-447e-b3e2-e7d09739bf0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4648053-lzs45" Oct 30 09:10:29.992417 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:29.992394 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/54c4b613-1d77-447e-b3e2-e7d09739bf0d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b4648053-lzs45\" (UID: \"54c4b613-1d77-447e-b3e2-e7d09739bf0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4648053-lzs45" Oct 30 09:10:30.012920 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:30.012896 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqcwq\" (UniqueName: \"kubernetes.io/projected/54c4b613-1d77-447e-b3e2-e7d09739bf0d-kube-api-access-rqcwq\") pod \"maas-api-revoke-sub-b4648053-lzs45\" (UID: \"54c4b613-1d77-447e-b3e2-e7d09739bf0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4648053-lzs45" Oct 30 09:10:30.116509 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:30.116484 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4648053-lzs45" Oct 30 09:10:30.419590 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:30.419563 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b4648053-lzs45"] Oct 30 09:10:30.421781 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:10:30.421757 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54c4b613_1d77_447e_b3e2_e7d09739bf0d.slice/crio-cabc8ca9b73e6543c9f703bbd79f777403319bad12774157d5869aa14a7026c4 WatchSource:0}: Error finding container cabc8ca9b73e6543c9f703bbd79f777403319bad12774157d5869aa14a7026c4: Status 404 returned error can't find the container with id cabc8ca9b73e6543c9f703bbd79f777403319bad12774157d5869aa14a7026c4 Oct 30 09:10:30.941054 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:30.940973 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4648053-lzs45" event={"ID":"54c4b613-1d77-447e-b3e2-e7d09739bf0d","Type":"ContainerStarted","Data":"b7a724134ab7fdac7b307863a7b2cbfa3d5755e4a722c8712028e6eb5d03eb08"} Oct 30 09:10:30.941054 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:30.941023 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4648053-lzs45" event={"ID":"54c4b613-1d77-447e-b3e2-e7d09739bf0d","Type":"ContainerStarted","Data":"cabc8ca9b73e6543c9f703bbd79f777403319bad12774157d5869aa14a7026c4"} Oct 30 09:10:30.980582 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:30.980533 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4648053-lzs45" podStartSLOduration=1.9805206050000002 podStartE2EDuration="1.980520605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 09:10:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 09:10:30.97897287 +0000 UTC m=+1045.195085269" watchObservedRunningTime="2026-10-30 09:10:30.980520605 +0000 UTC m=+1045.196632960" Oct 30 09:10:31.955020 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:31.954981 5028 generic.go:356] "Generic (PLEG): container finished" podID="54c4b613-1d77-447e-b3e2-e7d09739bf0d" containerID="b7a724134ab7fdac7b307863a7b2cbfa3d5755e4a722c8712028e6eb5d03eb08" exitCode=0 Oct 30 09:10:31.955555 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:31.955290 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4648053-lzs45" event={"ID":"54c4b613-1d77-447e-b3e2-e7d09739bf0d","Type":"ContainerDied","Data":"b7a724134ab7fdac7b307863a7b2cbfa3d5755e4a722c8712028e6eb5d03eb08"} Oct 30 09:10:33.902808 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:33.902780 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4648053-lzs45" Oct 30 09:10:34.076477 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:34.076395 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/54c4b613-1d77-447e-b3e2-e7d09739bf0d-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/54c4b613-1d77-447e-b3e2-e7d09739bf0d-maas-api-openshift-ca\") pod \"54c4b613-1d77-447e-b3e2-e7d09739bf0d\" (UID: \"54c4b613-1d77-447e-b3e2-e7d09739bf0d\") " Oct 30 09:10:34.076477 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:34.076446 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/54c4b613-1d77-447e-b3e2-e7d09739bf0d-kube-api-access-rqcwq\" (UniqueName: \"kubernetes.io/projected/54c4b613-1d77-447e-b3e2-e7d09739bf0d-kube-api-access-rqcwq\") pod \"54c4b613-1d77-447e-b3e2-e7d09739bf0d\" (UID: \"54c4b613-1d77-447e-b3e2-e7d09739bf0d\") " Oct 30 09:10:34.076718 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:34.076479 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/54c4b613-1d77-447e-b3e2-e7d09739bf0d-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/54c4b613-1d77-447e-b3e2-e7d09739bf0d-maas-api-xks-ca\") pod \"54c4b613-1d77-447e-b3e2-e7d09739bf0d\" (UID: \"54c4b613-1d77-447e-b3e2-e7d09739bf0d\") " Oct 30 09:10:34.079910 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:34.079871 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54c4b613-1d77-447e-b3e2-e7d09739bf0d-maas-api-openshift-ca" pod "54c4b613-1d77-447e-b3e2-e7d09739bf0d" (UID: "54c4b613-1d77-447e-b3e2-e7d09739bf0d"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 09:10:34.185691 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:34.185656 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/54c4b613-1d77-447e-b3e2-e7d09739bf0d-maas-api-openshift-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:10:34.187889 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:34.187643 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4648053-lzs45" event={"ID":"54c4b613-1d77-447e-b3e2-e7d09739bf0d","Type":"ContainerDied","Data":"cabc8ca9b73e6543c9f703bbd79f777403319bad12774157d5869aa14a7026c4"} Oct 30 09:10:34.188065 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:34.188049 5028 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cabc8ca9b73e6543c9f703bbd79f777403319bad12774157d5869aa14a7026c4" Oct 30 09:10:34.188171 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:34.187717 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b4648053-lzs45" Oct 30 09:10:34.261225 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:34.258036 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54c4b613-1d77-447e-b3e2-e7d09739bf0d-maas-api-xks-ca" pod "54c4b613-1d77-447e-b3e2-e7d09739bf0d" (UID: "54c4b613-1d77-447e-b3e2-e7d09739bf0d"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 09:10:34.266285 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:34.265344 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54c4b613-1d77-447e-b3e2-e7d09739bf0d-kube-api-access-rqcwq" pod "54c4b613-1d77-447e-b3e2-e7d09739bf0d" (UID: "54c4b613-1d77-447e-b3e2-e7d09739bf0d"). InnerVolumeSpecName "kube-api-access-rqcwq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 09:10:34.289235 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:34.288898 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqcwq\" (UniqueName: \"kubernetes.io/projected/54c4b613-1d77-447e-b3e2-e7d09739bf0d-kube-api-access-rqcwq\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:10:34.289235 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:34.288930 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/54c4b613-1d77-447e-b3e2-e7d09739bf0d-maas-api-xks-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:10:35.042229 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:35.041408 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-086e34f9-5nb7n"] Oct 30 09:10:35.047668 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:35.047572 5028 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-086e34f9-5nb7n"] Oct 30 09:10:35.911158 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:35.911125 5028 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a47adb2a-e7a4-44ac-9af3-4be5a3316b15" path="/var/lib/kubelet/pods/a47adb2a-e7a4-44ac-9af3-4be5a3316b15/volumes" Oct 30 09:10:40.165842 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:40.165808 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d22233b9-4khxn"] Oct 30 09:10:40.166297 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:40.166267 5028 cpu_manager.go:414] "containerMap: removing container" podUID="54c4b613-1d77-447e-b3e2-e7d09739bf0d" containerName="revoke-keys" Oct 30 09:10:40.166297 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:40.166279 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="54c4b613-1d77-447e-b3e2-e7d09739bf0d" containerName="revoke-keys" Oct 30 09:10:40.166391 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:40.166381 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="54c4b613-1d77-447e-b3e2-e7d09739bf0d" containerName="revoke-keys" Oct 30 09:10:40.170800 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:40.170783 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d22233b9-4khxn" Oct 30 09:10:40.187024 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:40.186999 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d22233b9-4khxn"] Oct 30 09:10:40.194185 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:40.194165 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 09:10:40.194321 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:40.194224 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kdwkr\"" Oct 30 09:10:40.194507 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:40.194487 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fqxf\" (UniqueName: \"kubernetes.io/projected/65320ca6-2542-403e-9ab6-725e6e1015e9-kube-api-access-4fqxf\") pod \"maas-api-revoke-sub-d22233b9-4khxn\" (UID: \"65320ca6-2542-403e-9ab6-725e6e1015e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d22233b9-4khxn" Oct 30 09:10:40.194611 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:40.194592 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/65320ca6-2542-403e-9ab6-725e6e1015e9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d22233b9-4khxn\" (UID: \"65320ca6-2542-403e-9ab6-725e6e1015e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d22233b9-4khxn" Oct 30 09:10:40.194663 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:40.194629 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/65320ca6-2542-403e-9ab6-725e6e1015e9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d22233b9-4khxn\" (UID: \"65320ca6-2542-403e-9ab6-725e6e1015e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d22233b9-4khxn" Oct 30 09:10:40.295309 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:40.295280 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fqxf\" (UniqueName: \"kubernetes.io/projected/65320ca6-2542-403e-9ab6-725e6e1015e9-kube-api-access-4fqxf\") pod \"maas-api-revoke-sub-d22233b9-4khxn\" (UID: \"65320ca6-2542-403e-9ab6-725e6e1015e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d22233b9-4khxn" Oct 30 09:10:40.295455 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:40.295338 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/65320ca6-2542-403e-9ab6-725e6e1015e9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d22233b9-4khxn\" (UID: \"65320ca6-2542-403e-9ab6-725e6e1015e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d22233b9-4khxn" Oct 30 09:10:40.295455 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:40.295360 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/65320ca6-2542-403e-9ab6-725e6e1015e9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d22233b9-4khxn\" (UID: \"65320ca6-2542-403e-9ab6-725e6e1015e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d22233b9-4khxn" Oct 30 09:10:40.296140 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:40.296112 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/65320ca6-2542-403e-9ab6-725e6e1015e9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d22233b9-4khxn\" (UID: \"65320ca6-2542-403e-9ab6-725e6e1015e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d22233b9-4khxn" Oct 30 09:10:40.297802 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:40.297779 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/65320ca6-2542-403e-9ab6-725e6e1015e9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d22233b9-4khxn\" (UID: \"65320ca6-2542-403e-9ab6-725e6e1015e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d22233b9-4khxn" Oct 30 09:10:40.318544 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:40.318513 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fqxf\" (UniqueName: \"kubernetes.io/projected/65320ca6-2542-403e-9ab6-725e6e1015e9-kube-api-access-4fqxf\") pod \"maas-api-revoke-sub-d22233b9-4khxn\" (UID: \"65320ca6-2542-403e-9ab6-725e6e1015e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d22233b9-4khxn" Oct 30 09:10:40.484365 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:40.484297 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d22233b9-4khxn" Oct 30 09:10:40.788368 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:40.788342 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d22233b9-4khxn"] Oct 30 09:10:40.790719 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:10:40.790688 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65320ca6_2542_403e_9ab6_725e6e1015e9.slice/crio-5c285afe69232672e50689a819544af57ffc1c8abb446d0926ceb5ed3c803998 WatchSource:0}: Error finding container 5c285afe69232672e50689a819544af57ffc1c8abb446d0926ceb5ed3c803998: Status 404 returned error can't find the container with id 5c285afe69232672e50689a819544af57ffc1c8abb446d0926ceb5ed3c803998 Oct 30 09:10:41.249410 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:41.249382 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d22233b9-4khxn" event={"ID":"65320ca6-2542-403e-9ab6-725e6e1015e9","Type":"ContainerStarted","Data":"74493ab893a64b1de1b9720cf9dd03dcee69e7e1467a4963115865574b11c150"} Oct 30 09:10:41.249777 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:41.249430 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d22233b9-4khxn" event={"ID":"65320ca6-2542-403e-9ab6-725e6e1015e9","Type":"ContainerStarted","Data":"5c285afe69232672e50689a819544af57ffc1c8abb446d0926ceb5ed3c803998"} Oct 30 09:10:41.291271 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:41.291221 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d22233b9-4khxn" podStartSLOduration=1.291193063 podStartE2EDuration="1.291193063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 09:10:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 09:10:41.287936371 +0000 UTC m=+1055.504048729" watchObservedRunningTime="2026-10-30 09:10:41.291193063 +0000 UTC m=+1055.507305421" Oct 30 09:10:42.258030 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:42.257996 5028 generic.go:356] "Generic (PLEG): container finished" podID="65320ca6-2542-403e-9ab6-725e6e1015e9" containerID="74493ab893a64b1de1b9720cf9dd03dcee69e7e1467a4963115865574b11c150" exitCode=0 Oct 30 09:10:42.258460 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:42.258082 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d22233b9-4khxn" event={"ID":"65320ca6-2542-403e-9ab6-725e6e1015e9","Type":"ContainerDied","Data":"74493ab893a64b1de1b9720cf9dd03dcee69e7e1467a4963115865574b11c150"} Oct 30 09:10:42.763643 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:10:42.763594 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 09:10:43.490985 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:43.490634 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d22233b9-4khxn" Oct 30 09:10:43.542282 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:43.542155 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65320ca6-2542-403e-9ab6-725e6e1015e9-maas-api-openshift-ca" pod "65320ca6-2542-403e-9ab6-725e6e1015e9" (UID: "65320ca6-2542-403e-9ab6-725e6e1015e9"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 09:10:43.542532 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:43.541770 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/65320ca6-2542-403e-9ab6-725e6e1015e9-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/65320ca6-2542-403e-9ab6-725e6e1015e9-maas-api-openshift-ca\") pod \"65320ca6-2542-403e-9ab6-725e6e1015e9\" (UID: \"65320ca6-2542-403e-9ab6-725e6e1015e9\") " Oct 30 09:10:43.542849 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:43.542828 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/65320ca6-2542-403e-9ab6-725e6e1015e9-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/65320ca6-2542-403e-9ab6-725e6e1015e9-maas-api-xks-ca\") pod \"65320ca6-2542-403e-9ab6-725e6e1015e9\" (UID: \"65320ca6-2542-403e-9ab6-725e6e1015e9\") " Oct 30 09:10:43.543427 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:43.543407 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/65320ca6-2542-403e-9ab6-725e6e1015e9-kube-api-access-4fqxf\" (UniqueName: \"kubernetes.io/projected/65320ca6-2542-403e-9ab6-725e6e1015e9-kube-api-access-4fqxf\") pod \"65320ca6-2542-403e-9ab6-725e6e1015e9\" (UID: \"65320ca6-2542-403e-9ab6-725e6e1015e9\") " Oct 30 09:10:43.544215 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:43.544186 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/65320ca6-2542-403e-9ab6-725e6e1015e9-maas-api-openshift-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:10:43.564081 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:43.563952 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65320ca6-2542-403e-9ab6-725e6e1015e9-maas-api-xks-ca" pod "65320ca6-2542-403e-9ab6-725e6e1015e9" (UID: "65320ca6-2542-403e-9ab6-725e6e1015e9"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 09:10:43.629152 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:43.629098 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65320ca6-2542-403e-9ab6-725e6e1015e9-kube-api-access-4fqxf" pod "65320ca6-2542-403e-9ab6-725e6e1015e9" (UID: "65320ca6-2542-403e-9ab6-725e6e1015e9"). InnerVolumeSpecName "kube-api-access-4fqxf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 09:10:43.645175 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:43.645119 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/65320ca6-2542-403e-9ab6-725e6e1015e9-maas-api-xks-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:10:43.645175 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:43.645154 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fqxf\" (UniqueName: \"kubernetes.io/projected/65320ca6-2542-403e-9ab6-725e6e1015e9-kube-api-access-4fqxf\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:10:44.299219 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:44.299109 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d22233b9-4khxn" event={"ID":"65320ca6-2542-403e-9ab6-725e6e1015e9","Type":"ContainerDied","Data":"5c285afe69232672e50689a819544af57ffc1c8abb446d0926ceb5ed3c803998"} Oct 30 09:10:44.299664 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:44.299638 5028 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c285afe69232672e50689a819544af57ffc1c8abb446d0926ceb5ed3c803998" Oct 30 09:10:44.299815 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:44.299449 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d22233b9-4khxn" Oct 30 09:10:44.693228 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:44.692313 5028 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fcb75c45f-p5khn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 09:10:44.693228 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:44.692393 5028 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-fcb75c45f-p5khn" podUID="37ad32b7-0a5f-4437-8855-cc6ddebec8e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 09:10:46.035240 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:46.033968 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-1058f3ff-q48n2"] Oct 30 09:10:46.054228 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:46.049553 5028 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-1058f3ff-q48n2"] Oct 30 09:10:47.910933 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:47.910898 5028 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ae20e5ce-54be-4899-97c3-3424924dfb62" path="/var/lib/kubelet/pods/ae20e5ce-54be-4899-97c3-3424924dfb62/volumes" Oct 30 09:10:58.042380 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:58.042342 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-7bd398-4hb89"] Oct 30 09:10:58.043809 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:58.043784 5028 cpu_manager.go:414] "containerMap: removing container" podUID="65320ca6-2542-403e-9ab6-725e6e1015e9" containerName="revoke-keys" Oct 30 09:10:58.043963 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:58.043947 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="65320ca6-2542-403e-9ab6-725e6e1015e9" containerName="revoke-keys" Oct 30 09:10:58.044327 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:58.044307 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="65320ca6-2542-403e-9ab6-725e6e1015e9" containerName="revoke-keys" Oct 30 09:10:58.087554 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:58.087527 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-7bd398-4hb89"] Oct 30 09:10:58.108863 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:58.090371 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-7bd398-4hb89" Oct 30 09:10:58.195987 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:58.195959 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kdwkr\"" Oct 30 09:10:58.206421 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:58.196310 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 09:10:58.251051 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:58.250740 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-main-7bd398-4hb89\" (UID: \"d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-7bd398-4hb89" Oct 30 09:10:58.251051 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:58.250822 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-main-7bd398-4hb89\" (UID: \"d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-7bd398-4hb89" Oct 30 09:10:58.251051 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:58.250988 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn2n9\" (UniqueName: \"kubernetes.io/projected/d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5-kube-api-access-pn2n9\") pod \"maas-api-revoke-keys-e2e-shared-a-main-7bd398-4hb89\" (UID: \"d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-7bd398-4hb89" Oct 30 09:10:58.353706 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:58.353671 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-main-7bd398-4hb89\" (UID: \"d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-7bd398-4hb89" Oct 30 09:10:58.354759 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:58.354637 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-main-7bd398-4hb89\" (UID: \"d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-7bd398-4hb89" Oct 30 09:10:58.355050 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:58.355032 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn2n9\" (UniqueName: \"kubernetes.io/projected/d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5-kube-api-access-pn2n9\") pod \"maas-api-revoke-keys-e2e-shared-a-main-7bd398-4hb89\" (UID: \"d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-7bd398-4hb89" Oct 30 09:10:58.355515 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:58.355496 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-main-7bd398-4hb89\" (UID: \"d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-7bd398-4hb89" Oct 30 09:10:58.359724 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:58.359700 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-main-7bd398-4hb89\" (UID: \"d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-7bd398-4hb89" Oct 30 09:10:58.380992 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:58.380965 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn2n9\" (UniqueName: \"kubernetes.io/projected/d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5-kube-api-access-pn2n9\") pod \"maas-api-revoke-keys-e2e-shared-a-main-7bd398-4hb89\" (UID: \"d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-7bd398-4hb89" Oct 30 09:10:58.588238 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:58.560771 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-7bd398-4hb89" Oct 30 09:10:59.657591 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:59.657556 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-7bd398-4hb89"] Oct 30 09:10:59.799773 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:10:59.799733 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-7bd398-4hb89" event={"ID":"d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5","Type":"ContainerStarted","Data":"61400cd84f3f854c240313d7ed83e1924e09181b6983090068340469b0ed6345"} Oct 30 09:11:00.811799 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:00.811757 5028 generic.go:356] "Generic (PLEG): container finished" podID="d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5" containerID="3b1eea3eeec535b528b618df256a3db821f4aba8d867ec141b6f1c817ea9296f" exitCode=0 Oct 30 09:11:00.812316 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:00.811942 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-7bd398-4hb89" event={"ID":"d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5","Type":"ContainerDied","Data":"3b1eea3eeec535b528b618df256a3db821f4aba8d867ec141b6f1c817ea9296f"} Oct 30 09:11:01.973270 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:01.973242 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-7bd398-4hb89" Oct 30 09:11:02.078955 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:02.078880 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5-kube-api-access-pn2n9\" (UniqueName: \"kubernetes.io/projected/d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5-kube-api-access-pn2n9\") pod \"d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5\" (UID: \"d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5\") " Oct 30 09:11:02.078955 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:02.078945 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5-maas-api-xks-ca\") pod \"d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5\" (UID: \"d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5\") " Oct 30 09:11:02.079144 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:02.078981 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5-maas-api-openshift-ca\") pod \"d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5\" (UID: \"d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5\") " Oct 30 09:11:02.079479 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:02.079449 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5-maas-api-openshift-ca" pod "d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5" (UID: "d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 09:11:02.081058 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:02.081036 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5-kube-api-access-pn2n9" pod "d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5" (UID: "d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5"). InnerVolumeSpecName "kube-api-access-pn2n9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 09:11:02.081191 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:02.081177 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5-maas-api-xks-ca" pod "d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5" (UID: "d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 09:11:02.180151 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:02.180125 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pn2n9\" (UniqueName: \"kubernetes.io/projected/d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5-kube-api-access-pn2n9\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:11:02.180151 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:02.180150 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5-maas-api-xks-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:11:02.180312 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:02.180159 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5-maas-api-openshift-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:11:02.853019 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:02.852983 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-7bd398-4hb89" event={"ID":"d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5","Type":"ContainerDied","Data":"61400cd84f3f854c240313d7ed83e1924e09181b6983090068340469b0ed6345"} Oct 30 09:11:02.853484 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:02.853464 5028 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="61400cd84f3f854c240313d7ed83e1924e09181b6983090068340469b0ed6345" Oct 30 09:11:02.853640 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:02.853414 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-7bd398-4hb89" Oct 30 09:11:06.112091 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:06.112059 5028 scope.go:122] "RemoveContainer" containerID="44131507cda52ecd86ee71c10cd1fdb601d915ca81bd629555d16b4cefedc06f" Oct 30 09:11:08.479680 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:08.479643 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-main-7bd398-5cf77c9b9d-mqb7f"] Oct 30 09:11:08.513375 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:08.513342 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-main-7bd398-58947ff495wtps7"] Oct 30 09:11:12.765535 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:11:12.765496 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 09:11:13.480622 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:13.480554 5028 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-main-7bd398-5cf77c9b9d-mqb7f" podUID="a1da2960-1274-4bd6-8a08-8c3930b5d39d" containerName="payload-processing" containerID="cri-o://603478a083a2e9c6b0888dd2bfd53008242fb8ee5667706b0c0d30990713d35f" gracePeriod=25 Oct 30 09:11:13.513916 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:13.513872 5028 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-7bd398-58947ff495wtps7" podUID="e3a795d8-9441-4ec2-9aa6-57075cbd7d55" containerName="payload-pre-processing" containerID="cri-o://93d8b9257e334524b2974fe498c7d7ef54f9adc27336c7f1e7c3f60fae6f6de2" gracePeriod=25 Oct 30 09:11:13.786088 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:13.786063 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-main-7bd398-5cf77c9b9d-mqb7f" Oct 30 09:11:13.805640 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:13.805620 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-7bd398-58947ff495wtps7" Oct 30 09:11:13.889117 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:13.889081 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a1da2960-1274-4bd6-8a08-8c3930b5d39d-kube-api-access-wlcnf\" (UniqueName: \"kubernetes.io/projected/a1da2960-1274-4bd6-8a08-8c3930b5d39d-kube-api-access-wlcnf\") pod \"a1da2960-1274-4bd6-8a08-8c3930b5d39d\" (UID: \"a1da2960-1274-4bd6-8a08-8c3930b5d39d\") " Oct 30 09:11:13.889294 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:13.889152 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a1da2960-1274-4bd6-8a08-8c3930b5d39d-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1da2960-1274-4bd6-8a08-8c3930b5d39d-plugins-config-volume\") pod \"a1da2960-1274-4bd6-8a08-8c3930b5d39d\" (UID: \"a1da2960-1274-4bd6-8a08-8c3930b5d39d\") " Oct 30 09:11:13.889294 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:13.889224 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e3a795d8-9441-4ec2-9aa6-57075cbd7d55-kube-api-access-m5w9d\" (UniqueName: \"kubernetes.io/projected/e3a795d8-9441-4ec2-9aa6-57075cbd7d55-kube-api-access-m5w9d\") pod \"e3a795d8-9441-4ec2-9aa6-57075cbd7d55\" (UID: \"e3a795d8-9441-4ec2-9aa6-57075cbd7d55\") " Oct 30 09:11:13.889423 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:13.889406 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e3a795d8-9441-4ec2-9aa6-57075cbd7d55-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3a795d8-9441-4ec2-9aa6-57075cbd7d55-plugins-config-volume\") pod \"e3a795d8-9441-4ec2-9aa6-57075cbd7d55\" (UID: \"e3a795d8-9441-4ec2-9aa6-57075cbd7d55\") " Oct 30 09:11:13.889553 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:13.889518 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1da2960-1274-4bd6-8a08-8c3930b5d39d-plugins-config-volume" pod "a1da2960-1274-4bd6-8a08-8c3930b5d39d" (UID: "a1da2960-1274-4bd6-8a08-8c3930b5d39d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 09:11:13.889791 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:13.889769 5028 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1da2960-1274-4bd6-8a08-8c3930b5d39d-plugins-config-volume\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:11:13.889865 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:13.889842 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3a795d8-9441-4ec2-9aa6-57075cbd7d55-plugins-config-volume" pod "e3a795d8-9441-4ec2-9aa6-57075cbd7d55" (UID: "e3a795d8-9441-4ec2-9aa6-57075cbd7d55"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 09:11:13.891753 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:13.891729 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1da2960-1274-4bd6-8a08-8c3930b5d39d-kube-api-access-wlcnf" pod "a1da2960-1274-4bd6-8a08-8c3930b5d39d" (UID: "a1da2960-1274-4bd6-8a08-8c3930b5d39d"). InnerVolumeSpecName "kube-api-access-wlcnf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 09:11:13.891859 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:13.891765 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3a795d8-9441-4ec2-9aa6-57075cbd7d55-kube-api-access-m5w9d" pod "e3a795d8-9441-4ec2-9aa6-57075cbd7d55" (UID: "e3a795d8-9441-4ec2-9aa6-57075cbd7d55"). InnerVolumeSpecName "kube-api-access-m5w9d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 09:11:13.959113 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:13.959083 5028 generic.go:356] "Generic (PLEG): container finished" podID="e3a795d8-9441-4ec2-9aa6-57075cbd7d55" containerID="93d8b9257e334524b2974fe498c7d7ef54f9adc27336c7f1e7c3f60fae6f6de2" exitCode=0 Oct 30 09:11:13.959225 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:13.959138 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-7bd398-58947ff495wtps7" Oct 30 09:11:13.959225 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:13.959174 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-7bd398-58947ff495wtps7" event={"ID":"e3a795d8-9441-4ec2-9aa6-57075cbd7d55","Type":"ContainerDied","Data":"93d8b9257e334524b2974fe498c7d7ef54f9adc27336c7f1e7c3f60fae6f6de2"} Oct 30 09:11:13.959356 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:13.959248 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-7bd398-58947ff495wtps7" event={"ID":"e3a795d8-9441-4ec2-9aa6-57075cbd7d55","Type":"ContainerDied","Data":"125645f25cba444448e87005a3ac86d40fb46d52631a907801e5d0bb13103093"} Oct 30 09:11:13.959356 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:13.959282 5028 scope.go:122] "RemoveContainer" containerID="93d8b9257e334524b2974fe498c7d7ef54f9adc27336c7f1e7c3f60fae6f6de2" Oct 30 09:11:13.961178 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:13.961156 5028 generic.go:356] "Generic (PLEG): container finished" podID="a1da2960-1274-4bd6-8a08-8c3930b5d39d" containerID="603478a083a2e9c6b0888dd2bfd53008242fb8ee5667706b0c0d30990713d35f" exitCode=0 Oct 30 09:11:13.961307 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:13.961200 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-main-7bd398-5cf77c9b9d-mqb7f" Oct 30 09:11:13.961307 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:13.961246 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-main-7bd398-5cf77c9b9d-mqb7f" event={"ID":"a1da2960-1274-4bd6-8a08-8c3930b5d39d","Type":"ContainerDied","Data":"603478a083a2e9c6b0888dd2bfd53008242fb8ee5667706b0c0d30990713d35f"} Oct 30 09:11:13.961400 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:13.961306 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-main-7bd398-5cf77c9b9d-mqb7f" event={"ID":"a1da2960-1274-4bd6-8a08-8c3930b5d39d","Type":"ContainerDied","Data":"576cece91f165caad2aba9521c68793ea517dc0559386a9449d0996d1a76600b"} Oct 30 09:11:13.969546 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:13.969527 5028 scope.go:122] "RemoveContainer" containerID="93d8b9257e334524b2974fe498c7d7ef54f9adc27336c7f1e7c3f60fae6f6de2" Oct 30 09:11:13.969814 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:11:13.969797 5028 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93d8b9257e334524b2974fe498c7d7ef54f9adc27336c7f1e7c3f60fae6f6de2\": container with ID starting with 93d8b9257e334524b2974fe498c7d7ef54f9adc27336c7f1e7c3f60fae6f6de2 not found: ID does not exist" containerID="93d8b9257e334524b2974fe498c7d7ef54f9adc27336c7f1e7c3f60fae6f6de2" Oct 30 09:11:13.969885 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:13.969824 5028 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93d8b9257e334524b2974fe498c7d7ef54f9adc27336c7f1e7c3f60fae6f6de2"} err="failed to get container status \"93d8b9257e334524b2974fe498c7d7ef54f9adc27336c7f1e7c3f60fae6f6de2\": rpc error: code = NotFound desc = could not find container \"93d8b9257e334524b2974fe498c7d7ef54f9adc27336c7f1e7c3f60fae6f6de2\": container with ID starting with 93d8b9257e334524b2974fe498c7d7ef54f9adc27336c7f1e7c3f60fae6f6de2 not found: ID does not exist" Oct 30 09:11:13.969885 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:13.969845 5028 scope.go:122] "RemoveContainer" containerID="603478a083a2e9c6b0888dd2bfd53008242fb8ee5667706b0c0d30990713d35f" Oct 30 09:11:13.978512 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:13.978496 5028 scope.go:122] "RemoveContainer" containerID="603478a083a2e9c6b0888dd2bfd53008242fb8ee5667706b0c0d30990713d35f" Oct 30 09:11:13.978722 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:11:13.978707 5028 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"603478a083a2e9c6b0888dd2bfd53008242fb8ee5667706b0c0d30990713d35f\": container with ID starting with 603478a083a2e9c6b0888dd2bfd53008242fb8ee5667706b0c0d30990713d35f not found: ID does not exist" containerID="603478a083a2e9c6b0888dd2bfd53008242fb8ee5667706b0c0d30990713d35f" Oct 30 09:11:13.978774 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:13.978726 5028 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"603478a083a2e9c6b0888dd2bfd53008242fb8ee5667706b0c0d30990713d35f"} err="failed to get container status \"603478a083a2e9c6b0888dd2bfd53008242fb8ee5667706b0c0d30990713d35f\": rpc error: code = NotFound desc = could not find container \"603478a083a2e9c6b0888dd2bfd53008242fb8ee5667706b0c0d30990713d35f\": container with ID starting with 603478a083a2e9c6b0888dd2bfd53008242fb8ee5667706b0c0d30990713d35f not found: ID does not exist" Oct 30 09:11:13.991258 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:13.991236 5028 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3a795d8-9441-4ec2-9aa6-57075cbd7d55-plugins-config-volume\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:11:13.991258 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:13.991258 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlcnf\" (UniqueName: \"kubernetes.io/projected/a1da2960-1274-4bd6-8a08-8c3930b5d39d-kube-api-access-wlcnf\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:11:13.991410 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:13.991267 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5w9d\" (UniqueName: \"kubernetes.io/projected/e3a795d8-9441-4ec2-9aa6-57075cbd7d55-kube-api-access-m5w9d\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:11:14.040812 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:14.040762 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-main-7bd398-5cf77c9b9d-mqb7f"] Oct 30 09:11:14.047562 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:14.047539 5028 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-main-7bd398-5cf77c9b9d-mqb7f"] Oct 30 09:11:14.080271 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:14.080252 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-main-7bd398-58947ff495wtps7"] Oct 30 09:11:14.086069 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:14.086050 5028 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-main-7bd398-58947ff495wtps7"] Oct 30 09:11:14.229707 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:14.229673 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-7bd398-4hb89"] Oct 30 09:11:14.232651 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:14.232625 5028 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-main-7bd398-4hb89"] Oct 30 09:11:15.911053 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:15.911016 5028 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a1da2960-1274-4bd6-8a08-8c3930b5d39d" path="/var/lib/kubelet/pods/a1da2960-1274-4bd6-8a08-8c3930b5d39d/volumes" Oct 30 09:11:15.911590 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:15.911566 5028 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5" path="/var/lib/kubelet/pods/d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5/volumes" Oct 30 09:11:15.911950 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:15.911929 5028 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e3a795d8-9441-4ec2-9aa6-57075cbd7d55" path="/var/lib/kubelet/pods/e3a795d8-9441-4ec2-9aa6-57075cbd7d55/volumes" Oct 30 09:11:20.800520 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:20.800472 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p"] Oct 30 09:11:20.800978 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:20.800746 5028 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" podUID="5a11bacf-f72d-4610-983b-de7f28351813" containerName="istio-proxy" containerID="cri-o://86676b25443a7533ca12e6e6f1c2f13f42ec48b1cd0869677dd406b389951b75" gracePeriod=30 Oct 30 09:11:21.409804 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:21.409768 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-3f394b-vh2tr"] Oct 30 09:11:21.410258 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:21.410244 5028 cpu_manager.go:414] "containerMap: removing container" podUID="e3a795d8-9441-4ec2-9aa6-57075cbd7d55" containerName="payload-pre-processing" Oct 30 09:11:21.410309 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:21.410258 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e3a795d8-9441-4ec2-9aa6-57075cbd7d55" containerName="payload-pre-processing" Oct 30 09:11:21.410309 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:21.410273 5028 cpu_manager.go:414] "containerMap: removing container" podUID="a1da2960-1274-4bd6-8a08-8c3930b5d39d" containerName="payload-processing" Oct 30 09:11:21.410309 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:21.410278 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a1da2960-1274-4bd6-8a08-8c3930b5d39d" containerName="payload-processing" Oct 30 09:11:21.410309 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:21.410286 5028 cpu_manager.go:414] "containerMap: removing container" podUID="d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5" containerName="revoke-keys" Oct 30 09:11:21.410309 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:21.410290 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5" containerName="revoke-keys" Oct 30 09:11:21.410459 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:21.410377 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="e3a795d8-9441-4ec2-9aa6-57075cbd7d55" containerName="payload-pre-processing" Oct 30 09:11:21.410459 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:21.410386 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="d2ee5a1d-8f27-4323-8cbb-b5e05d7e57f5" containerName="revoke-keys" Oct 30 09:11:21.410459 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:21.410394 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="a1da2960-1274-4bd6-8a08-8c3930b5d39d" containerName="payload-processing" Oct 30 09:11:21.415197 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:21.415181 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-3f394b-vh2tr" Oct 30 09:11:21.431254 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:21.431227 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-3f394b-vh2tr"] Oct 30 09:11:21.439319 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:21.439297 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 09:11:21.439426 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:21.439347 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kdwkr\"" Oct 30 09:11:21.587162 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:21.576413 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b8f5f513-1f0c-4041-888c-0fcfca5d2598-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-main-3f394b-vh2tr\" (UID: \"b8f5f513-1f0c-4041-888c-0fcfca5d2598\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-3f394b-vh2tr" Oct 30 09:11:21.587162 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:21.576501 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b8f5f513-1f0c-4041-888c-0fcfca5d2598-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-main-3f394b-vh2tr\" (UID: \"b8f5f513-1f0c-4041-888c-0fcfca5d2598\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-3f394b-vh2tr" Oct 30 09:11:21.587162 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:21.576547 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r882s\" (UniqueName: \"kubernetes.io/projected/b8f5f513-1f0c-4041-888c-0fcfca5d2598-kube-api-access-r882s\") pod \"maas-api-revoke-keys-e2e-shared-b-main-3f394b-vh2tr\" (UID: \"b8f5f513-1f0c-4041-888c-0fcfca5d2598\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-3f394b-vh2tr" Oct 30 09:11:21.683445 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:21.683348 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b8f5f513-1f0c-4041-888c-0fcfca5d2598-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-main-3f394b-vh2tr\" (UID: \"b8f5f513-1f0c-4041-888c-0fcfca5d2598\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-3f394b-vh2tr" Oct 30 09:11:21.683703 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:21.683680 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r882s\" (UniqueName: \"kubernetes.io/projected/b8f5f513-1f0c-4041-888c-0fcfca5d2598-kube-api-access-r882s\") pod \"maas-api-revoke-keys-e2e-shared-b-main-3f394b-vh2tr\" (UID: \"b8f5f513-1f0c-4041-888c-0fcfca5d2598\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-3f394b-vh2tr" Oct 30 09:11:21.683951 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:21.683932 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b8f5f513-1f0c-4041-888c-0fcfca5d2598-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-main-3f394b-vh2tr\" (UID: \"b8f5f513-1f0c-4041-888c-0fcfca5d2598\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-3f394b-vh2tr" Oct 30 09:11:21.684489 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:21.684458 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b8f5f513-1f0c-4041-888c-0fcfca5d2598-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-main-3f394b-vh2tr\" (UID: \"b8f5f513-1f0c-4041-888c-0fcfca5d2598\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-3f394b-vh2tr" Oct 30 09:11:21.687129 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:21.687093 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b8f5f513-1f0c-4041-888c-0fcfca5d2598-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-main-3f394b-vh2tr\" (UID: \"b8f5f513-1f0c-4041-888c-0fcfca5d2598\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-3f394b-vh2tr" Oct 30 09:11:21.710918 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:21.710891 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r882s\" (UniqueName: \"kubernetes.io/projected/b8f5f513-1f0c-4041-888c-0fcfca5d2598-kube-api-access-r882s\") pod \"maas-api-revoke-keys-e2e-shared-b-main-3f394b-vh2tr\" (UID: \"b8f5f513-1f0c-4041-888c-0fcfca5d2598\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-3f394b-vh2tr" Oct 30 09:11:21.727832 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:21.727808 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-3f394b-vh2tr" Oct 30 09:11:22.052877 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:22.052846 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-3f394b-vh2tr"] Oct 30 09:11:22.055057 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:11:22.055025 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8f5f513_1f0c_4041_888c_0fcfca5d2598.slice/crio-efe91895eac4bb72d412b71bc4d5fe3a7bb21584281e26efb6c5da0a030224fd WatchSource:0}: Error finding container efe91895eac4bb72d412b71bc4d5fe3a7bb21584281e26efb6c5da0a030224fd: Status 404 returned error can't find the container with id efe91895eac4bb72d412b71bc4d5fe3a7bb21584281e26efb6c5da0a030224fd Oct 30 09:11:23.036989 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:23.036956 5028 generic.go:356] "Generic (PLEG): container finished" podID="b8f5f513-1f0c-4041-888c-0fcfca5d2598" containerID="1a44929cf9b899e3ed1781c044d4d01a612f3fe76e2d8ff1ecf93cf1130412b3" exitCode=0 Oct 30 09:11:23.037162 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:23.037018 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-3f394b-vh2tr" event={"ID":"b8f5f513-1f0c-4041-888c-0fcfca5d2598","Type":"ContainerDied","Data":"1a44929cf9b899e3ed1781c044d4d01a612f3fe76e2d8ff1ecf93cf1130412b3"} Oct 30 09:11:23.037162 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:23.037059 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-3f394b-vh2tr" event={"ID":"b8f5f513-1f0c-4041-888c-0fcfca5d2598","Type":"ContainerStarted","Data":"efe91895eac4bb72d412b71bc4d5fe3a7bb21584281e26efb6c5da0a030224fd"} Oct 30 09:11:24.178236 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:24.178199 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-3f394b-vh2tr" Oct 30 09:11:24.311498 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:24.311433 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b8f5f513-1f0c-4041-888c-0fcfca5d2598-kube-api-access-r882s\" (UniqueName: \"kubernetes.io/projected/b8f5f513-1f0c-4041-888c-0fcfca5d2598-kube-api-access-r882s\") pod \"b8f5f513-1f0c-4041-888c-0fcfca5d2598\" (UID: \"b8f5f513-1f0c-4041-888c-0fcfca5d2598\") " Oct 30 09:11:24.311614 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:24.311526 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b8f5f513-1f0c-4041-888c-0fcfca5d2598-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b8f5f513-1f0c-4041-888c-0fcfca5d2598-maas-api-xks-ca\") pod \"b8f5f513-1f0c-4041-888c-0fcfca5d2598\" (UID: \"b8f5f513-1f0c-4041-888c-0fcfca5d2598\") " Oct 30 09:11:24.311614 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:24.311603 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b8f5f513-1f0c-4041-888c-0fcfca5d2598-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b8f5f513-1f0c-4041-888c-0fcfca5d2598-maas-api-openshift-ca\") pod \"b8f5f513-1f0c-4041-888c-0fcfca5d2598\" (UID: \"b8f5f513-1f0c-4041-888c-0fcfca5d2598\") " Oct 30 09:11:24.311949 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:24.311925 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8f5f513-1f0c-4041-888c-0fcfca5d2598-maas-api-openshift-ca" pod "b8f5f513-1f0c-4041-888c-0fcfca5d2598" (UID: "b8f5f513-1f0c-4041-888c-0fcfca5d2598"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 09:11:24.313459 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:24.313438 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8f5f513-1f0c-4041-888c-0fcfca5d2598-kube-api-access-r882s" pod "b8f5f513-1f0c-4041-888c-0fcfca5d2598" (UID: "b8f5f513-1f0c-4041-888c-0fcfca5d2598"). InnerVolumeSpecName "kube-api-access-r882s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 09:11:24.313535 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:24.313519 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8f5f513-1f0c-4041-888c-0fcfca5d2598-maas-api-xks-ca" pod "b8f5f513-1f0c-4041-888c-0fcfca5d2598" (UID: "b8f5f513-1f0c-4041-888c-0fcfca5d2598"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 09:11:24.413074 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:24.413045 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r882s\" (UniqueName: \"kubernetes.io/projected/b8f5f513-1f0c-4041-888c-0fcfca5d2598-kube-api-access-r882s\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:11:24.413074 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:24.413071 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b8f5f513-1f0c-4041-888c-0fcfca5d2598-maas-api-xks-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:11:24.413217 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:24.413087 5028 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b8f5f513-1f0c-4041-888c-0fcfca5d2598-maas-api-openshift-ca\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:11:25.050318 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:25.050283 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-3f394b-vh2tr" event={"ID":"b8f5f513-1f0c-4041-888c-0fcfca5d2598","Type":"ContainerDied","Data":"efe91895eac4bb72d412b71bc4d5fe3a7bb21584281e26efb6c5da0a030224fd"} Oct 30 09:11:25.050318 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:25.050314 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-3f394b-vh2tr" Oct 30 09:11:25.050579 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:25.050328 5028 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="efe91895eac4bb72d412b71bc4d5fe3a7bb21584281e26efb6c5da0a030224fd" Oct 30 09:11:26.059321 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.059295 5028 generic.go:356] "Generic (PLEG): container finished" podID="5a11bacf-f72d-4610-983b-de7f28351813" containerID="86676b25443a7533ca12e6e6f1c2f13f42ec48b1cd0869677dd406b389951b75" exitCode=0 Oct 30 09:11:26.059642 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.059372 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" event={"ID":"5a11bacf-f72d-4610-983b-de7f28351813","Type":"ContainerDied","Data":"86676b25443a7533ca12e6e6f1c2f13f42ec48b1cd0869677dd406b389951b75"} Oct 30 09:11:26.059642 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.059427 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" event={"ID":"5a11bacf-f72d-4610-983b-de7f28351813","Type":"ContainerDied","Data":"bcf70f926e2db226730d45713f800fdfe001472c38aa941812564f820fb9ad1d"} Oct 30 09:11:26.059642 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.059446 5028 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bcf70f926e2db226730d45713f800fdfe001472c38aa941812564f820fb9ad1d" Oct 30 09:11:26.059642 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.059460 5028 scope.go:122] "RemoveContainer" containerID="9c2f77cd1f4d1da693cbb3c9777a6c3d92b90aaafdc9b25d065057d985f748a2" Oct 30 09:11:26.065417 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.065399 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:11:26.243428 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.243405 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5a11bacf-f72d-4610-983b-de7f28351813-istio-token\" (UniqueName: \"kubernetes.io/projected/5a11bacf-f72d-4610-983b-de7f28351813-istio-token\") pod \"5a11bacf-f72d-4610-983b-de7f28351813\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " Oct 30 09:11:26.243590 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.243439 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-workload-certs\") pod \"5a11bacf-f72d-4610-983b-de7f28351813\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " Oct 30 09:11:26.243590 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.243469 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5a11bacf-f72d-4610-983b-de7f28351813-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a11bacf-f72d-4610-983b-de7f28351813-istio-podinfo\") pod \"5a11bacf-f72d-4610-983b-de7f28351813\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " Oct 30 09:11:26.243590 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.243507 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-workload-socket\") pod \"5a11bacf-f72d-4610-983b-de7f28351813\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " Oct 30 09:11:26.243590 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.243537 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5a11bacf-f72d-4610-983b-de7f28351813-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a11bacf-f72d-4610-983b-de7f28351813-istiod-ca-cert\") pod \"5a11bacf-f72d-4610-983b-de7f28351813\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " Oct 30 09:11:26.243590 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.243573 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-credential-socket\") pod \"5a11bacf-f72d-4610-983b-de7f28351813\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " Oct 30 09:11:26.243862 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.243602 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-istio-data\") pod \"5a11bacf-f72d-4610-983b-de7f28351813\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " Oct 30 09:11:26.243862 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.243645 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5a11bacf-f72d-4610-983b-de7f28351813-kube-api-access-wxrvl\" (UniqueName: \"kubernetes.io/projected/5a11bacf-f72d-4610-983b-de7f28351813-kube-api-access-wxrvl\") pod \"5a11bacf-f72d-4610-983b-de7f28351813\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " Oct 30 09:11:26.243862 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.243696 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-istio-envoy\") pod \"5a11bacf-f72d-4610-983b-de7f28351813\" (UID: \"5a11bacf-f72d-4610-983b-de7f28351813\") " Oct 30 09:11:26.243862 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.243775 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-workload-certs" pod "5a11bacf-f72d-4610-983b-de7f28351813" (UID: "5a11bacf-f72d-4610-983b-de7f28351813"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 09:11:26.244134 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.243874 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-workload-socket" pod "5a11bacf-f72d-4610-983b-de7f28351813" (UID: "5a11bacf-f72d-4610-983b-de7f28351813"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 09:11:26.244192 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.244133 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a11bacf-f72d-4610-983b-de7f28351813-istiod-ca-cert" pod "5a11bacf-f72d-4610-983b-de7f28351813" (UID: "5a11bacf-f72d-4610-983b-de7f28351813"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 09:11:26.244276 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.244189 5028 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-workload-socket\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:11:26.244276 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.244232 5028 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-workload-certs\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:11:26.244467 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.244411 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-credential-socket" pod "5a11bacf-f72d-4610-983b-de7f28351813" (UID: "5a11bacf-f72d-4610-983b-de7f28351813"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 09:11:26.244807 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.244781 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-istio-data" pod "5a11bacf-f72d-4610-983b-de7f28351813" (UID: "5a11bacf-f72d-4610-983b-de7f28351813"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 09:11:26.245791 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.245766 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a11bacf-f72d-4610-983b-de7f28351813-istio-token" pod "5a11bacf-f72d-4610-983b-de7f28351813" (UID: "5a11bacf-f72d-4610-983b-de7f28351813"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 09:11:26.245870 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.245811 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5a11bacf-f72d-4610-983b-de7f28351813-istio-podinfo" pod "5a11bacf-f72d-4610-983b-de7f28351813" (UID: "5a11bacf-f72d-4610-983b-de7f28351813"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 09:11:26.246307 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.246283 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-istio-envoy" pod "5a11bacf-f72d-4610-983b-de7f28351813" (UID: "5a11bacf-f72d-4610-983b-de7f28351813"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 09:11:26.246307 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.246301 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a11bacf-f72d-4610-983b-de7f28351813-kube-api-access-wxrvl" pod "5a11bacf-f72d-4610-983b-de7f28351813" (UID: "5a11bacf-f72d-4610-983b-de7f28351813"). InnerVolumeSpecName "kube-api-access-wxrvl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 09:11:26.345695 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.345673 5028 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a11bacf-f72d-4610-983b-de7f28351813-istiod-ca-cert\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:11:26.345784 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.345696 5028 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-credential-socket\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:11:26.345784 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.345709 5028 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-istio-data\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:11:26.345784 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.345718 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxrvl\" (UniqueName: \"kubernetes.io/projected/5a11bacf-f72d-4610-983b-de7f28351813-kube-api-access-wxrvl\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:11:26.345784 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.345727 5028 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a11bacf-f72d-4610-983b-de7f28351813-istio-envoy\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:11:26.345784 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.345735 5028 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a11bacf-f72d-4610-983b-de7f28351813-istio-token\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:11:26.345784 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:26.345742 5028 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a11bacf-f72d-4610-983b-de7f28351813-istio-podinfo\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:11:27.067288 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:27.067261 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p" Oct 30 09:11:27.165255 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:27.165218 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p"] Oct 30 09:11:27.169633 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:27.169607 5028 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-main-7bd398-openshift-default-76b656ffb5-g6j7p"] Oct 30 09:11:27.910828 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:27.910794 5028 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5a11bacf-f72d-4610-983b-de7f28351813" path="/var/lib/kubelet/pods/5a11bacf-f72d-4610-983b-de7f28351813/volumes" Oct 30 09:11:31.925600 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:31.925571 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7"] Oct 30 09:11:31.964020 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:31.963980 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw"] Oct 30 09:11:33.580719 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:33.580676 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-3f394b-vh2tr"] Oct 30 09:11:33.603826 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:33.603789 5028 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-main-3f394b-vh2tr"] Oct 30 09:11:33.911697 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:33.911667 5028 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b8f5f513-1f0c-4041-888c-0fcfca5d2598" path="/var/lib/kubelet/pods/b8f5f513-1f0c-4041-888c-0fcfca5d2598/volumes" Oct 30 09:11:36.925800 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:36.925762 5028 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7" podUID="8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b" containerName="payload-processing" containerID="cri-o://fd60ae10e33cb4246196db2dba7ac7cc517f8e7c1e6a4f50d5a918a061ace543" gracePeriod=25 Oct 30 09:11:36.964400 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:36.964369 5028 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw" podUID="d59cfe97-15ab-496e-9917-e4501f8f7249" containerName="payload-pre-processing" containerID="cri-o://fffae8cacc76918c5e7f37e2482b84641a5de8a0c214b5ad68d60e6bf7ab7d1b" gracePeriod=25 Oct 30 09:11:39.445733 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:39.445690 5028 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw" podUID="d59cfe97-15ab-496e-9917-e4501f8f7249" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 30 09:11:39.446087 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:39.445845 5028 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7" podUID="8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 30 09:11:42.741585 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:11:42.741546 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 09:11:49.446586 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:49.446547 5028 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw" podUID="d59cfe97-15ab-496e-9917-e4501f8f7249" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 30 09:11:49.447139 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:49.446550 5028 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7" podUID="8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 30 09:11:52.049581 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:52.049552 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-bff4ccf6f-7hqqw_0b97d933-5570-4ce2-86dd-db6e1c8a3ed1/manager/0.log" Oct 30 09:11:52.524665 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:52.524633 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-zksvh_e4569615-7d5a-4841-8684-514a391362c2/manager/0.log" Oct 30 09:11:54.649028 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:54.648997 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-13ccea3e-82p7w_93b4c66b-5f09-403b-a9cb-328c663c2013/revoke-keys/0.log" Oct 30 09:11:54.836528 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:54.836488 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-3aa439f4-zzckf_7a833d49-fa71-4144-922b-d7242dad03b0/revoke-keys/0.log" Oct 30 09:11:55.034761 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:55.034688 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-4f576c80-667fz_15cb4b30-540d-4e7d-a2ec-e0944cefb1c6/revoke-keys/0.log" Oct 30 09:11:55.210161 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:55.210128 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-5a042a34-tlp4m_d6e9140c-8f7b-46af-9047-32c2b7cb3099/revoke-keys/0.log" Oct 30 09:11:55.394951 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:55.394926 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-6f7b1f4f-nnhxg_6988c9dd-b724-42e2-9726-55dfac1befd8/revoke-keys/0.log" Oct 30 09:11:55.579343 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:55.579322 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-85723326-mxtsv_54670664-247d-4c0f-8052-79bd30be33c6/revoke-keys/0.log" Oct 30 09:11:55.766035 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:55.765975 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-9ce2012a-8w5wx_0d1796bd-de03-434c-954f-593c37bec768/revoke-keys/0.log" Oct 30 09:11:55.959958 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:55.959934 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-b4648053-lzs45_54c4b613-1d77-447e-b3e2-e7d09739bf0d/revoke-keys/0.log" Oct 30 09:11:56.145142 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:56.145121 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-c61f1c2e-sxw7v_08b2e049-adfc-4347-909b-d5c6bd08748a/revoke-keys/0.log" Oct 30 09:11:56.326571 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:56.326545 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-d22233b9-4khxn_65320ca6-2542-403e-9ab6-725e6e1015e9/revoke-keys/0.log" Oct 30 09:11:56.520557 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:56.520491 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-d9ec3d8e-f98nd_9061938d-3282-4801-9610-4bee14a71ee1/revoke-keys/0.log" Oct 30 09:11:56.699258 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:56.699234 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-r2fh8_16a56bac-f82e-4df6-9adb-5031d545c4a0/postgres/0.log" Oct 30 09:11:57.214232 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.214196 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7" Oct 30 09:11:57.241815 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.241789 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw" Oct 30 09:11:57.266747 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.266719 5028 generic.go:356] "Generic (PLEG): container finished" podID="8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b" containerID="fd60ae10e33cb4246196db2dba7ac7cc517f8e7c1e6a4f50d5a918a061ace543" exitCode=0 Oct 30 09:11:57.266866 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.266760 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7" Oct 30 09:11:57.266866 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.266789 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7" event={"ID":"8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b","Type":"ContainerDied","Data":"fd60ae10e33cb4246196db2dba7ac7cc517f8e7c1e6a4f50d5a918a061ace543"} Oct 30 09:11:57.266866 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.266836 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7" event={"ID":"8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b","Type":"ContainerDied","Data":"bc36fabe4ddfc2d44d98c3898408c488cd95484c0c280b0a975b72ce68b14325"} Oct 30 09:11:57.267014 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.266869 5028 scope.go:122] "RemoveContainer" containerID="fd60ae10e33cb4246196db2dba7ac7cc517f8e7c1e6a4f50d5a918a061ace543" Oct 30 09:11:57.268191 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.268171 5028 generic.go:356] "Generic (PLEG): container finished" podID="d59cfe97-15ab-496e-9917-e4501f8f7249" containerID="fffae8cacc76918c5e7f37e2482b84641a5de8a0c214b5ad68d60e6bf7ab7d1b" exitCode=0 Oct 30 09:11:57.268305 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.268226 5028 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw" Oct 30 09:11:57.268305 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.268237 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw" event={"ID":"d59cfe97-15ab-496e-9917-e4501f8f7249","Type":"ContainerDied","Data":"fffae8cacc76918c5e7f37e2482b84641a5de8a0c214b5ad68d60e6bf7ab7d1b"} Oct 30 09:11:57.268305 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.268281 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw" event={"ID":"d59cfe97-15ab-496e-9917-e4501f8f7249","Type":"ContainerDied","Data":"6acfe9b2e1e5b9b1406415177a6505f7faf27d0749d2e392686f223e967db47b"} Oct 30 09:11:57.278440 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.278425 5028 scope.go:122] "RemoveContainer" containerID="fd60ae10e33cb4246196db2dba7ac7cc517f8e7c1e6a4f50d5a918a061ace543" Oct 30 09:11:57.278755 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:11:57.278730 5028 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd60ae10e33cb4246196db2dba7ac7cc517f8e7c1e6a4f50d5a918a061ace543\": container with ID starting with fd60ae10e33cb4246196db2dba7ac7cc517f8e7c1e6a4f50d5a918a061ace543 not found: ID does not exist" containerID="fd60ae10e33cb4246196db2dba7ac7cc517f8e7c1e6a4f50d5a918a061ace543" Oct 30 09:11:57.278816 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.278760 5028 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd60ae10e33cb4246196db2dba7ac7cc517f8e7c1e6a4f50d5a918a061ace543"} err="failed to get container status \"fd60ae10e33cb4246196db2dba7ac7cc517f8e7c1e6a4f50d5a918a061ace543\": rpc error: code = NotFound desc = could not find container \"fd60ae10e33cb4246196db2dba7ac7cc517f8e7c1e6a4f50d5a918a061ace543\": container with ID starting with fd60ae10e33cb4246196db2dba7ac7cc517f8e7c1e6a4f50d5a918a061ace543 not found: ID does not exist" Oct 30 09:11:57.278816 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.278776 5028 scope.go:122] "RemoveContainer" containerID="fffae8cacc76918c5e7f37e2482b84641a5de8a0c214b5ad68d60e6bf7ab7d1b" Oct 30 09:11:57.287414 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.287394 5028 scope.go:122] "RemoveContainer" containerID="fffae8cacc76918c5e7f37e2482b84641a5de8a0c214b5ad68d60e6bf7ab7d1b" Oct 30 09:11:57.287741 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:11:57.287707 5028 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fffae8cacc76918c5e7f37e2482b84641a5de8a0c214b5ad68d60e6bf7ab7d1b\": container with ID starting with fffae8cacc76918c5e7f37e2482b84641a5de8a0c214b5ad68d60e6bf7ab7d1b not found: ID does not exist" containerID="fffae8cacc76918c5e7f37e2482b84641a5de8a0c214b5ad68d60e6bf7ab7d1b" Oct 30 09:11:57.287818 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.287749 5028 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fffae8cacc76918c5e7f37e2482b84641a5de8a0c214b5ad68d60e6bf7ab7d1b"} err="failed to get container status \"fffae8cacc76918c5e7f37e2482b84641a5de8a0c214b5ad68d60e6bf7ab7d1b\": rpc error: code = NotFound desc = could not find container \"fffae8cacc76918c5e7f37e2482b84641a5de8a0c214b5ad68d60e6bf7ab7d1b\": container with ID starting with fffae8cacc76918c5e7f37e2482b84641a5de8a0c214b5ad68d60e6bf7ab7d1b not found: ID does not exist" Oct 30 09:11:57.334657 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.334634 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b-plugins-config-volume\") pod \"8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b\" (UID: \"8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b\") " Oct 30 09:11:57.334761 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.334692 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d59cfe97-15ab-496e-9917-e4501f8f7249-kube-api-access-m2466\" (UniqueName: \"kubernetes.io/projected/d59cfe97-15ab-496e-9917-e4501f8f7249-kube-api-access-m2466\") pod \"d59cfe97-15ab-496e-9917-e4501f8f7249\" (UID: \"d59cfe97-15ab-496e-9917-e4501f8f7249\") " Oct 30 09:11:57.334803 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.334769 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d59cfe97-15ab-496e-9917-e4501f8f7249-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d59cfe97-15ab-496e-9917-e4501f8f7249-plugins-config-volume\") pod \"d59cfe97-15ab-496e-9917-e4501f8f7249\" (UID: \"d59cfe97-15ab-496e-9917-e4501f8f7249\") " Oct 30 09:11:57.334842 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.334823 5028 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b-kube-api-access-t59zp\" (UniqueName: \"kubernetes.io/projected/8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b-kube-api-access-t59zp\") pod \"8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b\" (UID: \"8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b\") " Oct 30 09:11:57.335135 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.335107 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b-plugins-config-volume" pod "8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b" (UID: "8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 09:11:57.335225 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.335160 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d59cfe97-15ab-496e-9917-e4501f8f7249-plugins-config-volume" pod "d59cfe97-15ab-496e-9917-e4501f8f7249" (UID: "d59cfe97-15ab-496e-9917-e4501f8f7249"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 09:11:57.336685 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.336666 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d59cfe97-15ab-496e-9917-e4501f8f7249-kube-api-access-m2466" pod "d59cfe97-15ab-496e-9917-e4501f8f7249" (UID: "d59cfe97-15ab-496e-9917-e4501f8f7249"). InnerVolumeSpecName "kube-api-access-m2466". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 09:11:57.336781 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.336759 5028 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b-kube-api-access-t59zp" pod "8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b" (UID: "8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b"). InnerVolumeSpecName "kube-api-access-t59zp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 09:11:57.436220 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.436184 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2466\" (UniqueName: \"kubernetes.io/projected/d59cfe97-15ab-496e-9917-e4501f8f7249-kube-api-access-m2466\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:11:57.436304 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.436227 5028 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d59cfe97-15ab-496e-9917-e4501f8f7249-plugins-config-volume\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:11:57.436304 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.436243 5028 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t59zp\" (UniqueName: \"kubernetes.io/projected/8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b-kube-api-access-t59zp\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:11:57.436304 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.436258 5028 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b-plugins-config-volume\") on node \"ip-10-0-140-65.ec2.internal\" DevicePath \"\"" Oct 30 09:11:57.615195 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.615173 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7"] Oct 30 09:11:57.620750 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.620732 5028 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-main-3f394b-5c9786f8d8-2jjs7"] Oct 30 09:11:57.654451 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.654425 5028 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw"] Oct 30 09:11:57.663314 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.663291 5028 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-main-3f394b-7f4bb44bff55whw"] Oct 30 09:11:57.910108 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.910081 5028 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b" path="/var/lib/kubelet/pods/8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b/volumes" Oct 30 09:11:57.910494 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:57.910480 5028 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d59cfe97-15ab-496e-9917-e4501f8f7249" path="/var/lib/kubelet/pods/d59cfe97-15ab-496e-9917-e4501f8f7249/volumes" Oct 30 09:11:58.431454 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:58.431431 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-jffhs_0a33a4c8-c195-44cb-b10c-7fc71f7428e6/manager/0.log" Oct 30 09:11:58.642448 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:58.642419 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-6zbnf_e5747093-4ff8-4a2f-915a-31271e9ccf1f/manager/0.log" Oct 30 09:11:59.126493 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:11:59.126468 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-7ns9n_d04c24e1-b59c-412c-af1f-58b220325b38/manager/0.log" Oct 30 09:12:00.325922 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:00.325879 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7c689579c-cm45f_9494399d-55d2-48ce-a8fa-4ffd9d1e9307/istio-proxy/0.log" Oct 30 09:12:00.529485 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:00.529461 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-cdrr6_17ab8d72-af0f-4eac-9f1a-1b407a38f0d0/discovery/0.log" Oct 30 09:12:01.484646 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:01.484619 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-9p2l5_5bffb6ff-3933-4688-ac60-835c70b0ce3c/istio-proxy/0.log" Oct 30 09:12:01.663873 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:01.663843 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-dr8ns_22314808-f2ad-49af-9cd2-f2f90f33b795/istio-proxy/0.log" Oct 30 09:12:02.239895 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:02.239857 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-p5khn_37ad32b7-0a5f-4437-8855-cc6ddebec8e3/istio-proxy/0.log" Oct 30 09:12:02.827909 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:02.827879 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-wkmvv_9c855b64-13be-4e63-8f3f-531056c34afc/istio-proxy/1.log" Oct 30 09:12:03.022717 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:03.022684 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc_5bafdeba-c0c2-48ef-9dbe-b189447b40bf/istio-proxy/0.log" Oct 30 09:12:03.221041 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:03.221013 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-w7gvc_8568914d-177e-4c0a-ab3b-deb3f6f79c84/payload-pre-processing/0.log" Oct 30 09:12:03.411022 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:03.410994 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-j2vnb_7da56025-b457-4cd5-9b72-9182d1420139/payload-processing/0.log" Oct 30 09:12:03.590641 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:03.590619 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-777d6b9d77-br8dn_f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f/router/0.log" Oct 30 09:12:04.037395 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:04.037321 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-wkmvv_9c855b64-13be-4e63-8f3f-531056c34afc/istio-proxy/0.log" Oct 30 09:12:04.607006 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:04.606979 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-dqvlj_26bf54d7-59dc-4eca-a226-0957237ae034/main/0.log" Oct 30 09:12:04.998936 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:04.998869 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-zcm66_781b05d1-4d9b-46de-8fff-4d26569ca881/main/0.log" Oct 30 09:12:05.405597 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:05.405568 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88x4xh_3e8ed68f-dab6-4e98-9005-919bde2da988/main/0.log" Oct 30 09:12:05.806941 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:05.806865 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-ssf75_fe0b4ce0-4aec-420c-8735-6ae70d6647ff/main/0.log" Oct 30 09:12:06.139092 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:06.139063 5028 scope.go:122] "RemoveContainer" containerID="588e7895f9a44111ab4c7c64b70d72c18026e9c15b8cac7d529ef1356e4b6e3d" Oct 30 09:12:06.148433 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:06.148412 5028 scope.go:122] "RemoveContainer" containerID="55e71fe5a1a05f0f542d31d862c6c06eeb90b9fa06cfbff1ba31e4b87032cba3" Oct 30 09:12:06.159267 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:06.159249 5028 scope.go:122] "RemoveContainer" containerID="7609243a0717976ff954b49179fe65908cb7bceb023112448ce237bb385a4ef7" Oct 30 09:12:06.167421 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:06.167404 5028 scope.go:122] "RemoveContainer" containerID="6c441589d9e9cf036c1bdda7a6e1c48f6fc7f9ff7b5c402cdff4263a4e9bd64b" Oct 30 09:12:12.742663 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:12:12.742626 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 09:12:15.894101 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:15.894073 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-k4gtj/must-gather-twmlj"] Oct 30 09:12:15.894520 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:15.894508 5028 cpu_manager.go:414] "containerMap: removing container" podUID="b8f5f513-1f0c-4041-888c-0fcfca5d2598" containerName="revoke-keys" Oct 30 09:12:15.894520 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:15.894520 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b8f5f513-1f0c-4041-888c-0fcfca5d2598" containerName="revoke-keys" Oct 30 09:12:15.894597 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:15.894540 5028 cpu_manager.go:414] "containerMap: removing container" podUID="8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b" containerName="payload-processing" Oct 30 09:12:15.894597 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:15.894545 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b" containerName="payload-processing" Oct 30 09:12:15.894597 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:15.894555 5028 cpu_manager.go:414] "containerMap: removing container" podUID="5a11bacf-f72d-4610-983b-de7f28351813" containerName="istio-proxy" Oct 30 09:12:15.894597 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:15.894560 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5a11bacf-f72d-4610-983b-de7f28351813" containerName="istio-proxy" Oct 30 09:12:15.894597 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:15.894566 5028 cpu_manager.go:414] "containerMap: removing container" podUID="d59cfe97-15ab-496e-9917-e4501f8f7249" containerName="payload-pre-processing" Oct 30 09:12:15.894597 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:15.894571 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d59cfe97-15ab-496e-9917-e4501f8f7249" containerName="payload-pre-processing" Oct 30 09:12:15.894597 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:15.894577 5028 cpu_manager.go:414] "containerMap: removing container" podUID="5a11bacf-f72d-4610-983b-de7f28351813" containerName="istio-proxy" Oct 30 09:12:15.894597 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:15.894582 5028 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5a11bacf-f72d-4610-983b-de7f28351813" containerName="istio-proxy" Oct 30 09:12:15.894825 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:15.894656 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="5a11bacf-f72d-4610-983b-de7f28351813" containerName="istio-proxy" Oct 30 09:12:15.894825 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:15.894663 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="d59cfe97-15ab-496e-9917-e4501f8f7249" containerName="payload-pre-processing" Oct 30 09:12:15.894825 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:15.894670 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="5a11bacf-f72d-4610-983b-de7f28351813" containerName="istio-proxy" Oct 30 09:12:15.894825 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:15.894680 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="b8f5f513-1f0c-4041-888c-0fcfca5d2598" containerName="revoke-keys" Oct 30 09:12:15.894825 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:15.894688 5028 memory_manager.go:365] "RemoveStaleState removing state" podUID="8dd6f0f9-dbb1-4fa4-8ac4-3882456d270b" containerName="payload-processing" Oct 30 09:12:15.899887 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:15.899870 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k4gtj/must-gather-twmlj" Oct 30 09:12:15.918060 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:15.918036 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k4gtj/must-gather-twmlj"] Oct 30 09:12:15.925560 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:15.925539 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k4gtj\"/\"kube-root-ca.crt\"" Oct 30 09:12:15.925678 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:15.925646 5028 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k4gtj\"/\"openshift-service-ca.crt\"" Oct 30 09:12:15.928830 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:15.928816 5028 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-k4gtj\"/\"default-dockercfg-jvtk8\"" Oct 30 09:12:15.990621 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:15.990594 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdz66\" (UniqueName: \"kubernetes.io/projected/d3bef099-dfb9-47db-ad46-32b45e050f98-kube-api-access-qdz66\") pod \"must-gather-twmlj\" (UID: \"d3bef099-dfb9-47db-ad46-32b45e050f98\") " pod="openshift-must-gather-k4gtj/must-gather-twmlj" Oct 30 09:12:15.990758 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:15.990647 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d3bef099-dfb9-47db-ad46-32b45e050f98-must-gather-output\") pod \"must-gather-twmlj\" (UID: \"d3bef099-dfb9-47db-ad46-32b45e050f98\") " pod="openshift-must-gather-k4gtj/must-gather-twmlj" Oct 30 09:12:16.091927 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:16.091905 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdz66\" (UniqueName: \"kubernetes.io/projected/d3bef099-dfb9-47db-ad46-32b45e050f98-kube-api-access-qdz66\") pod \"must-gather-twmlj\" (UID: \"d3bef099-dfb9-47db-ad46-32b45e050f98\") " pod="openshift-must-gather-k4gtj/must-gather-twmlj" Oct 30 09:12:16.092065 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:16.091955 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d3bef099-dfb9-47db-ad46-32b45e050f98-must-gather-output\") pod \"must-gather-twmlj\" (UID: \"d3bef099-dfb9-47db-ad46-32b45e050f98\") " pod="openshift-must-gather-k4gtj/must-gather-twmlj" Oct 30 09:12:16.092343 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:16.092325 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d3bef099-dfb9-47db-ad46-32b45e050f98-must-gather-output\") pod \"must-gather-twmlj\" (UID: \"d3bef099-dfb9-47db-ad46-32b45e050f98\") " pod="openshift-must-gather-k4gtj/must-gather-twmlj" Oct 30 09:12:16.114273 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:16.114249 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdz66\" (UniqueName: \"kubernetes.io/projected/d3bef099-dfb9-47db-ad46-32b45e050f98-kube-api-access-qdz66\") pod \"must-gather-twmlj\" (UID: \"d3bef099-dfb9-47db-ad46-32b45e050f98\") " pod="openshift-must-gather-k4gtj/must-gather-twmlj" Oct 30 09:12:16.225043 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:16.224991 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k4gtj/must-gather-twmlj" Oct 30 09:12:16.535289 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:16.535266 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k4gtj/must-gather-twmlj"] Oct 30 09:12:16.537380 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:12:16.537348 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3bef099_dfb9_47db_ad46_32b45e050f98.slice/crio-c5e62c3b2b0006cff77e16677840bd80d49f1bade3b03983f19e789475599a28 WatchSource:0}: Error finding container c5e62c3b2b0006cff77e16677840bd80d49f1bade3b03983f19e789475599a28: Status 404 returned error can't find the container with id c5e62c3b2b0006cff77e16677840bd80d49f1bade3b03983f19e789475599a28 Oct 30 09:12:16.539185 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:16.539166 5028 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 09:12:17.403664 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:17.403622 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k4gtj/must-gather-twmlj" event={"ID":"d3bef099-dfb9-47db-ad46-32b45e050f98","Type":"ContainerStarted","Data":"a08718ce5d1aff2b5237d5cc1370470d0a6beca1ea659f49654f27afe7cfa21b"} Oct 30 09:12:17.404093 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:17.403680 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k4gtj/must-gather-twmlj" event={"ID":"d3bef099-dfb9-47db-ad46-32b45e050f98","Type":"ContainerStarted","Data":"c5e62c3b2b0006cff77e16677840bd80d49f1bade3b03983f19e789475599a28"} Oct 30 09:12:18.415012 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:18.414962 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k4gtj/must-gather-twmlj" event={"ID":"d3bef099-dfb9-47db-ad46-32b45e050f98","Type":"ContainerStarted","Data":"0e193dc76508bd787ec7bec8696379279ad38503c117084898d11e018d0c3f4e"} Oct 30 09:12:18.461073 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:18.461022 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-k4gtj/must-gather-twmlj" podStartSLOduration=2.747620488 podStartE2EDuration="3.461008231s" totalImagesPullingTime="713.387743ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 09:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 09:12:18.455226525 +0000 UTC m=+1152.671338874" watchObservedRunningTime="2026-10-30 09:12:18.461008231 +0000 UTC m=+1152.677120589" Oct 30 09:12:20.533276 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:20.533240 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xgdfr_f039cecc-3f4f-4e9b-94e5-5d46918f9487/global-pull-secret-syncer/0.log" Oct 30 09:12:20.926542 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:20.926509 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-mzwbj_0e9e7178-b316-431d-851b-565dfc341afa/connection-checker/0.log" Oct 30 09:12:21.058996 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:21.058966 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-prnqf_d4b82adb-d2fe-406a-a9e9-ea28cb3679ff/connection-checker/0.log" Oct 30 09:12:21.197892 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:21.197816 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-q4sp5_e5371073-8444-4462-93f1-2cb7cfd54d9f/connection-checker/0.log" Oct 30 09:12:21.700228 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:21.698672 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wzfpw_e1be1b32-6246-4b96-a707-6df15d3d950f/konnectivity-agent/0.log" Oct 30 09:12:22.099218 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:22.099167 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-65.ec2.internal_95a72c37fac53f4d285523d303757dc7/haproxy/0.log" Oct 30 09:12:23.217576 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:23.216899 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-bff4ccf6f-7hqqw_0b97d933-5570-4ce2-86dd-db6e1c8a3ed1/manager/0.log" Oct 30 09:12:23.322234 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:23.322178 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-bff4ccf6f-7hqqw_0b97d933-5570-4ce2-86dd-db6e1c8a3ed1/manager/0.log" Oct 30 09:12:23.376258 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:23.375936 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-zksvh_e4569615-7d5a-4841-8684-514a391362c2/manager/0.log" Oct 30 09:12:23.474824 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:23.474747 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-zksvh_e4569615-7d5a-4841-8684-514a391362c2/manager/0.log" Oct 30 09:12:25.059238 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:25.059181 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-bff4ccf6f-7hqqw_0b97d933-5570-4ce2-86dd-db6e1c8a3ed1/manager/0.log" Oct 30 09:12:25.233689 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:25.233580 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-zksvh_e4569615-7d5a-4841-8684-514a391362c2/manager/0.log" Oct 30 09:12:25.342393 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:25.342368 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-bff4ccf6f-7hqqw_0b97d933-5570-4ce2-86dd-db6e1c8a3ed1/manager/0.log" Oct 30 09:12:25.494364 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:25.494058 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-zksvh_e4569615-7d5a-4841-8684-514a391362c2/manager/0.log" Oct 30 09:12:27.055500 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:27.055470 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-bff4ccf6f-7hqqw_0b97d933-5570-4ce2-86dd-db6e1c8a3ed1/manager/0.log" Oct 30 09:12:27.194534 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:27.194507 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-zksvh_e4569615-7d5a-4841-8684-514a391362c2/manager/0.log" Oct 30 09:12:27.234227 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:27.233288 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-bff4ccf6f-7hqqw_0b97d933-5570-4ce2-86dd-db6e1c8a3ed1/manager/0.log" Oct 30 09:12:27.373360 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:27.373215 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-zksvh_e4569615-7d5a-4841-8684-514a391362c2/manager/0.log" Oct 30 09:12:27.625624 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:27.625555 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-jffhs_0a33a4c8-c195-44cb-b10c-7fc71f7428e6/manager/0.log" Oct 30 09:12:27.757251 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:27.757188 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-6zbnf_e5747093-4ff8-4a2f-915a-31271e9ccf1f/manager/0.log" Oct 30 09:12:28.163224 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:28.154948 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-7ns9n_d04c24e1-b59c-412c-af1f-58b220325b38/manager/0.log" Oct 30 09:12:29.064226 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:29.063599 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7c689579c-cm45f_9494399d-55d2-48ce-a8fa-4ffd9d1e9307/istio-proxy/0.log" Oct 30 09:12:29.288224 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:29.287747 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7c689579c-cm45f_9494399d-55d2-48ce-a8fa-4ffd9d1e9307/istio-proxy/0.log" Oct 30 09:12:30.010478 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:30.010447 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-cdrr6_17ab8d72-af0f-4eac-9f1a-1b407a38f0d0/discovery/0.log" Oct 30 09:12:30.250044 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:30.250016 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-cdrr6_17ab8d72-af0f-4eac-9f1a-1b407a38f0d0/discovery/0.log" Oct 30 09:12:30.304186 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:30.304104 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-9p2l5_5bffb6ff-3933-4688-ac60-835c70b0ce3c/istio-proxy/0.log" Oct 30 09:12:30.368111 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:30.368077 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-dr8ns_22314808-f2ad-49af-9cd2-f2f90f33b795/istio-proxy/0.log" Oct 30 09:12:30.549474 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:30.549441 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-9p2l5_5bffb6ff-3933-4688-ac60-835c70b0ce3c/istio-proxy/0.log" Oct 30 09:12:30.552672 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:30.552638 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-p5khn_37ad32b7-0a5f-4437-8855-cc6ddebec8e3/istio-proxy/0.log" Oct 30 09:12:30.617066 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:30.617040 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-dr8ns_22314808-f2ad-49af-9cd2-f2f90f33b795/istio-proxy/0.log" Oct 30 09:12:30.743637 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:30.743607 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-wkmvv_9c855b64-13be-4e63-8f3f-531056c34afc/istio-proxy/0.log" Oct 30 09:12:30.744663 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:30.744646 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-wkmvv_9c855b64-13be-4e63-8f3f-531056c34afc/istio-proxy/1.log" Oct 30 09:12:30.779804 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:30.779778 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc_5bafdeba-c0c2-48ef-9dbe-b189447b40bf/istio-proxy/0.log" Oct 30 09:12:30.812058 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:30.811700 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-p5khn_37ad32b7-0a5f-4437-8855-cc6ddebec8e3/istio-proxy/0.log" Oct 30 09:12:30.838695 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:30.838668 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-w7gvc_8568914d-177e-4c0a-ab3b-deb3f6f79c84/payload-pre-processing/0.log" Oct 30 09:12:30.899291 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:30.899196 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-j2vnb_7da56025-b457-4cd5-9b72-9182d1420139/payload-processing/0.log" Oct 30 09:12:30.952483 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:30.952442 5028 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-k4gtj/perf-node-gather-daemonset-ccv5v"] Oct 30 09:12:30.959991 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:30.959967 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k4gtj/perf-node-gather-daemonset-ccv5v" Oct 30 09:12:30.963572 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:30.963547 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-777d6b9d77-br8dn_f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f/router/0.log" Oct 30 09:12:30.973568 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:30.973545 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k4gtj/perf-node-gather-daemonset-ccv5v"] Oct 30 09:12:31.025160 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:31.025109 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwktg\" (UniqueName: \"kubernetes.io/projected/784ff9b4-30dd-4653-ace4-9d23691dffec-kube-api-access-mwktg\") pod \"perf-node-gather-daemonset-ccv5v\" (UID: \"784ff9b4-30dd-4653-ace4-9d23691dffec\") " pod="openshift-must-gather-k4gtj/perf-node-gather-daemonset-ccv5v" Oct 30 09:12:31.025383 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:31.025185 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/784ff9b4-30dd-4653-ace4-9d23691dffec-sys\") pod \"perf-node-gather-daemonset-ccv5v\" (UID: \"784ff9b4-30dd-4653-ace4-9d23691dffec\") " pod="openshift-must-gather-k4gtj/perf-node-gather-daemonset-ccv5v" Oct 30 09:12:31.025383 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:31.025200 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-wkmvv_9c855b64-13be-4e63-8f3f-531056c34afc/istio-proxy/0.log" Oct 30 09:12:31.025383 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:31.025251 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/784ff9b4-30dd-4653-ace4-9d23691dffec-proc\") pod \"perf-node-gather-daemonset-ccv5v\" (UID: \"784ff9b4-30dd-4653-ace4-9d23691dffec\") " pod="openshift-must-gather-k4gtj/perf-node-gather-daemonset-ccv5v" Oct 30 09:12:31.025383 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:31.025360 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/784ff9b4-30dd-4653-ace4-9d23691dffec-lib-modules\") pod \"perf-node-gather-daemonset-ccv5v\" (UID: \"784ff9b4-30dd-4653-ace4-9d23691dffec\") " pod="openshift-must-gather-k4gtj/perf-node-gather-daemonset-ccv5v" Oct 30 09:12:31.025642 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:31.025398 5028 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/784ff9b4-30dd-4653-ace4-9d23691dffec-podres\") pod \"perf-node-gather-daemonset-ccv5v\" (UID: \"784ff9b4-30dd-4653-ace4-9d23691dffec\") " pod="openshift-must-gather-k4gtj/perf-node-gather-daemonset-ccv5v" Oct 30 09:12:31.028288 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:31.028261 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-wkmvv_9c855b64-13be-4e63-8f3f-531056c34afc/istio-proxy/1.log" Oct 30 09:12:31.034360 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:31.034327 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-r95n6_e02c520e-2276-440e-8f36-1047f78af40a/cluster-monitoring-operator/0.log" Oct 30 09:12:31.069715 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:31.069594 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc_5bafdeba-c0c2-48ef-9dbe-b189447b40bf/istio-proxy/0.log" Oct 30 09:12:31.126593 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:31.126553 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/784ff9b4-30dd-4653-ace4-9d23691dffec-lib-modules\") pod \"perf-node-gather-daemonset-ccv5v\" (UID: \"784ff9b4-30dd-4653-ace4-9d23691dffec\") " pod="openshift-must-gather-k4gtj/perf-node-gather-daemonset-ccv5v" Oct 30 09:12:31.126794 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:31.126613 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/784ff9b4-30dd-4653-ace4-9d23691dffec-podres\") pod \"perf-node-gather-daemonset-ccv5v\" (UID: \"784ff9b4-30dd-4653-ace4-9d23691dffec\") " pod="openshift-must-gather-k4gtj/perf-node-gather-daemonset-ccv5v" Oct 30 09:12:31.126794 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:31.126698 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/784ff9b4-30dd-4653-ace4-9d23691dffec-lib-modules\") pod \"perf-node-gather-daemonset-ccv5v\" (UID: \"784ff9b4-30dd-4653-ace4-9d23691dffec\") " pod="openshift-must-gather-k4gtj/perf-node-gather-daemonset-ccv5v" Oct 30 09:12:31.126794 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:31.126698 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/784ff9b4-30dd-4653-ace4-9d23691dffec-podres\") pod \"perf-node-gather-daemonset-ccv5v\" (UID: \"784ff9b4-30dd-4653-ace4-9d23691dffec\") " pod="openshift-must-gather-k4gtj/perf-node-gather-daemonset-ccv5v" Oct 30 09:12:31.126794 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:31.126703 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwktg\" (UniqueName: \"kubernetes.io/projected/784ff9b4-30dd-4653-ace4-9d23691dffec-kube-api-access-mwktg\") pod \"perf-node-gather-daemonset-ccv5v\" (UID: \"784ff9b4-30dd-4653-ace4-9d23691dffec\") " pod="openshift-must-gather-k4gtj/perf-node-gather-daemonset-ccv5v" Oct 30 09:12:31.126794 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:31.126790 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/784ff9b4-30dd-4653-ace4-9d23691dffec-sys\") pod \"perf-node-gather-daemonset-ccv5v\" (UID: \"784ff9b4-30dd-4653-ace4-9d23691dffec\") " pod="openshift-must-gather-k4gtj/perf-node-gather-daemonset-ccv5v" Oct 30 09:12:31.127122 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:31.126848 5028 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/784ff9b4-30dd-4653-ace4-9d23691dffec-proc\") pod \"perf-node-gather-daemonset-ccv5v\" (UID: \"784ff9b4-30dd-4653-ace4-9d23691dffec\") " pod="openshift-must-gather-k4gtj/perf-node-gather-daemonset-ccv5v" Oct 30 09:12:31.127122 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:31.126903 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/784ff9b4-30dd-4653-ace4-9d23691dffec-proc\") pod \"perf-node-gather-daemonset-ccv5v\" (UID: \"784ff9b4-30dd-4653-ace4-9d23691dffec\") " pod="openshift-must-gather-k4gtj/perf-node-gather-daemonset-ccv5v" Oct 30 09:12:31.127122 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:31.127063 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/784ff9b4-30dd-4653-ace4-9d23691dffec-sys\") pod \"perf-node-gather-daemonset-ccv5v\" (UID: \"784ff9b4-30dd-4653-ace4-9d23691dffec\") " pod="openshift-must-gather-k4gtj/perf-node-gather-daemonset-ccv5v" Oct 30 09:12:31.131701 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:31.131673 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-w7gvc_8568914d-177e-4c0a-ab3b-deb3f6f79c84/payload-pre-processing/0.log" Oct 30 09:12:31.149231 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:31.149177 5028 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwktg\" (UniqueName: \"kubernetes.io/projected/784ff9b4-30dd-4653-ace4-9d23691dffec-kube-api-access-mwktg\") pod \"perf-node-gather-daemonset-ccv5v\" (UID: \"784ff9b4-30dd-4653-ace4-9d23691dffec\") " pod="openshift-must-gather-k4gtj/perf-node-gather-daemonset-ccv5v" Oct 30 09:12:31.195690 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:31.195624 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-j2vnb_7da56025-b457-4cd5-9b72-9182d1420139/payload-processing/0.log" Oct 30 09:12:31.262689 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:31.262655 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-777d6b9d77-br8dn_f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f/router/0.log" Oct 30 09:12:31.313398 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:31.313368 5028 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k4gtj/perf-node-gather-daemonset-ccv5v" Oct 30 09:12:31.635548 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:31.635513 5028 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k4gtj/perf-node-gather-daemonset-ccv5v"] Oct 30 09:12:31.639653 ip-10-0-140-65 kubenswrapper[5028]: W1030 09:12:31.639623 5028 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod784ff9b4_30dd_4653_ace4_9d23691dffec.slice/crio-c87562a614af88d85fd435741208e39c63d87aedebff910def1263868c20b97c WatchSource:0}: Error finding container c87562a614af88d85fd435741208e39c63d87aedebff910def1263868c20b97c: Status 404 returned error can't find the container with id c87562a614af88d85fd435741208e39c63d87aedebff910def1263868c20b97c Oct 30 09:12:32.103108 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:32.103080 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7n5wn_ec5cfee8-15c1-4ed9-a140-8297f697c4ad/node-exporter/0.log" Oct 30 09:12:32.220161 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:32.220115 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7n5wn_ec5cfee8-15c1-4ed9-a140-8297f697c4ad/kube-rbac-proxy/0.log" Oct 30 09:12:32.336144 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:32.336117 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7n5wn_ec5cfee8-15c1-4ed9-a140-8297f697c4ad/init-textfile/0.log" Oct 30 09:12:32.507546 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:32.507450 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-jffhs_0a33a4c8-c195-44cb-b10c-7fc71f7428e6/manager/0.log" Oct 30 09:12:32.560849 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:32.560818 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-6zbnf_e5747093-4ff8-4a2f-915a-31271e9ccf1f/manager/0.log" Oct 30 09:12:32.587626 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:32.587601 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k4gtj/perf-node-gather-daemonset-ccv5v" event={"ID":"784ff9b4-30dd-4653-ace4-9d23691dffec","Type":"ContainerStarted","Data":"b863b8c7fa218b0cdfd713243393c10f8558318f1f5ae8f08e56986b823cfa0b"} Oct 30 09:12:32.587773 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:32.587645 5028 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k4gtj/perf-node-gather-daemonset-ccv5v" event={"ID":"784ff9b4-30dd-4653-ace4-9d23691dffec","Type":"ContainerStarted","Data":"c87562a614af88d85fd435741208e39c63d87aedebff910def1263868c20b97c"} Oct 30 09:12:32.587773 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:32.587741 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-k4gtj/perf-node-gather-daemonset-ccv5v" Oct 30 09:12:32.629518 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:32.629470 5028 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-k4gtj/perf-node-gather-daemonset-ccv5v" podStartSLOduration=2.62945627 podStartE2EDuration="2.62945627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 09:12:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 09:12:32.626126271 +0000 UTC m=+1166.842238630" watchObservedRunningTime="2026-10-30 09:12:32.62945627 +0000 UTC m=+1166.845568630" Oct 30 09:12:32.764610 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:32.764526 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-7ns9n_d04c24e1-b59c-412c-af1f-58b220325b38/manager/0.log" Oct 30 09:12:32.856494 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:32.856462 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-jffhs_0a33a4c8-c195-44cb-b10c-7fc71f7428e6/manager/0.log" Oct 30 09:12:32.913446 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:32.913418 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-6zbnf_e5747093-4ff8-4a2f-915a-31271e9ccf1f/manager/0.log" Oct 30 09:12:33.116345 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:33.116313 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-7ns9n_d04c24e1-b59c-412c-af1f-58b220325b38/manager/0.log" Oct 30 09:12:36.777907 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:36.777868 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-86c478bb88-8q4xg_0994c04f-63a8-4b19-a4a1-9a0c288a26f5/networking-console-plugin/0.log" Oct 30 09:12:37.801649 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:37.801594 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6jb9v_0c1ebb77-bd76-4329-ac03-87f60b688431/console-operator/1.log" Oct 30 09:12:37.810042 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:37.810019 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-6jb9v_0c1ebb77-bd76-4329-ac03-87f60b688431/console-operator/2.log" Oct 30 09:12:38.607878 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:38.607852 5028 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-k4gtj/perf-node-gather-daemonset-ccv5v" Oct 30 09:12:39.782918 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:39.782889 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-5645d865fb-5hlm6_6178d593-a79b-4e9d-b7fa-1488b989556a/manager/0.log" Oct 30 09:12:39.814225 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:39.814179 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-5645d865fb-5hlm6_6178d593-a79b-4e9d-b7fa-1488b989556a/copy-manifests/0.log" Oct 30 09:12:40.103029 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:40.102994 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-58c9f5f46d-jxz7s_0a14ed2f-0a6c-4ed6-b05a-54f733f19453/volume-data-source-validator/0.log" Oct 30 09:12:40.294652 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:40.293113 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-5645d865fb-5hlm6_6178d593-a79b-4e9d-b7fa-1488b989556a/manager/0.log" Oct 30 09:12:40.325425 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:40.325391 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-5645d865fb-5hlm6_6178d593-a79b-4e9d-b7fa-1488b989556a/copy-manifests/0.log" Oct 30 09:12:40.978223 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:40.978179 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-bff4ccf6f-7hqqw_0b97d933-5570-4ce2-86dd-db6e1c8a3ed1/manager/0.log" Oct 30 09:12:41.132867 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:41.132818 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-zksvh_e4569615-7d5a-4841-8684-514a391362c2/manager/0.log" Oct 30 09:12:41.509756 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:41.509727 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-bff4ccf6f-7hqqw_0b97d933-5570-4ce2-86dd-db6e1c8a3ed1/manager/0.log" Oct 30 09:12:41.653022 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:41.652988 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-zksvh_e4569615-7d5a-4841-8684-514a391362c2/manager/0.log" Oct 30 09:12:42.601645 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:42.601606 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7c689579c-cm45f_9494399d-55d2-48ce-a8fa-4ffd9d1e9307/istio-proxy/0.log" Oct 30 09:12:42.759754 ip-10-0-140-65 kubenswrapper[5028]: E1030 09:12:42.759720 5028 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-wphsz" containerName="extractor" Oct 30 09:12:43.030400 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:43.030319 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7c689579c-cm45f_9494399d-55d2-48ce-a8fa-4ffd9d1e9307/istio-proxy/0.log" Oct 30 09:12:43.045452 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:43.045429 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vbv2z_e5ddc593-a1bb-4f35-be9e-77b6f9486945/dns/0.log" Oct 30 09:12:43.155913 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:43.155884 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-cdrr6_17ab8d72-af0f-4eac-9f1a-1b407a38f0d0/discovery/0.log" Oct 30 09:12:43.163273 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:43.163244 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vbv2z_e5ddc593-a1bb-4f35-be9e-77b6f9486945/kube-rbac-proxy/0.log" Oct 30 09:12:43.418226 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:43.414608 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bqlk7_094983e9-88e8-4881-be25-8ba5d8bc0979/dns-node-resolver/0.log" Oct 30 09:12:43.462979 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:43.462947 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-9p2l5_5bffb6ff-3933-4688-ac60-835c70b0ce3c/istio-proxy/0.log" Oct 30 09:12:43.535660 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:43.535630 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-dr8ns_22314808-f2ad-49af-9cd2-f2f90f33b795/istio-proxy/0.log" Oct 30 09:12:43.596245 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:43.596192 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-cdrr6_17ab8d72-af0f-4eac-9f1a-1b407a38f0d0/discovery/0.log" Oct 30 09:12:43.728730 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:43.728648 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-p5khn_37ad32b7-0a5f-4437-8855-cc6ddebec8e3/istio-proxy/0.log" Oct 30 09:12:43.893666 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:43.893639 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-9p2l5_5bffb6ff-3933-4688-ac60-835c70b0ce3c/istio-proxy/0.log" Oct 30 09:12:43.925047 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:43.925020 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-wkmvv_9c855b64-13be-4e63-8f3f-531056c34afc/istio-proxy/0.log" Oct 30 09:12:43.926239 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:43.926178 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-wkmvv_9c855b64-13be-4e63-8f3f-531056c34afc/istio-proxy/1.log" Oct 30 09:12:43.957718 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:43.957697 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-dr8ns_22314808-f2ad-49af-9cd2-f2f90f33b795/istio-proxy/0.log" Oct 30 09:12:43.961492 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:43.961469 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc_5bafdeba-c0c2-48ef-9dbe-b189447b40bf/istio-proxy/0.log" Oct 30 09:12:44.022608 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:44.022544 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-w7gvc_8568914d-177e-4c0a-ab3b-deb3f6f79c84/payload-pre-processing/0.log" Oct 30 09:12:44.085588 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:44.085560 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-j2vnb_7da56025-b457-4cd5-9b72-9182d1420139/payload-processing/0.log" Oct 30 09:12:44.150483 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:44.150456 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-777d6b9d77-br8dn_f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f/router/0.log" Oct 30 09:12:44.154638 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:44.154606 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-p5khn_37ad32b7-0a5f-4437-8855-cc6ddebec8e3/istio-proxy/0.log" Oct 30 09:12:44.162799 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:44.162772 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7c689579c-cm45f_9494399d-55d2-48ce-a8fa-4ffd9d1e9307/istio-proxy/0.log" Oct 30 09:12:44.347749 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:44.347709 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-wkmvv_9c855b64-13be-4e63-8f3f-531056c34afc/istio-proxy/0.log" Oct 30 09:12:44.350410 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:44.349711 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-wkmvv_9c855b64-13be-4e63-8f3f-531056c34afc/istio-proxy/1.log" Oct 30 09:12:44.391915 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:44.391888 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc_5bafdeba-c0c2-48ef-9dbe-b189447b40bf/istio-proxy/0.log" Oct 30 09:12:44.453813 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:44.453784 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-w7gvc_8568914d-177e-4c0a-ab3b-deb3f6f79c84/payload-pre-processing/0.log" Oct 30 09:12:44.517088 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:44.517052 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-j2vnb_7da56025-b457-4cd5-9b72-9182d1420139/payload-processing/0.log" Oct 30 09:12:44.582075 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:44.582049 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-777d6b9d77-br8dn_f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f/router/0.log" Oct 30 09:12:44.701088 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:44.701024 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-cdrr6_17ab8d72-af0f-4eac-9f1a-1b407a38f0d0/discovery/0.log" Oct 30 09:12:44.991623 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:44.991547 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9fzvv_af7f9e2a-c57b-4396-bd6e-40c05cf1ef42/node-ca/0.log" Oct 30 09:12:45.015123 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:45.015102 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-9p2l5_5bffb6ff-3933-4688-ac60-835c70b0ce3c/istio-proxy/0.log" Oct 30 09:12:45.081699 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:45.081673 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-dr8ns_22314808-f2ad-49af-9cd2-f2f90f33b795/istio-proxy/0.log" Oct 30 09:12:45.291067 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:45.290994 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-p5khn_37ad32b7-0a5f-4437-8855-cc6ddebec8e3/istio-proxy/0.log" Oct 30 09:12:45.495992 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:45.495965 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-wkmvv_9c855b64-13be-4e63-8f3f-531056c34afc/istio-proxy/0.log" Oct 30 09:12:45.500361 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:45.500334 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-wkmvv_9c855b64-13be-4e63-8f3f-531056c34afc/istio-proxy/1.log" Oct 30 09:12:45.537962 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:45.537924 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc_5bafdeba-c0c2-48ef-9dbe-b189447b40bf/istio-proxy/0.log" Oct 30 09:12:45.606102 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:45.606079 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-w7gvc_8568914d-177e-4c0a-ab3b-deb3f6f79c84/payload-pre-processing/0.log" Oct 30 09:12:45.672458 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:45.672434 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-j2vnb_7da56025-b457-4cd5-9b72-9182d1420139/payload-processing/0.log" Oct 30 09:12:45.742433 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:45.742408 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-777d6b9d77-br8dn_f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f/router/0.log" Oct 30 09:12:46.955916 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:46.955882 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7c689579c-cm45f_9494399d-55d2-48ce-a8fa-4ffd9d1e9307/istio-proxy/0.log" Oct 30 09:12:47.522947 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:47.522914 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-cdrr6_17ab8d72-af0f-4eac-9f1a-1b407a38f0d0/discovery/0.log" Oct 30 09:12:47.556615 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:47.556581 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7c689579c-cm45f_9494399d-55d2-48ce-a8fa-4ffd9d1e9307/istio-proxy/0.log" Oct 30 09:12:48.075900 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:48.075872 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-cdrr6_17ab8d72-af0f-4eac-9f1a-1b407a38f0d0/discovery/0.log" Oct 30 09:12:48.148550 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:48.148526 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-9p2l5_5bffb6ff-3933-4688-ac60-835c70b0ce3c/istio-proxy/0.log" Oct 30 09:12:48.268409 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:48.268376 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-dr8ns_22314808-f2ad-49af-9cd2-f2f90f33b795/istio-proxy/0.log" Oct 30 09:12:48.404662 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:48.404635 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-9p2l5_5bffb6ff-3933-4688-ac60-835c70b0ce3c/istio-proxy/0.log" Oct 30 09:12:48.484306 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:48.484272 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-dr8ns_22314808-f2ad-49af-9cd2-f2f90f33b795/istio-proxy/0.log" Oct 30 09:12:48.643928 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:48.643899 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-p5khn_37ad32b7-0a5f-4437-8855-cc6ddebec8e3/istio-proxy/0.log" Oct 30 09:12:48.685910 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:48.685849 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-p5khn_37ad32b7-0a5f-4437-8855-cc6ddebec8e3/istio-proxy/0.log" Oct 30 09:12:48.896043 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:48.896011 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-wkmvv_9c855b64-13be-4e63-8f3f-531056c34afc/istio-proxy/0.log" Oct 30 09:12:48.897414 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:48.897389 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-wkmvv_9c855b64-13be-4e63-8f3f-531056c34afc/istio-proxy/1.log" Oct 30 09:12:48.945272 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:48.945175 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc_5bafdeba-c0c2-48ef-9dbe-b189447b40bf/istio-proxy/0.log" Oct 30 09:12:49.016587 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:49.016550 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-w7gvc_8568914d-177e-4c0a-ab3b-deb3f6f79c84/payload-pre-processing/0.log" Oct 30 09:12:49.025678 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:49.025650 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-wkmvv_9c855b64-13be-4e63-8f3f-531056c34afc/istio-proxy/0.log" Oct 30 09:12:49.027010 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:49.026992 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fcb75c45f-wkmvv_9c855b64-13be-4e63-8f3f-531056c34afc/istio-proxy/1.log" Oct 30 09:12:49.081886 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:49.081862 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-j2vnb_7da56025-b457-4cd5-9b72-9182d1420139/payload-processing/0.log" Oct 30 09:12:49.119942 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:49.119921 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-74987c9b47-r7mpc_5bafdeba-c0c2-48ef-9dbe-b189447b40bf/istio-proxy/0.log" Oct 30 09:12:49.154944 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:49.154927 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-777d6b9d77-br8dn_f26f2650-b317-4a4b-8dbc-0c1aa2e80f1f/router/0.log" Oct 30 09:12:49.249660 ip-10-0-140-65 kubenswrapper[5028]: I1030 09:12:49.249594 5028 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-w7gvc_8568914d-177e-4c0a-ab3b-deb3f6f79c84/payload-pre-processing/0.log"